In this study, novel self-assembled carbazole-thiooctanoic acid nanoparticles (CTNs) were synthesized from amino carbazole (a mutagen) and thiooctanoic acid (an antioxidant). The nanoparticles were characterized using hyperspectral techniques. Then, the antiproliferative potential of CTNs was determined in HepG2 liver carcinoma cells. This study employed a solvent-antisolvent interaction method to synthesize a spherical CTN of size less than 50 nm. Moreover, CT was subsequently capped to gold nanoparticles (AuNPs) in the additional comparative studies. The CT derivative was synthesized from carbazole and lipoic acid by the amide bond formation reaction using a coupling agent. Furthermore, it was characterized using infrared (IR), 1H nuclear magnetic resonance, dynamic light scattering (DLS), and transmission electron microscopy techniques. The CT-capped gold nanoparticles (CTAuNPs) were prepared from CT, chloroauric acid, and NaBH4. The CTAuNPs were characterized using ultraviolet-visible, high-resolution TEM, DLS, and Fourier transform IR techniques. The cytotoxicity and apoptosis-inducing ability of both nanoparticles were determined in HepG2 cells. The results demonstrate that CTNs exhibit antiproliferative activity in the cancerous HepG2 cells. Moreover, molecular docking and molecular dynamics studies were conducted to explore the therapeutic potential of CT against human EGFR suppressor protein to gain more insights into the binding mode of the CT, which may show a significant role in anticancer therapy.