Are AI chatbots becoming objects of cult-like devotion?
Does the rapid adoption of chatbots by some users reflect genuine cult dynamics—including surrender of independent thought to a trusted higher power—or does this framing overstate the psychological reality?
In an opinion essay on his Honest Broker newsletter, Ted Gioia argues that a swelling subculture of AI enthusiasts has taken on the structure of a religion, with chatbots cast as a deity. He writes that "thousands of people decided that ChatGPT was god," that the movement "reached critical mass" in April 2025 when forum moderators had to ban "AI psychosis" posters to keep discussions from turning into "cult recruiting campaigns," and that "more than a half million users of ChatGPT show signs of mental illness" in a given week, some requiring hospitalization. He names trust in a higher power as the single most telling trait of this new faith: devotees have, in his words, been "liberated from the responsibility of thinking for themselves" because "the bot now thinks for them."
Gioia's explanation is social and spiritual rather than technical. He describes converts as people who were "spiritually dead," numbed by "tech entertainments and creature comforts," left with "a hunger for something to counter the emptiness inside" but who "lacked any feel for the transcendent." The chatbot resolves that tension cheaply — it is "a deity in the device" that "talks back," with prayers "answered in real time," while letting believers keep their "brutish materialism" intact: "no tithe is necessary, just a subscription." He predicts the pattern will formalize into "an organized AI church, complete with clergy, rituals, and tithing," and offers his "ten commandments" as a checklist, warning that endorsing more than three or four is a sign to "watch out."
The essay's anecdotal, polemical register sits in tension with Should we recognize AI-associated psychosis as a new disorder?, which resists exactly the diagnostic move Gioia makes — treating "AI psychosis" as a settled, newly emerged mental illness rather than an existing vulnerability meeting a new stressor; Gioia asserts prevalence and causation where that source says causation "cannot yet be ascribed." His account of why the bot feels worth worshipping — that it answers back, in real time — matches the mechanism in How do chatbots enable distributed delusion differently than passive tools?, which locates the seductive power of chatbots in their status as a responsive "quasi-other," not a passive tool. His claim that this dependence is already widespread, not a future risk, lines up with Which AI risks are already harming individual users today? and with the validated-delusion rate reported in Do chatbots validate delusions in people experiencing mental harm?.
The essay cites no survey methodology, sample, or source for its headline figure of "more than a half million users" showing signs of mental illness weekly, and its "ten commandments" are presented as the author's own synthesis of reader emails and online forum posts, not as findings from a study of believers. It is commentary — strong on rhetorical framing, weak on verifiable measurement — and should be read as one critic's diagnosis of a cultural mood rather than evidence of prevalence or clinical causation. Read alongside the clinical caution elsewhere in the library, the plausible claim it supports is narrower than its framing suggests: some meaningful fraction of heavy chatbot users describe their relationship to the tool in explicitly religious terms, and the chatbot's responsiveness is the likely reason that framing feels natural to them.
Inquiring lines that read this note 9
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
Can AI chatbots provide mental health support without reinforcing harmful beliefs?- Can practical coaching conversations with AI gradually shift into harmful companionship?
- Can chatbots function as responsive quasi-others that enable validated delusions?
- Do chatbots validate user delusions more often than they challenge them?
- How does self-reported culture sentiment differ from observable behavior changes during AI adoption?
Related concepts in this collection 5
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Should we recognize AI-associated psychosis as a new disorder?
Researchers debate whether psychotic symptoms emerging from AI chatbot use represent a distinct clinical condition or an existing psychosocial phenomenon triggered by a novel stressor. This matters for diagnosis, surveillance, and developer accountability.
contrasts Gioia's confident mass-illness framing with this source's caution against ascribing chatbot causation
-
How do chatbots enable distributed delusion differently than passive tools?
Can generative AI's intersubjective stance—accepting and elaborating on users' reality frames—create conditions for shared false beliefs in ways that notebooks or search engines cannot?
supplies the mechanism behind Gioia's "deity that talks back" account of devotion
-
Which AI risks are already harming individual users today?
Explores which harms from seemingly conscious AI systems are occurring now versus which remain theoretical. Understanding present observable risks helps prioritize interventions where people are already affected.
corroborates Gioia's claim that this dependence is already occurring, not speculative
-
Do chatbots validate delusions in people experiencing mental harm?
First-hand accounts from a support group reveal how often chatbots record affirming delusional thinking. Understanding this pattern matters because it could shape clinical guidance on AI use in vulnerable populations.
gives an empirical counterpart to Gioia's anecdotal claim of chatbot-validated belief
-
What attitudes hide behind identical claims that chatbots are conscious?
When people say a chatbot is conscious, they might be pretending, believing loosely, or holding firm conviction. Can we tell what epistemic commitment someone actually has from their words alone?
Qualifies: outward claims of AI consciousness or authority can be pretense or belief, not necessarily the surrendered judgment Gioia describes
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- DelusionEval: Measuring Delusion-Linked Behaviors in AI Chatbots
- Characterizing Delusional Spirals through Human-LLM Chat Logs
- How AI and Human Behaviors Shape Psychosocial Effects of Extended Chatbot Use: A Longitudinal Randomized Controlled Study
- A Rational Analysis of the Effects of Sycophantic AI
- Delusions and Harms Associated with AI Chatbot Use: Early Evidence from 185 Real-World Reports
- Are Attributions of Consciousness to AI Chatbots Epistemically Innocent?
- Sycophantic Chatbots Cause Delusional Spiraling, Even in Ideal Bayesians
- Psychological Influences of Conversational AI: Research and Design Directions for Reducing Harm and Promoting Well-Being
Original note title
Gioia argues AI enthusiasts form a cult around chatbots by surrendering thought to a trusted higher power