Do heavy AI users actually encounter more hallucinations?
A survey found power users report 3x more hallucinations than casual users. But does this reflect worse AI performance, harder tasks, or simply higher user standards and scrutiny?
A survey of 1,038 US adults who use AI, fielded by Centiment for Rev between July 25–28, 2025 (margin of error ≈±2% at 95% confidence), finds self-reported experience with AI correlates with more friction, not less. "Heavy AI users are nearly 3x more likely to experience frequent hallucinations" than casual users; while "77% get an answer they like in under two minutes" overall, that share drops to 50% among people who use AI "over six hours a week." Those power users are "10x more likely than casual users" to spend more than 11 minutes revising before they're satisfied (21% vs. 2%), and when a session runs past 20 minutes, "almost 9 out of 10 (88%) say they 'very often' have to revise for hallucinations." Daily users are also "14x more likely than casual users to double-check AI's work."
Rev's own reading is explicitly not that the tools get worse with heavier use: "This isn't necessarily tied to inefficiency — complexity is the likely culprit." Heavy users "are trying to do much harder things, like getting the AI to perform an in-depth analysis or perfectly mimic a specific writing style," while light users "stick to simple requests that lead to quick victories"; heavy users also "have higher standards." Asked why more use brings more reported flaws, Rev hedges between two rival explanations rather than choosing one: "experienced users are either asking tougher questions or have just gotten much better at noticing when the AI gets something wrong."
This runs parallel to Do AI coding tools actually speed up experienced developers? and Does AI assistance help less experienced workers most?: across three populations — developers, support agents, general AI users — the people with the most AI experience or skill are the ones for whom the tool's promised speed and reliability fail to show up, while novices and light users capture the easy wins. It also echoes Does chat delegation actually save time on task completion?'s split between effort and time savings, and complicates the more optimistic Do AI coding features actually speed up engineer productivity? by suggesting an aggregate time-saved figure can hide large variance by user type.
Every figure here is self-reported — felt hallucination frequency, felt session length, felt double-checking — none measured against ground truth or a clock, and the 1,038-respondent, US-only, unweighted sample doesn't generalize past US AI users in July 2025. It's also commissioned content on a vendor's blog: Rev, an AI transcription company, publishing survey results that rank competing chat tools (ChatGPT, Gemini, Perplexity), not neutral research. Correlation between hours of use and reported hallucination frequency is not evidence that AI tools degrade with use or that heavy users are less skilled — Rev's own account points the opposite way, toward harder tasks and sharper scrutiny. The defensible implication: self-reported hallucination and satisfaction-time rates are confounded by task difficulty and user calibration, so raw survey "hallucination frequency" figures shouldn't be read as product-quality scores without controlling for what respondents were actually attempting.
Inquiring lines that read this note 2
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
Why do language models hallucinate and how can we prevent it? Does AI assistance erode cognitive skills while inflating perceived competence?Related concepts in this collection 5
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Does chat delegation actually save time on task completion?
When users can delegate work to an AI agent through chat, interaction effort clearly drops—fewer clicks, scrolls, and navigations. But does that effort savings translate into finishing tasks faster? Understanding the gap between effort and speed matters for interface design.
same split between lowered effort and unchanged completion time, here running by user segment instead of interface
-
Do AI coding tools actually speed up experienced developers?
Developers predicted AI tools would make them 24% faster, but a randomized trial measuring real work found the opposite. Understanding this gap between forecast and outcome matters for assessing AI's real productivity impact.
parallel case of experienced users getting worse-than-expected speed from AI despite skill
-
Does AI assistance help less experienced workers most?
When customer support agents gain access to an AI chat assistant, do productivity gains concentrate among newer, less skilled workers? Understanding this pattern matters for knowing who benefits from AI tools and whether deployment widens or narrows workplace skill gaps.
same experience-skews-the-gain pattern: novices benefit most, experienced users see declines or friction
-
Do AI coding features actually speed up engineer productivity?
A randomized trial of Google engineers tested whether AI-powered coding tools reduce time spent on complex tasks. Understanding real-world productivity gains matters as companies invest heavily in these features.
contrasts an aggregate time-saving figure with Rev's finding that heavy, skilled use can cost more time, not less
-
How much time do workers really spend fixing AI mistakes?
Enterprise workers report spending substantial weekly hours correcting AI output despite claiming productivity gains. Understanding this gap matters for realistic AI adoption planning and hidden cost accounting.
Evidence for: Zapier's 4.5 hrs/week spent fixing AI mistakes corroborates the extra time cost from AI inaccuracy
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- Heavy AI Users Face 3x More Hallucinations and Spend 10x Longer to Get Answers
- Delusions and Harms Associated with AI Chatbot Use: Early Evidence from 185 Real-World Reports
- A Comprehensive Survey of Hallucination Mitigation Techniques in Large Language Models
- The Decision to Verify: How Warmth and User Characteristics Shape Reliance on Conversational Agents for Information Search
- UX Roundup (28 Sep 2026): Bogus Deskilling Research
- Hallucination-Free? Assessing the Reliability of Leading AI Legal Research Tools
- Fine-grained Hallucination Detection and Editing for Language Models
- We are Changing our Developer Productivity Experiment Design
Original note title
Rev's survey finds heavy AI users are 3x more likely to report frequent hallucinations and 10x more likely to spend 11+ minutes for a satisfying answer