Can people reliably spot content made by AI?
This systematic review of 30 studies asks whether human judgment can distinguish AI-generated text, images, and voice from human-created content, and whether detection accuracy has improved as AI becomes more realistic.
This PRISMA-guided systematic review finds that human ability to tell generative AI content from human-produced content, across text, image and voice, "varied widely but generally clustered around chance performance." The search ran in Scopus, restricted to 2025 and 2026, and returned 22,541 records. Titles and abstracts were screened in relevance order until 1,200 had been reviewed, and 30 studies entered the synthesis. The review's summary is blunt: "humans are generally unreliable detectors of gen AI content." The Discussion makes the same point about the average. Humans "do not distinguish AI-generated content from human-generated content reliably better than chance," and human accuracy "has not meaningfully improved over time or at least has not improved at a pace that keeps up with the increasing realism of gen AI content."
The review does not compute a pooled estimate. It says "substantial methodological heterogeneity across studies limited the ability to compute pooled effect sizes," so its case rests on consistency across studies. It also reports that screening reached saturation, since "no eligible studies had been identified in the last 100 records" before it stopped. The modality pattern is the most specific claim in the excerpt. Voice detection succeeds more often than image detection, and image detection more often than text. For voice, the review cites work suggesting listeners may pick up "subtle artifacts in timing, pitch, or prosody." For images, the visual heuristics that might help (inconsistent reflections, unnatural textures, impossible lighting) still produce accuracy that "mostly did not vary convincingly from chance." These mechanisms are proposals from the cited literature. The review does not test them.
Read against the library, the review turns single-study findings into a cross-modality pattern. Can humans detect AI text if machines can measure it? and Can human judges detect measurable differences in AI text? both describe text that differs from human writing on measurable dimensions while judges fail to notice. This review extends that pattern across 30 studies and into image and voice. It does not check whether the measurable differences exist, because it measures human accuracy and nothing about the content itself. The text-level result, which is the most consequential for evaluation, is developed in Does polished writing actually signal better quality work?.
The excerpt does not establish several things a reader might want. It gives no per-study accuracy values, no per-modality figures, no confidence intervals and no chance baseline for each task. Its Table 1 is referenced but not included. So "around chance" is a summary of how the reviewed literature is distributed, and it carries the strength of a non-pooled review. The scope is bounded by design too: Scopus only, English only, 2025 to 2026, and the first 1,200 of 22,541 records by relevance, which the authors say may miss preprints and fast-moving computer science venues. The implication is that unaided human judgment is a weak basis for flagging AI content. The excerpt says nothing about automated detectors, and nothing about whether training or tools change the picture, so it cannot support a claim either way on those.
Inquiring lines that read this note 102
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
How reliably can humans and AI detectors identify machine-generated text?- How do lay readers differ from classifiers in detecting AI text?
- How much does the human-authorship halo affect AI evaluation across different task domains?
- What false-positive rates do AI detectors show on mixed human-AI drafts?
- Are detector errors on AI text systematic or random by design?
- Can AI detectors reliably distinguish human from machine-generated text?
- Can a classifier distinguish machine-written text from poor human writing?
- What signals do AI text detectors actually measure in their classification?
- Can detection systems identify AI text rewritten to match human author style?
- Would detectors trained on unaltered AI text catch heavily rewritten versions?
- Can AI-rewritten text still be detected as machine-modified?
- Can text detection methods distinguish between AI collaboration and delegation?
- Can user feedback flags rival AI detector accuracy for identifying AI slop?
- How accurate is Originality.ai's detector at identifying AI-written content?
- What differences exist between detector-based AI measurement methods across platforms?
- Does the 94% figure measure precision or recall of generic content detection?
- Can readers distinguish machine-generated text from human-written comments?
- Are AI systems trained to devalue content labeled as machine-generated?
- Which modality is easiest for humans to detect as AI?
- Can training or tools improve human detection of AI content?
- How do automated detectors compare to human judgment on AI?
- How do slop judgments correlate with actual AI detection performance in practice?
- How often do human annotators mistake human writing for AI-generated text?
- Can AI text detection improve enough to help evaluators make better decisions?
- How accurate are automated AI text detectors compared to human judgment?
- Why do consumers show lower valid-view rates for AI-generated videos?
- Do AI-generated articles rank worse in Google Search than human-written ones?
- Do AI-generated articles receive less search traffic than human writing?
- Do mixed human-AI posts rank differently than fully generated content?
- Can volume-based moderation catch AI-generated top-level posts effectively?
- Do audiences penalize AI-written posts through visible callouts at scale?
- How does YouTube identify which channels use AI-generated personas in practice?
- Are channels using AI voices without claiming expertise also affected by this policy?
- How should platforms balance removing AI content against wrongly limiting human reach?
- Can AI-generated content feel interchangeable while still delivering viewer satisfaction?
- What fraction of Reddit users are responsible for all machine-generated content?
- How does Reddit's AI prevalence compare to the broader internet?
- Why do accusations focus on gatekeeping rather than detecting AI?
- How robust is algorithmic content matching when controlling for creator characteristics and categories?
- Does algorithmic adjustment of AI content exposure hold as supply grows beyond twelve months?
- Can generic AI content harm discussions among people not using AI?
- Do AI-generated articles now dominate search results as organic traffic declines?
- Does AI intermediation reallocate attention across different types of content producers?
- How much of new web content is AI-generated by mid-2025?
- Can search performance data distinguish AI-generated content from human-written articles?
- What percentage of workplace communication now contains AI-generated content?
- Does artificial amplification of creator content weaken authentic social proof signals?
- How similar are GPT-generated fake profiles to real human profiles?
- Does detecting AI authorship actually improve social media feed quality?
- How accurate is the detector labeling these posts?
- How much do humans edit AI-generated text before publishing?
- Do human readers still recognize authors after heavy AI rewriting?
- Can readers actually distinguish AI text from human writing?
- Can style and perspective be reliably separated by automated detection systems?
- What prose features actually distinguish AI-generated text from human writing?
- Can readers reliably distinguish AI-written abstracts from human-written ones?
- Does AI-written text score higher because of presentation alone or judgment shift?
- Do human reviewers detect rhetorical polish as a sign of AI authorship?
- What prose features distinguish automatically generated text from human writing?
- Does AI output resemble Baudrillard's obscene surface detached from its scene?
- Why do false positive rates matter for AI content measurement?
- What metrics would prove an AI detection button is working?
- Can commercial AI detectors accurately identify AI-written application essays?
- Do admissions penalties follow actual AI detection or suspected authorship?
- Do human essays wrongly suspected of AI use also face rating penalties?
- How do live screening workflows differ from controlled experiments with labeled AI output?
- How does AI detection accuracy affect confidence in prevalence estimates?
- Do AI detection tools assume false certainty about assessment integrity?
- Why do people view AI-assisted work as less legitimate than human work?
- How does workload affect human processing of AI-generated information?
- Does the 'feel of AI' in unedited posts trigger audience backlash and detection?
- How do viewers react when they learn AI helped create channel content?
- Does knowing about AI tools used change how persuasive or authentic content feels?
- Do informed readers scrutinize AI messages more while still finding them persuasive?
- Do populations with different AI exposure levels rate messages differently?
- How does salience of AI involvement shape judgments at the moment of reading?
- Does awareness of AI involvement make readers more critically scrutinize arguments?
- How much does knowing about AI use actually change how readers judge text?
- How do we culturally discount AI-generated content the way we already discount advertising?
- What gap exists between how creators think they made work versus how audiences perceive it?
- What counts as human versus AI contribution in research disclosure?
- What specific errors did participants report finding in the AI-generated reviews?
- Should rhetorical polish in AI reviews be separated from actual technical accuracy?
- Can polished AI text fool both reviewers and detection methods?
- Does AI content in reviews correlate with differences in paper quality control?
- Can human reviewers reliably detect AI-written peer review text by sight?
- Can machine review catch flaws in AI-generated work that humans miss?
- Can humans reliably detect whether research text was written by AI?
- How do citation errors in AI-generated papers differ from human hallucinations?
- Can AI systems distinguish fabricated papers from legitimate research?
- How much undetected fraud exists beyond current retraction statistics?
- Can statistical detection of synthetic text identify actual fraudulent manuscripts?
- How do courts distinguish between AI hallucinations and ordinary typographical errors?
Related concepts in this collection 4
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Can humans detect AI text if machines can measure it?
AI-generated text shows measurable differences from human writing across multiple linguistic dimensions, yet human judges consistently fail to identify it. Why does the gap between what is measurable and what is perceptible exist?
the same measurable-but-imperceptible pattern; this review extends it across 30 studies and three modalities.
-
Can human judges detect measurable differences in AI text?
Research shows LLM text differs statistically across six lexical dimensions, but human readers—even experts—cannot reliably identify which texts are AI-generated. Why does measurement succeed where human perception fails?
a single-study lexical finding in the same vein; the review measures no lexical features at all.
-
Does polished writing actually signal better quality work?
When evaluators judge applications and manuscripts, does rhetorical sophistication predict merit, or does it distract from verifiable evidence of competence and rigor?
the sibling note on the text subgroup, where the 58% figure and the perceived-quality finding are developed.
-
Why do newer AI models diverge further from human writing patterns?
As language models improve, they seem to generate text that is measurably less human-like in lexical patterns, yet humans struggle to detect this difference. What drives this divergence, and what does it reveal about how models optimize for quality?
evidence for: ChatGPT-4.5 and o4-mini diverge more from human lexical patterns yet are less detectable by human judges, widening the gap
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- Is it Cake or is it AI? A Systematic Review of Human Uncertainty in Distinguishing Generative Artificial Intelligence Content
- The human-authorship halo: attribution bias in literary style evaluation by humans and AI
- Monitoring AI-Modified Content at Scale: A Case Study on the Impact of ChatGPT on AI Conference Peer Reviews
- Machines in the Crowd? Measuring the Footprint of Machine-Generated Text on Reddit
- Do LLMs produce texts with "human-like" lexical diversity?
- AI Now Writes as Many Online Articles as Humans
- Linguistic markers of inherently false AI communication and intentionally false human communication: Evidence from hotel reviews
- Measuring AI "Slop" in Text
Original note title
human detection of generative AI content generally clusters around chance — a 30-study systematic review finds