People's ability to spot AI-written text is roughly a coin flip, so do automated detectors do any better, and why?

This explores whether automated detectors beat human readers at telling AI-written text from human writing. In the studies collected here, they do by a wide margin, but only in narrow settings, and the reasons they win say a lot about what AI writing is. Start with the human side. A review of 30 studies found that people's ability to spot AI content in text, images and voice Can people reliably spot content made by AI? is generally no better than a coin flip, and it hasn't improved as AI output has become more realistic. Expertise doesn't rescue it: trained linguists and NLP researchers also fail Can human judges detect measurable differences in AI text?.

The puzzle is that AI text *is* measurably different. Statistical analysis shows it differs from human writing on six separate measures of vocabulary use, including how varied, evenly spread and dispersed its word choices are Can humans detect AI text if machines can measure it?. The difference is real, but people can't perceive it. Worse, newer models drift *further* from human patterns while becoming *harder* for people to spot. What readers notice and what can be measured are moving in opposite directions.

That gap is what automated detectors exploit, and in focused domains they do it very well. Simple, readable features (sentence style plus markers of argument quality) caught AI-written counter-arguments on Reddit's r/ChangeMyView with 99% accuracy Can simple linguistic features detect AI-written arguments?. That matched heavyweight neural detectors, which suggests the signal is not subtle once you know where to look. In AI models' arguments, the giveaways are how closely they mirror the prompt and their tidy, textbook-quality structure. Fiction offers an even more interesting case. One system reached 93% accuracy using only story structure, such as how much agency characters have and whether events run in time order, and kept almost all of that accuracy with every stylistic cue removed Can AI stories be detected without analyzing writing style?. Choices at that level are hard to disguise, because hiding them means rewriting the story, not polishing sentences.

Three caveats keep this from being a clean win for machines. First, the high accuracy figures come from specific genres; none of these notes tests a general-purpose detector on writing in general. Second, it's unclear how well detectors survive deliberate rewriting. One paper claims heavily reworked messages slip past detectors, but it never actually ran detector tests Do rewrites that hide authorship also fool AI detectors?. Third, 'automated' doesn't automatically mean better. When AI models judged chat transcripts in a Turing-test setup, they scored below chance, just as human readers did Can humans detect AI by passively reading its text?. The only judges who kept any edge were people *questioning the AI in real time*. Interaction helped. Passive reading didn't, whether a person or a machine was doing it.

The practical stakes come from how people actually read. Writers edit AI drafts only 23% of the time, and even then barely change them Do writers actually edit AI-generated text before publishing?. Recipients rate unlabeled AI-assisted emails exactly as they rate human ones, and only become skeptical when told AI was involved Do readers trust unlabeled AI-written messages as much as human ones?. So human judgment isn't just inaccurate. By default it trusts. That leaves detection to tools that work best on narrow, well-studied genres and haven't been proven against deliberate disguise.