Heavy AI rewriting blurs who wrote a text, but does it also hide that a machine touched it?
Can AI-rewritten text still be detected as machine-modified?
This explores whether text that has passed through an AI rewriter still carries detectable machine fingerprints, or whether rewriting wipes them out, and who or what could catch them.
This explores whether text that an AI has rewritten still shows signs of machine involvement, whether that's a human draft polished by an assistant or AI output reworked to look human. The collection has a surprising answer: the evidence shows clearly what rewriting erases. It shows much less about what rewriting leaves behind. Heavy AI rewriting badly damages the signals that identify *who* wrote something. Computer-based author identification drops by 66.5 points on blogs, but only about 10 points on news articles How much does AI rewriting erase distinctive author voice?. Personal writing loses its voice. Topic-driven writing keeps more of it. The same research then claims these rewrites also slip past AI-text detectors, a "double erasure." But nobody ran a detector experiment to test that. The claim rests only on rewritten texts converging toward one shared style Do rewrites that hide authorship also fool AI detectors?. So the obvious question, whether rewritten text gets flagged as machine-made, is still open in this corpus.
That convergence may itself be a clue. When an AI rewrites many people's messages, they start to sound alike, and sameness is something machines can measure. AI text differs from human text in statistically clear ways: how many distinct words it uses, how evenly it spreads them, and how widely it ranges across vocabulary Can human judges detect measurable differences in AI text?. Newer models drift further from human patterns, not closer Can humans detect AI text if machines can measure it?. Simple, cheap language features can spot AI-written arguments on Reddit with 99% accuracy. Two patterns give it away: the text bends toward whatever the prompt asked for, and it reads like textbook-quality argument Can simple linguistic features detect AI-written arguments?. Whether those patterns survive a rewrite hasn't been tested directly. Still, they come from the model's habits rather than from any single draft, which suggests that rewriting could add them as easily as it strips them out.
The strongest clue comes from fiction. AI stories can be told apart from human ones with 93% accuracy using only story-level choices: how much the characters drive events and whether events are told in order. The detector keeps 97% of its accuracy even after every stylistic cue is removed Can AI stories be detected without analyzing writing style?. Tools that make AI text sound more human mostly work on wording. Changing these deeper choices would mean rebuilding the story, not editing it. That points to a useful distinction: rewriting can scrub surface style, but the deeper decisions about how a piece is put together are much harder to disguise.
The human side is bleak. Across 30 studies, people spot AI-made text, images and voices at about the level of a coin flip Can people reliably spot content made by AI?. Even trained linguists miss the lexical differences that statistics pick up easily Can humans detect AI text if machines can measure it?. When people do call something "AI slop" online, their accusations don't follow the features that actually separate AI text from human text. A study of 25 million comments found the label works as social gatekeeping, not detection Do AI slop accusations actually detect AI text?. One more twist: the rewriting arms race may matter less than it seems. Writers edit AI-drafted paragraphs only 23% of the time, and their edited versions stay 96% similar to the original Do writers actually edit AI-generated text before publishing?. Most AI text that gets published is barely rewritten, so its machine fingerprints are probably still there. Statistical tools may be able to see them, but human readers can't.
Sources 9 notes
Heavy rewriting by AI assistants dramatically weakens computational author attribution, dropping accuracy by 66.5 points on blogs but only 10 points on news. The gap reflects how topic-structured writing preserves authorship cues that personal writing does not.
The paper asserts that rewritten messages evade AI-text detectors but provides no detector experiments, only attribution results showing stylistic convergence. The double erasure claim needs direct empirical testing.
Six-dimension MANOVA analysis confirms significant differences between ChatGPT and human writing across vocabulary volume, abundance, variety, evenness, disparity, and dispersion. Despite these robust statistical differences, human judges including linguists and NLP researchers fail to reliably distinguish AI from human text.
LLM-generated text differs significantly on six lexical diversity dimensions, confirmed through statistical analysis across multiple models. Yet human judges, including trained linguists, cannot reliably detect these differences—and newer models diverge further while becoming harder to spot.
General linguistic features combined with argument-quality measures achieved 99% accuracy detecting LLM-generated counter-arguments on r/ChangeMyView, matching heavyweight neural detectors while remaining computationally cheap and transparent. LLMs produce detectable stylistic signatures: accommodation to prompts and textbook-quality argument markers that humans don't replicate.
Show all 9 sources
StoryScope achieved 93.2% accuracy separating AI from human fiction using only discourse-level features like character agency and chronological structure, retaining 97% of performance while eliminating stylistic cues. These structural choices resist humanization because they require rewrites, not surface edits.
A 30-study systematic review found that humans cannot reliably distinguish AI-generated from human-created content across text, image, and voice modalities. Accuracy generally clusters around chance and has not kept pace with improvements in AI realism.
A matched-control study of 25 million Hacker News and Reddit comments found that prose features distinguishing AI from human text do not predict which comments get accused as slop. The label functions as social regulation rather than accurate screening.
Writers edited AI-generated paragraphs only 23% of the time, with edits averaging 96% similarity to the original. This means AI's opinionated and distorted voice propagates with minimal human filtering before publication.
Papers this line draws on 8
The research behind the notes this line reads — ranked by how closely each paper relates.
- Monitoring AI-Modified Content at Scale: A Case Study on the Impact of ChatGPT on AI Conference Peer Reviews
- The human-authorship halo: attribution bias in literary style evaluation by humans and AI
- Measuring AI "Slop" in Text
- Understanding Reader Perception Shifts upon Disclosure of AI Authorship
- Is it Cake or is it AI? A Systematic Review of Human Uncertainty in Distinguishing Generative Artificial Intelligence Content
- Linguistic markers of inherently false AI communication and intentionally false human communication: Evidence from hotel reviews
- AI Argues Differently: Distinct Argumentative and Linguistic Patterns of LLMs in Persuasive Contexts
- The Assistant Erased You: Measuring Loss of Authorship Signals in AI-Mediated Communication