Do writers edit AI drafts enough to fool detectors, or do most publish them nearly unchanged?
Do writers edit AI assistance enough to fool content filters?
This explores whether people who use AI writing tools change the output enough that AI-text detectors (and readers) can no longer tell a machine helped, and what the collection says about how much editing actually happens.
This explores whether writers rework AI-assisted text enough to slip past AI detectors. The short answer from the collection is that most writers barely edit at all, so the question of fooling filters usually never comes up. One large study found writers changed AI-suggested paragraphs only 23% of the time, and the edits they did make left the text about 96% identical to the original Do writers actually edit AI-generated text before publishing?. In practice, the human writer is a very weak filter: whatever the model produced is mostly what gets published.
Why so little editing? One answer is that writers like what the AI gives them. Researchers trained reward models to remove the ways AI assistance distorts a writer's voice, and writers then accepted the output less often Can AI writing assistance remove distortion without losing appeal?. The polish, confidence and clarity people want come from the same tendencies that make the text sound less like them. Those tendencies are measurable. Across 29 traits, AI-assisted writers came across as more confident, more agreeable and more extreme Does AI writing assistance change how readers perceive the writer?. Readers also judged them far more likely to be educated, well-paid native English speakers Does AI writing make authors seem more privileged than they are?. Writers have little reason to edit away a voice that flatters them.
When people do rewrite heavily, the evidence on detector evasion is thinner than it sounds. One paper claims heavily rewritten messages hide both who wrote them and the fact that AI was involved. But it only tested authorship attribution and never ran an AI detector, so the 'fools detectors' half of the claim is unproven Do rewrites that hide authorship also fool AI detectors?. Detection may also be harder to escape than people think. A fiction detector reached 93% accuracy using only story-level choices, such as how much control characters have over events and how the timeline is ordered, with no word-level style clues at all Can AI stories be detected without analyzing writing style?. Swapping words and smoothing sentences won't touch those signals. Only rethinking the story itself would.
The strongest detector may be ordinary readers. In an experiment with AI commenting tools, readers rated AI-assisted discussion as more generic and less authentic. That drop in perceived quality spread even to conversations among people who never used the tools Do AI writing tools improve online discussion or degrade it?. And the penalty for simply admitting AI help turns out to be small: disclosure lowered article ratings by less than 0.15 points on a 7-point scale, from both human and LLM raters Does disclosing AI assistance make readers trust articles less?. Some writers even prefer shared editors that show collaborators their AI prompts Do writers want to see each other's AI prompts in shared editors?.
The collection doesn't contain a direct test of how much editing it takes to beat a commercial AI detector. What it does suggest is that the 'fooling filters' framing may miss the point. Most AI-assisted text passes through almost unedited. The bigger effect isn't detectors being fooled. It's the AI's voice spreading quietly, changing how writers come across to the people reading them.
Sources 9 notes
Writers edited AI-generated paragraphs only 23% of the time, with edits averaging 96% similarity to the original. This means AI's opinionated and distorted voice propagates with minimal human filtering before publication.
Training reward models successfully reduced measured persona distortions, but also reduced writer acceptance of the output. This suggests desirable properties like clarity and confidence operate through the same generative tendencies that produce problematic distortions.
A study of 2,939 writers and 11,091 readers found AI assistance shifted every tested dimension—29 total—toward extremism, confidence, quality, agreeableness, and perceived privilege. Distortions were statistically significant and directional, not random noise.
Writers using AI assistance were perceived as significantly more educated (5.3×), higher-income (4.4×), native English speakers (4.1×), and white (1.1×). This demographic distortion compresses distinctive voice markers into a generic privileged persona, creating what researchers call identity laundering.
The paper asserts that rewritten messages evade AI-text detectors but provides no detector experiments, only attribution results showing stylistic convergence. The double erasure claim needs direct empirical testing.
Show all 9 sources
StoryScope achieved 93.2% accuracy separating AI from human fiction using only discourse-level features like character agency and chronological structure, retaining 97% of performance while eliminating stylistic cues. These structural choices resist humanization because they require rewrites, not surface edits.
In a 680-participant experiment, AI-assisted commenting tools produced longer comments and higher participation rates, yet readers perceived the content as generic and less authentic. The perceived decline in quality extended even to conversations among users who did not use the AI tools.
Both human raters (n=1,970) and LLM raters (n=2,520) scored an identical news article lower when it included an AI disclosure statement, but the penalty was small—less than 0.15 points on a 7-point scale.
Sixteen paired writers showed strong preference for higher levels of prompt visibility in shared editors, valuing awareness of when, how, and where AI was used. Benefits included understanding collaborators' thinking and verifying AI-generated text, though some found full sharing intrusive and self-conscious.
Papers this line draws on 8
The research behind the notes this line reads — ranked by how closely each paper relates.
- Understanding Reader Perception Shifts upon Disclosure of AI Authorship
- Penalizing Transparency? How AI Disclosure and Author Demographics Shape Human and AI Judgments About Writing
- What Influences Readers' and Writers' Perceived Necessity of AI Disclosure?
- Measuring and Mitigating Persona Distortions from AI Writing Assistance
- "It was 80% me, 20% AI": Seeking Authenticity in Co-Writing with Large Language Models
- The Assistant Erased You: Measuring Loss of Authorship Signals in AI-Mediated Communication
- AI Suggestions Homogenize Writing Toward Western Styles and Diminish Cultural Nuances
- The AI Ghostwriter Effect: When Users Do Not Perceive Ownership of AI-Generated Text But Self-Declare as Authors