SYNTHESIS NOTE
Topics›Co Writing Collaboration›this note

Do writers actually edit AI-generated text before publishing?

This research tests whether the "human-in-the-loop" safeguard against AI text quality issues actually works in practice. It examines how often writers revise AI-generated paragraphs and how substantially they change them.

Synthesis note · 2026-05-01 · sourced from Co Writing Collaboration
How do people decide what to share with AI systems?

A common reassurance about AI writing assistance is that humans remain in the loop — they will edit, correct, override. The persona-distortion study tested this assumption directly. Writers were given AI-generated paragraphs and asked to edit them until the text reflected their opinions to their satisfaction. The result: writers edited the AI-generated paragraphs only 23 percent of the time, and most edits were minor — median Levenshtein ratio of 0.96, meaning the edited text was 96 percent identical to the AI's original.

This finding has two implications. First, the standard "human-in-the-loop" defense against AI text quality concerns is empirically wrong at population scale. Editing is rare and shallow when it does occur. The AI's text is reaching its audience in nearly the form the model produced it. Second, this means the persona distortions documented in the same study — opinionated, confident, demographically privileged, emotionally compressed — propagate with minimal human modulation. The distortion is not filtered by the writer's revision; it is embraced or ignored.

This forecloses one common mitigation strategy: relying on the writer to detect and remove distortions before publication. The writer who would have caught and corrected the distortion is the same writer who, the study shows, mostly does not edit and mostly prefers the AI version even after being given the chance to edit it. The distortion arrives at the audience because the writer does not interrupt it. Any intervention that hopes to reduce AI's influence on public discourse cannot rely on the writer-as-gatekeeper assumption — that role, in practice, is not being performed.

Inquiring lines that read this note 186

This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.

How reliably can humans and AI detectors identify machine-generated text? Are AI-generated articles systematically disadvantaged in search ranking and user engagement? Can readers reliably distinguish AI-written text from human writing? How do interpretive frames override surface features in text comprehension? How do writers navigate authorship and delegation with AI? Does disclosing AI authorship change how audiences evaluate the writing? How do hallucinated citations emerge in AI scholarly output? Why do abstract preferences outperform episodic memories in personalization? Why does polished AI output gain credibility despite fundamental verifiability problems? What human oversight must AI research systems have? Why do retrieval-augmented generation systems fail in practice despite sound architecture? Can AI systems perform peer review as effectively as humans? Does AI deployment reduce or exacerbate workplace inequality and income instability? Can AI chatbots provide mental health support without reinforcing harmful beliefs? How does AI-generated content create social proof without authentic interaction? How should human-AI contributions be measured, disclosed, and verified? How do educators verify student capability when AI can produce indistinguishable work? How do clinicians calibrate trust in AI medical recommendations? Does AI-assisted work increase total productivity or just shift time? How do AI hiring systems affect authenticity, fairness, and candidate preferences? Does AI assistance erode cognitive skills while inflating perceived competence? Do language models encode knowledge that influences generation, or primarily imitate surface patterns? Can LLMs distinguish between linguistic form and semantic meaning?

Related papers in this collection 8

Papers most semantically related to this note, ranked by cosine similarity in the embedding space.

Original note title

The 23 percent edit rate of AI writing assistance establishes that distortions reach audiences in nearly unedited form