INQUIRING LINE

When AI helps with writing, do readers judge the writer's intent differently in real texts, not just made-up examples?

Does the intentionality reversal hold in real writing contexts beyond vignettes?

This explores whether a lab finding holds up outside short, made-up scenarios (vignettes). The finding is that people's sense of what a writer meant or intended flips once AI is involved. The question is whether it survives when real people write real texts and other real people read them.


This explores whether the 'intentionality reversal' holds up in real writing. That's the finding from short, made-up scenarios that people's reading of a writer's intent flips once AI enters the picture. The direct answer first: the collection doesn't hold the original vignette study, or any study that tests that exact reversal on naturally occurring text. What it does have is a group of studies that use real writing and real readers. They suggest the effect may be stronger and more systematic outside vignettes, though in a different form than a clean 'flip'.

The closest real-world evidence comes from a large study of 2,939 writers and 11,091 readers. AI assistance shifted how readers saw the writer on all 29 social dimensions measured. Writers came across as more confident, more extreme, more agreeable and more privileged than they were Does AI writing assistance change how readers perceive the writer?. The important point is that readers didn't need to be told AI was involved. The text itself carried a distorted signal about who wrote it and what they meant. A vignette tests what happens when a label changes. This study shows the person behind the words gets reshaped even when nobody mentions AI.

Why would intent read differently in AI-shaped text? Several notes point to features built into how the text is made, not surface style. Human writing makes an internal appeal for the reader's attention. AI posts take on a platform's visibility without making that appeal, which is the 'aloofness' readers report Does AI writing lack the internal appeal to attention that humans use?. ChatGPT tends to organize text by summarizing what it already said, while human writers more often point ahead to what's coming. That suggests the two are writing for different imagined readers Does ChatGPT organize text differently than human writers?. AI fiction can be detected with 93% accuracy from story-level choices alone, like how much characters drive events and how time is ordered, with no style cues used Can AI stories be detected without analyzing writing style?. Together these suggest real readers react to traces of intention, or its absence, that are built into the structure. A vignette that only swaps an author label can't capture that.

There's a reason to be careful about expecting one clean reversal in real contexts: readers already disagree a lot about intent. Differences in how people read socially loaded sentences reflect real differences in their perspectives, not noise Why do readers interpret the same sentence so differently?. Models attribute intent unevenly too. GPT-4o sees irony far more often than humans do, because ironic examples stand out more in training data than in everyday use Do language models overestimate how often irony appears?. In real writing, then, any effect of AI on perceived intent sits on top of a spread of readings that varies from reader to reader. A vignette's single average can hide that.

If you want to go deeper on the underlying question of where intent comes from, two notes reframe it. One argues that the speaker is produced within the act of communicating rather than existing before it Does language create subjects or express them?. The other argues that AI text comes out in sequence but without the time spent reflecting that shapes what a human writes next Does AI text generation unfold through temporal reflection?. If both are right, the 'reversal' may not be readers changing their minds about intent. It may be readers noticing that the usual process that produces intent didn't happen.


Sources 8 notes

Does AI writing assistance change how readers perceive the writer?

A study of 2,939 writers and 11,091 readers found AI assistance shifted every tested dimension—29 total—toward extremism, confidence, quality, agreeableness, and perceived privilege. Distortions were statistically significant and directional, not random noise.

Does AI writing lack the internal appeal to attention that humans use?

Human writing contains an appeal to the reader's attention as a fundamental property of communication itself. AI-generated posts inherit platform visibility but do not perform this internal appeal, producing the reported aloofness readers perceive — a structural absence, not a stylistic defect.

Does ChatGPT organize text differently than human writers?

ChatGPT defaults to summarizing what was already said, while students use more forward-pointing structure that previews upcoming arguments. This reflects different reader models and may stem from how autoregressive generation works token by token.

Can AI stories be detected without analyzing writing style?

StoryScope achieved 93.2% accuracy separating AI from human fiction using only discourse-level features like character agency and chronological structure, retaining 97% of performance while eliminating stylistic cues. These structural choices resist humanization because they require rewrites, not surface edits.

Why do readers interpret the same sentence so differently?

Interpretation Modeling research shows that disagreement on socially embedded sentences reflects valid differences in reader perspective, not annotation failure. Structured human disagreement in NLI benchmarks confirms that interpretation distributions carry meaningful information.

Show all 8 sources
Do language models overestimate how often irony appears?

GPT-4o assigns significantly higher irony scores than humans (p < .001), revealing that LLMs detect irony as a pattern but miscalibrate its prevalence because ironic examples are more salient in training data than in actual use.

Does language create subjects or express them?

Subjecthood is produced within communicative events, not possessed prior to them. This convergent position across philosophy, linguistics, and cognitive science inverts the standard picture of language as a tool used by pre-existing subjects.

Does AI text generation unfold through temporal reflection?

Token ordering in LLMs follows probabilistic selection without intervening reflection or revision. Human discourse gains meaning from temporal structure—time spent thinking changes what comes next—but AI text production lacks this duration-in-reflection despite appearing sequentially composed.

Papers this line draws on 8

The research behind the notes this line reads — ranked by how closely each paper relates.