Language Understanding and Pragmatics

Does ChatGPT organize text differently than human writers?

This explores how ChatGPT relies on backward-pointing references while human academic writers use forward-pointing structure. Understanding this difference reveals different assumptions about how readers process argument.

Note · 2026-02-21 · sourced from Discourses
Where exactly does language competence break down in LLMs? How should researchers navigate LLM reasoning research?

A specific syntactic finding from the metadiscursive nouns comparison: ChatGPT relies heavily on anaphoric references (pointing backward to previously discussed material), while students demonstrate greater use of cataphoric references (pointing forward to material that is about to be introduced).

In practical terms:

This is not a trivial stylistic preference. The choice of anaphoric vs. cataphoric structure reflects a fundamentally different model of the reader. Cataphoric structure assumes an active reader who needs a roadmap: you tell them where you're going before you take them there. Anaphoric structure assumes a passive reader who is following along: you refer back to what you've established.

Effective academic argument typically uses cataphoric structure to build anticipation and signal logical progression. ChatGPT's preference for anaphoric structure means it tends to summarize what it has said rather than set up what it is about to argue — a writing habit that is organizationally safe but rhetorically weak.

The deeper implication: this pattern may reflect something about how autoregressive generation works. Token-by-token generation is inherently backward-looking (each token is conditioned on prior tokens). Generating cataphoric structure requires projecting forward to what will be said, which is a higher-order planning operation that autoregressive generation doesn't naturally support.


Source: Discourses

Related concepts in this collection

Concept map
12 direct connections · 106 in 2-hop network ·medium cluster

Click a node to walk · click center to open · click Open full network for a force-directed map

your link semantically near linked from elsewhere
Original note title

chatgpt favors anaphoric text organization while human writers prefer cataphoric structure