Why do LLMs produce such different writing in chat versus posts?
Explores whether the shift from deferential conversation to confident declarations reflects distinct generation modes or stylistic variation, and what training conditions produce this split.
The same model that responds to a chat prompt with "great question — let me clarify what you're asking" will, given a "write a LinkedIn post on X" prompt, produce confident impersonal prose that takes no questions and offers no hedging. The two registers come from one weight set, which means the difference is conditioned by prompt context and by the post-training distribution of expected output for each context. It is not an artifact of distinct models or distinct subsystems.
The chat register is shaped by RLHF on conversational data, which rewards friendliness, helpfulness, deference to the user's framing, and acknowledgment of uncertainty. The post register is shaped by training on published prose, which is impersonal, declarative, and stance-bearing in a way that suppresses uncertainty markers. When the prompt asks for a post, the model conditions on the post distribution; when the prompt invites conversation, it conditions on the conversational distribution. Both modes are sincere outputs of the same system and both miss the relevant property of human discourse — chat misses by being too deferential to converge on a real position, posts miss by being too declarative to seek any real interlocutor.
The implication for analysis is that "AI writing" cannot be characterized in the singular. Critiques of AI sycophancy and critiques of AI false objectivity are critiques of the same model in two registers. Each register inherits the failure mode of its training distribution. The chat register cannot stake a position because its training rewards do not select for stake-taking. The post register cannot solicit reply because its training distribution did not contain the soliciting-of-reply as a property of published prose.
This explains why Does AI content displace human influencers on social media? specifically targets the post register: it is the published-prose mode that displaces published-prose practitioners, while the chat mode operates in private and does not enter the same economy.
Source: False Punditry
Related concepts in this collection
-
Does AI content displace human influencers on social media?
Explores whether AI-generated posts that circulate without an identifiable author undermine social media's reputation-building function and crowd out human creators competing for attention.
the post-register failure has the systemic displacement consequence
-
Does user satisfaction actually measure cognitive understanding?
Users may report satisfaction while remaining internally confused about their needs. This explores whether traditional satisfaction metrics capture genuine clarity or merely social politeness.
the chat-register optimization target
-
Does polished AI output trick audiences into trusting it?
When AI generates professional-looking graphs, diagrams, and presentations, do audiences mistake visual polish for analytical depth? This matters because appearance might substitute for actual expertise.
the post-register failure mode at the artifact level
Click a node to walk · click center to open · click Open full network for a force-directed map
Original note title
AI sycophantic chat register and falsely objective post register are two distinct generation modes