Do AI writing tools improve online discussion or degrade it?

The paper's central finding is what it calls a "complex duality": "some AI-tools increase user engagement and volume of generated content, but at the same time decrease the perceived quality and authenticity of discussion, and introduce a negative spill-over effect on conversations." The evidence is a controlled experiment on a custom platform that simulates an online chat room. A sample the paper calls representative, 680 U.S. participants, was split into groups of five and assigned to a control condition or one of four AI tools: an open-ended Chat, Conversation Starters, Feedback on comment drafts, and Suggestions of replies in agree, neutral and disagree stances. On the producer side, all AI-supported tools significantly increased the average length of comments, and Chat and Suggestions users reported that the AI would make them more willing to take part. The consumer side is thinner. The introduction says "no single AI tool enhances both producer and consumer experiences," and the discussion reports that although treatment participants produced more content, "they often recognized it as generic, impersonal, and of lower quality."

The mechanism the paper gives runs through volume and authenticity. Content that reads as generic "diminishes trust and informational value." The authors' "central concern" is that generative AI "may saturate platforms with superficial or generic content, diluting the visibility and impact of more original contributions—and, as our findings suggest, lowering the quality of subsequent conversations within threads, even among users not using the AI themselves." That last clause is the spillover, and it matters most because it puts the cost on people who never touched the tool. But the excerpt states it only as something the findings "suggest." It does not describe how spillover was measured, so the claim rests on the authors' wording.

This is where the experiment bears on Does AI threaten social media's conversational function?. That note argues the damage to social media is structural, to its function as a place for talk, not to sentiment. The experiment locates its cost in whether comments read as authentic and whether threads stay good, which is closer to the structural side. It does not measure conversational style, so it supports the neighbor only indirectly. The benefit-and-cost pairing also echoes Does chatbot personalization build trust or expose privacy risks?, where personalization raises trust and privacy concern together. Here, volume rises as perceived quality falls. On my reading, the overlap figures (13–16% of final Chat comments and 16–19% of submitted Conversation Starter comments) mean most final wording stayed the participant's own. That sits nearer the passive-channel pole in Is AI shifting from message conduit to active conversation participant? than the active-participant pole, though the excerpt does not use that frame.

The excerpt gives no effect sizes, test statistics or intervals for the main outcomes, so it supports the direction of the effects but not their size. The demographic checks found "only minor effects that did not reach statistical significance," which the authors attribute to "limited sample sizes across treatment groups." The sample is U.S.-only, each discussion round ran ten minutes, every tool used GPT-4o, and participants were not told which model they were using or whether content was AI-generated. Those choices limit how far a single short session on one platform can stand in for long-run platform behavior. The defensible reading is narrower: in this setup, AI assistance increased output while participants judged that output lower, and the spillover to non-users is reported as a suggestion, not as a measured result.