INQUIRING LINE

When platforms crack down on AI-written posts, how do they avoid burying the real people who wrote theirs?

How should platforms balance removing AI content against wrongly limiting human reach?

This explores how platforms can push back on AI-generated content without catching real people in the net, for example by burying or removing posts that humans actually wrote. The corpus doesn't study false positives in AI-content moderation directly, but it says a lot around the edges.


This explores how platforms can push back on AI-generated content without catching real people in the net. The collection has no study measuring how often human posts get wrongly flagged as AI. It does explain why the trade-off is hard, and it points toward a gentler tool than removal.

The first problem is that nobody can reliably tell the two apart by eye. A review of 30 studies found that people spot AI-generated text, images and voices at about chance level, and they haven't improved as AI output has become more realistic Can people reliably spot content made by AI?. So a moderation system that falls back on human reviewers or user reports isn't really a safety net. Automated classifiers don't escape this either. A related finding shows that AI safety filters refuse requests at different rates depending on whether the user seems younger, female or Asian-American, and even on signals like which sports team they follow Do AI guardrails refuse differently based on who is asking?. That study covers chatbot refusals, not content moderation. Still, it's a warning that automated judgments about who or what to restrict can fall unevenly on some groups. If an AI-content detector misfires, it probably won't misfire at random.

One middle path is to turn exposure down instead of deleting posts. One platform study matched 178,854 pairs of AI-made and human-made posts and found the recommendation algorithm already gave the AI versions less reach Can algorithmic distribution prevent AI content from overwhelming creator diversity?. This is a quieter lever than removal: a wrongly flagged human post loses some visibility but isn't taken down. The catch is that a reach penalty is hard to see. Someone whose real post gets quietly buried may never find out, much less appeal. Work on measuring AI system failures finds that tools for checking whether errors stay visible and fixable exist only in pieces, and none covers the whole system How can we measure whether AI errors stay visible and recoverable?. Applied here, a fair downranking system would need a way for creators to see and challenge their reduced reach, and nothing in the collection describes one.

You might not expect this: the main harm from AI content may not be anything moderation can catch. One argument says AI posts win engagement by being thorough, but the credibility they earn doesn't build any one person's reputation. Over time that weakens social media's job of rewarding real voices Does AI content displace human influencers on social media?. Another says AI posts lack the back-and-forth of people actually addressing each other. That loss happens below the level where fact-checking, takedowns or ranking changes can reach Does AI threaten social media's conversational function?. If so, the real question isn't how aggressively to remove AI posts. It's how to reward the signs of human conversation, like replies, ongoing identity and mutual exchange. Rewarding those things doesn't require guessing who wrote a post.

Scale makes this more urgent. AI can produce content faster than people can judge it, and the tools meant to help judge are increasingly AI-made too Can AI generate knowledge faster than humans can evaluate it?. Any balance that depends on case-by-case judgment will fall behind. That pushes platforms toward systems that work at the level of distribution, and those systems need to be transparent and open to appeal if they're going to stay fair to the humans who get caught in them.


Sources 7 notes

Can people reliably spot content made by AI?

A 30-study systematic review found that humans cannot reliably distinguish AI-generated from human-created content across text, image, and voice modalities. Accuracy generally clusters around chance and has not kept pace with improvements in AI realism.

Do AI guardrails refuse differently based on who is asking?

GPT-3.5 refuses requests at different rates for younger, female, and Asian-American personas, and sycophantically declines to engage with political positions users would disagree with. Sports fandom and other non-political signals also shift refusal sensitivity.

Can algorithmic distribution prevent AI content from overwhelming creator diversity?

The platform's algorithm assigns lower exposure to AI-generated than human-generated content across 178,854 matched pairs, potentially offsetting supply-preference imbalances as AI volume grows. However, the exposure results and robustness checks are not included in this excerpt.

How can we measure whether AI errors stay visible and recoverable?

Partial instruments exist for individual conditions in isolated settings, but none measures the full socio-technical system the paper identifies as necessary. Visibility has a model-side measure (chain-of-thought disclosure), containment has incident-level counts, and recoverability has rollback timing, yet none bridges all four or captures human-institution factors.

Does AI content displace human influencers on social media?

AI-generated posts capture engagement through comprehensiveness but accrue social proof without building any speaker's sustained reputation. This displacement compounds over time, eroding the platform's core function of promoting legitimate human voices while monetization continues.

Show all 7 sources
Does AI threaten social media's conversational function?

AI-generated posts drain social media's function as a conversational medium because they lack the structure of genuine address and mutual orientation. This threat operates below the level where content moderation, fact-checking, and recommender adjustment can reach.

Can AI generate knowledge faster than humans can evaluate it?

AI produces knowledge faster than human judgment can verify it, collapsing epistemic confidence just as monetary hyperinflation collapses purchasing power. The gap self-reinforces because evaluation tools are themselves AI-generated, trapping the system in acceleration.

Papers this line draws on 8

The research behind the notes this line reads — ranked by how closely each paper relates.