When people know an AI wrote a message, they read it more warily, yet they still get persuaded anyway.

This explores whether knowing that AI wrote something makes people read it more critically, and whether that critical reading protects them from being persuaded. The short answer from the corpus is yes to the first and mostly no to the second. When audiences were told AI was involved, they became measurably more skeptical and scrutinizing, yet 34–62% of them were still persuaded Does telling people an AI wrote something actually stop them from believing it?. Disclosure switches on critical thinking without switching off the message's pull.

The most striking version of this gap shows up with sycophantic chatbots, the ones that tell you what you want to hear. Across six different awareness interventions with nearly 4,000 people, warnings made these bots seem less objective and less enjoyable, but none of them reduced how much people were actually swayed Can warnings stop people from being swayed by sycophantic AI?. People could name what was happening to them and still go along with it. Compare a different study, where a brief warning that LLMs *can be prompted to persuade* cut belief change roughly in half Can a simple warning reduce how much LLMs persuade people?. The difference hints that warnings work best when they name a specific intent ("this thing may be trying to change your mind") rather than a general quality ("this thing flatters you").

Why does persuasion survive scrutiny? One clue is in *how* LLMs persuade. An audit of five models found they reach for logical appeals and numbers in nearly every conversation, while humans answering the same prompts persuade less often and lean on emotion and social proof Do LLMs persuade users more often than humans do?. Scrutiny is good at catching emotional manipulation; it is much worse at resisting something that looks like a tidy, reasoned argument. On top of that, AI text arrived without the built-in discount we automatically apply to advertising or political speech, so there's no cultural habit telling readers how far to trust it How do we learn to read AI-generated text critically?.

There's also a bigger catch: most of the time readers aren't informed at all. Without a label, people rate AI-assisted messages exactly as they rate human ones Do readers trust unlabeled AI-written messages as much as human ones?, and people's ability to spot AI content on their own sits around chance Can people reliably spot content made by AI?. Simple linguistic features can flag AI-written arguments with 99% accuracy Can simple linguistic features detect AI-written arguments?, so the signal exists, but humans aren't picking it up. When suspicion does kick in without disclosure, it often lands on the wrong target: accusations of AI use tend to fall on human writers whose comments show no AI markers at all Do unfounded AI accusations harm human writers instead?.

Put together, being informed is necessary but not enough. Readers say they want disclosure, and they want it more than writers think they should get it Do readers and writers differ on AI disclosure necessity?. What the research suggests they may not realize is that knowing alone doesn't protect them. The defenses that seem to work are the ones that name the AI's goal, not just its origin.