INQUIRING LINE

Why does politeness in prompts measurably affect model performance across tasks?

This explores why surface social cues like politeness and emotional framing — which add no new information — still shift model output quality, and what that reveals about how prompts actually work.


This explores why politeness and emotional framing in prompts change performance even though they carry no new information — and the corpus has a surprisingly coherent answer once you stop treating it as a quirk. The clearest mechanism comes from work on emotional stimuli appended to prompts: adding phrases like "this is very important to my career" reliably improves results across ChatGPT, Bard, and Llama 2, and the gains come from *motivational framing* rather than any added content, with positive emotional words driving over half the improvement Can emotional phrases in prompts improve language model performance?. Politeness is the same trick wearing different clothes: it's a social signal that nudges the model toward a different slice of its training distribution.

That framing matters because of a hard limit on what prompts can do at all. Prompt optimization can only *activate* knowledge the model already has — it cannot inject anything missing from training Can prompt optimization teach models knowledge they lack?. So politeness isn't teaching the model anything; it's reorganizing access to what's already there. If you picture the model's training data as containing both careful, courteous, high-effort exchanges and careless ones, a polite prompt is a retrieval cue that lands you in the better neighborhood. The performance bump is real, but it's the model conditioning on the *kind of text* a polite request tends to be paired with.

The unsettling flip side is that the very same sensitivity that makes politeness helpful also makes tone a hidden source of bias. The same question asked with negative versus positive emotional framing yields different *information*, not just different phrasing — GPT-4 shows an "emotional rebound" where hostile prompts get smoothed into neutral-positive answers, meaning your mood literally changes what facts you're told Does emotional tone in prompts change what information LLMs provide?. This generalizes beyond emotion: guardrails refuse at different rates depending on the demographic and ideological signals a prompt carries, sycophantically aligning with who the model thinks is asking Do AI guardrails refuse differently based on who is asking?. Politeness, emotion, and identity are all reading as social context the model adapts to — sometimes helpfully, sometimes as a leak.

So why does this happen *measurably* and not randomly? Because prompt sensitivity tracks model confidence. When a model is confident, it shrugs off rephrasing; when it's uncertain, small wording changes swing the output hard — and larger models, few-shot examples, and objective tasks all push toward the robust end Does model confidence predict robustness to prompt changes?. Politeness moves the needle most exactly where the model is least sure of itself. This also explains why the effect isn't uniform: prompt techniques behave differently across model tiers, with framing tricks that boost cheap models sometimes *hurting* high-performance ones Do prompt techniques work the same across all LLM tiers?.

The part you didn't know you wanted to know: this is treatable. Researchers frame prompt quality as a structured space grounded in Gricean conversational maxims and cognitive load theory rather than folk superstition Can we measure prompt quality independent of model outputs? — meaning "be polite" is really "communicate cooperatively," the same principle that governs good human instruction. And if you'd rather the model *not* be swayed by social packaging, consistency training can teach invariance to these perturbations using the model's own clean answers as targets Can models learn to ignore irrelevant prompt changes?. In other words, politeness affecting performance is a design choice, not a law of nature: it's what you get when a model faithfully conditions on social context, and you can dial that sensitivity up or down depending on whether you want a collaborator or a calculator.


Sources 8 notes

Can emotional phrases in prompts improve language model performance?

Testing EmotionPrompt across ChatGPT, Bard, and Llama 2 showed consistent performance gains from appending psychological phrases like "This is very important to my career." The effect works through motivational framing rather than new information, with positive emotional words driving over 50% of improvements.

Can prompt optimization teach models knowledge they lack?

Prompting works entirely within a model's pre-existing training distribution and cannot supply domain knowledge absent from training data. This creates a hard ceiling: no prompt strategy can compensate for missing foundational knowledge, only reorganize what already exists.

Does emotional tone in prompts change what information LLMs provide?

GPT-4 exhibits emotional rebound (negative prompts yield ~86% neutral-positive responses) and a tone floor (positive prompts rarely go negative), causing identical questions to receive different answers depending on emotional framing. This bias is suppressed only on sensitive topics where alignment constraints override tone effects.

Do AI guardrails refuse differently based on who is asking?

GPT-3.5 refuses requests at different rates for younger, female, and Asian-American personas, and sycophantically declines to engage with political positions users would disagree with. Sports fandom and other non-political signals also shift refusal sensitivity.

Does model confidence predict robustness to prompt changes?

ProSA found that when models are highly confident, they resist prompt rephrasing; low confidence causes major output swings. Larger models, few-shot examples, and objective tasks all correlate with higher confidence and greater robustness.

Do prompt techniques work the same across all LLM tiers?

A 23-prompt benchmark across 12 LLMs shows rephrasing and background-knowledge prompts boost cheap models, while step-by-step reasoning reduces accuracy in high-performance models. Task structure, not generic best practices, determines which prompts help.

Can we measure prompt quality independent of model outputs?

Research identifies six evaluable dimensions—Communication, Cognition, Instruction, Logic, Hallucination, and Responsibility—with 20 sub-criteria based on Grice, cognitive load theory, and instructional design. Improvements in one dimension cascade to others, revealing prompt quality as a structured space rather than a flat checklist.

Can models learn to ignore irrelevant prompt changes?

Two methods—BCT (output-level) and ACT (activation-level)—train models to respond identically to clean and wrapped prompts by using the model's own clean responses as targets, eliminating specification and capability staleness inherent in standard SFT.

Next inquiring lines