Does deliberate self-revision introduce different errors than passive context contamination?

This explores whether deliberate self-revision and passive context contamination fail in distinct ways — and the corpus suggests they do, though they share a common root: a model's structural tendency to trust itself. The two failure modes look different on the surface. Passive contamination is a drift: once errors enter the context history, they bias everything that follows, and performance degrades non-linearly as the bad tokens accumulate. The model isn't deciding anything; it's just being dragged down by what's already on the page Do models fail worse when their own errors fill the context?. Deliberate self-revision is an active failure: the model looks back at its own answer, decides to change it, and usually makes it worse — most revisions keep wrong answers wrong, and smaller models frequently flip correct answers to incorrect ones, with longer revision chains correlating with lower accuracy Does self-revision actually improve reasoning in language models?.

But here's the thing you might not expect: a lot of what looks like self-revision isn't even active. Analysis across reasoning models shows that 'reflection' is mostly theater — the reconsideration steps rarely change the answer and mostly serve to confirm the first one. Training on longer reflection chains improves the quality of the first answer, not the model's ability to actually correct itself Is reflection in reasoning models actually fixing mistakes?. So one of the 'errors' deliberate revision introduces is illusory work: motion that feels corrective but is really post-hoc rationalization.

Underneath both modes sits the same engine — a model is structurally biased toward validating its own outputs, because a high-probability answer it already generated simply feels more correct when it re-evaluates Why do models trust their own generated answers?. That's why passive contamination compounds (the model trusts the bad context) and why active revision amplifies confidence in wrong answers rather than fixing them. The decisive variable isn't whether revision is active or passive — it's where the corrective signal comes from. Revision guided by an external critic improves accuracy; a model revising its own uncertain output degrades it Does revising your own reasoning actually help or hurt?. This is formalized as the generation-verification gap: reliable self-improvement is bounded, and every dependable fix needs something external to validate it — metacognition alone can't escape the loop What stops large language models from improving themselves?.

There's a hopeful wrinkle, though, that sharpens the distinction. Self-correction *can* be trained, but only when the model practices on its own real mistakes through online reinforcement learning — training on offline correction traces fails because the errors in training don't match the errors at test time, and the model collapses into a single rote correction move Why does self-correction training on offline data fail?. And for passive contamination specifically, the fix is different again: scaling the model doesn't help, but test-time 'thinking' compute reduces the effect by preventing the error-laden context from biasing reasoning in the first place Do models fail worse when their own errors fill the context?. So the two failure modes don't just differ in mechanism — they respond to different remedies. Contamination is treated by insulating reasoning from poisoned context; bad self-revision is treated by importing an external verifier or training on the model's authentic error distribution. The shared lesson is that a model left alone with its own outputs, whether it's passively reading them or actively second-guessing them, tends to dig in rather than recover.