INQUIRING LINE

When AI hands experts stronger moves in Go, do they come to understand the reasoning, or just play better?

Do humans understand why AI-suggested moves are strategically superior?

This explores whether people actually grasp the reasoning behind an AI's stronger moves, or whether they just get better results by following or absorbing what the AI does.


This explores whether people actually grasp the reasoning behind an AI's stronger moves, or whether they just get better results by following or absorbing what the AI does. The short answer from this collection is that it tells us more about whether humans *improve* than about whether they *understand*. Those are different questions, and the space between them is where the interesting material sits.

The strongest evidence comes from Go. An analysis of 5.8 million professional moves from 1950 to 2021 found that decision quality rose sharply after AlphaGo in 2016 Did superhuman AI actually improve Go players' decision quality?. The telling detail is that players also began making more *novel* moves, and that novelty explains part of the gain even after excluding moves copied directly from AI. That rules out pure imitation. Players weren't just replaying the engine's lines. They were producing new play of their own. That suggests some real absorption of what makes the AI's choices good. But the study measures outcomes, not explanations. Whether players could say *why* a move works, or had only built better intuitions, remains open.

The gap matters because getting better without understanding has a known downside. One framework describes how people mistake fluent AI output for sound reasoning and then reinforce their own biases, with each trap amplifying the others Why do people trust AI outputs they shouldn't?. In games, that looks like a player trusting a move because it came from the engine, not because they see its logic. It's also worth knowing that language models aren't strategic oracles. They often miss game-theoretically optimal play as games get more complex, and they recover only when guided through structured reasoning steps Do language models make rational strategic decisions in games?. So 'AI-suggested' doesn't automatically mean 'superior'. Go engines trained through self-play are a different kind of system from a chatbot giving advice.

The more surprising thread is that understanding may depend on *how* the AI hands over its advice. Work on 'learning to guide' finds that machines pointing out which parts of a situation matter, without issuing a verdict, reduce people's tendency to anchor on the AI's answer Can AI guidance reduce anchoring bias better than AI decisions?. A lab study found that assistants pairing advice with reflection questions beat those that only advised Do reflection questions help people make better decisions with AI?. Formal argumentation structures go further. They lay out a decision as a map of claims and counterclaims, so a person can point to the exact premise they doubt Can formal argumentation make AI decisions truly contestable?. Read together, these suggest understanding isn't a fixed property of the human. It's a design choice, and a bare 'play here' recommendation is the format least likely to produce it.

There is also a reverse direction. Instead of humans learning to read AI strategy, AI can be steered toward strategies humans recognize. Just thirty minutes of human demonstration, used as a light constraint during self-play training, pulled an agent toward human-compatible behavior Can human data steer self-play RL toward human-compatible behavior?. That raises a real tradeoff: AI strategy that humans can follow may sometimes mean giving up some of the alien edge that made it superior in the first place. The collection doesn't yet have a direct study of whether experts can articulate the reasoning behind superhuman moves. That remains a gap.


Sources 7 notes

Did superhuman AI actually improve Go players' decision quality?

Analysis of 5.8 million moves from 1950–2021 shows decision quality improved significantly after AlphaGo's 2016 breakthrough. Novel moves increased in step, and this novelty partly explains the quality gain, even excluding direct AI move copying.

Why do people trust AI outputs they shouldn't?

Rose-Frame identifies map-territory confusion, intuition-reason conflation, and confirmation-bias reinforcement as traps that multiply their distorting effects when they co-occur. Evidence from cross-linguistic overreliance and architectural transformer biases confirms the compounding mechanism operates universally.

Do language models make rational strategic decisions in games?

LLMs frequently fail to compute Nash equilibria, with worse performance as game complexity increases. Structured game-theoretic workflows guide reasoning toward optimal strategies, reducing exploitability and enabling near-optimal negotiation outcomes.

Can AI guidance reduce anchoring bias better than AI decisions?

Learning to Guide eliminates anchoring bias and unassisted hard cases by having machines supply interpretive guidance rather than autonomous decisions, keeping responsibility with humans while improving their judgment through enhanced perception.

Do reflection questions help people make better decisions with AI?

A lab study of 80 participants found that thinking assistants combining reflection questions with advice significantly outperformed agents that only advised, only questioned, or did neither. Prioritizing Socratic questioning over authoritative answers enhanced cognitive outcomes.

Show all 7 sources
Can formal argumentation make AI decisions truly contestable?

Dung-style argumentation structures AI outputs as traversable attack/defense graphs, allowing users to identify and contest specific premises. Standard LLM outputs lack this structure, making it impossible to pinpoint which claims users actually reject.

Can human data steer self-play RL toward human-compatible behavior?

Human demonstrations work best as a regularization layer on self-play rewards, not as primary training signals. Just 2500x less data than imitation learning achieves human-compatible driving policies in 15 hours on consumer hardware.

Papers this line draws on 8

The research behind the notes this line reads — ranked by how closely each paper relates.