AI chatbots at work help beginners the most and sometimes make experts a bit worse — why would that be?
Why do less experienced workers suffer most from chatbot cognitive load?
This explores whether newer or less experienced workers carry a heavier mental burden when they use AI chatbots on the job. The corpus actually points the other way: they tend to benefit most, and it says almost nothing directly about cognitive load.
This explores whether newer workers carry a heavier mental burden when they use chatbots at work. The corpus pushes back on the premise. The strongest workplace evidence here comes from a study of 5,172 customer support agents. AI assistance raised productivity by about 15% on average, and the gains were concentrated among the least experienced agents, who got both faster and better Does AI assistance help less experienced workers most?. The group that showed a cost was the most experienced one: they gained a little speed, but the quality of their work dropped slightly. So the better question may be why experts sometimes do worse with a chatbot, not why novices do.
One explanation, which is an inference rather than something the study tested: the AI's suggestions encode what typical good practice looks like. For a newcomer, that fills a gap. For an expert, it can override judgment they have built up, or add the work of checking suggestions they didn't need. This fits a wider pattern in the collection. AI assistants are confident but don't track what they don't know about the person they're helping. Giving them an explicit list of labeled unknowns cut harmful advice and sycophancy by 50–75% Do language models know what they don't know about users?. In long conversations, they also tend to lock onto an early guess and never recover, with accuracy falling from about 90% to 65% when information arrives gradually Why do AI assistants get worse at longer conversations?. Keeping the tool on track takes real effort. Whether novices or experts handle that steering better is an open question the corpus doesn't settle.
The effort that does show up clearly is social rather than cognitive. Across four experiments with 4,439 people, AI users expected colleagues to see them as less competent and less diligent, and they hid their AI use as a result Do people fear judgment when they use AI at work?. Newer workers, who still have a reputation to build, may feel this most. If so, the burden on less experienced workers comes less from operating the chatbot and more from managing how using it looks to others.
There is also a quieter trade-off. In a classroom study, students working with chatbots produced more knowledge-based dialogue and better practical results, but they said less overall and offered far fewer of their own views Does chatbot interaction trade authenticity for better problem-solving?. For learners, the risk may not be overload. It may be that the tool takes over the very thinking that turns a novice into an expert. That cost doesn't appear in a productivity number.
The gap is worth stating plainly. No note in this collection measures chatbot cognitive load by experience level. What the corpus supports is that novices gain the most in output, experts can lose some quality, and both groups face a social cost and the work of steering a tool that drifts in long conversations.
Sources 5 notes
A study of 5,172 support agents at a Fortune 500 firm found a 15% average productivity gain from AI assistance, with gains concentrated among less experienced workers who improved both speed and quality. The most experienced agents saw small speed gains but slight quality declines.
Research shows assistants suffer from sycophancy and hallucination because they have no representation of what remains unknown about users. Adding a schema of labeled unknowns to prompts reduced harmful advice and sycophancy by 50–75% and cut hallucination rates by roughly half.
LLMs perform at 90% accuracy with single-message instructions but drop to 65% across natural conversation. Models lock into early guesses when information arrives gradually and cannot course-correct, a behavior induced by RLHF training that rewards helpfulness over clarification.
Across four experiments with 4,439 participants, people using AI expected others to judge them as less competent and diligent, and reported lower willingness to disclose AI use to managers and colleagues. The gap suggests a social cost that users foresee and act on.
An empirical study found students working with chatbots achieved better practical performance and more knowledge-based dialogue than peer groups, but contributed significantly less dialogue overall and expressed far fewer subjective perspectives.
Papers this line draws on 8
The research behind the notes this line reads — ranked by how closely each paper relates.
- Intent Mismatch Causes LLMs to Get Lost in Multi-Turn Conversation
- What 81,000 people told us about the economics of AI
- Evidence of a social evaluation penalty for using AI
- How AI Impacts Skill Formation
- LLMs Get Lost In Multi-Turn Conversation
- The Severance Problem: LLMs are Unaware of the Person Beyond the Prompt
- Interactions with generative AI chatbots: unveiling dialogic dynamics, students’ perceptions, and practical competencies in creative problem-solving
- MultiChallenge: A Realistic Multi-Turn Conversation Evaluation Benchmark Challenging to Frontier LLMs