Does AI make everyone equally more productive, or mainly help beginners while experts gain less — or even slip?
How do user skill levels change which AI productivity gains actually materialize?
This explores whether AI makes everyone more productive equally, or whether the gains depend on who is using it: beginners or experts, people applying skills they already have or people trying to learn new ones.
This explores whether AI's productivity boost depends on who is using it and what they're trying to do. The corpus doesn't give one simple answer. Who gains depends on how much a worker already knows, and on whether they're doing familiar work or learning something new. The clearest data point comes from customer support. Across 5,172 agents, AI assistance raised issues resolved per hour by 15% on average. Most of that gain went to less experienced agents, who got faster and better. The most experienced agents barely sped up and saw slight drops in quality Does AI assistance help less experienced workers most?. In that setting, AI works like a way of passing expert knowledge down to newcomers. It helps less the closer you already are to the top.
High expertise can even turn the gain negative. In a randomized trial, experienced open-source developers working in codebases they knew well took 19% longer with early-2025 AI tools. Before starting, they had predicted a 24% speedup Do AI coding tools actually speed up experienced developers?. Part of the reason is that deep familiarity leaves little room for AI to add anything, while checking unreliable suggestions still costs time. That fits a broader pattern. A survey of 3,200 AI users found that almost 40% of time saved is lost to fixing and verifying outputs Where does AI's time savings actually go in practice?. A 535-person study found that people working with an LLM captured only about half of the model's accuracy gains, ending up worse than the better of the two working alone Why does assisted accuracy capture only half the LLM gain?. Turning AI output into real productivity is a skill of its own, and it doesn't happen automatically.
The twist is that 'less experienced' doesn't mean 'learning.' The support agents' gains came from doing a job they had already been trained for. When workers used AI to pick up genuinely new skills, the productivity gains disappeared and learning suffered When does AI actually boost worker productivity?. One likely reason: polished AI output feels easy to read, and people take that ease as a sign of their own competence, even though they didn't produce the work Does processing ease mislead users about their own competence?. So a novice can feel more capable while building less real skill. This may help explain why perceived gains run ahead of measured ones, both for individual developers and for the executives surveyed in Do AI productivity gains feel larger than they actually measure?.
Over time, skill level isn't fixed. AI changes it. Interviews with knowledge workers found four different outcomes: some skills grew, some held steady, some faded, and some changed in value. Which one happened depended on how each person used the tool How does generative AI actually change worker skills?. Narayanan and Kapoor point to why. AI mostly shrinks the 'execute' part of knowledge work, while deciding what to do and delivering the result stay the same or grow Does AI really compress all layers of knowledge work equally?. That suggests a takeaway you might not expect. AI helps novices most at execution, the part it is absorbing. The judgment that experts already have, and that AI-assisted learners may never build, is the part that keeps its value.
Sources 9 notes
A study of 5,172 support agents at a Fortune 500 firm found a 15% average productivity gain from AI assistance, with gains concentrated among less experienced workers who improved both speed and quality. The most experienced agents saw small speed gains but slight quality declines.
A randomized controlled trial of 16 developers on 246 real tasks found completion times increased 19%, despite developers forecasting a 24% speedup beforehand. Experts in economics and ML also overestimated gains; slowdown factors included over-optimism, low AI reliability, and developers' deep familiarity with mature codebases.
A Workday-commissioned survey of 3,200 active AI users found that while 85% save 1–7 hours weekly, almost 40% of those savings disappear into correcting errors and verifying outputs. Only 14% of employees consistently see positive net outcomes, with success tied to organizations that retrain staff and redesign roles rather than simply deploying tools.
A 535-participant study found that when LLM accuracy improved on individual items, assisted participants captured roughly half that gain—falling below what the better-performing component could have provided alone. This shows complementarity creates potential but does not guarantee synergy.
Studies showing AI productivity gains measured tasks within workers' existing domains. When workers used AI to learn new skills, productivity gains disappeared and learning suffered, suggesting prior findings do not generalize to skill acquisition.
Show all 9 sources
High-quality AI output triggers a metacognitive heuristic: users experience fluency as a signal of their own capability, even though they didn't generate it. This self-directed fluency illusion systematically inflates perceived competence because LLMs optimize for fluency regardless of user understanding.
A survey of 750 executives found that perceived AI productivity gains exceed measured ones, likely because revenue lags operational improvements. Effects concentrate in high-skill services and finance, with labor reallocating rather than shrinking overall.
Interviews with 38 Dutch knowledge workers revealed four outcomes—development, maintenance, erosion, and revaluation—rather than a binary upskilling-versus-deskilling split. The same technology produces different skill effects depending on how workers use it and which tasks change in their role.
Narayanan and Kapoor argue AI narrows only the middle execution layer of knowledge work while decide and deliver layers persist or grow. Translation and legal work show stable or expanding employment despite AI gains, suggesting task-level compression doesn't shrink occupational demand.
Papers this line draws on 8
The research behind the notes this line reads — ranked by how closely each paper relates.
- How AI Impacts Skill Formation
- Toward Measuring AI's Effects on Skill Formation: The Stock-Formation Gap
- What 81,000 people told us about the economics of AI
- Does generative AI narrow education-based productivity gaps? Evidence from a randomized experiment
- Beyond Productivity: Measuring the Real Value of AI
- Generative AI at Work
- Adoption of Generative AI in the Workplace: Increasing and Shifting the Balance of Productivity and Communication Activity
- How much does AI impact development speed? An enterprise-based randomized controlled trial