Does AI assistance help less experienced workers most?
When customer support agents gain access to an AI chat assistant, do productivity gains concentrate among newer, less skilled workers? Understanding this pattern matters for knowing who benefits from AI tools and whether deployment widens or narrows workplace skill gaps.
The study measures a 15% average productivity gain from access to a generative AI conversational assistant, counted as issues resolved per hour, and finds that the gain is uneven. The abstract states the split directly: "less experienced and lower-skilled workers improve both the speed and quality of their output while the most experienced and highest-skilled workers see small gains in speed and small declines in quality." The data cover 5,172 agents in a staggered rollout at a Fortune 500 software firm (the introduction says 5,000). The abstract also reports that AI assistance "facilitates worker learning and improves English fluency, particularly among international agents," that the gains were largest for "relatively rare problems," and that customers became more polite and less likely to ask for a manager.
The mechanism the excerpt gives concerns what the tool does and what it learns from. The assistant "monitors customer chats and provides agents with realtime suggestions for how to respond," and agents "remain responsible for the conversation and are free to ignore or edit the AI's suggestions." The introduction argues that machine learning infers instructions from examples, and that a model trained on data from human workers "can implicitly learn what specific behaviors and characteristics set high-performing workers apart." On this account the tool passes the techniques of stronger agents to weaker ones, which is why the gains skew toward the less skilled. The excerpt presents this as the expected mechanism. It does not show the analysis that would test it.
Against the neighbors, this paper is the source of the 15% figure that When does AI actually boost worker productivity? reads as skill application. That reading holds that AI speeds up work the worker already understands. The abstract's learning claim complicates it, because this paper says AI assistance also improved learning on the job. The two can only be partly squared. The excerpt does not say how learning was measured, and live suggestions in chats are a different setting from the developers learning a new library in the other note, so this is a qualification of the skill-application reading rather than a refutation. The setting also differs from Can AI narrow the education performance gap?. That study is a randomized experiment with 1,174 adults. This one is a live workplace, which gives it more external weight, and it points the same way: the least skilled gain most. Set against Does generative AI prevent juniors from getting entry-level work?, the two notes pull in different directions about who benefits. Short-run gains for the least experienced do not show whether the struggle that builds expertise is being lost.
What the excerpt does not establish is substantial. It describes one firm's customer-support chat, so it says little about knowledge work in general. It stops before the results, and its limitations passage is cut off mid-sentence, so the paper's own caveats and its quality measure are not visible. The learning and English-fluency findings appear only in the abstract, and the excerpt offers no follow-up measure of whether any skill persists after the assistant is removed. The broader suggestion that generative AI "may be capable of capturing and disseminating the behaviors of the most productive agents" is the authors' conjecture, not a result shown here. The defensible implication is narrow. In this deployment, AI assistance raised short-run output most for the least experienced agents, and whether that carries over once the tool is gone is still open.
Inquiring lines that read this note 18
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
Does AI assistance help or harm professional skill development?- Does AI assistance improve worker learning on the job?
- Does AI assistance erode skill development over time among professionals?
- Do quality gains from AI help persist after the tool is removed?
- Why do experienced developers benefit more from AI coding assistance?
- Does AI coding assistance help junior developers close skill gaps?
- Which new tasks emerge when employers adopt AI chatbots?
- Why does the AI hiring gap concentrate among workers aged 22 to 25?
- Do gains from AI assistance disappear when workers complete tasks alone?
- Does benefit from AI partnership depend on the individual worker?
- Are entry-level workers bearing the labor costs of AI productivity gains?
- Can AI agents replacing chatbots improve outcomes for less experienced workers?
- Does AI assistance help experienced workers more than inexperienced ones?
- Does AI assistance reduce effort differently for novice versus expert workers?
- How do user skill levels change which AI productivity gains actually materialize?
Related concepts in this collection 4
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
When does AI actually boost worker productivity?
Do AI productivity gains hold across all task types, or only when workers apply existing skills? Understanding where AI helps matters for deployment strategy.
Supplies the 15% figure that note reads as skill application; its abstract also reports on-the-job learning, a qualification to that reading.
-
Can AI narrow the education performance gap?
Does generative AI help lower-education people catch up to higher-education people on complex tasks? This matters because AI's impact on inequality depends on whether it democratizes skills or widens existing gaps.
Same direction in a randomized experiment; this study adds live-workplace evidence that the least skilled gain most.
-
Does generative AI prevent juniors from getting entry-level work?
When AI systems absorb the foundational tasks that once taught junior engineers, what happens to the pipeline that develops new senior experts? This explores whether the path to expertise is being erased.
Tension over who benefits: short-run gains for the least experienced do not show whether expertise-building struggle is lost.
-
Can automation raise output while slowing growth?
Entry-level automation can boost immediate productivity but reduce long-term growth if it disrupts how novices learn from top experts. The question asks whether employment headcounts alone miss what matters for welfare.
Qualifies: output gains for novices can coexist with slower growth, since pulling them from experts cuts tacit-knowledge spread
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- How AI Impacts Skill Formation
- Generative AI at Work
- Toward Measuring AI's Effects on Skill Formation: The Stock-Formation Gap
- What 81,000 people told us about the economics of AI
- Does generative AI narrow education-based productivity gaps? Evidence from a randomized experiment
- Future of Work with AI Agents: Auditing Automation and Augmentation Potential across the U.S. Workforce
- Estimating AI productivity gains from Claude conversations
- Research: Gen AI Makes People More Productive—and Less Motivated
Original note title
AI assistance lifted support agents' issues resolved per hour 15 percent, most for the least experienced — the most experienced saw small quality declines