INQUIRING LINE

Letting AI summarize your research for you might make you understand it less — because the real learning happens in the digging, not the reading.

Does effort reduction during search affect how deeply people understand topics?

This explores whether letting AI do the legwork of searching, by reading, sorting and summarizing sources for you, changes how well you actually come to understand a topic.


This explores whether handing the work of searching over to AI leaves people understanding a topic less deeply. The most direct evidence in the corpus says yes. Across seven randomized experiments with more than 10,000 people, those who learned a topic through ChatGPT reported learning less and felt less ownership of what they knew than people who used ordinary web search. Their advice to others was also thinner: independent raters judged it sparser and less informative Does learning from AI summaries produce shallower knowledge than web search?. The likely reason is that the effort of search is where much of the learning happens. When you click through sources, compare them and piece together your own picture, you build understanding. A finished summary skips that step.

The corpus also suggests why summaries might go shallow even when they're accurate. Common words tend to be more general than rare ones, so when an LLM picks the most frequent way to say something, it drifts toward abstraction. The precise, expert-level detail is the first thing to go Does word frequency correlate with semantic abstraction?. So low effort for the reader may also mean less specific content to work with.

Other notes show how quickly reduced effort becomes the default. An eye-tracking study found that when Google's AI Overviews appear, they take over the spot on the page that used to get the most attention. The share of attention going to the top-ranked link fell from 31% to 9%, and people trusted the AI summary just as much as the ranked results Where do searchers look when AI Overviews appear?. People also judge AI answers by surface cues. In one large study, adding irrelevant citations raised users' trust almost as much as adding relevant ones Do users trust citations more when there are simply more of them?. Put together, this suggests that when the work is done for them, readers check sources less and judge credibility by how an answer looks.

There is a counterweight. A Nielsen Norman Group study found that people still used traditional search alongside AI chat, often running both side by side Does generative AI chat actually replace traditional search?. Effort hasn't disappeared, at least not yet. One surprising twist: on the machine side, more search effort clearly buys better answers. Research agents improve steadily as they get more search rounds, much as models improve with more reasoning time Does search budget scale like reasoning tokens for answer quality?, and agents that search the live web beat models that rely only on what they memorized in training Why do search agents beat memorized retrieval on hard questions?. The effort that produces understanding still happens, but the agent does it instead of the person. The answer gets better while the person's understanding may get shallower.

The corpus has one strong direct study and several supporting threads. It doesn't yet have research on interventions, such as designs that bring back productive effort without losing the convenience of AI search.


Sources 7 notes

Does learning from AI summaries produce shallower knowledge than web search?

Seven randomized experiments (n=10,426) show people who learned via ChatGPT reported less learning, felt less ownership of knowledge, and produced advice that independent raters found sparser and less informative than advice from web search users.

Does word frequency correlate with semantic abstraction?

WordNet analysis shows hypernyms (general concepts) occur more frequently than hyponyms (specific ones). Combined with LLMs' frequency bias, this means preferring common paraphrases systematically drifts toward abstraction, erasing expert-level specificity.

Where do searchers look when AI Overviews appear?

Eye-tracking data shows AI Overviews receive significantly longer fixation times, reducing attention to the first-ranked result from 31% to 9%. Trust ratings between AI Overviews and ranked results remained equally high despite this attention shift.

Do users trust citations more when there are simply more of them?

Analysis of 24,000 Search Arena interactions shows irrelevant citations boost user preference (β=0.273) nearly as much as relevant citations (β=0.285), indicating citation count functions as a decoupled trust heuristic.

Does generative AI chat actually replace traditional search?

Nielsen Norman Group's qualitative study found all participants continued using traditional search throughout tasks, often running both methods in tandem. The main barrier to AI adoption is not resistance but lack of awareness about when and how to use AI chat for information-seeking.

Show all 7 sources
Does search budget scale like reasoning tokens for answer quality?

Agentic deep research shows monotonic-to-diminishing-returns curves for search iterations, matching reasoning token scaling. This creates a new inference-compute axis: models can trade off reasoning budget against search budget to optimize answer quality.

Why do search agents beat memorized retrieval on hard questions?

DeepResearcher agents trained on live web search beat static knowledge models on knowledge-intensive tasks. The mechanism is not better reasoning but retrieval: real-time search avoids temporal bounds and probabilistic compression that plague training-data memorization.

Papers this line draws on 8

The research behind the notes this line reads — ranked by how closely each paper relates.