SYNTHESIS NOTE
Topics›Design Frameworks›this note

Can language models discover what users actually want from activity logs?

Users pursue month-long interest journeys that transcend individual item clicks. Can LLMs extract these persistent goals from behavioral patterns, and does this change how we should think about personalization?

Synthesis note · 2026-02-23 · sourced from Design Frameworks

Recommender systems predict the next item a user might click on, given their history. But when you ask users what they're actually doing on the platform, they describe something different: persistent, overarching interests — "designing hydroponic systems for small spaces," "learning the ukulele as a beginner," "cooking Italian recipes." These are interest journeys, and they operate at a completely different level of abstraction from next-item prediction.

Survey data shows 66% of respondents recently pursued a valued journey on the platform. Of those, 80% consumed relevant content for more than a month, with half saying some journeys last more than a year. People pursue 1-3 journeys simultaneously.

The semantic gap is real: collaborative filtering captures correlational patterns between items ("people who watched X also watched Y") but cannot reason about the user's underlying goal, need, or interest. Two users both interested in stand-up comedy may pursue completely different aspects — history documentaries vs. SNL skits. The journey is personalized at a granularity collaborative filtering cannot reach.

LLMs can bridge this gap. Through personalized clustering of user activity logs followed by LLM-powered journey naming, the system produces journey descriptions users identify with. But specificity matters — "greenhouse designs for cold climates" was irrelevant for someone pursuing indoor gardening. The right level of abstraction is what the user would actually say to a friend asking about their interests.

This connects to How do personalization granularity levels trade precision against scalability? — interest journeys operate at the user level but require persona-level precision. Since Does chatbot personalization build trust or expose privacy risks?, journey-aware systems that understand your persistent interests will trigger both the trust and privacy dimensions of this dual dynamic.

Inquiring lines that read this note 39

This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.

Why do abstract preferences outperform episodic memories in personalization? Why do language models struggle to implement user intent accurately from prompts? How should recommendation systems balance individual preference and diversity? What gaps exist between benchmark performance and real deployment outcomes? How do knowledge graph structures enable efficient multi-hop reasoning and retrieval? How can agents discover and adapt to user preferences during conversation? How does personalization simultaneously affect user trust and privacy concerns? Can persona profiles improve LLM prediction accuracy and consistency? How should AI agents balance proactive engagement with conversational respect? Do language models reason through disagreement or only accommodate it? When do simpler collaborative filtering approaches outperform complex LLM recommenders? Can models develop genuine introspective capability, or only mimic it? Do persona-based approaches introduce systematic biases in user simulation? What human oversight must AI research systems have? How can we maintain privacy when agents prioritize task completion? How do network effects and self-selection distort aggregated rating accuracy?

Related concepts in this collection 5

This note in its neighbourhood — explore the map, then jump to a related concept in the list below.

Concept map
15 direct connections · 112 in 2-hop network ·medium cluster Open in graph ↗

Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph

your link semantically near linked from elsewhere

Related papers in this collection 8

Papers most semantically related to this note, ranked by cosine similarity in the embedding space.

Original note title

LLMs can discover and describe persistent user interest journeys from activity patterns but recommender systems predict next items instead