Can LLMs predict character choices from narrative context?
Explores whether language models can predict fictional character decisions when given rich personality profiles and retrieved narrative memories. This tests whether LLMs can model complex human motivation grounded in literary analysis.
Can LLMs predict how fictional characters will act at pivotal moments? The Character is Destiny paper (2024) constructs LIFECHOICE — a benchmark of 1,462 decision points from 388 novels, leveraging expert character analyses from literary scholars. The task: given the preceding narrative, predict which choice the character makes.
The architecture decomposes into two components. First, a character profile combining a static description (personality, experiences, values) with retrieved memories — specific passages from the preceding text. Second, a reasoning step using the profile to answer the decision question.
Three methods for constructing descriptions reveal a hierarchy: expert-written descriptions (from Supersummary) outperform both hierarchical merging (summarize chunks, merge summaries iteratively) and incremental updating (summarize sequentially, refine). This suggests that literary expertise captures something about character motivation — the relationship between personality, values, and action — that automated summarization misses.
The CHARMAP method adds persona-based memory retrieval: selecting narrative passages relevant to the character's psychological profile rather than just the decision context. This yields a 5.03% accuracy gain, indicating that who the character is determines which memories matter for predicting what they will do.
Character-driven motivations decompose into: personality and traits, emotions and psychological state, social relationships, values and beliefs, and desires and goals. This taxonomy suggests that persona simulation for decision-making requires richer internal models than the demographic + preference approaches used in most LLM persona work.
The connection to Why do LLMs fail to act on their stated beliefs? is instructive: when beliefs are extracted from rich narrative context rather than assigned through brief prompts, behavioral prediction improves.
Inquiring lines that read this note 26
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
Do persona-based approaches introduce systematic biases in user simulation?- What narrative elements trigger emotional connection that structured personas lack?
- Can demographic personas predict behavior without rich narrative grounding?
- What specific character traits drive memory selection in persona-based retrieval?
- Can general chatbot skill predict how well models roleplay adversarial personas?
- How do entity graphs connect faces, voices, and preferences across modalities?
- How do LLMs identify which personality items matter most for trait inference?
- What does the 20-questions test reveal about LLM character consistency?
- Can LLMs infer psychological profiles without explicit user disclosure?
- Can persona profiles be enriched to constrain LLM predictions and reduce run-to-run variance?
- Does richer input to LLM personas improve their fidelity to human responses?
- Can large language models extract psychological traits directly from natural language text?
- Why does expert character analysis outperform automated narrative summarization?
- What specific narrative features best distinguish AI from human fiction?
- Do stated character beliefs predict decisions better when extracted from text?
- How do hierarchical knowledge layers capture different types of narrative information?
- How do LLMs compress literary language without losing essential nuance?
- Why do LLM-generated stories differ at the discourse and narrative level?
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- Character is Destiny: Can Role-Playing Language Agents Make Persona-Driven Decisions?
- EvolvingWorld: An Open-Schema Framework for Co-Evolving Role-Play Agents and World Model in Interactive Literary World
- Two Tales of Persona in LLMs: A Survey of Role-Playing and Personalization
- H2HTalk: Evaluating Large Language Models as Emotional Companion
- Do LLMs Understand Personality? Rethinking Persona Fidelity Evaluation through Structured Behavioral Inference
- Deep Persona: A Psychologically Grounded Architecture and Evaluation Framework for Role-Playing Agents and Simulations
- From Five Dimensions to Many: Large Language Models as Precise and Interpretable Psychological Profilers
- Too Good to be Bad: On the Failure of LLMs to Role-Play Villains
Original note title
persona-driven memory retrieval from narrative text enables LLMs to predict character decisions — expert-written descriptions plus embedding retrieval outperform hierarchical summarization