How do LLMs identify which personality items matter most for trait inference?

This explores how LLMs figure out which personality signals matter most for trait inference. The honest starting point: the corpus doesn't show models doing explicit item-weighting the way a psychometrician would. Instead it suggests something more interesting — models don't rank items so much as compress them into a different representation where the important relationships are already baked in. In zero-shot profiling work, an LLM handed raw Big Five scores writes a natural-language summary that captures *second-order* patterns — how traits interact, not just their levels — and that summary then predicts nine unrelated psychological scales with striking structural alignment (Can language summaries unlock hidden psychological patterns?). The combined summary-plus-score prediction beats either alone, which is the tell: the model isn't selecting a few decisive items, it's surfacing emergent structure that the raw items don't expose on their own.

A second answer lives below the prompt, in the model's weights. Research on persona vectors finds linear directions in activation space that correspond to specific traits like sycophancy or hallucination (Can we track and steer personality shifts during model finetuning?). If a trait is a direction, then "which items matter" becomes "how strongly does this input project onto that direction" — a geometric question, not a checklist. PsychAdapter pushes the same logic into architecture, modifying every transformer layer with under 0.1% extra parameters to hit 87% Big Five accuracy (Can we control personality in language models without prompting?). Both say trait inference is distributed across the network rather than localized to a handful of salient cues.

Here's the cross-current worth knowing: this representational machinery is good at *populations* and shaky at *individuals*. Conditioning an LLM on a specific person's profile across 208,000 participants produced no measurable gain in person-level prediction (Does conditioning LLMs on personal profiles improve prediction?). So whatever items the model is weighting, the weighting generalizes the average and washes out the idiosyncratic. The one place individual-level inference does work is narrative: persona-driven memory retrieval lets a model predict a specific character's choices when fed an expert persona profile plus psychologically relevant retrieved memories (Can LLMs predict character choices from narrative context?). That's a clue about which items matter most — not trait scores, but situated memories that ground the trait in context.

There's also a thumb on the scale the model brings before it sees any items at all. Open LLMs converge on an ENFJ-like default and resist conditioning away from it (Why do open language models converge on one personality type?, Can open language models adopt different personalities through prompting?). So "which items matter" is never asked on a blank slate — instruction tuning has already pre-weighted toward helpful, structured, supportive readings, which can distort inference toward identity-congruent biases (How accurately can language models simulate human personalities?).

The thing you may not have known you wanted: the most reliable signal of *whether* an inference will hold isn't any personality item at all — it's effect strength. AI persona simulations replicate experimental main effects in proportion to the original p-value, nailing strong effects and flickering on marginal ones (Can AI personas reliably replicate human experiment results?). Trait inference, in other words, inherits the same calibration as the underlying psychology: the model surfaces what was robust to begin with.