Can an AI guess your age, gender, and politics just from your username and public posts?
Can LLMs infer user demographics from implicit signals alone?
This explores whether LLMs can work out who someone is (their age, gender, politics, expertise) from indirect traces like usernames, comments, or activity logs, without being told, and how far those guesses can be trusted.
This explores whether LLMs can work out who you are from indirect traces you leave behind, and whether their guesses hold up. The short answer is yes, and that's the uncomfortable part. Web-browsing LLMs given nothing more than an X username and public profile correctly predicted gender, age and political orientation for real survey participants Can LLMs predict demographics from social media usernames alone?. That's a privacy finding as much as a capability finding. The signals people assume are anonymous turn out to be readable.
The more revealing detail is where the inference breaks down. On low-activity accounts, where there was little to go on, the models didn't hold back. They fell back on stereotype-driven defaults, which showed up as systematic gender and political biases Can LLMs predict demographics from social media usernames alone?. This pattern holds well beyond social media. Across 12 models from 7 families, every one claimed things about users that the evidence didn't support, in 35–49% of its claims. The drivers were wordiness, reliance on what the model learned in training, and assumptions about what a given kind of text 'should' come from Do large language models fabricate user attributes beyond available evidence?. Worse, the models that rated themselves as least prone to over-inferring actually did it most. So an LLM inferring your demographics is part detective and part storyteller, and from the outside you can't easily tell which part is talking.
There's a deeper reason for those defaults. When a model lacks specific information, it fills the gap with whatever dominates its training data. Interpretability work shows low-resource cultures such as Ethiopia and Algeria are represented internally through high-resource cultural stand-ins Do LLMs represent low-resource cultures through dominant cultural proxies?, and broader critiques argue LLMs reflect skewed slices of human experience Do large language models narrow human expression and thought?. Put together, this suggests that when implicit signals run thin, the 'inferred' user drifts toward the statistically typical user. The less a person resembles the training data, the more likely the inference is wrong.
The same ability looks more useful when it targets traits and interests rather than census categories. LLMs reading audience comments can extract things like expertise level and learning style, and these group people more coherently than clustering on the comment text itself Can LLMs extract audience traits better than comment similarity?. From activity logs, they can name long-running interests in specific terms like 'designing hydroponic systems for small spaces,' which collaborative-filtering recommenders miss entirely Can language models discover what users actually want from activity logs?. That's why Benedict Evans argues platforms could rent this kind of inferred understanding through an API instead of building it from their own behavioral data. The 35–49% fabrication rate is the catch in that argument Can LLMs infer user needs better than owned behavioral data?.
What you might not expect is that the inference doesn't stay passive. Once a model holds a picture of who you are, its behavior changes. Personal context makes models more agreeable, narrower in what they offer and prone to irrelevant personal references Does personalization make large language models worse at their jobs?. Demographic cues can also quietly shift how models judge people. LLM raters favored Black or women authors until AI involvement was disclosed, at which point the preference disappeared Do LLM raters show hidden demographic preferences that disclosure erases?. So the real question isn't only 'can it guess who I am?' It's also 'what does it do differently once it has guessed?'
Sources 9 notes
Evaluated on 1,384 survey participants and 48 synthetic accounts, web-browsing LLMs successfully predicted gender, age, and political orientation from X usernames and profiles alone. The models showed systematic gender and political biases specifically against low-activity accounts, relying on stereotype-driven defaults when content was sparse.
MirageBench evaluated 12 LLMs across 7 families and found all of them over-infer user attributes in 35–49% of claims, driven by verbosity, reliance on pretraining priors, and genre expectations. Models that self-assess as over-inferring less actually over-infer more when judged independently.
Mechanistic interpretability analysis reveals that low-resource cultures like Ethiopia and Algeria are structurally represented through high-resource cultural proxies in internal model states, not just output. This architectural bias persists even when models can produce correct surface-level answers.
LLMs mirror skewed slices of human experience shaped by training data regularities, and widespread reliance on identical models amplifies convergence. Co-writing studies show users unconsciously adopt model stances and framings.
LLM-extracted latent characteristics like expertise and learning style produce more homogeneous audience clusters than k-means on comment text alone. This captures who people are, not just what they say.
Show all 9 sources
66% of users pursue valued interest journeys lasting over a month, described in specific phrases like 'designing hydroponic systems for small spaces.' LLM-powered journey discovery bridges the semantic gap that collaborative filtering cannot reach, operating at user-level granularity with persona-level precision.
Benedict Evans contends that LLMs can infer deeper user motivations (the "why") than correlation-based recommenders, allowing platforms to rent this capability via API rather than accumulating their own behavioral data. However, research shows LLMs fabricate 35–49% of user attribute claims, undermining confidence in their inferred understanding.
A 13-model evaluation found that personal context pushes models toward irrelevant personal references, narrower responses and excessive agreement with users. User profiles drove most degradation by shifting model objectives from balanced information toward user satisfaction.
GPT-4o-mini showed pronounced preference for Black authors and Qwen2.5-7B-Instruct favored women authors when AI use was undisclosed, but both preferences vanished under disclosure. Human raters showed uniform disclosure penalties regardless of author demographics.
Papers this line draws on 8
The research behind the notes this line reads — ranked by how closely each paper relates.
- The Personalization Mirage: How LLMs Fabricate User Profiles, and Why Self-Monitoring Misleads
- LLM Targeted Underperformance Disproportionately Impacts Vulnerable Users
- Evaluating the Hidden Costs of Personalization in Large Language Models
- User-LLM: Efficient LLM Contextualization with User Embeddings
- Understanding the Role of User Profile in the Personalization of Large Language Models
- Large Language Models for User Interest Journeys
- Personalization of Large Language Models: A Survey
- The Homogenizing Effect of Large Language Models on Human Expression and Thought