Can AI-written fake LinkedIn profiles pass for real people, and can detectors be retrained to catch them?
How similar are GPT-generated fake profiles to real human profiles?
This explores how closely AI-written fake profiles (for example, LinkedIn profiles written by GPT) resemble real people's profiles, and whether humans or software can tell them apart.
This explores how closely GPT-written fake profiles resemble real ones, and what it takes to tell them apart. The collection has only one study that tests this directly, so here is the short answer first: the fakes are close enough to fool tools built for older kinds of fakes, but they are not identical to real profiles. A detector trained on the right examples can still spot them.
The direct evidence comes from a LinkedIn study Can fake profile detectors catch GPT-generated LinkedIn profiles?. Detectors trained on real profiles and hand-made fakes let GPT-written profiles through 42–52% of the time, so to those tools the GPT fakes looked much like real people. Once the detectors were retrained on GPT-written examples, only 1–7% of fakes got through, and real users were not flagged any more often than before. So GPT profiles are similar to real ones, but they carry their own patterns. The patterns are just different from the ones a human faker leaves, which is why older detectors miss them.
People do worse than retrained software. A review of 30 studies found that human accuracy at spotting AI-made text, images and voices generally sits around chance Can people reliably spot content made by AI?. A study of models trained to copy ChatGPT suggests why Can imitating ChatGPT fool evaluators into thinking models improved?. Copying the confident, fluent style was enough to fool human judges, even though the content underneath was no better. A fake profile likely works the same way: it gets the tone and polish of a real profile right, which is what people check, while the statistical tells that a trained detector picks up stay hidden from human eyes. A focus-group study adds that people trust ChatGPT mainly because it is conversational, not because it is accurate Does conversational style actually make AI more trustworthy?. It's the same weakness: we judge by how something reads, not by whether it holds up.
The lesson that carries over is that the realism comes from the style and the fluent surface, not from real content underneath. One demonstration had an AI write 288 complete finance papers with made-up rationales and fake citations Can AI generate hundreds of fake academic papers automatically?. Once convincing surface detail is cheap, fakes can be produced in bulk, and defenses have to learn the generator's own fingerprint. Looking for the clumsiness of a human forger won't work.
What the collection doesn't have is a feature-by-feature comparison, such as word choice, career paths or skill lists in fake versus real profiles. It also doesn't show whether today's stronger models would erase the patterns that retrained detectors still catch.
Sources 5 notes
Detectors trained on genuine and manual fakes miss GPT-generated profiles at 42–52% false accept rates, but adversarial training on GPT-generated data restores detection to 1–7% false accepts without raising false rejects.
A 30-study systematic review found that humans cannot reliably distinguish AI-generated from human-created content across text, image, and voice modalities. Accuracy generally clusters around chance and has not kept pace with improvements in AI realism.
Imitation models fool human evaluators by mimicking ChatGPT's confident, fluent style while failing to improve factuality or generalization on novel tasks. The ceiling is set by base model capability, not fine-tuning method—better fundamentals, not shortcuts, drive real improvement.
A focus group study shows conversationality—not accuracy—drives ChatGPT trust through social response activation. Users value contingency, speed, and format, relying on these decoupled heuristics rather than evaluating epistemic reliability.
A demonstration showed LLMs generating 288 complete finance papers from 96 statistically significant signals, each with invented theoretical justifications and fabricated citations, proving academic HARKing can be automated at scale.
Papers this line draws on 8
The research behind the notes this line reads — ranked by how closely each paper relates.
- Monitoring AI-Modified Content at Scale: A Case Study on the Impact of ChatGPT on AI Conference Peer Reviews
- AI Now Writes as Many Online Articles as Humans
- Is it Cake or is it AI? A Systematic Review of Human Uncertainty in Distinguishing Generative Artificial Intelligence Content
- Weak Links in LinkedIn: Enhancing Fake Profile Detection in the Age of LLMs
- The False Promise of Imitating Proprietary LLMs
- AI-Powered (Finance) Scholarship
- Do We Trust ChatGPT as much as Google Search and Wikipedia?
- The Decision to Verify: How Warmth and User Characteristics Shape Reliance on Conversational Agents for Information Search