A great cover letter used to cost real effort, so it hinted at a strong candidate — what changes when AI writes them in seconds?
Why did excellent cover letters only come from strong candidates before?
This explores why, before AI writing tools, a polished and tailored cover letter was a fairly reliable sign of a strong candidate, and what happened to that link once machines could write the letter.
This explores why a great cover letter used to point to a great candidate, and what broke when AI started writing them. One correction first: the corpus never claims excellent letters came *only* from strong candidates. What it shows is that letter quality used to be a useful predictor of who would be hired and who would do good work. The reason is cost. A tailored, well-aligned letter took time and effort to write, and the people willing and able to pay that cost were disproportionately the stronger workers. The letter's value didn't come from its prose. It came from the effort the prose proved someone had spent. Does cheap writing weaken hiring based on worker ability? calls this the 'costly-effort signal'. Its simulation of Freelancer.com hiring without written signals finds top-quintile workers hired 19% less often and bottom-quintile workers hired 14% more often.
The natural experiment came when Freelancer.com launched an AI bid writer. Once a tailored letter cost almost nothing, it stopped separating anyone. The correlation between how well a letter matched the job and whether it got a callback fell by about half Does AI cover letter writing change what employers value?, and letter quality became much weaker at predicting interviews and offers Does AI-generated cover letter access weaken hiring signals?. Overall hiring didn't collapse. Employers moved their attention to things AI can't fake as easily, such as work history and reputation. A faint trace of the old signal survives: workers who spend more time editing their AI drafts do better, even though most submit the drafts almost untouched Does editing time on AI drafts predict hiring success?. Effort still says something. It's just no longer visible in the finished letter.
There's a less comfortable side to this. Polish may never have been as trustworthy as it looked. Human evaluators often take AI-written documents for human work and rate them higher Does polished writing actually signal better quality work?. LLM screeners go further and prefer resumes written in their own style, even when the content is the same Do language models favor resumes they rewrote themselves?. So a good letter was always partly a proxy for style, and AI made that proxy both cheap and easy to game. The result can spiral. Applicants send more applications and plant prompt injections, and recruiters spend more of their week filtering spam Are job applicants and employers locked in an escalating AI arms race?.
If the cover letter is finished as a signal, what replaces it? Can hiring signals survive when AI makes cover letters worthless? splits the answer in two. Quality can be vouched for by a third party who stakes their own reputation, as in a recommendation letter. Interest can be shown with scarce resources like time, through in-person meetings or networking. The same logic of visible, attributable cost explains why LinkedIn users avoid AI-written posts: public authorship carries a reputational price that private drafting doesn't Why aren't LinkedIn users adopting AI post-writing tools?.
The twist worth carrying away: you might expect a solid track record to protect the best workers once letters stop counting. An Upwork study found it didn't. Past performance gave no shelter from ChatGPT's effects, and top freelancers may have been hit hardest Does a strong track record protect freelancers from AI?. When a costly signal becomes cheap, the people who lose most are the ones who could afford to pay for it.
Sources 10 notes
A simulation of Freelancer.com hiring without written signals shows top-quintile workers get hired 19% less often, while bottom-quintile workers get hired 14% more often. Employers lose the costly-effort signal that once distinguished able workers.
After Freelancer.com's AI Bid Writer launched, the correlation between cover letter alignment and callbacks fell 51%, and employers shifted to evaluating prior work histories instead. Overall hiring rates stayed stable, suggesting the market adjusted by using different signals.
On Freelancer.com, when an AI letter generator lowered the cost of writing tailored letters, letter quality became much weaker at predicting interviews and job offers. Employers then relied more on work history and reputation instead.
Within workers on Freelancer.com, time spent editing AI-generated cover letter drafts is associated with higher hiring success, even though most workers submit drafts with minimal revision. The paper measured this through click timestamps and application submissions.
Studies show evaluators perceived AI-generated documents as both human-written and better quality than human submissions. This suggests rhetorical polish misleads judgment and should not serve as a quality signal in evaluation.
Show all 10 sources
Across a controlled experiment on 2,245 resumes, eight of nine LLMs preferred their own rewrites over matched human versions when evaluating candidates, with preference rates ranging from 26% to 98%. The bias strengthened in larger models and emerged from stylistic alignment rather than content quality differences.
Greenhouse's survey found 49% of job seekers submit more applications than before, 41% use AI prompt injections to bypass filters, while 91% of recruiters spot deception and 34% spend half their week filtering spam. The data supports each leg of the loop but does not establish causal direction or measure the trend over time.
Kessler proposes replacing cover letters with third-party recommendations (which signal accountability) and in-person meetings or networking (which signal genuine interest through scarcity). Recommendation letters showed measurable hiring benefits, though the interest-signal half remains untested.
LinkedIn's CEO attributes lower-than-expected adoption of AI post-writing to reputational risk: posts are publicly attributed and readers who detect machine-generated prose call it out, reducing the poster's economic opportunity. This contrasts with private AI use in drafting and email.
An Upwork study found no evidence that past performance or employment history moderated ChatGPT's negative effects on freelancer employment. The data even suggests top freelancers were hit disproportionately hard, contrary to experimental findings favoring low-ability workers.
Papers this line draws on 8
The research behind the notes this line reads — ranked by how closely each paper relates.
- Signaling in the Age of AI: Evidence from Cover Letters
- AI Self-preferencing in Algorithmic Hiring: Empirical Evidence and Insights
- AI Skills Improve Job Prospects: Causal Evidence from a Hiring Experiment
- AI-written admissions essays are widespread but penalized
- AI Is Killing the Cover Letter
- Making Talk Cheap: Generative AI and Labor Market Signaling
- Stranded Credentials: Keeping Online Reputation Systems Informative in the AI Era
- The Short-Term Effects of Generative Artificial Intelligence on Employment: Evidence from an Online Labor Market