When the same freelancer spends longer editing an AI-drafted cover letter, that bid gets hired more often, but is the editing the cause?
Are workers who edit longer more experienced or better matched to jobs?
This explores why freelancers who spend more time editing AI-drafted cover letters get hired more often: is it because the people who edit are more experienced, or because they edit harder when a job actually fits them, or because the editing itself makes the application better?
This explores what is really behind the link between editing AI drafts and getting hired: is the editing a sign of who the worker is (more experienced), of which job they're applying to (a better fit), or of the effort itself? The corpus can't fully settle this, but one detail narrows it a lot. The Freelancer.com finding is measured *within* each worker Does editing time on AI drafts predict hiring success?. It compares the same person's applications with each other, so fixed traits like experience, skill and reputation are held constant. 'Experienced people edit more' therefore can't explain the pattern. When one worker spends longer on one bid than on another, that bid does better. That leaves two readings. Either the extra editing improves the letter, or workers put in more effort on jobs they already know they fit. The note doesn't say which, and the corpus has no direct test that separates them.
The surrounding evidence suggests why the question matters. Most workers barely touch the AI draft. That matches a separate study where writers edited AI paragraphs only 23% of the time, and their edits left the text about 96% the same Do writers actually edit AI-generated text before publishing?. When almost nobody edits, the few who do stand out. Before AI drafting tools, writing a careful cover letter cost effort, and that cost helped employers spot capable workers. A simulation of hiring without written signals found the market becomes 19% less merit-based: top workers get hired less often and weaker ones more often Does cheap writing weaken hiring based on worker ability?. Seen this way, editing time may be one of the last costly signals of effort left in the application.
Employers seem to have picked up on this. After Freelancer.com launched its AI Bid Writer, the link between how well a cover letter matched the job and whether the applicant got a callback dropped by 51%. Employers turned to workers' past job histories instead Does AI cover letter writing change what employers value?. So experience still counts in hiring, but employers now read it from the work record, not the letter. That makes the within-worker editing effect more interesting: it adds something on top of a person's history. Experience is not a full shield either. An Upwork study found that a strong track record didn't protect freelancers from ChatGPT's effect on their employment, and top freelancers may have been hit hardest Does a strong track record protect freelancers from AI?.
Here is the twist you might not have expected. If editing mostly signals fit, it is useful information. If it mostly adds polish, it may be misleading. Reviewers tend to rate polished AI text as better and more human than real human writing Does polished writing actually signal better quality work?. LLM screeners also favor text written in their own style Do language models favor resumes they rewrote themselves?. So the open question isn't only 'experience or fit?' It is also whether editing time reflects real engagement with a job, or just one more layer of polish that employers have learned to discount.
Sources 7 notes
Within workers on Freelancer.com, time spent editing AI-generated cover letter drafts is associated with higher hiring success, even though most workers submit drafts with minimal revision. The paper measured this through click timestamps and application submissions.
Writers edited AI-generated paragraphs only 23% of the time, with edits averaging 96% similarity to the original. This means AI's opinionated and distorted voice propagates with minimal human filtering before publication.
A simulation of Freelancer.com hiring without written signals shows top-quintile workers get hired 19% less often, while bottom-quintile workers get hired 14% more often. Employers lose the costly-effort signal that once distinguished able workers.
After Freelancer.com's AI Bid Writer launched, the correlation between cover letter alignment and callbacks fell 51%, and employers shifted to evaluating prior work histories instead. Overall hiring rates stayed stable, suggesting the market adjusted by using different signals.
An Upwork study found no evidence that past performance or employment history moderated ChatGPT's negative effects on freelancer employment. The data even suggests top freelancers were hit disproportionately hard, contrary to experimental findings favoring low-ability workers.
Show all 7 sources
Studies show evaluators perceived AI-generated documents as both human-written and better quality than human submissions. This suggests rhetorical polish misleads judgment and should not serve as a quality signal in evaluation.
Across a controlled experiment on 2,245 resumes, eight of nine LLMs preferred their own rewrites over matched human versions when evaluating candidates, with preference rates ranging from 26% to 98%. The bias strengthened in larger models and emerged from stylistic alignment rather than content quality differences.
Papers this line draws on 8
The research behind the notes this line reads — ranked by how closely each paper relates.
- Signaling in the Age of AI: Evidence from Cover Letters
- AI Self-preferencing in Algorithmic Hiring: Empirical Evidence and Insights
- AI-written admissions essays are widespread but penalized
- AI Is Killing the Cover Letter
- AI Skills Improve Job Prospects: Causal Evidence from a Hiring Experiment
- The Short-Term Effects of Generative Artificial Intelligence on Employment: Evidence from an Online Labor Market
- From Producing to Validating: How AI Is Deskilling Freelancers
- Is it Cake or is it AI? A Systematic Review of Human Uncertainty in Distinguishing Generative Artificial Intelligence Content