INQUIRING LINE

When people edit an AI draft, does the time they spend reveal real judgment, or do most just send it along?

What does editing time reveal about worker judgment and accountability?

This explores whether the time people spend revising AI drafts shows that they are actually exercising judgment and taking responsibility for the work, rather than passing the AI's output along unchanged.


This explores whether the minutes someone spends editing an AI draft are a visible sign of human judgment, and what that sign can and can't tell us about who is accountable for the result. The clearest evidence comes from freelance job applications. When the same worker spent more time editing an AI-written cover letter, they were more likely to be hired, even though most workers sent drafts with almost no changes Does editing time on AI drafts predict hiring success?. That result is correlational, not proof that editing causes hiring. It still suggests that clients notice the difference between a draft someone has worked through and one they forwarded. The default behavior is the bigger story. In a separate study, writers edited AI paragraphs only 23% of the time, and the edited versions stayed 96% similar to the original. The AI's opinions and slants therefore reached readers almost untouched Do writers actually edit AI-generated text before publishing?.

Why would editing matter so much? One argument is that once AI makes first-pass thinking cheap, the scarce thing is a person who checks the output, puts their name on it, and answers for it What makes accountable judgment scarce when AI cognition is cheap?. Seen that way, editing time is one of the few traces of accountability you can measure. It also connects to how people feel about the text. Writers feel more ownership of AI-generated text when they have more influence over it. Personalizing the AI model doesn't produce the same effect Does user control over AI text shape feelings of ownership?. Editing is how a draft becomes yours, both to you and to the person reading it.

Time is a weak measure on its own, though. AI doesn't reliably shorten tasks. It moves time from doing the work toward writing prompts and figuring out what the model produced Does AI really save time, or just change how we spend it?. So a long session could mean careful judgment, or it could mean confusion. A study of 640 employees found that reviewers caught more AI errors only when the reasoning they needed to check the output was easy to recall at review time. Explaining things in their own words or getting retrieval cues helped Can reviewers access what they know when checking LLM outputs?. Someone can spend a long time staring at a draft and still miss what matters if that knowledge isn't available to them in the moment.

There's also a social twist. People expect to be seen as less competent and less diligent when they use AI, so they tend not to tell their managers Do people fear judgment when they use AI at work?. That pushes editing out of sight at exactly the point where it could show diligence. Collaborative writing tools point the other way. Writers working in pairs wanted to see when and where their partner used AI, partly so they could check the AI-written parts, although some found full visibility uncomfortable Do writers want to see each other's AI prompts in shared editors?. One more risk runs underneath all of this. People can come to treat AI output as evidence of their own ability, a self-perception error separate from hallucination or over-reliance on automation How does AI-assisted work reshape how people see their own abilities?. Editing helps here because it makes the line between the person's contribution and the machine's harder to blur. The takeaway is that editing time works less as a productivity number and more as a rough, partly hidden record of whether anyone actually took responsibility for the words.


Sources 9 notes

Does editing time on AI drafts predict hiring success?

Within workers on Freelancer.com, time spent editing AI-generated cover letter drafts is associated with higher hiring success, even though most workers submit drafts with minimal revision. The paper measured this through click timestamps and application submissions.

Do writers actually edit AI-generated text before publishing?

Writers edited AI-generated paragraphs only 23% of the time, with edits averaging 96% similarity to the original. This means AI's opinionated and distorted voice propagates with minimal human filtering before publication.

What makes accountable judgment scarce when AI cognition is cheap?

Labor-market outcomes depend more on institutional design than raw AI capability. When first-pass cognition is cheap, human work survives where people exercise consequential judgment, verify outputs, accept accountability, and learn from practice—but only if institutions preserve learning and question rights.

Does user control over AI text shape feelings of ownership?

Study 1 found that greater user control over generated text raised sense of ownership, while personalizing the AI model had no impact on the AI Ghostwriter Effect.

Does AI really save time, or just change how we spend it?

Research shows AI doesn't reduce total task time; it reallocates it away from active work toward composing prompts and understanding outputs. This shift changes the cognitive demands and learning outcomes, making time-on-task a poor productivity metric.

Show all 9 sources
Can reviewers access what they know when checking LLM outputs?

Two experiments with 640 employees showed that error detection improved when verification-relevant reasoning was accessible at review time. Self-generated explanations and retrieval cues strengthened detection, revealing a third failure mode beyond capability or engagement gaps.

Do people fear judgment when they use AI at work?

Across four experiments with 4,439 participants, people using AI expected others to judge them as less competent and diligent, and reported lower willingness to disclose AI use to managers and colleagues. The gap suggests a social cost that users foresee and act on.

Do writers want to see each other's AI prompts in shared editors?

Sixteen paired writers showed strong preference for higher levels of prompt visibility in shared editors, valuing awareness of when, how, and where AI was used. Benefits included understanding collaborators' thinking and verifying AI-generated text, though some found full sharing intrusive and self-conscious.

How does AI-assisted work reshape how people see their own abilities?

Research shows the LLM Fallacy operates through misattribution of AI outputs to personal capability, independent of output accuracy or reliance behavior. It requires interventions that clarify human-machine contribution boundaries, not just better system accuracy or forced verification.

Papers this line draws on 8

The research behind the notes this line reads — ranked by how closely each paper relates.