Readers want AI use disclosed more than writers do, and they discount hard work, focusing on AI text that goes straight into the piece.
What counts as human versus AI contribution in research disclosure?
This explores where the line falls between a human's work and an AI's work when researchers and writers disclose AI use, and who gets to decide where that line sits.
This explores where the line between human and AI contribution falls when researchers and writers disclose AI use, and who gets to draw it. The corpus has no settled taxonomy, such as 'AI for editing is fine, AI for ideas must be disclosed.' What it does offer is a sharper finding: the line depends on who's looking. In a 727-person vignette study, readers rated disclosure as more necessary than writers did, in every condition. Two things drove those judgments. One was whether AI text went directly into the final piece. The other was whether that contribution was irreplaceable, meaning the human couldn't easily have produced it. How much effort the writer put in made no difference Do readers and writers differ on AI disclosure necessity?. So the intuition that 'I worked hard on this, so it's mine' doesn't persuade readers. What they care about is whether the AI supplied something essential.
That raises a practical problem: disclosure is close to an honor system. A review of 30 studies found that people can't reliably tell AI-generated text, images, or voice from human work. Accuracy hovers around chance and hasn't kept up as AI output has become more realistic Can people reliably spot content made by AI?. When no one can check, suspicion fills the gap. Comments that get accused of being AI-written turn out to lack any features that actually separate AI text from human text. The accusations act more like gatekeeping than detection, and the people they wrong are human writers who aren't believed Do unfounded AI accusations harm human writers instead?. Disclosure norms therefore protect honest authors as well as readers.
The research-publishing cases show how concealment, not AI use itself, becomes the ethical breach. Researchers found 18 arXiv manuscripts with hidden instructions telling AI reviewers to praise the paper. That counts as questionable research practice because it is both concealed and self-serving, whatever the authors say they intended Are hidden AI prompts in preprints a deceptive research practice?. The opposite case is the AI Scientist-v2 experiment. Three fully AI-generated papers went to an ICLR workshop under an agreement made in advance with the organizers. One scored well enough to be accepted and was then withdrawn as planned Can AI systems generate research papers that pass peer review?. The AI's contribution was total, yet the experiment was considered legitimate because the right people knew about it beforehand. These cases sit inside a broader arms race in which AI speeds up paper production, automates review, enables manipulation, and prompts new defenses, each feeding the others Does AI create a coupled arms race in research production and review?.
There is also a reason to want disclosure beyond individual honesty. Researchers who use AI publish about 3 times as many papers and get 4.8 times as many citations. Across science as a whole, though, topic coverage shrinks and collaboration falls, as work concentrates on data-rich problems Does AI help individual scientists while narrowing scientific focus?. Disclosure is one of the few ways to see that drift happening. Another line of work argues that human-AI collaboration beats fully autonomous AI research on both speed and safety, partly because a human stays in a position to check the work Can human-AI research teams improve faster than autonomous AI systems?. On that view, a disclosure statement is a record of who verified what, as much as a confession of AI use.
The surprise in this material is that 'how much did the AI do?' may be the wrong question. Readers seem to ask 'could the human have done this without it?' Institutions seem to ask 'was it hidden?' Neither is a percentage of authorship. The corpus does not answer the more practical question of how journals and conferences should word their disclosure categories, so treat those policy specifics as an open gap.
Sources 8 notes
A 727-person vignette study found readers consistently rated AI disclosure as more necessary than writers did. Disclosure seemed most necessary when AI text was directly incorporated and irreplaceable, while writer effort had no effect on these judgments.
A 30-study systematic review found that humans cannot reliably distinguish AI-generated from human-created content across text, image, and voice modalities. Accuracy generally clusters around chance and has not kept pace with improvements in AI realism.
Accused comments lack features that distinguish AI text from human writing, suggesting accusations function as gatekeeping rather than detection. This inverts the AI-as-perpetrator framing, placing harm at the receiving side through reader skepticism.
Eighteen arXiv manuscripts contained concealed instructions directing AI reviewers to give positive assessments. The practice qualifies as questionable research conduct because concealment plus self-serving design violates ethics regardless of stated intent.
AI Scientist-v2 submitted three fully autonomous manuscripts to ICLR; one averaged 6.33 from reviewers and ranked in the top 45% of workshop submissions. The authors acknowledged the work does not yet meet top-tier conference standards and withdrew the accepted paper before publication.
Show all 8 sources
A survey of 230 publications reveals production scaling, evaluation automation, manipulation, defenses, evasion, and ecosystem feedback as linked response relations among actors. Evidence is strongest for early stages and weakens toward long-horizon adaptation and feedback.
AI-augmented researchers publish 3× more papers and receive 4.8× more citations, but collective science shrinks topic coverage by 4.63% and researcher collaboration by 22%. AI concentrates work on data-rich problems rather than exploring new questions.
Historical evidence shows every major AI breakthrough required human-discovered tandem advances in data and methods. Co-improvement leverages human intuition with AI exploration to sidestep the generation-verification gap while preserving human oversight.
Papers this line draws on 8
The research behind the notes this line reads — ranked by how closely each paper relates.
- Stop Automating Peer Review Without Rigorous Evaluation
- AI for Auto-Research: Roadmap & User Guide
- The Emerging AI Paper-Review Arms Race: Adversarial Co-Evolution in Scholarly Publishing
- What Influences Readers' and Writers' Perceived Necessity of AI Disclosure?
- Artificial Intelligence Tools Expand Scientists' Impact but Contract Science's Focus (Just accepted by Nature, to be online soon)
- AI-Assisted Peer Review at Scale: The AAAI-26 AI Review Pilot
- Is it Cake or is it AI? A Systematic Review of Human Uncertainty in Distinguishing Generative Artificial Intelligence Content
- The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Search