All That Glitters is Not Novel: Plagiarism in AI Generated Research
Abstract
Automating scientific research is considered the final frontier of science. Recently, several papers claim autonomous research agents can generate novel research ideas. Amidst the prevailing optimism, we document a critical concern: a considerable fraction of such research documents are smartly plagiarized. Unlike past efforts where experts evaluate the novelty and feasibility of research ideas, we request 13 experts to operate under a different situational logic: to identify similarities between LLMgenerated research documents and existing work. Concerningly, the experts identify 24% of the 50 evaluated research documents to be either paraphrased (with one-to-one methodological mapping), or significantly borrowed from existing work. These reported instances are cross-verified by authors of the source papers. The remaining 76% of documents show varying degrees of similarity with existing work, with only a small fraction appearing completely novel. Problematically, these LLM-generated research documents do not acknowledge original sources, and bypass inbuilt plagiarism detectors. Lastly, through controlled experiments we show that automated plagiarism detectors are inadequate at catching plagiarized ideas from such systems. We recommend a careful assessment of LLM-generated research, and discuss the implications of our findings on academic publishing. 1
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
3 top-tier papers have cited it since. Know what they found before your reviewers do.
Lune can draw on
the full paper · the top-tier papers that cite it · related work
Free to start. No credit card required.
Lineage
Cited by top-tier papers3
- AI use in American newspapers is widespread, uneven, and rarely disclosedJenna Russell, Marzena Karpinska, Destiny Akinode, James Zhou et al.ACL 2026 · 9 citations
- Training AI Co-Scientists Using Rubric RewardsShashwat Goel, Rishi Hazra, Dulhan Jayalath, Timon Willi et al.ICML 2026
- Roll the dice & look before you leap: Going beyond the creative limits of next-token predictionVaishnavh Nagarajan, Chen Henry Wu, Charles Ding, Aditi RaghunathanICML 2025
Builds on8
- Enabling Large Language Models to Generate Text with CitationsTianyu Gao, Howard Yen, Jiatong Yu, Danqi ChenEMNLP 2023 · 152 citations
- Matryoshka Diffusion ModelsJiatao Gu, Shuangfei Zhai, Yizhe Zhang, Joshua Susskind et al.ICLR 2024 · 73 citations
- Large Language Models for Automated Open-domain Scientific Hypotheses DiscoveryZonglin Yang, Xinya Du, Junxian Li, Jie Zheng et al.ACL Findings 2024 · 34 citations
- SciMON: Scientific Inspiration Machines Optimized for NoveltyQingyun Wang, Doug Downey, Heng Ji, Tom HopeACL 2024 · 22 citations
- LongRecipe: Recipe for Efficient Long Context Generalization in Large Language ModelsZhiyuan Hu, Yuliang Liu, Jinman Zhao, Suyuchen Wang et al.ACL 2025
Related papers
- Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP ResearchersChenglei Si, Diyi Yang, Tatsunori HashimotoICLR 2025
- How Large Language Models are Transforming Machine-Paraphrase PlagiarismJan Philip Wahle, Terry Ruas, Frederic Kirstein, Bela GippEMNLP 2022 · 26 citations
- The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research IdeasChenglei Si, Tatsunori Hashimoto, Diyi YangICLR 2026 · 60 citations
- MAGE: Machine-generated Text Detection in the WildYafu Li, Qintong Li, Leyang Cui, Wei Bi et al.ACL 2024 · 44 citations
- People who frequently use ChatGPT for writing tasks are accurate and robust detectors of AI-generated textJenna Russell, Marzena Karpinska, Mohit IyyerACL 2025 · 39 citations
