Risks of abuse of large language models, like <scp>ChatGPT</scp>, in scientific publishing: Authorship, predatory publishing, and paper mills

2023/09/08 by Graham Kendall, Jaime A. Teixeira da Silva · 13 citations
Medicine · #Artificial Intelligence in Healthcare and Education #Ethics in Clinical Research

paper · pdf · doi:10.1002/leap.1578

Abstract

Key points Academia is already witnessing the abuse of authorship in papers with text generated by large language models (LLMs) such as ChatGPT. LLM‐generated text is testing the limits of publishing ethics as we traditionally know it. We alert the community to imminent risks of LLM technologies, like ChatGPT, for amplifying the predatory publishing ‘industry’. The abuse of ChatGPT for the paper mill industry cannot be over‐emphasized. Detection of LLM‐generated text is the responsibility of editors and journals/publishers.

Citations

• I.—COMPUTING MACHINERY AND INTELLIGENCE
• On Computable Numbers, with an Application to the Entscheidungsproblem
• Challenges for enforcing editorial policies on AI-generated papers

Cited by

• <scp>AI</scp> In Academic Publishing for Non‐Native English Speakers: The Good, the Bot, and the Ugly
• A Cross‐Disciplinary Analysis of <scp>AI</scp> Policies in Academic Peer Review
• The publish or perish, publish and perish, publish then perish, and now retract and perish cultures in academia
• (Non-)retracted academic papers in OpenAlex
• Gen-Review: A Large-scale Dataset of AI-Generated (and Human-written) Peer Reviews
• Maintaining research integrity in the age of GenAI: an analysis of ethical challenges and recommendations to researchers
• PRIVMARK: Private Large Language Models Watermarking with MPC
• More transparency is required for article processing charges
• Artificial Intelligence (AI) guidance for authors, peer reviewers, and editors: A content analysis of journal policies
• The impact of artificial intelligence on research efficiency
• When and how to disclose AI use in academic publishing: AMEE Guide No.192
• Exploring the change in scientific readability following the release of ChatGPT
• A Multi-Task Evaluation of LLMs' Processing of Academic Text Input
• Does <scp>ChatGPT</scp> Ignore Article Retractions and Other Reliability Concerns?

Related

• ChatGPT "contamination": estimating the prevalence of LLMs in the scholarly literature
• ‘As of my last knowledge update’: How is content generated by <scp>ChatGPT</scp> infiltrating scientific papers published in premier journals?
• Risks, Causes, and Mitigations of Widespread Deployments of Large Language Models (LLMs): A Survey
• ChatGPT: Excellent Paper! Accept It. Editor: Imposter Found! Review Rejected
• Estimating the prevalence of LLM-assisted text in scholarly writing