Adarkwah, MA, Islam, AYMA, Schneider, K, Luckin, R, Thomas, M and Spector, JM (2024) Are preprints a threat to the credibility and quality of artificial intelligence literature in the ChatGPT era? A scoping review and qualitative study. International Journal of Human-Computer Interaction. ISSN 1044-7318

Text Are preprints a threat to the credibility and quality of artificial intelligence literature in the ChatGPT era .pdf - Accepted Version Restricted to Repository staff only until 18 June 2025. Available under License Creative Commons Attribution Non-commercial No Derivatives. Download (631kB)

Abstract

ChatGPT, as the pioneer of advanced generative AI tools, has triggered scholarly discussions about the potential use of such AI technologies in interdisciplinary fields. With a focus on the surge of AI-related preprints since the introduction of ChatGPT by OpenAI, the study investigated what the surge implies for AI literature, particularly in terms of credibility and quality. A scoping review was initially conducted to study the characteristics of the AI-related preprints in the Web of Science (WoS) database and also in five (5) preprint platforms (ArXiv, MedRxiv, SocArxiv, SSRN, and Research Square). The publication date range was set at 2023-01-01–2023-08-09. This was followed up by an interpretive phenomenological analysis (IPA) of the perceptions of experts in the AI field about the preprints. Employing a scoping review of AI-related preprints across six (6) databases and a qualitative analysis of fifteen (15) AI experts' opinions, our study reveals concerns about the research accuracy, quality, and credibility of preprints, and advocates for a robust evaluation and high-quality assurance process to promote open science objectives during their dissemination. Specifically, 45,918 AI-related preprints were found in the 6 preprint databases or repositories across different fields. The nine (9) themes from the IPA showed that preprints can be of value. However, experts advocated for the safe and responsible use of AI-related preprints, involving such tenets as maintaining ethical integrity and high-quality work on the part of authors and establishing sound AI-content guidelines from publishers and editors. Future studies are recommended to investigate the impact of preprints on decision-making processes in educational research and practice.

Item Type:	Article
Additional Information:	This is an Accepted Manuscript of an article published by Taylor & Francis in International Journal of Human-Computer Interaction on 18th June 2024, available at: http://www.tandfonline.com/10.1080/10447318.2024.2364140
Uncontrolled Keywords:	08 Information and Computing Sciences; 16 Studies in Human Society; Human Factors
Subjects:	L Education > L Education (General) Q Science > QA Mathematics > QA75 Electronic computers. Computer science T Technology > T Technology (General)
Divisions:	Education
Publisher:	Taylor and Francis Group
SWORD Depositor:	A Symplectic
Date Deposited:	03 Jun 2024 11:28
Last Modified:	24 Jun 2024 11:15
DOI or ID number:	10.1080/10447318.2024.2364140
URI:	https://researchonline.ljmu.ac.uk/id/eprint/23409

View Item