Thelwall, M. orcid.org/0000-0001-6065-205X and Nunkoo, R. (2025) Evaluating the quality of tourism research using ChatGPT. Current Issues in Tourism. ISSN: 1368-3500
Abstract
This article evaluates the quality of tourism research by comparing the results obtained from citation analysis with those obtained from ChatGPT quality scores based on the Research Excellence Framework criteria, applied to 50 of the largest tourism and leisure journals. Whilst there was an article-level weak correlation between normalized citation rates and normalized ChatGPT scores, there was a moderately strong journal-level correlation between the two measures. The latter supports the value of normalized ChatGPT scores for journal quality indicators. The results also suggest important nuances between and within qualitative and qualitative methods used in tourism. Articles using experiments, advanced statistical tests, and theories scored well on both indicators but the opposite for those based on surveys and convenience sampling.
Metadata
| Item Type: | Article |
|---|---|
| Authors/Creators: |
|
| Copyright, Publisher and Additional Information: | © 2025 The Authors. Except as otherwise noted, this author-accepted version of a journal article published in Current Issues in Tourism is made available via the University of Sheffield Research Publications and Copyright Policy under the terms of the Creative Commons Attribution 4.0 International License (CC-BY 4.0), which permits unrestricted use, distribution and reproduction in any medium, provided the original work is properly cited. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ |
| Keywords: | ChatGPT; Large Language Models; bibliometrics; citation analysis; research evaluation |
| Dates: |
|
| Institution: | The University of Sheffield |
| Academic Units: | The University of Sheffield > Faculty of Social Sciences (Sheffield) > Information School (Sheffield) ?? Sheffield.IJC ?? |
| Funding Information: | Funder Grant number UK RESEARCH AND INNOVATION UKRI1079 |
| Date Deposited: | 01 Dec 2025 15:45 |
| Last Modified: | 17 Dec 2025 10:16 |
| Status: | Published online |
| Publisher: | Taylor & Francis |
| Refereed: | Yes |
| Identification Number: | 10.1080/13683500.2025.2596265 |
| Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:234970 |
Download
Filename: Evaluating the quality preprint.pdf
Licence: CC-BY 4.0

CORE (COnnecting REpositories)
CORE (COnnecting REpositories)