ChatGPTest : Opportunities and Cautionary Tales of Utilizing AI for Questionnaire Pretesting

Francisco Javier OLIVOS RAVE*, Minhui LIU

*Corresponding author for this work

Research output: Journal PublicationsJournal Article (refereed)peer-review

Abstract

The rapid advancements in generative artificial intelligence have opened new avenues for enhancing various aspects of research, including the design and evaluation of survey questionnaires. However, the recent pioneering applications have not considered questionnaire pretesting. This article explores the use of GPT models as a useful tool for pretesting survey questionnaires, particularly in the early stages of survey design. Illustrated with two applications, the article suggests incorporating GPT feedback as an additional stage before human pretesting, potentially reducing successive iterations. The article also emphasizes the indispensable role of researchers’ judgment in interpreting and implementing AI-generated feedback.

Original languageEnglish
JournalField Methods
Early online date12 Sept 2024
DOIs
Publication statusE-pub ahead of print - 12 Sept 2024

Bibliographical note

Publisher Copyright:
© Author(s) (or their employer(s)) 2023. No commercial re-use. See rights and permissions. Published by BMJ.

This idea originated from the Sociological Research Methods course for undergraduate students taught by the corresponding author at Lingnan University. Thanks to the students who were willing to share part of their class assignment for this illustration and Tobias Kamelski for his comments.

Publisher Copyright:
© The Author(s) 2024.

Keywords

  • Medical Education

Fingerprint

Dive into the research topics of 'ChatGPTest : Opportunities and Cautionary Tales of Utilizing AI for Questionnaire Pretesting'. Together they form a unique fingerprint.

Cite this