2023/11/11 by Mohna Chakraborty, Chakraborty, Mohna, Adithya Kulkarni +3
Computer Science · #FOS: Computer and information sciences #Information Retrieval (cs.IR) #Topic Modeling
paper · pdf · doi:10.48550/arxiv.2311.06592
openalex publication_date 2023/11/11 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28
ChatGPT has recently emerged as a powerful tool for performing diverse NLP tasks. However, ChatGPT has been criticized for generating nonfactual responses, raising concerns about its usability for sensitive tasks like fact verification. This study investigates three key research questions: (1) Can ChatGPT be used for fact verification tasks? (2) What are different prompts performance using ChatGPT for fact verification tasks? (3) For the best-performing prompt, what common mistakes does ChatGPT make? Specifically, this study focuses on conducting a comprehensive and systematic analysis by designing and comparing the performance of three different prompts for fact verification tasks on the benchmark FEVER dataset using ChatGPT.