2025/02/17 by Nguyen, Phuong-Nam, Nguyen-The, Quang, Vu-Minh, An +2
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #FOS: Mathematics #G.3 #History and Overview (math.HO) #I.2.7 #K.3.1
paper · doi:10.48550/arxiv.2502.11915
ChatGPT, an Artificial Intelligence model, has the potential to revolutionize education. However, its effectiveness in solving non-English questions remains uncertain. This study evaluates ChatGPT's robustness using 586 Korean mathematics questions. ChatGPT achieves 66.72% accuracy, correctly answering 391 out of 586 questions. We also assess its ability to rate mathematics questions based on eleven criteria and perform a topic analysis. Our findings show that ChatGPT's ratings align with educational theory and test-taker perspectives. While ChatGPT performs well in question classification, it struggles with non-English contexts, highlighting areas for improvement. Future research should address linguistic biases and enhance accuracy across diverse languages. Domain-specific optimizations and multilingual training could improve ChatGPT's role in personalized education.