2025/06/09 by Gerardo Aleman Manzanarez, Nora de la Cruz Arana, Manzanarez, Gerardo Aleman +9
Arts and Humanities · Computer Science · #Artificial Intelligence in Games #Computation and Language (cs.CL) #Digital Humanities and Scholarship #FOS: Computer and information sciences #Narrative Theory and Analysis
paper · pdf · doi:10.48550/arxiv.2506.08172
openalex publication_date 2025/06/09 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28
Automated story writing has been a subject of study for over 60 years. Large language models can generate narratively consistent and linguistically coherent short fiction texts. Despite these advancements, rigorous assessment of such outputs for literary merit - especially concerning aesthetic qualities - has received scant attention. In this paper, we address the challenge of evaluating AI-generated microfictions and argue that this task requires consideration of literary criteria across various aspects of the text, such as thematic coherence, textual clarity, interpretive depth, and aesthetic quality. To facilitate this, we present GrAImes: an evaluation protocol grounded in literary theory, specifically drawing from a literary perspective, to offer an objective framework for assessing AI-generated microfiction. Furthermore, we report the results of our validation of the evaluation protocol, as answered by both literature experts and literary enthusiasts. This protocol will serve as a foundation for evaluating automatically generated microfictions and assessing their literary value.