2023/06/15 by Nicolas Bizzozzero, Bizzozzero, Nicolas, Ihab Bendidi +3
Computer Science · #Advanced Image and Video Retrieval Techniques #FOS: Computer and information sciences #Image Retrieval and Classification Techniques #Information Retrieval (cs.IR) #Information Retrieval and Search Behavior
paper · pdf · doi:10.48550/arxiv.2306.08915
openalex publication_date 2023/06/15 · openalex created_date 2023/06/17 · openalex updated_date 2026/07/28
The ability to predict the performance of a query before results are returned has been a longstanding challenge in Information Retrieval (IR) systems. Inspired by this task, we introduce, in this paper, a novel task called "Prompt Performance Prediction" (PPP) that aims to predict the performance of a prompt, before obtaining the actual generated images. We demonstrate the plausibility of our task by measuring the correlation coefficient between predicted and actual performance scores across: three datasets containing pairs of prompts and generated images AND three art domain datasets of real images and real user appreciation ratings. Our results show promising performance prediction capabilities, suggesting potential applications for optimizing user prompts.