2025/07/06 by Christin Katharina Kreutz, Kreutz, Christin Katharina, Anja Perry +3
Computer Science · Decision Sciences · #Data Mining Algorithms and Applications #Data Quality and Management #Digital Libraries (cs.DL) #FOS: Computer and information sciences #Semantic Web and Ontologies
paper · doi:10.48550/arxiv.2507.04444
openalex publication_date 2025/07/06 · openalex created_date 2025/10/30 · openalex updated_date 2026/07/28
Data search for scientific research is more complex than a simple web search. The emergence of large language models (LLMs) and their applicability for scientific tasks offers new opportunities for researchers who are looking for data, e.g., to freely express their data needs instead of fitting them into restrictions of data catalogues and portals. However, this also creates uncertainty about whether LLMs are suitable for this task. To answer this question, we conducted a user study with 32 researchers. We qualitatively and quantitively analysed participants' information interaction behaviour while searching for data using LLMs in two data search tasks, one in which we prompted the LLM to behave as a persona. We found that participants interact with LLMs in natural language, but LLMs remain a tool for them rather than an equal conversational partner. This changes slightly when the LLM is prompted to behave as a persona, but the prompting only affects participants' user experience when they are already experienced in LLM use.