vix.ing · top · new · best · stats · spec

Should We Trust (X)AI? Design Dimensions for Structured Experimental Evaluations

2020/09/14 by Fabian Sperrle, Mennatallah El‐Assady, Sperrle, Fabian +9
Computer Science · Social Sciences · #Artificial Intelligence (cs.AI) #Ethics and Social Impacts of AI #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Human-Computer Interaction (cs.HC) #Machine Learning and Data Classification

paper · pdf · doi:10.48550/arxiv.2009.06433

openalex publication_date 2020/09/14 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

This paper systematically derives design dimensions for the structured evaluation of explainable artificial intelligence (XAI) approaches. These dimensions enable a descriptive characterization, facilitating comparisons between different study designs. They further structure the design space of XAI, converging towards a precise terminology required for a rigorous study of XAI. Our literature review differentiates between comparative studies and application papers, revealing methodological differences between the fields of machine learning, human-computer interaction, and visual analytics. Generally, each of these disciplines targets specific parts of the XAI process. Bridging the resulting gaps enables a holistic evaluation of XAI in real-world scenarios, as proposed by our conceptual model characterizing bias sources and trust-building. Furthermore, we identify and discuss the potential for future work based on observed research gaps that should lead to better coverage of the proposed model.

Citations

Related