Abstracted Trajectory Visualization for Explainability in Reinforcement Learning

2024/02/05 by Yoshiki Takagi, Takagi, Yoshiki, Roderick Tabalba +5 · 1 citation
Computer Science · #Anomaly Detection Techniques and Applications #Artificial Intelligence (cs.AI) #Data Visualization and Analytics #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Human-Computer Interaction (cs.HC) #Machine Learning (cs.LG)

paper · pdf · doi:10.48550/arxiv.2402.07928

openalex publication_date 2024/02/05 · openalex created_date 2024/02/15 · openalex updated_date 2026/07/28

Abstract

Explainable AI (XAI) has demonstrated the potential to help reinforcement learning (RL) practitioners to understand how RL models work. However, XAI for users who do not have RL expertise (non-RL experts), has not been studied sufficiently. This results in a difficulty for the non-RL experts to participate in the fundamental discussion of how RL models should be designed for an incoming society where humans and AI coexist. Solving such a problem would enable RL experts to communicate with the non-RL experts in producing machine learning solutions that better fit our society. We argue that abstracted trajectories, that depicts transitions between the major states of the RL model, will be useful for non-RL experts to build a mental model of the agents. Our early results suggest that by leveraging a visualization of the abstracted trajectories, users without RL expertise are able to infer the behavior patterns of RL.

Cited by

• Know your Trajectory -- Trustworthy Reinforcement Learning deployment through Importance-Based Trajectory Analysis

Related

• Explainable Reinforcement Learning Agents Using World Models
• Explainable Reinforcement Learning: A Survey
• Explaining RL Decisions with Trajectories
• Explainability in Deep Reinforcement Learning
• A Survey of Explainable Reinforcement Learning: Targets, Methods and Needs