2018/12/29 by Zhao Yang, Song Bai, Yang, Zhao +5 · 15 citations
Computer Science · #A priori and a posteriori #Adversarial Robustness in Machine Learning #Artificial intelligence #Computer science #Domain (mathematical analysis) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Inference #Interpretability #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine learning #Rainbow #Reinforcement Learning in Robotics #Reinforcement learning #Suite #Visualization
paper · pdf · doi:10.48550/arxiv.1812.11276
published in arXiv (Cornell University) (Cornell University)
openalex publication_date 2018/12/29 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28
Deep reinforcement learning (DeepRL) agents surpass human-level performance in many tasks. However, the direct mapping from states to actions makes it hard to interpret the rationale behind the decision-making of the agents. In contrast to previous a-posteriori methods for visualizing DeepRL policies, in this work, we propose to equip the DeepRL model with an innate visualization ability. Our proposed agent, named region-sensitive Rainbow (RS-Rainbow), is an end-to-end trainable network based on the original Rainbow, a powerful deep Q-network agent. It learns important regions in the input domain via an attention module. At inference time, after each forward pass, we can visualize regions that are most important to decision-making by backpropagating gradients from the attention module to the input frames. The incorporation of our proposed module not only improves model interpretability, but leads to performance improvement. Extensive experiments on games from the Atari 2600 suite demonstrate the effectiveness of RS-Rainbow.