vix.ing · top · new · best · stats · spec

Demystifying Deep Neural Networks Through Interpretation: A Survey

2020/12/13 by Giang Dao, Minwoo Lee, Dao, Giang +1
Computer Science · #Adversarial Robustness in Machine Learning #Artificial Intelligence (cs.AI) #Explainable Artificial Intelligence (XAI) #FOS: Computer and information sciences #Machine Learning (cs.LG)

paper · pdf · doi:10.48550/arxiv.2012.07119

openalex publication_date 2020/12/13 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

Modern deep learning algorithms tend to optimize an objective metric, such as minimize a cross entropy loss on a training dataset, to be able to learn. The problem is that the single metric is an incomplete description of the real world tasks. The single metric cannot explain why the algorithm learn. When an erroneous happens, the lack of interpretability causes a hardness of understanding and fixing the error. Recently, there are works done to tackle the problem of interpretability to provide insights into neural networks behavior and thought process. The works are important to identify potential bias and to ensure algorithm fairness as well as expected performance.

Related