vix.ing · top · new · best · stats · spec

Beyond Distribution Shift: Spurious Features Through the Lens of Training Dynamics

2023/02/18 by Nihal Murali, Murali, Nihal, Aahlad Puli +7 · 3 citations
Business, Management and Accounting · Decision Sciences · Engineering · #Artificial Intelligence (cs.AI) #Complex Systems and Decision Making #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Mining Techniques and Economics #Organizational Management and Leadership

paper · doi:10.48550/arxiv.2302.09344

openalex publication_date 2023/02/18 · openalex created_date 2023/02/22 · openalex updated_date 2026/07/28

Abstract

-usable information (Ethayarajh et al., 2021). Lastly, our experiments show that monitoring only accuracy during training (as is common in machine learning pipelines) is insufficient to detect spurious features. We, therefore, highlight the need for monitoring early training dynamics using suitable instance difficulty metrics.

Cited by

Related