vix.ing · top · new · best · stats · spec

Score-Based Change Detection for Gradient-Based Learning Machines

2021/06/27 by Lang Liu, Liu, Lang, Joseph Salmon +3
Computer Science · Decision Sciences · Engineering · #Advanced Statistical Process Monitoring #Data Stream Mining Techniques #FOS: Computer and information sciences #Fault Detection and Control Systems #Machine Learning (cs.LG) #Machine Learning (stat.ML)

paper · pdf · doi:10.48550/arxiv.2106.14122

openalex publication_date 2021/06/27 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

The widespread use of machine learning algorithms calls for automatic change detection algorithms to monitor their behavior over time. As a machine learning algorithm learns from a continuous, possibly evolving, stream of data, it is desirable and often critical to supplement it with a companion change detection algorithm to facilitate its monitoring and control. We present a generic score-based change detection method that can detect a change in any number of components of a machine learning model trained via empirical risk minimization. This proposed statistical hypothesis test can be readily implemented for such models designed within a differentiable programming framework. We establish the consistency of the hypothesis test and show how to calibrate it to achieve a prescribed false alarm rate. We illustrate the versatility of the approach on synthetic and real data.

Citations

Related