vix.ing · top · new · best · stats · spec

Sequential Density Ratio Estimation for Simultaneous Optimization of Speed and Accuracy

2020/06/09 by Akinori F. Ebihara, Ebihara, Akinori F., Taiki Miyagawa +5
Computer Science · Engineering · #Anomaly Detection Techniques and Applications #Autonomous Vehicle Technology and Safety #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Music and Audio Processing #Time Series Analysis and Forecasting #Vehicle Noise and Vibration Control

paper · pdf · doi:10.48550/arxiv.2006.05587

openalex publication_date 2020/06/10 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

Classifying sequential data as early and as accurately as possible is a challenging yet critical problem, especially when a sampling cost is high. One algorithm that achieves this goal is the sequential probability ratio test (SPRT), which is known as Bayes-optimal: it can keep the expected number of data samples as small as possible, given the desired error upper-bound. However, the original SPRT makes two critical assumptions that limit its application in real-world scenarios: (i) samples are independently and identically distributed, and (ii) the likelihood of the data being derived from each class can be calculated precisely. Here, we propose the SPRT-TANDEM, a deep neural network-based SPRT algorithm that overcomes the above two obstacles. The SPRT-TANDEM sequentially estimates the log-likelihood ratio of two alternative hypotheses by leveraging a novel Loss function for Log-Likelihood Ratio estimation (LLLR) while allowing correlations up to N (∈ ℕ) preceding samples. In tests on one original and two public video databases, Nosaic MNIST, UCF101, and SiW, the SPRT-TANDEM achieves statistically significantly better classification accuracy than other baseline classifiers, with a smaller number of data samples. The code and Nosaic MNIST are publicly available at https://github.com/TaikiMiyagawa/SPRT-TANDEM.

Citations

Related