2024/08/30 by Hanbing Ma, Ma, Hengyi, Weitong Chen +1
Computer Science · #68T07 #Anomaly Detection Techniques and Applications #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Fuzzy Logic and Control Systems #I.2.0 #Machine Learning (cs.LG)
paper · pdf · doi:10.48550/arxiv.2408.17010
openalex publication_date 2024/08/30 · openalex created_date 2024/10/19 · openalex updated_date 2026/07/28
Previous research has indicated that deep neural network based models for time series classification (TSC) tasks are prone to overfitting. This issue can be mitigated by employing strategies that prevent the model from becoming overly confident in its predictions, such as label smoothing and confidence penalty. Building upon the concept of label smoothing, we propose a novel approach to generate more reliable soft labels, which we refer to as representation soft label smoothing. We apply label smoothing, confidence penalty, and our method representation soft label smoothing to several TSC models and compare their performance with baseline method which only uses hard labels for training. Our results demonstrate that the use of these enhancement techniques yields competitive results compared to the baseline method. Importantly, our method demonstrates strong performance across models with varying structures and complexities.