A Real-time Anomaly Detection Using Convolutional Autoencoder with Dynamic Threshold

2024/04/05 by Sarit Maitra, Maitra, Sarit, Sukanya Kundu +3
Computer Science · #Anomaly Detection Techniques and Applications #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Network Security and Intrusion Detection

paper · pdf · doi:10.48550/arxiv.2404.04311

openalex publication_date 2024/04/05 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

The majority of modern consumer-level energy is generated by real-time smart metering systems. These frequently contain anomalies, which prevent reliable estimates of the series' evolution. This work introduces a hybrid modeling approach combining statistics and a Convolutional Autoencoder with a dynamic threshold. The threshold is determined based on Mahalanobis distance and moving averages. It has been tested using real-life energy consumption data collected from smart metering systems. The solution includes a real-time, meter-level anomaly detection system that connects to an advanced monitoring system. This makes a substantial contribution by detecting unusual data movements and delivering an early warning. Early detection and subsequent troubleshooting can financially benefit organizations and consumers and prevent disasters from occurring.

Related

• A Data Mining-Based Dynamical Anomaly Detection Method for Integrating with an Advance Metering System
• Smart Meter Data Anomaly Detection using Variational Recurrent Autoencoders with Attention
• Anomaly Detection of Smart Metering System for Power Management with Battery Storage System/Electric Vehicle
• Label Assisted Autoencoder for Anomaly Detection in Power Generation Plants
• Smart Metering System Capable of Anomaly Detection by Bi-directional LSTM Autoencoder