2025/05/27 by Marius Bock, Bock, Marius, Juergen Gall +4
Computer Science · Engineering · #Context-Aware Activity Recognition Systems #FOS: Computer and information sciences #FOS: Electrical engineering #Human Pose and Action Recognition #Human-Computer Interaction (cs.HC) #Image and Video Processing (eess.IV) #Machine Learning (cs.LG) #cs.HC #cs.LG #eess.IV #electronic engineering #information engineering
paper · pdf · doi:10.48550/arxiv.2505.20894
7 pages, 4 figures
openalex publication_date 2025/05/27 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28 · arxiv created 2026/08/03 · arxiv updated 2026/08/04
Despite recognized limitations in modeling long-range temporal dependencies, Human Activity Recognition (HAR) has traditionally relied on a sliding window approach to segment labeled datasets. Deep learning models like the DeepConvLSTM typically classify each window independently, restricting learnable temporal context to within-window information and producing fragmented, temporally incoherent activity timelines. To address this constraint, we propose DeepConvContext, a multi-scale time series classification framework for HAR. Drawing inspiration from the vision-based Temporal Action Localization community, DeepConvContext models both intra- and inter-window temporal patterns separately by processing sequences of time-ordered windows. Across six widely-used HAR benchmarks, DeepConvContext achieves an average 5% improvement in F1-score and up to 18-point improvement in mAP over related approaches, while achieving latency and throughput comparable to prior methods that extend temporal context through hidden state propagation across batches. Our quantitative and qualitative analysis underline the importance of inter-window learning and show how it produces more coherent activity segments even in online prediction scenarios. Code to reproduce our experiments is publicly available via www.github.com/mariusbock/deepconvcontext.