2025/08/02 by Xiuliang Zhang, Zhang, Xiuliang, Tadiwa Elisha Nyamasvisva +3
Computer Science · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Artificial neural network #Benchmark (surveying) #Computer Vision and Pattern Recognition (cs.CV) #Context-Aware Activity Recognition Systems #Convolutional neural network #Deep learning #FOS: Computer and information sciences #Feature learning #Human Pose and Action Recognition #Pattern recognition (psychology) #Scalability #Transformer
paper · pdf · doi:10.48550/arxiv.2508.06528
published in arXiv (Cornell University) (Cornell University)
openalex publication_date 2025/08/02 · openalex created_date 2025/10/10 · openalex updated_date 2026/08/05
Video-based behavior recognition is essential in fields such as public safety, intelligent surveillance, and human-computer interaction. Traditional 3D Convolutional Neural Network (3D CNN) effectively capture local spatiotemporal features but struggle with modeling long-range dependencies. Conversely, Transformers excel at learning global contextual information but face challenges with high computational costs. To address these limitations, we propose a hybrid framework combining 3D CNN and Transformer architectures. The 3D CNN module extracts low-level spatiotemporal features, while the Transformer module captures long-range temporal dependencies, with a fusion mechanism integrating both representations. Evaluated on benchmark datasets, the proposed model outperforms traditional 3D CNN and standalone Transformers, achieving higher recognition accuracy with manageable complexity. Ablation studies further validate the complementary strengths of the two modules. This hybrid framework offers an effective and scalable solution for video-based behavior recognition.