2016/08/02 by Yuanjun Xiong, Limin Wang, Xiong, Yuanjun +16 · 1 citation
Computer Science · #Human Pose and Action Recognition #Video Analysis and Summarization #Multimodal Machine Learning Applications
paper · pdf · doi:10.48550/arxiv.1608.00797
This paper presents the method that underlies our submission to the untrimmed video classification task of ActivityNet Challenge 2016. We follow the basic pipeline of temporal segment networks and further raise the performance via a number of other techniques. Specifically, we use the latest deep model architecture, e.g., ResNet and Inception V3, and introduce new aggregation schemes (top-k and attention-weighted pooling). Additionally, we incorporate the audio as a complementary channel, extracting relevant information via a CNN applied to the spectrograms. With these techniques, we derive an ensemble of deep models, which, together, attains a high classification accuracy (mAP 93.23%) on the testing set and secured the first place in the challenge.