Anticipation and next action forecasting in video: an end-to-end model\n with memory

2019/01/11 by Fiora Pirri, Pirri, Fiora, Lorenzo Mauro +9
Computer Science · #Advanced Vision and Imaging #Anomaly Detection Techniques and Applications #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition

paper · pdf · doi:10.48550/arxiv.1901.03728

openalex publication_date 2019/01/11 · openalex created_date 2022/07/30 · openalex updated_date 2026/07/28

Abstract

Action anticipation and forecasting in videos do not require a hat-trick, as\nfar as there are signs in the context to foresee how actions are going to be\ndeployed. Capturing these signs is hard because the context includes the past.\nWe propose an end-to-end network for action anticipation and forecasting with\nmemory, to both anticipate the current action and foresee the next one.\nExperiments on action sequence datasets show excellent results indicating that\ntraining on histories with a dynamic memory can significantly improve\nforecasting performance.\n

Related

• Rethinking Learning Approaches for Long-Term Action Anticipation
• From Recognition to Prediction: Leveraging Sequence Reasoning for Action Anticipation
• Long-Term Anticipation of Activities with Cycle Consistency
• Predicting the Future: A Jointly Learnt Model for Action Anticipation
• Memory-and-Anticipation Transformer for Online Action Understanding