vix.ing · top · new · best · stats · spec

VideoPCDNet: Video Parsing and Prediction with Phase Correlation Networks

2025/06/24 by Noel José Rodrigues Vicente, Enrique Lehner, Vicente, Noel José Rodrigues +7
Computer Science · #Image and Signal Denoising Methods #Anomaly Detection Techniques and Applications #Human Pose and Action Recognition

paper · pdf · doi:10.48550/arxiv.2506.19621

Abstract

Understanding and predicting video content is essential for planning and reasoning in dynamic environments. Despite advancements, unsupervised learning of object representations and dynamics remains challenging. We present VideoPCDNet, an unsupervised framework for object-centric video decomposition and prediction. Our model uses frequency-domain phase correlation techniques to recursively parse videos into object components, which are represented as transformed versions of learned object prototypes, enabling accurate and interpretable tracking. By explicitly modeling object motion through a combination of frequency domain operations and lightweight learned modules, VideoPCDNet enables accurate unsupervised object tracking and prediction of future video frames. In our experiments, we demonstrate that VideoPCDNet outperforms multiple object-centric baseline models for unsupervised tracking and prediction on several synthetic datasets, while learning interpretable object and motion representations.

Citations

Related