2014/12/01 by Luca Del Pero, Del Pero, Luca, Susanna Ricco +5 · 2 citations
Computer Science · Engineering · Mathematics · #Advanced Vision and Imaging #Artificial intelligence #Computer Vision and Pattern Recognition (cs.CV) #Computer science #Computer vision #Exploit #FOS: Computer and information sciences #Feature extraction #Geometry #Human Motion and Animation #Human Pose and Action Recognition #Image (mathematics) #Mathematics #Motion (physics) #Object (grammar) #Optical flow #Pattern recognition (psychology) #Point (geometry) #Scale-invariant feature transform #cs.CV
paper · pdf · doi:10.48550/arxiv.1412.0477
published in arXiv (Cornell University) (Cornell University) · 9 pages, 14 figures. This article is obsolete. Its contents are now covered in arXiv:1511.09319, where we discuss a comprehensive system for behavior discovery and spatial alignment of articulated object classes from unstructured video (available at https://arxiv.org/abs/1511.09319)
openalex publication_date 2014/12/01 · openalex created_date 2016/06/24 · arxiv created 2016/08/16 · arxiv updated 2016/08/18 · openalex updated_date 2026/07/28
Given unstructured videos of deformable objects, we automatically recover spatiotemporal correspondences to map one object to another (such as animals in the wild). While traditional methods based on appearance fail in such challenging conditions, we exploit consistency in object motion between instances. Our approach discovers pairs of short video intervals where the object moves in a consistent manner and uses these candidates as seeds for spatial alignment. We model the spatial correspondence between the point trajectories on the object in one interval to those in the other using a time-varying Thin Plate Spline deformation model. On a large dataset of tiger and horse videos, our method automatically aligns thousands of pairs of frames to a high accuracy, and outperforms the popular SIFT Flow algorithm.