2021/06/22 by Hau Chu, Chu, Hau, Jia‐Hong Lee +13 · 1 citation
Computer Science · #Advanced Vision and Imaging #Artificial intelligence #Computer Vision and Pattern Recognition (cs.CV) #Computer science #Computer vision #Consistency (knowledge bases) #Construct (python library) #FOS: Computer and information sciences #Human Pose and Action Recognition #Outlier #Pose #Tracking (education) #Video Surveillance and Tracking Methods #cs.CV
paper · pdf · doi:10.48550/arxiv.2106.11589
12 pages with supplementary material; accepted to CVPR 2021 B-AMFG Workshop
arxiv created 2021/06/22 · openalex publication_date 2021/06/22 · arxiv updated 2021/06/23 · openalex created_date 2021/07/05 · openalex updated_date 2026/07/28
This paper introduces an approach for multi-human 3D pose estimation and tracking based on calibrated multi-view. The main challenge lies in finding the cross-view and temporal correspondences correctly even when several human pose estimations are noisy. Compare to previous solutions that construct 3D poses from multiple views, our approach takes advantage of temporal consistency to match the 2D poses estimated with previously constructed 3D skeletons in every view. Therefore cross-view and temporal associations are accomplished simultaneously. Since the performance suffers from mistaken association and noisy predictions, we design two strategies for aiming better correspondences and 3D reconstruction. Specifically, we propose a part-aware measurement for 2D-3D association and a filter that can cope with 2D outliers during reconstruction. Our approach is efficient and effective comparing to state-of-the-art methods; it achieves competitive results on two benchmarks: 96.8% on Campus and 97.4% on Shelf. Moreover, we extends the length of Campus evaluation frames to be more challenging and our proposal also reach well-performed result.