A Comprehensive Review of Real-Time Multi-View Multi-Person Markerless Motion Capture

2025/08/27 by Pierre Nagorny, Bart Kevelham, Sylvain Chagué +1 · 1 voice
Computer Science · Engineering · #Human Pose and Action Recognition #Video Surveillance and Tracking Methods #Gait Recognition and Analysis

paper · pdf · doi:10.1145/3757733

openalex publication_date 2025/08/27 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/31

Abstract

Markerless human body motion capture promises to remove markers from capture studios, thus simplifying its diverse application fields, from life science to virtual reality. This comprehensive review examines recent advances in real-time markerless motion capture systems from 2020 to 2024, focusing on real-time multi-view, multi-person tracking solutions. Recent advancements, particularly driven by neural network-based pose estimation, have enabled real-time tracking with minimal latency, achieving at least 25 frames per second. Through systematic analysis, we evaluate these methods based on three key metrics: accuracy in pose reconstruction, end-to-end latency, and computational efficiency. Special attention is given to how architectural decisions impact system scalability regarding the number of camera viewpoints and tracked individuals. While current methods show promise for applications like sports analysis and virtual reality, challenges remain in achieving optimal performance across all metrics. Through systematic analysis of leading real-time pipelines, we identify key technical advances and persistent challenges. This synthesis provides critical insights for researchers and practitioners working to develop more robust markerless motion capture systems, while outlining important directions for future research.

Citations

• On the shortest spanning subtree of a graph and the traveling salesman problem
• VNect
• Cascaded Pyramid Network for Multi-Person Pose Estimation
• Model Cards for Model Reporting
• Deep High-Resolution Representation Learning for Human Pose Estimation
• FastPose: Towards Real-time Pose Estimation and Tracking via Scale-normalized Multi-task Networks
• Cross View Fusion for 3D Human Pose Estimation
• Deep Learning-Based Human Pose Estimation: A Survey
• Monocular, One-stage, Regression of Multiple 3D People
• DeepMultiCap: Performance Capture of Multiple Characters Using Sparse Multiview Cameras
• When Human Pose Estimation Meets Robustness: Adversarial Algorithms and Benchmarks
• HSPACE: Synthetic Parametric Humans Animated in Complex Environments
• A review of 3D human pose estimation algorithms for markerless motion\n capture
• Learning to Detect and Track Visible and Occluded Body Joints in a\n Virtual World
• YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors
• RTMPose: Real-Time Multi-Person Pose Estimation based on MMPose
• SynBody: Synthetic Dataset with Layered Human Models for 3D Human Perception and Modeling
• VoxelKeypointFusion: Generalizable Multi-View Multi-Person Pose Estimation

Discussions

• Our paper "A Comprehensive Review of Real-Time Multi-View Multi-Person Markerless Motion Capture" has just been published by ACM Comp. Sur. doi.org/10.1145/3757... It is the result of an extensive re [bsky, 1 points, 2 comments]

Related

• Markerless 3D human pose tracking through multiple cameras and AI: Enabling high accuracy, robustness, and real-time performance
• A review of 3D human pose estimation algorithms for markerless motion\n capture
• Towards Accurate Markerless Human Shape and Pose Estimation over Time
• Real-Time Human Motion Capture with Multiple Depth Cameras
• Real-time Human Motion Capture with Simple Marker Sets and Monocular Video