Algorithmic Principles of Remote PPG
2016/09/13 by Wenjin Wang, Albertus C. den Brinker, Sander Stuijk +1 · 1,200 citations
Engineering · Medicine · #Algorithm #Artificial intelligence #Benchmark (surveying) #Computer science #Computer vision #ECG Monitoring and Analysis #Machine learning #Non-Invasive Vital Sign Monitoring #Optical Imaging and Spectroscopy Techniques #Photoplethysmogram #Projection (relational algebra) #Pulse (music)
paper · open access · doi:10.1109/tbme.2016.2609282
published in IEEE Transactions on Biomedical Engineering 64(7), 1479-1491 (Institute of Electrical and Electronics Engineers)
openalex publication_date 2016/09/13 · openalex created_date 2025/10/10 · openalex updated_date 2026/08/02
Abstract
This paper introduces a mathematical model that incorporates the pertinent optical and physiological properties of skin reflections with the objective to increase our understanding of the algorithmic principles behind remote photoplethysmography (rPPG). The model is used to explain the different choices that were made in existing rPPG methods for pulse extraction. The understanding that comes from the model can be used to design robust or application-specific rPPG solutions. We illustrate this by designing an alternative rPPG method, where a projection plane orthogonal to the skin tone is used for pulse extraction. A large benchmark on the various discussed rPPG methods shows that their relative merits can indeed be understood from the proposed model.
Citations
Cited by
- Multispectral Depolarization Based Living-Skin Detection: A New Measurement Principle
- CPulse: Heart Rate Estimation From RGB Videos Under Realistic Conditions
- Non-contact PPG signal and heart rate estimation with multi-hierarchical convolutional network
- GraphPhys: Facial video-based physiological measurement with graph neural network
- Physiological Signals as a Forensic Modality for Talking-Face Deepfake Detection
- CanonicalPhys: Pose-Robust Remote Photoplethysmography via Canonical-Space Priors
- RhythmFormer: Extracting Patterned rPPG Signals based on Periodic Sparse Attention
- Quality-Aware Framework for Video-Derived Respiratory Signals
- 3D Blood Pulsation Maps
- FacePhys: State of the Heart Learning
- Adaptive Parameter Optimization for Robust Remote Photoplethysmography
- Reperio-rPPG: Relational Temporal Graph Neural Networks for Periodicity Learning in Remote Physiological Measurement
- M3PD Dataset: Dual-view Photoplethysmography (PPG) Using Front-and-rear Cameras of Smartphones in Lab and Clinical Settings
- Dual-domain Microwave Photonic Radar for Non-contact High-resolution Monitoring of Vital Signs in Multiple Individuals
- VitalLens 2.0: High-Fidelity rPPG for Heart Rate Variability Estimation from Face Video
- DeepPhys: Video-Based Physiological Measurement Using Convolutional Attention Networks
- JAMSNet: A Remote Pulse Extraction Network Based on Joint Attention and Multi-Scale Fusion
- PulseGAN: Learning to generate realistic pulse waveforms in remote photoplethysmography
- EfficientPhys: Enabling Simple, Fast and Accurate Camera-Based Vitals Measurement
- FedHUG: Federated Heterogeneous Unsupervised Generalization for Remote Physiological Measurements
- Diverse R-PPG: Camera-Based Heart Rate Estimation for Diverse Subject Skin-Tones and Scenes
- SkinMap: Weighted Full-Body Skin Segmentation for Robust Remote Photoplethysmography
- To Remember, To Adapt, To Preempt: A Stable Continual Test-Time Adaptation Framework for Remote Physiological Measurement in Dynamic Domain Shifts
- PHASE-Net: Physics-Grounded Harmonic Attention System for Efficient Remote Photoplethysmography Measurement
- Skin Deep: Investigating Subjectivity in Skin Tone Annotations for Computer Vision Benchmark Datasets
- Editing Physiological Signals in Videos Using Latent Representations
- Gaze into the Heart: A Multi-View Video Dataset for rPPG and Health Biomarkers Estimation
- StressNet: Detecting Stress in Thermal Videos
- Multi-Task Temporal Shift Attention Networks for On-Device Contactless Vitals Measurement
- PhysDrive: A Multimodal Remote Physiological Measurement Dataset for In-vehicle Driver Monitoring
- BeatFormer: Efficient motion-robust remote heart rate estimation through unsupervised spectral zoomed attention filters
- Analysis of CNN-based remote-PPG to understand limitations and sensitivities
- Video-based Remote Physiological Measurement via Cross-verified Feature Disentangling
- TransRPPG: Remote Photoplethysmography Transformer for 3D Mask Face Presentation Attack Detection
- Not Only Consistency: Enhance Test-Time Adaptation with Spatio-temporal Inconsistency for Remote Physiological Measurement
- Robust and Generalizable Heart Rate Estimation via Deep Learning for Remote Photoplethysmography in Complex Scenarios
- CAST-Phys: Contactless Affective States Through Physiological signals Database
- Exploring Remote Physiological Signal Measurement under Dynamic Lighting Conditions at Night: Dataset, Experiment, and Analysis
- Remote Heart Rate Measurement from Highly Compressed Facial Videos: an End-to-end Deep Learning Solution with Video Enhancement
- Ultra-Short rPPG Estimation via Periodicity Guidance and Signal Reconstruction
- Periodic-MAE: Periodic Video Masked Autoencoder for rPPG Estimation
- Align the GAP: Prior-based Unified Multi-Task Remote Physiological Measurement Framework For Domain Generalization and Personalization
- VIPL-HR: A Multi-modal Database for Pulse Estimation from Less-constrained Face Video
- Overcoming Difficulty in Obtaining Dark-skinned Subjects for Remote-PPG by Synthetic Augmentation
- Advancing Non-Contact Vital Sign Measurement using Synthetic Avatars
- The 1st Challenge on Remote Physiological Signal Sensing (RePSS)
- Smartwatch Photoplethysmography-Derived Heart Age via ECG-Guided Cross-Modal Pretraining as a Digital Biomarker of Vascular Aging
- PhysAgent: A Multi-Agent Framework for Reliable Remote Heart Rate Estimation
- Video-based HR measurement using adaptive facial regions with multiple color spaces
- Using imaging photoplethysmography for heart rate estimation in non-human primates. [europepmc]
- Non-Contact, Simple Neonatal Monitoring by Photoplethysmography. [europepmc]
- Current progress of photoplethysmography and SPO 2 for health monitoring. [europepmc]
- An open-source remote heart rate imaging method with practical apparatus and algorithms. [europepmc]
- A Broader Look: Camera-Based Vital Sign Estimation across the Spectrum. [europepmc]
- Analysis of CNN-based remote-PPG to understand limitations and sensitivities. [europepmc]
- Non-contact imaging of peripheral hemodynamics during cognitive and psychological stressors. [europepmc]
- Integration of novel monitoring devices with machine learning technology for scalable cardiovascular management. [europepmc]
- Sources of Inaccuracy in Photoplethysmography for Continuous Cardiovascular Monitoring. [europepmc]
- Evaluation of biases in remote photoplethysmography methods. [europepmc]
- Assessment of Non-Invasive Blood Pressure Prediction from PPG and rPPG Signals Using Deep Learning. [europepmc]
- Deep Learning Methods for Remote Heart Rate Measurement: A Review and Future Research Agenda. [europepmc]
- Smartphones and Video Cameras: Future Methods for Blood Pressure Measurement. [europepmc]
- Assessment of ROI Selection for Facial Video-Based rPPG. [europepmc]
- Contactless facial video recording with deep learning models for the detection of atrial fibrillation. [europepmc]
- Contactless Vital Signs Monitoring From Videos Recorded With Digital Cameras: An Overview. [europepmc]
- Imaging PPG for In Vivo Human Tissue Perfusion Assessment during Surgery. [europepmc]
- Mobile Robotic Platform for Contactless Vital Sign Monitoring. [europepmc]
- Prospective validation of smartphone-based heart rate and respiratory rate measurement algorithms. [europepmc]
- Effectiveness of Remote PPG Construction Methods: A Preliminary Analysis. [europepmc]
- Contactless Cardiovascular Assessment by Imaging Photoplethysmography: A Comparison with Wearable Monitoring. [europepmc]
- Are Activity Wrist-Worn Devices Accurate for Determining Heart Rate during Intense Exercise? [europepmc]
- Emotion Recognition Using Different Sensors, Emotion Models, Methods and Datasets: A Comprehensive Review. [europepmc]
- Remote Blood Oxygen Estimation From Videos Using Neural Networks. [europepmc]
- Contactless Technologies, Sensors, and Systems for Cardiac and Respiratory Measurement during Sleep: A Systematic Review. [europepmc]
Related