vix.ing · top · new · best · stats · spec

Detecting facial landmarks in the video based on a hybrid framework

2016/09/21 by Nian Cai, Cai, Nian, Zhineng Lin +7
Computer Science · #Biometric Identification and Security #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Face and Expression Recognition #Face recognition and analysis

paper · pdf · doi:10.48550/arxiv.1609.06441

openalex publication_date 2016/09/21 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

To dynamically detect the facial landmarks in the video, we propose a novel hybrid framework termed as detection-tracking-detection (DTD). First, the face bounding box is achieved from the first frame of the video sequence based on a traditional face detection method. Then, a landmark detector detects the facial landmarks, which is based on a cascaded deep convolution neural network (DCNN). Next, the face bounding box in the current frame is estimated and validated after the facial landmarks in the previous frame are tracked based on the median flow. Finally, the facial landmarks in the current frame are exactly detected from the validated face bounding box via the landmark detector. Experimental results indicate that the proposed framework can detect the facial landmarks in the video sequence more effectively and with lower consuming time compared to the frame-by-frame method via the DCNN.

Citations

Related