1998/05/01 by Tsuhan Chen, R.R. Rao · 1 citation
Psychology · Computer Science · #Multisensory perception and integration #Speech and Audio Processing #Music and Audio Processing
paper · doi:10.1109/5.664274
openalex publication_date 1998/05/01 · openalex created_date 2025/10/10 · openalex updated_date 2026/06/11
We review recent research that examines audio-visual integration in multimodal communication. The topics include bimodality in human speech, human and automated lip reading, facial animation, lip synchronization, joint audio-video coding, and bimodal speaker verification. We also study the enabling technologies for these research topics, including automatic facial-feature tracking and audio-to-visual mapping. Recent progress in audio-visual research shows that joint processing of audio and video provides advantages that are not available when the audio and video are processed independently.