Rouditchenko, Andrew
- The Sound of Pixels
2018/04/09 by Hang Zhao, Chuang Gan, Zhao, Hang +9 · 17 citations
Computer Science · Engineering · #Acoustic Wave Phenomena Research #Audio and Speech Processing (eess.AS) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Music and Audio Processing #Sound (cs.SD) #Speech and Audio Processing #electronic engineering #information engineering
- Contrastive Audio-Visual Masked Autoencoder
2022/10/02 by Yuan Gong, Andrew Rouditchenko, Gong, Yuan +11 · 21 citations
Computer Science · #Music and Audio Processing #Speech and Audio Processing #Video Analysis and Summarization
- Everything at Once -- Multi-modal Fusion Transformer for Video Retrieval
2021/12/08 by Shvetsova, Nina, Chen, Brian, Rouditchenko, Andrew +6 · 7 citations
#Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Sound (cs.SD) #electronic engineering #information engineering
- Cross-Modal Discrete Representation Learning
2021/06/10 by Liu, Alexander H., Jin, SouYoung, Lai, Cheng-I Jeff +3 · 6 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- Whisper-Flamingo: Integrating Visual Features into Whisper for Audio-Visual Speech Recognition and Translation
2024/06/14 by Rouditchenko, Andrew, Gong, Yuan, Thomas, Samuel +4 · 12 citations
#Audio and Speech Processing (eess.AS) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Sound (cs.SD) #electronic engineering #information engineering
- Omni-R1: Do You Really Need Audio to Fine-Tune Your Audio LLM?
2025/05/14 by Andrew Rouditchenko, Saurabhchand Bhati, Rouditchenko, Andrew +11 · 22 citations
Computer Science · #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Music and Audio Processing #Sound (cs.SD) #electronic engineering #information engineering
- Comparison of Multilingual Self-Supervised and Weakly-Supervised Speech Pre-Training for Adaptation to Unseen Languages
2023/05/21 by Rouditchenko, Andrew, Khurana, Sameer, Thomas, Samuel +6 · 3 citations
#Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Sound (cs.SD) #electronic engineering #information engineering
- AVLnet: Learning Audio-Visual Language Representations from Instructional Videos
2020/06/16 by Rouditchenko, Andrew, Boggust, Angie, Harwath, David +11 · 2 citations
#Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Multimedia (cs.MM) #Sound (cs.SD) #electronic engineering #information engineering
- Self-Supervised Audio-Visual Co-Segmentation
2019/04/18 by Rouditchenko, Andrew, Zhao, Hang, Gan, Chuang +2 · 1 citation
#Audio and Speech Processing (eess.AS) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Image and Video Processing (eess.IV) #Sound (cs.SD) #electronic engineering #information engineering
- CAV-MAE Sync: Improving Contrastive Audio-Visual Mask Autoencoders via Fine-Grained Alignment
2025/05/02 by Edson Araujo, Andrew Rouditchenko, Araujo, Edson +17 · 2 citations
Computer Science · #Audio and Speech Processing (eess.AS) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Generative Adversarial Networks and Image Synthesis #Image and Signal Denoising Methods #Multimedia (cs.MM) #Sound (cs.SD) #Speech and Audio Processing #electronic engineering #information engineering
- What, when, and where? -- Self-Supervised Spatio-Temporal Grounding in Untrimmed Multi-Action Videos from Narrated Instructions
2023/03/29 by Brian Chen, Nina Shvetsova, Chen, Brian +15 · 1 citation
Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Pose and Action Recognition #Multimodal Machine Learning Applications #Video Analysis and Summarization
- AV-CPL: Continuous Pseudo-Labeling for Audio-Visual Speech Recognition
2023/09/29 by Andrew Rouditchenko, Ronan Collobert, Rouditchenko, Andrew +3 · 1 citation
Computer Science · Engineering · #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Indoor and Outdoor Localization Technologies #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Music and Audio Processing #Sound (cs.SD) #Speech and Audio Processing #electronic engineering #information engineering
- mWhisper-Flamingo for Multilingual Audio-Visual Noise-Robust Speech Recognition
2025/02/03 by Andrew Rouditchenko, Samuel Thomas, Rouditchenko, Andrew +7 · 1 citation
Computer Science · #Audio and Speech Processing (eess.AS) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Music and Audio Processing #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and Audio Processing #electronic engineering #information engineering