Rafael Valle
- Audio Flamingo: A Novel Audio Language Model with Few-Shot Learning and Dialogue Abilities
2024/02/02 by Zhifeng Kong, Arushi Goel, Kong, Zhifeng +8 · 44 citations
Computer Science · #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and dialogue systems #electronic engineering #information engineering
- Flowtron: an Autoregressive Flow-based Generative Network for Text-to-Speech Synthesis
2020/05/12 by Rafael Valle, Valle, Rafael, Kevin J. Shih +5 · 7 citations
Computer Science · #Speech Recognition and Synthesis #Music and Audio Processing #Topic Modeling
- SPACE: Speech-driven Portrait Animation with Controllable Expression
2022/11/17 by Siddharth Gururani, Gururani, Siddharth, Arun Mallya +7 · 6 citations
Computer Science · Engineering · #Face recognition and analysis #Generative Adversarial Networks and Image Synthesis #Human Motion and Animation
- One TTS Alignment To Rule Them All
2021/08/23 by Rohan Badlani, Adrian Łancucki, Badlani, Rohan +8 · 4 citations
Computer Science · #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and dialogue systems #Topic Modeling #electronic engineering #information engineering
- Koel-TTS: Enhancing LLM based Speech Generation with Preference Alignment and Classifier Free Guidance
2025/02/07 by Shehzeen Hussain, Hussain, Shehzeen, Paarth Neekhara +15 · 11 citations
Computer Science · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Natural Language Processing Techniques #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and dialogue systems #electronic engineering #information engineering
- SelfVC: Voice Conversion With Iterative Refinement using Self Transformations
2023/10/14 by Paarth Neekhara, Neekhara, Paarth, Shehzeen Hussain +13 · 3 citations
Computer Science · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Sound (cs.SD) #Speech Recognition and Synthesis #Topic Modeling #electronic engineering #information engineering
- UniWav: Towards Unified Pre-training for Speech Representation Learning and Generation
2025/03/02 by Alexander H. Liu, Sang-gil Lee, Liu, Alexander H. +13 · 3 citations
Computer Science · #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Natural Language Processing Techniques #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and dialogue systems #electronic engineering #information engineering
- Audio Dialogues: Dialogues dataset for audio and music understanding
2024/04/11 by Arushi Goel, Zhifeng Kong, Goel, Arushi +5 · 1 citation
Computer Science · #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Music and Audio Processing #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and Audio Processing #electronic engineering #information engineering
- OMCAT: Omni Context Aware Transformer
2024/10/15 by Arushi Goel, Karan Sapra, Goel, Arushi +9 · 1 citation
Computer Science · #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Context-Aware Activity Recognition Systems #FOS: Computer and information sciences