Nieto, Oriol
- MMAU: A Massive Multi-Task Audio Understanding and Reasoning Benchmark
2024/10/24 by S Sakshi, Sakshi, S, Utkarsh Tyagi +15 · 121 citations
Computer Science · #Music and Audio Processing #Speech and Audio Processing #Speech Recognition and Synthesis
- GAMA: A Large Audio-Language Model with Advanced Audio Understanding and Complex Reasoning Abilities
2024/06/17 by Sreyan Ghosh, Ghosh, Sreyan, Sonal Kumar +15 · 81 citations
Computer Science · #Music and Audio Processing #Music Technology and Sound Studies
- Video-Guided Foley Sound Generation with Multimodal Controls
2024/11/26 by Ziyang Chen, Chen, Ziyang, Prem Seetharaman +12 · 4 voices · 21 citations
Computer Science · Engineering · #Speech and Audio Processing #cs.CV #cs.MM #cs.SD #eess.AS
- CompA: Addressing the Gap in Compositional Reasoning in Audio-Language Models
2023/10/12 by Sreyan Ghosh, Ghosh, Sreyan, Ashish Seth +17 · 24 citations
Computer Science · Arts and Humanities · #Music and Audio Processing #Diverse Musicological Studies #Speech Recognition and Synthesis
- Sketch2Sound: Controllable Audio Generation via Time-Varying Signals and Sonic Imitations
2024/12/11 by Hugo Flores García, García, Hugo Flores, Oriol Nieto +7 · 4 voices · 13 citations
Computer Science · #Music Technology and Sound Studies #Music and Audio Processing #Speech and Audio Processing
- Audio-Text Models Do Not Yet Leverage Natural Language
2023/03/19 by Ho-Hsiang Wu, Wu, Ho-Hsiang, Oriol Nieto +5 · 11 citations
Computer Science · #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Music and Audio Processing #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and Audio Processing #electronic engineering #information engineering
- Visual Description Grounding Reduces Hallucinations and Boosts Reasoning in LVLMs
2024/05/24 by Sreyan Ghosh, Chandra Kiran Reddy Evuru, Ghosh, Sreyan +11 · 11 citations
Arts and Humanities · Neuroscience · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Functional Brain Connectivity Studies #Hallucinations in medical conditions #Mental Health and Psychiatry
- Language-Guided Audio-Visual Source Separation via Trimodal Consistency
2023/03/28 by Reuben Tan, Arijit Ray, Tan, Reuben +13 · 6 citations
Computer Science · Neuroscience · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Hearing Loss and Rehabilitation #Music and Audio Processing #Speech and Audio Processing
- Multi-label Music Genre Classification from Audio, Text, and Images Using Deep Features
2017/07/16 by Sergio Oramas, Oriol Nieto, Oramas, Sergio +5 · 3 citations
Computer Science · Arts and Humanities · #Music and Audio Processing #Diverse Musicological Studies #Music Technology and Sound Studies
- Music Enhancement via Image Translation and Vocoding
2022/04/28 by Nikhil Kandpal, Kandpal, Nikhil, Oriol Nieto +3 · 2 citations
Computer Science · Neuroscience · #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Hearing Loss and Rehabilitation #Machine Learning (cs.LG) #Music and Audio Processing #Sound (cs.SD) #Speech and Audio Processing #electronic engineering #information engineering
- ReCLAP: Improving Zero Shot Audio Classification by Describing Sounds
2024/09/13 by Sreyan Ghosh, Ghosh, Sreyan, Sonal Kumar +9 · 5 citations
Computer Science · #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Music and Audio Processing #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and Audio Processing #electronic engineering #information engineering
- FLAM: Frame-Wise Language-Audio Modeling
2025/05/08 by Yusong Wu, Wu, Yusong, Christos Tsirigotis +12 · 1 voice · 7 citations
Computer Science · #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Music and Audio Processing #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and Audio Processing #electronic engineering #information engineering
- End-to-end learning for music audio tagging at scale
2017/11/07 by Pons, Jordi, Nieto, Oriol, Prockup, Matthew +3 · 1 citation
#Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Sound (cs.SD) #electronic engineering #information engineering
- Augment, Drop & Swap: Improving Diversity in LLM Captions for Efficient Music-Text Representation Learning
2024/09/17 by Ilaria Manco, Justin Salamon, Manco, Ilaria +3 · 3 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #Cancer-related molecular mechanisms research #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Music and Audio Processing #Natural Language Processing Techniques #Sound (cs.SD) #electronic engineering #information engineering
- Mood Classification Using Listening Data
2020/10/11 by Filip Korzeniowski, Korzeniowski, Filip, Oriol Nieto +9 · 1 citation
Computer Science · Neuroscience · #Music and Audio Processing #Neuroscience and Music Perception #Music Technology and Sound Studies
- Multi-Domain Audio Question Answering Toward Acoustic Content Reasoning in The DCASE 2025 Challenge
2025/05/12 by Yang, Chao-Han Huck, Ghosh, Sreyan, Wang, Qing +14 · 2 citations
#Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Multimedia (cs.MM) #Sound (cs.SD) #electronic engineering #information engineering
- Bridging High-Quality Audio and Video via Language for Sound Effects Retrieval from Visual Queries
2023/08/17 by Julia Wilkins, Wilkins, Julia, Justin Salamon +7 · 1 citation
Arts and Humanities · Computer Science · #Audio and Speech Processing (eess.AS) #Computer Vision and Pattern Recognition (cs.CV) #Diverse Musicological Studies #FOS: Computer and information sciences #FOS: Electrical engineering #Information Retrieval (cs.IR) #Multimedia (cs.MM) #Music and Audio Processing #Sound (cs.SD) #Speech and Audio Processing #electronic engineering #information engineering