Kumar, Sonal
- MMAU: A Massive Multi-Task Audio Understanding and Reasoning Benchmark
2024/10/24 by S Sakshi, Utkarsh Tyagi, Sakshi, S +15 · 86 citations
Computer Science · #Music and Audio Processing #Speech and Audio Processing #Speech Recognition and Synthesis
- GAMA: A Large Audio-Language Model with Advanced Audio Understanding and Complex Reasoning Abilities
2024/06/17 by Sreyan Ghosh, Ghosh, Sreyan, Sonal Kumar +15 · 43 citations
Computer Science · #Music and Audio Processing #Music Technology and Sound Studies
- Audio Flamingo 2: An Audio-Language Model with Long-Audio Understanding and Expert Reasoning Abilities
2025/03/06 by Ghosh, Sreyan, Kong, Zhifeng, Kumar, Sonal +6 · 44 citations
#Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Sound (cs.SD) #electronic engineering #information engineering
- A Closer Look at the Limitations of Instruction Tuning
2024/02/03 by Sreyan Ghosh, Ghosh, Sreyan, Chandra Kiran Reddy Evuru +13 · 17 citations
Social Sciences · #Education and Technology Integration
- Audio Flamingo 3: Advancing Audio Intelligence with Fully Open Large Audio Language Models
2025/07/10 by Goel, Arushi, Ghosh, Sreyan, Kim, Jaehyeon +8 · 59 citations
#Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Sound (cs.SD) #electronic engineering #information engineering
- CompA: Addressing the Gap in Compositional Reasoning in Audio-Language Models
2023/10/12 by Sreyan Ghosh, Ghosh, Sreyan, Ashish Seth +17 · 11 citations
Computer Science · Arts and Humanities · #Music and Audio Processing #Diverse Musicological Studies #Speech Recognition and Synthesis
- AV-RIR: Audio-Visual Room Impulse Response Estimation
2023/11/30 by Anton Ratnarajah, Sreyan Ghosh, Ratnarajah, Anton +7 · 8 citations
Computer Science · Engineering · Neuroscience · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Hearing Loss and Rehabilitation #Indoor and Outdoor Localization Technologies #Sound (cs.SD) #Speech and Audio Processing
- Visual Description Grounding Reduces Hallucinations and Boosts Reasoning in LVLMs
2024/05/24 by Sreyan Ghosh, Ghosh, Sreyan, Chandra Kiran Reddy Evuru +11 · 8 citations
Arts and Humanities · Neuroscience · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Functional Brain Connectivity Studies #Hallucinations in medical conditions #Mental Health and Psychiatry
- RECAP: Retrieval-Augmented Audio Captioning
2023/09/18 by Sreyan Ghosh, Sonal Kumar, Ghosh, Sreyan +7 · 6 citations
Arts and Humanities · Computer Science · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #Diverse Musicological Studies #FOS: Computer and information sciences #FOS: Electrical engineering #Music and Audio Processing #Sound (cs.SD) #Speech Recognition and Synthesis #electronic engineering #information engineering
- EH-MAM: Easy-to-Hard Masked Acoustic Modeling for Self-Supervised Speech Representation Learning
2024/10/17 by Ashish Seth, R. K. Selvakumar, Seth, Ashish +9 · 4 citations
Computer Science · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Music and Audio Processing #Natural Language Processing Techniques #Sound (cs.SD) #Speech Recognition and Synthesis #electronic engineering #information engineering
- CoSyn: Detecting Implicit Hate Speech in Online Conversations Using a Context Synergized Hyperbolic Network
2023/03/02 by Ghosh, Sreyan, Suri, Manan, Chiniya, Purva +3 · 2 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Social and Information Networks (cs.SI)
- MMAU-Pro: A Challenging and Comprehensive Benchmark for Holistic Evaluation of Audio General Intelligence
2025/08/19 by Kumar, Sonal, Sedláček, Šimon, Lokegaonkar, Vaibhavi +31 · 14 citations
#Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Sound (cs.SD) #electronic engineering #information engineering
- ACLM: A Selective-Denoising based Generative Data Augmentation Approach for Low-Resource Complex NER
2023/06/01 by Ghosh, Sreyan, Tyagi, Utkarsh, Suri, Manan +3 · 2 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Information Retrieval (cs.IR)
- ASPIRE: Language-Guided Data Augmentation for Improving Robustness Against Spurious Correlations
2023/08/19 by Sreyan Ghosh, Chandra Kiran Reddy Evuru, Ghosh, Sreyan +11 · 2 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Topic Modeling
- CoDa: Constrained Generation based Data Augmentation for Low-Resource NLP
2024/03/30 by Chandra Kiran Reddy Evuru, Evuru, Chandra Kiran Reddy, Sreyan Ghosh +9 · 2 citations
Computer Science · #Natural Language Processing Techniques
- ABEX: Data Augmentation for Low-Resource NLU via Expanding Abstract Descriptions
2024/06/06 by Sreyan Ghosh, Utkarsh Tyagi, Ghosh, Sreyan +11 · 2 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques
- Synthio: Augmenting Small-Scale Audio Classification Datasets with Synthetic Data
2024/10/02 by Ghosh, Sreyan, Kumar, Sonal, Kong, Zhifeng +3 · 2 citations
#Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #electronic engineering #information engineering
- ReCLAP: Improving Zero Shot Audio Classification by Describing Sounds
2024/09/13 by Sreyan Ghosh, Sonal Kumar, Ghosh, Sreyan +9 · 2 citations
Computer Science · #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Music and Audio Processing #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and Audio Processing #electronic engineering #information engineering
- LipGER: Visually-Conditioned Generative Error Correction for Robust Automatic Speech Recognition
2024/06/06 by Ghosh, Sreyan, Kumar, Sonal, Seth, Ashish +4 · 1 citation
#Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #electronic engineering #information engineering
- Do Vision-Language Models Understand Compound Nouns?
2024/03/30 by Sonal Kumar, Kumar, Sonal, Sreyan Ghosh +7 · 1 citation
Computer Science · #Natural Language Processing Techniques #Speech and dialogue systems
- Multi-Domain Audio Question Answering Toward Acoustic Content Reasoning in The DCASE 2025 Challenge
2025/05/12 by Yang, Chao-Han Huck, Ghosh, Sreyan, Wang, Qing +14 · 2 citations
#Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Multimedia (cs.MM) #Sound (cs.SD) #electronic engineering #information engineering