Yu, Wenyi

1. SALMONN: Towards Generic Hearing Abilities for Large Language Models
   2023/10/20 by Changli Tang, Wenyi Yu, Tang, Changli +15 · 112 citations
   Computer Science · #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Music and Audio Processing #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and Audio Processing #electronic engineering #information engineering
2. video-SALMONN: Speech-Enhanced Audio-Visual Large Language Models
   2024/06/22 by Guangzhi Sun, Sun, Guangzhi, Wenyi Yu +17 · 27 citations
   Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Music and Audio Processing #Speech and Audio Processing
3. Connecting Speech Encoder and Large Language Model for ASR
   2023/09/25 by Wenyi Yu, Changli Tang, Yu, Wenyi +15 · 13 citations
   Computer Science · #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Natural Language Processing Techniques #Sound (cs.SD) #Speech Recognition and Synthesis #Topic Modeling #electronic engineering #information engineering
4. Enabling Auditory Large Language Models for Automatic Speech Quality Evaluation
   2024/09/25 by Siyin Wang, Wang, Siyin, Wenyi Yu +20 · 9 citations
   Computer Science · #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Sound (cs.SD) #Speech and Audio Processing #electronic engineering #information engineering
5. SALMONN-omni: A Codec-free LLM for Full-duplex Speech Understanding and Generation
   2024/11/27 by Yu, Wenyi, Wang, Siyin, Yang, Xiaoyu +7 · 9 citations
   #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Sound (cs.SD) #electronic engineering #information engineering
6. Can Large Language Models Understand Spatial Audio?
   2024/06/12 by Changli Tang, Wenyi Yu, Tang, Changli +19 · 6 citations
   Computer Science · Social Sciences · #Audio and Speech Processing (eess.AS) #Computational and Text Analysis Methods #FOS: Computer and information sciences #FOS: Electrical engineering #Music and Audio Processing #Sound (cs.SD) #electronic engineering #information engineering
7. Fine-grained Audio-Visual Joint Representations for Multimodal Large Language Models
   2023/10/09 by Guangzhi Sun, Wenyi Yu, Sun, Guangzhi +14 · 3 citations
   Computer Science · #Music and Audio Processing #Multimodal Machine Learning Applications #Speech and Audio Processing
8. SALMONN-omni: A Standalone Speech LLM without Codec Injection for Full-duplex Conversation
   2025/05/17 by Yu, Wenyi, Wang, Siyin, Yang, Xiaoyu +7 · 10 citations
   #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
9. An Improved Empirical Fisher Approximation for Natural Gradient Descent
   2024/06/10 by Wu, Xiaodong, Yu, Wenyi, Zhang, Chao +1 · 4 citations
   #FOS: Computer and information sciences #Machine Learning (cs.LG)
10. MMAU-Pro: A Challenging and Comprehensive Benchmark for Holistic Evaluation of Audio General Intelligence
    2025/08/19 by Kumar, Sonal, Sedláček, Šimon, Lokegaonkar, Vaibhavi +31 · 14 citations
    #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Sound (cs.SD) #electronic engineering #information engineering
11. QualiSpeech: A Speech Quality Assessment Dataset with Natural Language Reasoning and Descriptions
    2025/03/26 by Siyin Wang, Wenyi Yu, Wang, Siyin +16 · 6 citations
    Computer Science · #Natural Language Processing Techniques #Speech Recognition and Synthesis
12. M³AV: A Multimodal, Multigenre, and Multipurpose Audio-Visual Academic Lecture Dataset
    2024/03/21 by Zhe Chen, Chen, Zhe, Heyang Liu +15 · 2 citations
    Arts and Humanities · Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Music and Audio Processing #Subtitles and Audiovisual Media #Video Analysis and Summarization