William Chen
- ML-SUPERB: Multilingual Speech Universal PERformance Benchmark
2023/05/18 by Jiatong Shi, Dan Berrebbi, Shi, Jiatong +19 · 17 citations
Computer Science · #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Music and Audio Processing #Natural Language Processing Techniques #Sound (cs.SD) #Speech Recognition and Synthesis #electronic engineering #information engineering
- OWSM v3.1: Better and Faster Open Whisper-Style Speech Models based on E-Branchformer
2024/01/30 by Yifan Peng, Peng, Yifan, Jinchuan Tian +21 · 23 citations
Computer Science · #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Speech Recognition and Synthesis #electronic engineering #information engineering
- YODAS: Youtube-Oriented Dataset for Audio and Speech
2024/06/02 by Xinjian Li, Shinnosuke Takamichi, Li, Xinjian +9 · 22 citations
Computer Science · #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Music and Audio Processing #Sound (cs.SD) #Speech and Audio Processing #Video Analysis and Summarization #electronic engineering #information engineering
- Measuring General Intelligence with Generated Games
2025/05/12 by Vivek Kr Verma, Vivek Verma, Verma, Vivek +8 · 2 voices · 9 citations
Computer Science · #Artificial Intelligence in Games #Multimodal Machine Learning Applications #Reinforcement Learning in Robotics
- Towards Robust Speech Representation Learning for Thousands of Languages
2024/06/30 by William Chen, Chen, William, Wangyou Zhang +17 · 19 citations
Computer Science · #Speech Recognition and Synthesis #Natural Language Processing Techniques #Speech and dialogue systems
- Reproducing Whisper-Style Training Using an Open-Source Toolkit and Publicly Available Data
2023/09/25 by Yifan Peng, Jinchuan Tian, Peng, Yifan +29 · 13 citations
Computer Science · #Speech Recognition and Synthesis #Topic Modeling #Natural Language Processing Techniques
- Indoor and Outdoor 3D Scene Graph Generation via Language-Enabled Spatial Ontologies
2023/12/18 by Jared Strader, Strader, Jared, Nathan Hughes +7 · 10 citations
Social Sciences · Computer Science · #Geographic Information Systems Studies #Semantic Web and Ontologies #Data Management and Algorithms
- Vision-Language Models Provide Promptable Representations for Reinforcement Learning
2024/02/05 by William Chen, Oier Mees, Chen, William +5 · 8 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications #Reinforcement Learning in Robotics
- OWLS: Scaling Laws for Multilingual Speech Recognition and Translation Models
2025/02/14 by William Chen, Chen, William, Jinchuan Tian +9 · 12 citations
Computer Science · #Speech Recognition and Synthesis
- OWSM v4: Improving Open Whisper-Style Speech Models via Data Scaling and Cleaning
2025/05/31 by Yifan Peng, Shakeel Muhammad, Peng, Yifan +11 · 13 citations
Computer Science · #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Sound (cs.SD) #Speech Recognition and Synthesis #electronic engineering #information engineering
- Findings of the IWSLT 2024 Evaluation Campaign
2024/11/07 by Ibrahim Said Ahmad, Antonios Anastasopoulos, Ahmad, Ibrahim Said +87 · 8 citations
Computer Science · Engineering · #Advanced Data Processing Techniques #Computation and Language (cs.CL) #FOS: Computer and information sciences #GNSS positioning and interference #Seismology and Earthquake Studies
- Reducing Barriers to Self-Supervised Learning: HuBERT Pre-training with Academic Compute
2023/06/11 by William Chen, Xuankai Chang, Chen, William +9 · 3 citations
Computer Science · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling #electronic engineering #information engineering
- On the Evaluation of Speech Foundation Models for Spoken Language Understanding
2024/06/14 by Siddhant Arora, Ankita Pasad, Arora, Siddhant +21 · 4 citations
Computer Science · #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and dialogue systems #electronic engineering #information engineering
- On the Effects of Heterogeneous Data Sources on Speech-to-Text Foundation Models
2024/06/13 by Jinchuan Tian, Yifan Peng, Tian, Jinchuan +9 · 4 citations
Computer Science · #Speech Recognition and Synthesis #Natural Language Processing Techniques
- AugSumm: towards generalizable speech summarization using synthetic labels from large language model
2024/01/10 by Jee-weon Jung, Jung, Jee-weon, Roshan Sharma +7 · 2 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #Speech Recognition and Synthesis
- CAST: Counterfactual Labels Improve Instruction Following in Vision-Language-Action Models
2025/08/19 by Catherine Glossop, Glossop, Catherine, William Chen +7 · 6 citations
Psychology · #FOS: Computer and information sciences #Language, Metaphor, and Cognition #Robotics (cs.RO)
- ESPnet-SDS: Unified Toolkit and Demo for Spoken Dialogue Systems
2025/03/11 by Siddhant Arora, Arora, Siddhant, Yifan Peng +21 · 1 voice · 4 citations
Computer Science · #Speech and dialogue systems #Multi-Agent Systems and Negotiation #Natural Language Processing Techniques
- Findings of the 2023 ML-SUPERB Challenge: Pre-Training and Evaluation over More Languages and Beyond
2023/10/09 by Jiatong Shi, William Chen, Shi, Jiatong +23 · 2 citations
Computer Science · #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Natural Language Processing Techniques #Sound (cs.SD) #Speech Recognition and Synthesis #electronic engineering #information engineering
- OpusLM: A Family of Open Unified Speech Language Models
2025/06/21 by Jinchuan Tian, Tian, Jinchuan, William Chen +21 · 6 citations
Computer Science · #Speech Recognition and Synthesis #Topic Modeling #Natural Language Processing Techniques
- Extracting Zero-shot Common Sense from Large Language Models for Robot 3D Scene Understanding
2022/06/09 by William Chen, Siyi Hu, Chen, William +5 · 1 citation
Computer Science · #Advanced Image and Video Retrieval Techniques #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Robotics (cs.RO)
- ESPnet-SpeechLM: An Open Speech Language Model Toolkit
2025/02/21 by Jinchuan Tian, Tian, Jinchuan, Jiatong Shi +29 · 6 citations
Computer Science · #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Natural Language Processing Techniques #Sound (cs.SD) #Speech and dialogue systems #electronic engineering #information engineering
- EFFUSE: Efficient Self-Supervised Feature Fusion for E2E ASR in Low Resource and Multilingual Scenarios
2023/10/05 by Tejes Srivastava, Jiatong Shi, Srivastava, Tejes +5 · 1 citation
Computer Science · Engineering · #Advanced Chemical Sensor Technologies #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Fault Detection and Control Systems #Sound (cs.SD) #Speech Recognition and Synthesis #electronic engineering #information engineering
- A New Benchmark of Aphasia Speech Recognition and Detection Based on E-Branchformer and Multi-task Learning
2023/05/19 by Jiyang Tang, William Chen, Tang, Jiyang +7 · 1 citation
Computer Science · Neuroscience · #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Natural Language Processing Techniques #Neurobiology of Language and Bilingualism #Speech and dialogue systems #electronic engineering #information engineering
- Proactive Privacy Amnesia for Large Language Models: Safeguarding PII with Negligible Impact on Model Utility
2025/02/24 by Martin Kuo, Jingyang Zhang, Kuo, Martin +21 · 2 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Privacy-Preserving Technologies in Data
- NetForge: A Programmable Substrate for Bottleneck-Centric Network Data Generation
2025/07/17 by Jaber Daneshamooz, Satyandra Guthula, Daneshamooz, Jaber +13 · 2 citations
Computer Science · #Cloud Computing and Resource Management #FOS: Computer and information sciences #Network Traffic and Congestion Control #Networking and Internet Architecture (cs.NI) #Software-Defined Networks and 5G
- Why Does Action Chunking Improve Behavioral Cloning Performance in Robotic Control?
2026/08/03 by Filippo Lazzati, Kyle Stachowicz, William Chen +3
Computer Science · #cs.RO
- Dissecting Sensitivity to Training Language in Self-Supervised Speech Learning Using Neural Audio Codec Tokens
2026/07/28 by Daigo Takizawa, Tomohiko Nakamura, Samuele Cornell +3
Computer Science · #cs.CL #cs.SD