Pan, Jiahao
- Spark-TTS: An Efficient LLM-Based Text-to-Speech Model with Single-Stream Decoupled Speech Tokens
2025/03/03 by Xinsheng Wang, Mingqi Jiang, Ming Jiang +49 · 2 voices · 84 citations
Computer Science · Engineering · #Natural Language Processing Techniques #Speech Recognition and Synthesis #Speech and dialogue systems #cs.AI #cs.SD #eess.AS
- Codec Does Matter: Exploring the Semantic Shortcoming of Codec for Audio Language Model
2024/08/30 by Zhen Ye, Peiwen Sun, Ye, Zhen +21 · 46 citations
Computer Science · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Music and Audio Processing #Sound (cs.SD) #Speech Recognition and Synthesis #electronic engineering #information engineering
- YuE: Scaling Open Foundation Models for Long-Form Music Generation
2025/03/11 by Ruibin Yuan, Yuan, Ruibin, Lin, Hanfeng +110 · 35 citations
Computer Science · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #Computer Graphics and Visualization Techniques #FOS: Computer and information sciences #FOS: Electrical engineering #Multimedia (cs.MM) #Music Technology and Sound Studies #Music and Audio Processing #Sound (cs.SD) #electronic engineering #information engineering
- ComposerX: Multi-Agent Symbolic Music Composition with LLMs
2024/04/28 by Qixin Deng, Qikai Yang, Deng, Qixin +35 · 15 citations
Computer Science · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Multimedia (cs.MM) #Music Technology and Sound Studies #Music and Audio Processing #Sound (cs.SD) #electronic engineering #information engineering
- LyricWhiz: Robust Multilingual Zero-shot Lyrics Transcription by Whispering to ChatGPT
2023/06/29 by Le Zhuo, Zhuo, Le, Ruibin Yuan +23 · 8 citations
Arts and Humanities · Computer Science · #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #Diverse Musicological Studies #FOS: Computer and information sciences #FOS: Electrical engineering #Music and Audio Processing #Sound (cs.SD) #Speech Recognition and Synthesis #electronic engineering #information engineering
- VidMuse: A Simple Video-to-Music Generation Framework with Long-Short-Term Modeling
2024/06/06 by Zeyue Tian, Zhaoyang Liu, Tian, Zeyue +15 · 10 citations
Computer Science · Social Sciences · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimedia (cs.MM) #Multimedia Communication and Technology #Music Technology and Sound Studies #Music and Audio Processing #Sound (cs.SD)
- Weakly-Supervised Emotion Transition Learning for Diverse 3D Co-speech Gesture Generation
2023/11/29 by Xingqun Qi, Qi, Xingqun, Jiahao Pan +19 · 6 citations
Computer Science · Psychology · #Hand Gesture Recognition Systems #Speech and dialogue systems #Emotion and Mood Recognition
- FlashSpeech: Efficient Zero-Shot Speech Synthesis
2024/04/23 by Zhen Ye, Ye, Zhen, Zeqian Ju +23 · 6 citations
Computer Science · #Speech Recognition and Synthesis #Speech and Audio Processing
- CoCoGesture: Toward Coherent Co-speech 3D Gesture Generation in the Wild
2024/05/27 by Xingqun Qi, Qi, Xingqun, Hengyuan Zhang +23 · 2 citations
Computer Science · Engineering · #Hand Gesture Recognition Systems #Human Motion and Animation #Robotics and Automated Systems
- Co3Gesture: Towards Coherent Concurrent Co-speech 3D Gesture Generation with Interactive Diffusion
2025/05/03 by Xingqun Qi, Qi, Xingqun, Yatian Wang +15 · 4 citations
Computer Science · Engineering · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Hand Gesture Recognition Systems #Human Motion and Animation #Human Pose and Action Recognition
- MMTrail: A Multimodal Trailer Video Dataset with Language and Music Descriptions
2024/07/30 by Xiaowei Chi, Yatian Wang, Chi, Xiaowei +35 · 1 citation
Arts and Humanities · Computer Science · #Audio and Speech Processing (eess.AS) #Computer Vision and Pattern Recognition (cs.CV) #Diverse Musicological Studies #FOS: Computer and information sciences #FOS: Electrical engineering #Multimedia (cs.MM) #Music and Audio Processing #Sound (cs.SD) #electronic engineering #information engineering
- Atomic cluster expansion interatomic potential for defects and thermodynamics of Cu-W system
2024/07/01 by Pan, Jiahao, Cheng, Huiqun, Yan, Gaosheng +3 · 1 citation
#FOS: Physical sciences #Materials Science (cond-mat.mtrl-sci)