Xia, Gus
- MERT: Acoustic Music Understanding Model with Large-Scale Self-supervised Training
2023/05/31 by Yizhi Li, Li, Yizhi, Ruibin Yuan +35 · 74 citations
Computer Science · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Music Technology and Sound Studies #Music and Audio Processing #Sound (cs.SD) #Speech Recognition and Synthesis #electronic engineering #information engineering
- ChatMusician: Understanding and Generating Music Intrinsically with LLM
2024/02/25 by Ruibin Yuan, Yuan, Ruibin, Y. F. Wang +66 · 24 citations
Computer Science · Decision Sciences · Materials Science · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Machine Learning in Materials Science #Multimedia (cs.MM) #Scientific Computing and Data Management #Sound (cs.SD) #Topic Modeling #electronic engineering #information engineering
- MARBLE: Music Audio Representation Benchmark for Universal Evaluation
2023/06/18 by Ruibin Yuan, Yinghao Ma, Yuan, Ruibin +46 · 14 citations
Computer Science · Arts and Humanities · #Music and Audio Processing #Diverse Musicological Studies #Music Technology and Sound Studies
- Beat Transformer: Demixed Beat and Downbeat Tracking with Dilated Self-Attention
2022/09/15 by Jingwei Zhao, Gus Xia, Zhao, Jingwei +3 · 10 citations
Computer Science · #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Music Technology and Sound Studies #Music and Audio Processing #Sound (cs.SD) #Speech and Audio Processing #electronic engineering #information engineering
- YuE: Scaling Open Foundation Models for Long-Form Music Generation
2025/03/11 by Ruibin Yuan, Yuan, Ruibin, Lin, Hanfeng +110 · 31 citations
Computer Science · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #Computer Graphics and Visualization Techniques #FOS: Computer and information sciences #FOS: Electrical engineering #Multimedia (cs.MM) #Music Technology and Sound Studies #Music and Audio Processing #Sound (cs.SD) #electronic engineering #information engineering
- Polyffusion: A Diffusion Model for Polyphonic Score Generation with Internal and External Controls
2023/07/19 by Lejun Min, Junyan Jiang, Min, Lejun +5 · 9 citations
Computer Science · Neuroscience · #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Music Technology and Sound Studies #Music and Audio Processing #Neuroscience and Music Perception #Sound (cs.SD) #electronic engineering #information engineering
- MusicMagus: Zero-Shot Text-to-Music Editing via Diffusion Models
2024/02/09 by Yixiao Zhang, Yukara Ikemiya, Zhang, Yixiao +13 · 11 citations
Computer Science · #Music and Audio Processing #Music Technology and Sound Studies #Speech Recognition and Synthesis
- MuPT: A Generative Symbolic Music Pretrained Transformer
2024/04/09 by Xingwei Qu, Yuelin Bai, Qu, Xingwei +53 · 12 citations
Computer Science · Neuroscience · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Music Technology and Sound Studies #Music and Audio Processing #Neuroscience and Music Perception #Sound (cs.SD) #electronic engineering #information engineering
- Foundation Models for Music: A Survey
2024/08/26 by Yinghao Ma, Anders Øland, Ma, Yinghao +81 · 13 citations
Computer Science · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Music Technology and Sound Studies #Sound (cs.SD) #electronic engineering #information engineering
- CLaMP 3: Universal Music Information Retrieval Across Unaligned Modalities and Unseen Languages
2025/02/14 by Shangda Wu, Zhancheng Guo, Wu, Shangda +17 · 15 citations
Computer Science · Arts and Humanities · #Music and Audio Processing #Diverse Musicological Studies #Music Technology and Sound Studies
- Deep Music Analogy Via Latent Representation Disentanglement
2019/06/09 by Ruihan Yang, Yang, Ruihan, Dingsu Wang +9 · 4 citations
Computer Science · #Audio and Speech Processing (eess.AS) #Digital Media Forensic Detection #FOS: Computer and information sciences #FOS: Electrical engineering #Generative Adversarial Networks and Image Synthesis #Information Retrieval (cs.IR) #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Music and Audio Processing #Sound (cs.SD) #electronic engineering #information engineering
- A Unified Model for Zero-shot Music Source Separation, Transcription and Synthesis
2021/08/07 by Liwei Lin, Lin, Liwei, Qiuqiang Kong +5 · 4 citations
Computer Science · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Music Technology and Sound Studies #Music and Audio Processing #Sound (cs.SD) #Speech and Audio Processing #electronic engineering #information engineering
- Content-based Controls For Music Large Language Modeling
2023/10/26 by Liwei Lin, Lin, Liwei, Gus Xia +5 · 7 citations
Computer Science · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Music Technology and Sound Studies #Music and Audio Processing #Sound (cs.SD) #Speech Recognition and Synthesis #electronic engineering #information engineering
- Instruct-MusicGen: Unlocking Text-to-Music Editing for Music Language Models via Instruction Tuning
2024/05/28 by Zhang, Yixiao, Ikemiya, Yukara, Choi, Woosung +7 · 8 citations
#Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Multimedia (cs.MM) #Sound (cs.SD) #electronic engineering #information engineering
- Whole-Song Hierarchical Generation of Symbolic Music Using Cascaded Diffusion Models
2024/05/16 by Ziyu Wang, Lejun Min, Wang, Ziyu +3 · 8 citations
Computer Science · Neuroscience · #Music and Audio Processing #Music Technology and Sound Studies #Neuroscience and Music Perception
- AccoMontage: Accompaniment Arrangement via Phrase Selection and Style Transfer
2021/08/25 by Jingwei Zhao, Gus Xia, Zhao, Jingwei +1 · 3 citations
Computer Science · #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Information Retrieval (cs.IR) #Multimedia (cs.MM) #Natural Language Processing Techniques #Sound (cs.SD) #Speech Recognition and Synthesis #Topic Modeling #electronic engineering #information engineering
- Arrange, Inpaint, and Refine: Steerable Long-term Music Audio Generation and Editing via Content-based Controls
2024/02/14 by Liwei Lin, Gus Xia, Lin, Liwei +5 · 5 citations
Computer Science · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Music Technology and Sound Studies #Music and Audio Processing #Sound (cs.SD) #electronic engineering #information engineering
- Music for All: Representational Bias and Cross-Cultural Adaptability of Music Generation Models
2025/02/11 by Atharva Mehta, Shivam Chauhan, Mehta, Atharva +9 · 1 voice · 7 citations
Computer Science · #Music Technology and Sound Studies #cs.AI #cs.CL #cs.LG #cs.MM #cs.SD
- Loop Copilot: Conducting AI Ensembles for Music Generation and Iterative Editing
2023/10/19 by Yixiao Zhang, Zhang, Yixiao, Akira Maezawa +7 · 3 citations
Computer Science · #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Human-Computer Interaction (cs.HC) #Innovative Human-Technology Interaction #Machine Learning (cs.LG) #Music Technology and Sound Studies #Music and Audio Processing #Sound (cs.SD) #electronic engineering #information engineering
- Learning Hierarchical Metrical Structure Beyond Measures
2022/09/21 by Junyan Jiang, Daniel Chin, Jiang, Junyan +5 · 2 citations
Arts and Humanities · Computer Science · #Audio and Speech Processing (eess.AS) #Diverse Musicological Studies #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Music Technology and Sound Studies #Music and Audio Processing #Sound (cs.SD) #electronic engineering #information engineering
- Human-Centered LLM-Agent User Interface: A Position Paper
2024/05/19 by Daniel J. Chin, Chin, Daniel, Yuxuan Wang +3 · 3 citations
Computer Science · #Multi-Agent Systems and Negotiation #Semantic Web and Ontologies
- Melodic Phrase Segmentation By Deep Neural Networks
2018/11/14 by Yixing Guan, Guan, Yixing, Jinyu Zhao +7 · 1 citation
Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Music and Audio Processing #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and Audio Processing
- Interpreting Song Lyrics with an Audio-Informed Pre-trained Language Model
2022/08/24 by Yixiao Zhang, Zhang, Yixiao, Junyan Jiang +5 · 1 citation
Arts and Humanities · Computer Science · #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #Diverse Musicological Studies #FOS: Computer and information sciences #FOS: Electrical engineering #Music Technology and Sound Studies #Music and Audio Processing #Sound (cs.SD) #electronic engineering #information engineering
- AccoMontage2: A Complete Harmonization and Accompaniment Arrangement System
2022/09/01 by Yi, Li, Hu, Haochen, Zhao, Jingwei +1 · 1 citation
#Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Information Retrieval (cs.IR) #Multimedia (cs.MM) #Sound (cs.SD) #electronic engineering #information engineering
- Learning Interpretable Low-dimensional Representation via Physical Symmetry
2023/02/05 by Xuanjie Liu, Daniel Chin, Liu, Xuanjie +5 · 1 citation
Computer Science · Neuroscience · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Music Technology and Sound Studies #Music and Audio Processing #Neuroscience and Music Perception
- Structured Multi-Track Accompaniment Arrangement via Style Prior Modelling
2023/10/25 by Jingwei Zhao, Gus Xia, Zhao, Jingwei +4 · 2 citations
Computer Science · Engineering · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Modular Robots and Swarm Intelligence #Multimedia (cs.MM) #Music Technology and Sound Studies #Music and Audio Processing #Sound (cs.SD) #electronic engineering #information engineering
- Calliffusion: Chinese Calligraphy Generation and Style Transfer with Diffusion Modeling
2023/05/30 by Qisheng Liao, Gus Xia, Liao, Qisheng +3 · 1 citation
Computer Science · Engineering · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Human Motion and Animation
- On the Effectiveness of Speech Self-supervised Learning for Music
2023/07/11 by Yinghao Ma, Ruibin Yuan, Ma, Yinghao +27 · 1 citation
Computer Science · #Music and Audio Processing #Speech Recognition and Synthesis #Music Technology and Sound Studies
- CalliPaint: Chinese Calligraphy Inpainting with Diffusion Model
2023/12/03 by Liao, Qisheng, Wang, Zhinuo, Abdul-Mageed, Muhammad +1 · 1 citation
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences
- CalliffusionV2: Personalized Natural Calligraphy Generation with Flexible Multi-modal Control
2024/10/03 by Qisheng Liao, Liang Li, Liao, Qisheng +4 · 1 citation
Computer Science · Engineering · #Advanced Image and Video Retrieval Techniques #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Human Motion and Animation #Multimedia (cs.MM) #Multimodal Machine Learning Applications
- Exploring GPT's Ability as a Judge in Music Understanding
2025/01/22 by Ziyu Wang, Fang, Kun, Gus Xia +4 · 1 citation
Computer Science · Decision Sciences · #Audio and Speech Processing (eess.AS) #Diverse Interdisciplinary Research Innovations #FOS: Computer and information sciences #FOS: Electrical engineering #Information Retrieval (cs.IR) #Online Learning and Analytics #Sound (cs.SD) #electronic engineering #information engineering