Xinhao Mei
- AudioLDM: Text-to-Audio Generation with Latent Diffusion Models
2023/01/29 by Haohe Liu, Liu, Haohe, Zehua Chen +13 · 121 citations
Computer Science · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Multimedia (cs.MM) #Music and Audio Processing #Signal Processing (eess.SP) #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and Audio Processing #electronic engineering #information engineering
- AudioLDM 2: Learning Holistic Audio Generation with Self-supervised Pretraining
2023/08/10 by Haohe Liu, Yi Yuan, Liu, Haohe +17 · 85 citations
Computer Science · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Multimedia (cs.MM) #Music and Audio Processing #Signal Processing (eess.SP) #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and Audio Processing #electronic engineering #information engineering
- Separate What You Describe: Language-Queried Audio Source Separation
2022/03/28 by Xubo Liu, Haohe Liu, Liu, Xubo +13 · 11 citations
Computer Science · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Music and Audio Processing #Signal Processing (eess.SP) #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and Audio Processing #electronic engineering #information engineering
- FoleyGen: Visually-Guided Audio Generation
2023/09/19 by Xinhao Mei, Varun Nagaraja, Mei, Xinhao +11 · 10 citations
Computer Science · #Speech and Audio Processing #Music and Audio Processing #Generative Adversarial Networks and Image Synthesis
- Audio Captioning Transformer
2021/07/21 by Xinhao Mei, Mei, Xinhao, Xubo Liu +7 · 5 citations
Computer Science · #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Music and Audio Processing #Sound (cs.SD) #Speech and Audio Processing #Video Analysis and Summarization #electronic engineering #information engineering
- SyncFlow: Toward Temporally Aligned Joint Audio-Video Generation from Text
2024/12/03 by Haohe Liu, Gaël Le Lan, Liu, Haohe +17 · 6 citations
Computer Science · #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Multimedia (cs.MM) #Music Technology and Sound Studies #Music and Audio Processing #Sound (cs.SD) #Speech Recognition and Synthesis #electronic engineering #information engineering
- Diverse Audio Captioning via Adversarial Training
2021/10/13 by Xinhao Mei, Xubo Liu, Mei, Xinhao +7 · 2 citations
Computer Science · #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Music Technology and Sound Studies #Music and Audio Processing #Sound (cs.SD) #Speech and Audio Processing #electronic engineering #information engineering
- First-Shot Unsupervised Anomalous Sound Detection With Unknown Anomalies Estimated by Metadata-Assisted Audio Generation
2023/10/22 by Hejing Zhang, Zhang, Hejing, Qiaoxi Zhu +15 · 3 citations
Computer Science · #Music and Audio Processing #Anomaly Detection Techniques and Applications #Speech and Audio Processing
- On Metric Learning for Audio-Text Cross-Modal Retrieval
2022/03/29 by Xinhao Mei, Xubo Liu, Mei, Xinhao +7 · 2 citations
Computer Science · #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Music and Audio Processing #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and Audio Processing #electronic engineering #information engineering
- An Encoder-Decoder Based Audio Captioning System With Transfer and Reinforcement Learning
2021/08/05 by Xinhao Mei, Mei, Xinhao, Qiushi Huang +22 · 1 citation
Computer Science · #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Music and Audio Processing #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and Audio Processing #electronic engineering #information engineering
- Leveraging Pre-trained BERT for Audio Captioning
2022/03/06 by Xubo Liu, Xinhao Mei, Liu, Xubo +15 · 1 citation
Computer Science · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Music and Audio Processing #Natural Language Processing Techniques #Sound (cs.SD) #Speech Recognition and Synthesis #electronic engineering #information engineering
- Surrey System for DCASE 2022 Task 5: Few-shot Bioacoustic Event Detection with Segment-level Metric Learning
2022/07/21 by Haohe Liu, Xubo Liu, Liu, Haohe +9 · 1 citation
Computer Science · Biochemistry, Genetics and Molecular Biology · #Music and Audio Processing #Speech and Audio Processing #Animal Vocal Communication and Behavior
- Simple Pooling Front-ends For Efficient Audio Classification
2022/10/03 by Xubo Liu, Liu, Xubo, Haohe Liu +9 · 1 citation
Computer Science · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Music and Audio Processing #Neural Networks and Applications #Signal Processing (eess.SP) #Sound (cs.SD) #Speech and Audio Processing #electronic engineering #information engineering
- Enhance audio generation controllability through representation similarity regularization
2023/09/15 by Yangyang Shi, Gaël Le Lan, Shi, Yangyang +15 · 1 citation
Computer Science · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Music and Audio Processing #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and Audio Processing #electronic engineering #information engineering