Mark D. Plumbley
- PANNs: Large-Scale Pretrained Audio Neural Networks for Audio Pattern Recognition
2019/12/21 by Qiuqiang Kong, Kong, Qiuqiang, Yin Cao +9 · 120 citations
Computer Science · #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Music and Audio Processing #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and Audio Processing #electronic engineering #information engineering
- AudioLDM: Text-to-Audio Generation with Latent Diffusion Models
2023/01/29 by Haohe Liu, Liu, Haohe, Zehua Chen +13 · 129 citations
Computer Science · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Multimedia (cs.MM) #Music and Audio Processing #Signal Processing (eess.SP) #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and Audio Processing #electronic engineering #information engineering
- AudioLDM 2: Learning Holistic Audio Generation with Self-supervised Pretraining
2023/08/10 by Haohe Liu, Yi Yuan, Liu, Haohe +17 · 92 citations
Computer Science · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Multimedia (cs.MM) #Music and Audio Processing #Signal Processing (eess.SP) #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and Audio Processing #electronic engineering #information engineering
- An Improved Event-Independent Network for Polyphonic Sound Event Localization and Detection
2020/10/25 by Yin Cao, Turab Iqbal, Cao, Yin +9 · 16 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · #Animal Vocal Communication and Behavior #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Music and Audio Processing #Sound (cs.SD) #Speech and Audio Processing #electronic engineering #information engineering
- Separate Anything You Describe
2023/08/09 by Xubo Liu, Qiuqiang Kong, Liu, Xubo +17 · 16 citations
Computer Science · #Speech and Audio Processing #Music and Audio Processing #Speech Recognition and Synthesis
- Separate What You Describe: Language-Queried Audio Source Separation
2022/03/28 by Xubo Liu, Liu, Xubo, Haohe Liu +13 · 11 citations
Computer Science · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Music and Audio Processing #Signal Processing (eess.SP) #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and Audio Processing #electronic engineering #information engineering
- Deep Karaoke: Extracting Vocals from Musical Mixtures Using a\n Convolutional Deep Neural Network
2015/04/17 by Andrew J. R. Simpson, Andrew Simpson, Gerard Roma +4 · 1 voice · 2 citations
Computer Science · #Music and Audio Processing #Speech Recognition and Synthesis #Speech and Audio Processing #cs.LG #cs.NE #cs.SD
- Universal Source Separation with Weakly Labelled Data
2023/05/11 by Qiuqiang Kong, Ke Chen, Kong, Qiuqiang +11 · 8 citations
Computer Science · #Speech and Audio Processing #Music and Audio Processing #Speech Recognition and Synthesis
- WavJourney: Compositional Audio Creation with Large Language Models
2023/07/26 by Xubo Liu, Liu, Xubo, Zhongkai Zhu +19 · 9 citations
Computer Science · #Music and Audio Processing #Music Technology and Sound Studies
- FlowSep: Language-Queried Sound Separation with Rectified Flow Matching
2024/09/11 by Yi Yuan, Xubo Liu, Yuan, Yi +7 · 12 citations
Computer Science · #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Music and Audio Processing #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and Audio Processing #electronic engineering #information engineering
- Audio Captioning Transformer
2021/07/21 by Xinhao Mei, Xubo Liu, Mei, Xinhao +7 · 5 citations
Computer Science · #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Music and Audio Processing #Sound (cs.SD) #Speech and Audio Processing #Video Analysis and Summarization #electronic engineering #information engineering
- Event-Independent Network for Polyphonic Sound Event Localization and Detection
2020/09/30 by Yin Cao, Turab Iqbal, Cao, Yin +9 · 4 citations
Computer Science · #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Music Technology and Sound Studies #Music and Audio Processing #Sound (cs.SD) #Speech and Audio Processing #electronic engineering #information engineering
- T-CLAP: Temporal-Enhanced Contrastive Language-Audio Pretraining
2024/04/27 by Yi Yuan, Zhuo Chen, Yuan, Yi +15 · 8 citations
Computer Science · Psychology · #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Music and Audio Processing #Phonetics and Phonology Research #Sound (cs.SD) #Speech and Audio Processing #electronic engineering #information engineering
- AudioSetCaps: An Enriched Audio-Caption Dataset using Automated Generation Pipeline with Large Audio and Language Models
2024/11/28 by Jisheng Bai, Bai, Jisheng, Haohe Liu +13 · 10 citations
Computer Science · #Music and Audio Processing #Speech Recognition and Synthesis #Speech and Audio Processing
- Sound-VECaps: Improving Audio Generation with Visual Enhanced Captions
2024/07/05 by Yi Yuan, Dongya Jia, Yuan, Yi +19 · 8 citations
Arts and Humanities · Computer Science · #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Multimedia (cs.MM) #Music and Audio Processing #Sound (cs.SD) #Subtitles and Audiovisual Media #Video Analysis and Summarization #electronic engineering #information engineering
- A Track-Wise Ensemble Event Independent Network for Polyphonic Sound Event Localization and Detection
2022/03/19 by Jinbo Hu, Yin Cao, Hu, Jinbo +11 · 4 citations
Computer Science · #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Music Technology and Sound Studies #Music and Audio Processing #Sound (cs.SD) #Speech and Audio Processing #electronic engineering #information engineering
- Description on IEEE ICME 2024 Grand Challenge: Semi-supervised Acoustic Scene Classification under Domain Shift
2024/02/05 by Jisheng Bai, Bai, Jisheng, Mou Wang +25 · 5 citations
Computer Science · #Speech and Audio Processing #Music and Audio Processing #Speech Recognition and Synthesis
- Source separation with weakly labelled data: An approach to computational auditory scene analysis
2020/02/06 by Qiuqiang Kong, Kong, Qiuqiang, Yuxuan Wang +9 · 2 citations
Computer Science · #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Music and Audio Processing #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and Audio Processing #electronic engineering #information engineering
- SyncFlow: Toward Temporally Aligned Joint Audio-Video Generation from Text
2024/12/03 by Haohe Liu, Liu, Haohe, Gaël Le Lan +17 · 6 citations
Computer Science · #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Multimedia (cs.MM) #Music Technology and Sound Studies #Music and Audio Processing #Sound (cs.SD) #Speech Recognition and Synthesis #electronic engineering #information engineering
- Convolutional Gated Recurrent Neural Network Incorporating Spatial Features for Audio Tagging
2017/02/24 by Yong Xu, Xu, Yong, Qiuqiang Kong +7 · 2 citations
Computer Science · #Digital Media Forensic Detection #FOS: Computer and information sciences #Machine Learning (cs.LG) #Music and Audio Processing #Neural and Evolutionary Computing (cs.NE) #Sound (cs.SD) #Speech and Audio Processing
- An Encoder-Decoder Based Audio Captioning System With Transfer and Reinforcement Learning
2021/08/05 by Xinhao Mei, Mei, Xinhao, Qiushi Huang +22 · 2 citations
Computer Science · #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Music and Audio Processing #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and Audio Processing #electronic engineering #information engineering
- Adapting Language-Audio Models as Few-Shot Audio Learners
2023/05/28 by Jinhua Liang, Liang, Jinhua, Xubo Liu +11 · 3 citations
Computer Science · #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Music and Audio Processing #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and Audio Processing #electronic engineering #information engineering
- Diverse Audio Captioning via Adversarial Training
2021/10/13 by Xinhao Mei, Xubo Liu, Mei, Xinhao +7 · 2 citations
Computer Science · #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Music Technology and Sound Studies #Music and Audio Processing #Sound (cs.SD) #Speech and Audio Processing #electronic engineering #information engineering
- On Metric Learning for Audio-Text Cross-Modal Retrieval
2022/03/29 by Xinhao Mei, Xubo Liu, Mei, Xinhao +7 · 2 citations
Computer Science · #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Music and Audio Processing #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and Audio Processing #electronic engineering #information engineering
- Sound Event Localization and Detection for Real Spatial Sound Scenes: Event-Independent Network and Data Augmentation Chains
2022/09/05 by Jinbo Hu, Hu, Jinbo, Yin Cao +11 · 3 citations
Computer Science · Engineering · #Acoustic Wave Phenomena Research #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Music and Audio Processing #Sound (cs.SD) #Speech and Audio Processing #electronic engineering #information engineering
- A measure of statistical complexity based on predictive information
2010/12/08 by Samer Abdallah, Mark D. Plumbley, Abdallah, Samer A. +1 · 1 citation
Physics and Astronomy · #Data Analysis #FOS: Computer and information sciences #FOS: Mathematics #FOS: Physical sciences #Information Theory (cs.IT) #Statistical Mechanics and Entropy #Statistics Theory (math.ST) #Statistics and Probability (physics.data-an)
- EnvSDD: Benchmarking Environmental Sound Deepfake Detection
2025/05/25 by Han Yin, Yang Xiao, Yin, Han +11 · 9 citations
Computer Science · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Music and Audio Processing #Sound (cs.SD) #Speech and Audio Processing #electronic engineering #information engineering
- WavCraft: Audio Editing and Generation with Large Language Models
2024/03/14 by Jinhua Liang, Huan Zhang, Liang, Jinhua +17 · 4 citations
Computer Science · #Music and Audio Processing #Speech Recognition and Synthesis
- An open dataset for research on audio field recording archives: freefield1010
2013/09/20 by Dan Stowell, Stowell, Dan, Mark D. Plumbley +1 · 1 citation
Computer Science · #Digital Libraries (cs.DL) #FOS: Computer and information sciences #Music Technology and Sound Studies #Music and Audio Processing #Sound (cs.SD) #Video Analysis and Summarization
- Conditional Sound Generation Using Neural Discrete Time-Frequency Representation Learning
2021/07/21 by Xubo Liu, Turab Iqbal, Liu, Xubo +9 · 2 citations
Computer Science · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Music Technology and Sound Studies #Music and Audio Processing #Sound (cs.SD) #Speech and Audio Processing #electronic engineering #information engineering
- E-PANNs: Sound Recognition Using Efficient Pre-trained Audio Neural Networks
2023/05/30 by Arshdeep Singh, Haohe Liu, Singh, Arshdeep +3 · 2 citations
Computer Science · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Music Technology and Sound Studies #Music and Audio Processing #Signal Processing (eess.SP) #Sound (cs.SD) #Speech and Audio Processing #electronic engineering #information engineering
- Retrieval-Augmented Text-to-Audio Generation
2023/09/14 by Yi Yuan, Haohe Liu, Yuan, Yi +9 · 3 citations
Computer Science · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Multimedia (cs.MM) #Music and Audio Processing #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and Audio Processing #electronic engineering #information engineering
- A decade of DCASE: Achievements, practices, evaluations and future challenges
2024/10/07 by Annamaria Mesaros, Mesaros, Annamaria, Serizel, Romain +6 · 4 citations
Computer Science · #Music and Audio Processing #Speech Recognition and Synthesis #Time Series Analysis and Forecasting
- Surrey-cvssp system for DCASE2017 challenge task4
2017/09/02 by Yong Xu, Qiuqiang Kong, Xu, Yong +5 · 2 citations
Computer Science · #Computational Physics and Python Applications #Time Series Analysis and Forecasting #Anomaly Detection Techniques and Applications
- PSELDNets: Pre-trained Neural Networks on a Large-scale Synthetic Dataset for Sound Event Localization and Detection
2024/11/10 by Jinbo Hu, Hu, Jinbo, Yin Cao +13 · 4 citations
Computer Science · #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Music and Audio Processing #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and Audio Processing #electronic engineering #information engineering
- Efficient CNNs via Passive Filter Pruning
2023/04/05 by Arshdeep Singh, Mark D. Plumbley, Singh, Arshdeep +1 · 2 citations
Computer Science · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Music and Audio Processing #Signal Processing (eess.SP) #Speech and Audio Processing #electronic engineering #information engineering
- ARCA23K: An audio dataset for investigating open-set label noise
2021/09/19 by Turab Iqbal, Iqbal, Turab, Yin Cao +7 · 1 citation
Computer Science · #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Music Technology and Sound Studies #Music and Audio Processing #Sound (cs.SD) #Speech and Audio Processing #electronic engineering #information engineering
- Leveraging Pre-trained BERT for Audio Captioning
2022/03/06 by Xubo Liu, Xinhao Mei, Liu, Xubo +15 · 1 citation
Computer Science · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Music and Audio Processing #Natural Language Processing Techniques #Sound (cs.SD) #Speech Recognition and Synthesis #electronic engineering #information engineering
- Surrey System for DCASE 2022 Task 5: Few-shot Bioacoustic Event Detection with Segment-level Metric Learning
2022/07/21 by Haohe Liu, Liu, Haohe, Xubo Liu +9 · 1 citation
Computer Science · Biochemistry, Genetics and Molecular Biology · #Music and Audio Processing #Speech and Audio Processing #Animal Vocal Communication and Behavior
- Learning Temporal Resolution in Spectrogram for Audio Classification
2022/10/04 by Haohe Liu, Xubo Liu, Liu, Haohe +7 · 1 citation
Computer Science · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Multimedia (cs.MM) #Music Technology and Sound Studies #Music and Audio Processing #Signal Processing (eess.SP) #Sound (cs.SD) #Speech and Audio Processing #electronic engineering #information engineering
- Simple Pooling Front-ends For Efficient Audio Classification
2022/10/03 by Xubo Liu, Haohe Liu, Liu, Xubo +9 · 1 citation
Computer Science · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Music and Audio Processing #Neural Networks and Applications #Signal Processing (eess.SP) #Sound (cs.SD) #Speech and Audio Processing #electronic engineering #information engineering
- Efficient Similarity-based Passive Filter Pruning for Compressing CNNs
2022/10/27 by Arshdeep Singh, Mark D. Plumbley, Singh, Arshdeep +1 · 1 citation
Computer Science · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Music and Audio Processing #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and Audio Processing #electronic engineering #information engineering
- Selective-Memory Meta-Learning with Environment Representations for Sound Event Localization and Detection
2023/12/27 by Jinbo Hu, Yin Cao, Hu, Jinbo +11 · 2 citations
Computer Science · Engineering · #Music and Audio Processing #Speech and Audio Processing #Acoustic Wave Phenomena Research
- Leveraging Pre-trained AudioLDM for Sound Generation: A Benchmark Study
2023/03/07 by Yi Yuan, Yuan, Yi, Haohe Liu +9 · 2 citations
Computer Science · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Multimedia (cs.MM) #Music and Audio Processing #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and Audio Processing #electronic engineering #information engineering
- AudioTurbo: Fast Text-to-Audio Generation with Rectified Diffusion
2025/05/28 by Junqi Zhao, Jinzheng Zhao, Zhao, Junqi +13 · 3 citations
Computer Science · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Generative Adversarial Networks and Image Synthesis #Music Technology and Sound Studies #Music and Audio Processing #Sound (cs.SD) #electronic engineering #information engineering
- Summary of DCASE 2026 Task 5: Audio-Dependent Question Answering
2026/07/21 by Haolin He, Renhe Sun, Zheqi Dai +16
#eess.AS