Plumbley, Mark D.
- PANNs: Large-Scale Pretrained Audio Neural Networks for Audio Pattern Recognition
2019/12/21 by Qiuqiang Kong, Kong, Qiuqiang, Yin Cao +9 · 140 citations
Computer Science · #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Music and Audio Processing #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and Audio Processing #electronic engineering #information engineering
- AudioLDM: Text-to-Audio Generation with Latent Diffusion Models
2023/01/29 by Haohe Liu, Zehua Chen, Liu, Haohe +13 · 162 citations
Computer Science · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Multimedia (cs.MM) #Music and Audio Processing #Signal Processing (eess.SP) #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and Audio Processing #electronic engineering #information engineering
- AudioLDM 2: Learning Holistic Audio Generation with Self-supervised Pretraining
2023/08/10 by Haohe Liu, Liu, Haohe, Yi Yuan +17 · 110 citations
Computer Science · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Multimedia (cs.MM) #Music and Audio Processing #Signal Processing (eess.SP) #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and Audio Processing #electronic engineering #information engineering
- An Improved Event-Independent Network for Polyphonic Sound Event Localization and Detection
2020/10/25 by Yin Cao, Cao, Yin, Turab Iqbal +9 · 17 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · #Animal Vocal Communication and Behavior #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Music and Audio Processing #Sound (cs.SD) #Speech and Audio Processing #electronic engineering #information engineering
- Separate What You Describe: Language-Queried Audio Source Separation
2022/03/28 by Xubo Liu, Haohe Liu, Liu, Xubo +13 · 19 citations
Computer Science · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Music and Audio Processing #Signal Processing (eess.SP) #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and Audio Processing #electronic engineering #information engineering
- Separate Anything You Describe
2023/08/09 by Xubo Liu, Liu, Xubo, Qiuqiang Kong +17 · 23 citations
Computer Science · #Speech and Audio Processing #Music and Audio Processing #Speech Recognition and Synthesis
- AudioSR: Versatile Audio Super-resolution at Scale
2023/09/13 by Liu, Haohe, Chen, Ke, Tian, Qiao +2 · 20 citations
#Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Multimedia (cs.MM) #Signal Processing (eess.SP) #Sound (cs.SD) #electronic engineering #information engineering
- Deep Karaoke: Extracting Vocals from Musical Mixtures Using a\n Convolutional Deep Neural Network
2015/04/17 by Andrew Simpson, Andrew J. R. Simpson, Simpson, Andrew J. R. +4 · 1 voice · 3 citations
Computer Science · #Music and Audio Processing #Speech Recognition and Synthesis #Speech and Audio Processing #cs.LG #cs.NE #cs.SD
- Universal Source Separation with Weakly Labelled Data
2023/05/11 by Qiuqiang Kong, Ke Chen, Kong, Qiuqiang +11 · 11 citations
Computer Science · #Speech and Audio Processing #Music and Audio Processing #Speech Recognition and Synthesis
- WavJourney: Compositional Audio Creation with Large Language Models
2023/07/26 by Xubo Liu, Liu, Xubo, Zhongkai Zhu +19 · 11 citations
Computer Science · #Music and Audio Processing #Music Technology and Sound Studies
- FlowSep: Language-Queried Sound Separation with Rectified Flow Matching
2024/09/11 by Yi Yuan, Yuan, Yi, Xubo Liu +7 · 17 citations
Computer Science · #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Music and Audio Processing #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and Audio Processing #electronic engineering #information engineering
- Audio Captioning Transformer
2021/07/21 by Xinhao Mei, Mei, Xinhao, Xubo Liu +7 · 7 citations
Computer Science · #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Music and Audio Processing #Sound (cs.SD) #Speech and Audio Processing #Video Analysis and Summarization #electronic engineering #information engineering
- Gender Bias in Depression Detection Using Audio Features
2020/10/28 by Bailey, Andrew, Plumbley, Mark D. · 5 citations
#Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Signal Processing (eess.SP) #Sound (cs.SD) #electronic engineering #information engineering
- T-CLAP: Temporal-Enhanced Contrastive Language-Audio Pretraining
2024/04/27 by Yi Yuan, Yuan, Yi, Zhuo Chen +15 · 10 citations
Computer Science · Psychology · #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Music and Audio Processing #Phonetics and Phonology Research #Sound (cs.SD) #Speech and Audio Processing #electronic engineering #information engineering
- Event-Independent Network for Polyphonic Sound Event Localization and Detection
2020/09/30 by Yin Cao, Cao, Yin, Turab Iqbal +9 · 4 citations
Computer Science · #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Music Technology and Sound Studies #Music and Audio Processing #Sound (cs.SD) #Speech and Audio Processing #electronic engineering #information engineering
- Sound-VECaps: Improving Audio Generation with Visual Enhanced Captions
2024/07/05 by Yi Yuan, Dongya Jia, Yuan, Yi +19 · 10 citations
Arts and Humanities · Computer Science · #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Multimedia (cs.MM) #Music and Audio Processing #Sound (cs.SD) #Subtitles and Audiovisual Media #Video Analysis and Summarization #electronic engineering #information engineering
- AudioSetCaps: An Enriched Audio-Caption Dataset using Automated Generation Pipeline with Large Audio and Language Models
2024/11/28 by Jisheng Bai, Bai, Jisheng, Haohe Liu +13 · 11 citations
Computer Science · #Music and Audio Processing #Speech Recognition and Synthesis #Speech and Audio Processing
- On Metric Learning for Audio-Text Cross-Modal Retrieval
2022/03/29 by Xinhao Mei, Mei, Xinhao, Xubo Liu +7 · 4 citations
Computer Science · #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Music and Audio Processing #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and Audio Processing #electronic engineering #information engineering
- Sound Event Detection of Weakly Labelled Data with CNN-Transformer and Automatic Threshold Optimization
2019/12/10 by Qiuqiang Kong, Kong, Qiuqiang, Yong Xu +5 · 3 citations
Computer Science · #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Music Technology and Sound Studies #Music and Audio Processing #Sound (cs.SD) #Speech and Audio Processing #electronic engineering #information engineering
- Visually-Aware Audio Captioning With Adaptive Audio-Visual Attention
2022/10/28 by Xubo Liu, Liu, Xubo, Qiushi Huang +23 · 4 citations
Arts and Humanities · Computer Science · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Multimedia (cs.MM) #Music and Audio Processing #Sound (cs.SD) #Subtitles and Audiovisual Media #Video Analysis and Summarization #electronic engineering #information engineering
- An open dataset for research on audio field recording archives: freefield1010
2013/09/20 by Dan Stowell, Mark D. Plumbley, Stowell, Dan +1 · 2 citations
Computer Science · #Digital Libraries (cs.DL) #FOS: Computer and information sciences #Music Technology and Sound Studies #Music and Audio Processing #Sound (cs.SD) #Video Analysis and Summarization
- A Track-Wise Ensemble Event Independent Network for Polyphonic Sound Event Localization and Detection
2022/03/19 by Jinbo Hu, Hu, Jinbo, Yin Cao +11 · 4 citations
Computer Science · #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Music Technology and Sound Studies #Music and Audio Processing #Sound (cs.SD) #Speech and Audio Processing #electronic engineering #information engineering
- Description on IEEE ICME 2024 Grand Challenge: Semi-supervised Acoustic Scene Classification under Domain Shift
2024/02/05 by Jisheng Bai, Mou Wang, Bai, Jisheng +25 · 5 citations
Computer Science · #Speech and Audio Processing #Music and Audio Processing #Speech Recognition and Synthesis
- Convolutional Gated Recurrent Neural Network Incorporating Spatial Features for Audio Tagging
2017/02/24 by Yong Xu, Xu, Yong, Qiuqiang Kong +7 · 4 citations
Computer Science · #Digital Media Forensic Detection #FOS: Computer and information sciences #Machine Learning (cs.LG) #Music and Audio Processing #Neural and Evolutionary Computing (cs.NE) #Sound (cs.SD) #Speech and Audio Processing
- Retrieval-Augmented Text-to-Audio Generation
2023/09/14 by Yi Yuan, Yuan, Yi, Haohe Liu +9 · 5 citations
Computer Science · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Multimedia (cs.MM) #Music and Audio Processing #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and Audio Processing #electronic engineering #information engineering
- WavCraft: Audio Editing and Generation with Large Language Models
2024/03/14 by Jinhua Liang, Huan Zhang, Liang, Jinhua +17 · 6 citations
Computer Science · #Music and Audio Processing #Speech Recognition and Synthesis
- Source separation with weakly labelled data: An approach to computational auditory scene analysis
2020/02/06 by Qiuqiang Kong, Yuxuan Wang, Kong, Qiuqiang +9 · 2 citations
Computer Science · #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Music and Audio Processing #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and Audio Processing #electronic engineering #information engineering
- SyncFlow: Toward Temporally Aligned Joint Audio-Video Generation from Text
2024/12/03 by Haohe Liu, Gaël Le Lan, Liu, Haohe +17 · 6 citations
Computer Science · #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Multimedia (cs.MM) #Music Technology and Sound Studies #Music and Audio Processing #Sound (cs.SD) #Speech Recognition and Synthesis #electronic engineering #information engineering
- An Encoder-Decoder Based Audio Captioning System With Transfer and Reinforcement Learning
2021/08/05 by Xinhao Mei, Mei, Xinhao, Qiushi Huang +22 · 2 citations
Computer Science · #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Music and Audio Processing #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and Audio Processing #electronic engineering #information engineering
- Adapting Language-Audio Models as Few-Shot Audio Learners
2023/05/28 by Jinhua Liang, Liang, Jinhua, Xubo Liu +11 · 3 citations
Computer Science · #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Music and Audio Processing #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and Audio Processing #electronic engineering #information engineering
- Diverse Audio Captioning via Adversarial Training
2021/10/13 by Xinhao Mei, Xubo Liu, Mei, Xinhao +7 · 2 citations
Computer Science · #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Music Technology and Sound Studies #Music and Audio Processing #Sound (cs.SD) #Speech and Audio Processing #electronic engineering #information engineering
- ARCA23K: An audio dataset for investigating open-set label noise
2021/09/19 by Turab Iqbal, Iqbal, Turab, Yin Cao +7 · 2 citations
Computer Science · #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Music Technology and Sound Studies #Music and Audio Processing #Sound (cs.SD) #Speech and Audio Processing #electronic engineering #information engineering
- Sound Event Localization and Detection for Real Spatial Sound Scenes: Event-Independent Network and Data Augmentation Chains
2022/09/05 by Jinbo Hu, Hu, Jinbo, Yin Cao +11 · 3 citations
Computer Science · Engineering · #Acoustic Wave Phenomena Research #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Music and Audio Processing #Sound (cs.SD) #Speech and Audio Processing #electronic engineering #information engineering
- Leveraging Pre-trained BERT for Audio Captioning
2022/03/06 by Xubo Liu, Liu, Xubo, Xinhao Mei +15 · 2 citations
Computer Science · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Music and Audio Processing #Natural Language Processing Techniques #Sound (cs.SD) #Speech Recognition and Synthesis #electronic engineering #information engineering
- A decade of DCASE: Achievements, practices, evaluations and future challenges
2024/10/07 by Annamaria Mesaros, Mesaros, Annamaria, Serizel, Romain +6 · 6 citations
Computer Science · #Music and Audio Processing #Speech Recognition and Synthesis #Time Series Analysis and Forecasting
- A measure of statistical complexity based on predictive information
2010/12/08 by Samer Abdallah, Abdallah, Samer A., Mark D. Plumbley +1 · 1 citation
Physics and Astronomy · #Data Analysis #FOS: Computer and information sciences #FOS: Mathematics #FOS: Physical sciences #Information Theory (cs.IT) #Statistical Mechanics and Entropy #Statistics Theory (math.ST) #Statistics and Probability (physics.data-an)
- Surrey-cvssp system for DCASE2017 challenge task4
2017/09/02 by Yong Xu, Qiuqiang Kong, Xu, Yong +5 · 3 citations
Computer Science · #Computational Physics and Python Applications #Time Series Analysis and Forecasting #Anomaly Detection Techniques and Applications
- Conditional Sound Generation Using Neural Discrete Time-Frequency Representation Learning
2021/07/21 by Xubo Liu, Turab Iqbal, Liu, Xubo +9 · 2 citations
Computer Science · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Music Technology and Sound Studies #Music and Audio Processing #Sound (cs.SD) #Speech and Audio Processing #electronic engineering #information engineering
- E-PANNs: Sound Recognition Using Efficient Pre-trained Audio Neural Networks
2023/05/30 by Arshdeep Singh, Singh, Arshdeep, Haohe Liu +3 · 2 citations
Computer Science · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Music Technology and Sound Studies #Music and Audio Processing #Signal Processing (eess.SP) #Sound (cs.SD) #Speech and Audio Processing #electronic engineering #information engineering
- Large-scale weakly supervised audio classification using gated convolutional neural network
2017/10/01 by Yong Xu, Qiuqiang Kong, Xu, Yong +5 · 1 citation
Computer Science · #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Music and Audio Processing #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and Audio Processing #electronic engineering #information engineering
- Continual Learning For On-Device Environmental Sound Classification
2022/07/15 by Xiao Yang, Xubo Liu, Xiao, Yang +11 · 2 citations
Computer Science · Earth and Planetary Sciences · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Music and Audio Processing #Sound (cs.SD) #Speech and Audio Processing #Underwater Acoustics Research #electronic engineering #information engineering
- Leveraging Pre-trained AudioLDM for Sound Generation: A Benchmark Study
2023/03/07 by Yi Yuan, Yuan, Yi, Haohe Liu +9 · 3 citations
Computer Science · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Multimedia (cs.MM) #Music and Audio Processing #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and Audio Processing #electronic engineering #information engineering
- PSELDNets: Pre-trained Neural Networks on a Large-scale Synthetic Dataset for Sound Event Localization and Detection
2024/11/10 by Jinbo Hu, Yin Cao, Hu, Jinbo +13 · 4 citations
Computer Science · #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Music and Audio Processing #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and Audio Processing #electronic engineering #information engineering
- Efficient CNNs via Passive Filter Pruning
2023/04/05 by Arshdeep Singh, Singh, Arshdeep, Mark D. Plumbley +1 · 2 citations
Computer Science · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Music and Audio Processing #Signal Processing (eess.SP) #Speech and Audio Processing #electronic engineering #information engineering
- Federated Learning With Highly Imbalanced Audio Data
2021/05/18 by Marc C. Green, Green, Marc C., Mark D. Plumbley +1 · 1 citation
Computer Science · #Advanced Steganography and Watermarking Techniques #Audio and Speech Processing (eess.AS) #Digital Media Forensic Detection #FOS: Computer and information sciences #FOS: Electrical engineering #Music and Audio Processing #Sound (cs.SD) #electronic engineering #information engineering
- Text-Driven Foley Sound Generation With Latent Diffusion Model
2023/06/17 by Yuan, Yi, Liu, Haohe, Liu, Xubo +4 · 2 citations
#Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Sound (cs.SD) #electronic engineering #information engineering
- Surrey System for DCASE 2022 Task 5: Few-shot Bioacoustic Event Detection with Segment-level Metric Learning
2022/07/21 by Haohe Liu, Xubo Liu, Liu, Haohe +9 · 1 citation
Computer Science · Biochemistry, Genetics and Molecular Biology · #Music and Audio Processing #Speech and Audio Processing #Animal Vocal Communication and Behavior
- Learning Temporal Resolution in Spectrogram for Audio Classification
2022/10/04 by Haohe Liu, Xubo Liu, Liu, Haohe +7 · 1 citation
Computer Science · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Multimedia (cs.MM) #Music Technology and Sound Studies #Music and Audio Processing #Signal Processing (eess.SP) #Sound (cs.SD) #Speech and Audio Processing #electronic engineering #information engineering
- Simple Pooling Front-ends For Efficient Audio Classification
2022/10/03 by Xubo Liu, Liu, Xubo, Haohe Liu +9 · 1 citation
Computer Science · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Music and Audio Processing #Neural Networks and Applications #Signal Processing (eess.SP) #Sound (cs.SD) #Speech and Audio Processing #electronic engineering #information engineering
- Efficient Similarity-based Passive Filter Pruning for Compressing CNNs
2022/10/27 by Arshdeep Singh, Singh, Arshdeep, Mark D. Plumbley +1 · 1 citation
Computer Science · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Music and Audio Processing #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and Audio Processing #electronic engineering #information engineering
- Selective-Memory Meta-Learning with Environment Representations for Sound Event Localization and Detection
2023/12/27 by Jinbo Hu, Yin Cao, Hu, Jinbo +11 · 2 citations
Computer Science · Engineering · #Music and Audio Processing #Speech and Audio Processing #Acoustic Wave Phenomena Research
- Universal Sound Separation with Self-Supervised Audio Masked Autoencoder
2024/07/16 by Junqi Zhao, Zhao, Junqi, Xubo Liu +11 · 1 citation
Computer Science · #Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Music and Audio Processing #Sound (cs.SD) #Speech Recognition and Synthesis #Speech and Audio Processing #electronic engineering #information engineering