2021/01/01 by Yuan Gong, Yu-An Chung, James Glass
Computer Science · Engineering · #Artificial intelligence #Computer science #Computer vision #Machine learning #Music and Audio Processing #Range (aeronautics) #Sampling (signal processing) #Speech Recognition and Synthesis #Speech and Audio Processing #Training set #cs.LG #cs.SD #eess.AS
paper · pdf · doi:10.1109/taslp.2021.3120633
published as in IEEE/ACM Transactions on Audio, Speech, and Language Processing, vol. 29, pp. 3292-3306, 2021 · Published in IEEE/ACM Transactions on Audio Speech and Language Processing. Code at https://github.com/YuanGongND/psla
openalex publication_date 2021/01/01 · arxiv created 2021/11/17 · arxiv updated 2021/11/18 · openalex created_date 2025/10/10 · openalex updated_date 2026/08/05
Audio tagging is an active research area and has a wide range of applications. Since the release of AudioSet, great progress has been made in advancing model performance, which mostly comes from the development of novel model architectures and attention modules. However, we find that appropriate training techniques are equally important for building audio tagging models with AudioSet, but have not received the attention they deserve. To fill the gap, in this work, we present PSLA, a collection of training techniques that can noticeably boost the model accuracy including ImageNet pretraining, balanced sampling, data augmentation, label enhancement, model aggregation and their design choices. By training an EfficientNet with these techniques, we obtain a single model (with 13.6M parameters) and an ensemble model that achieve mean average precision (mAP) scores of 0.444 and 0.474 on AudioSet, respectively, outperforming the previous best system of 0.439 with 81M parameters. In addition, our model also achieves a new state-of-the-art mAP of 0.567 on FSD50K.