Multitask Learning for Fundamental Frequency Estimation in Music

2018/09/02 by Bittner, Rachel M., McFee, Brian, Bello, Juan P.
#Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Sound (cs.SD) #electronic engineering #information engineering

paper · doi:10.48550/arxiv.1809.00381

Abstract

Fundamental frequency (f0) estimation from polyphonic music includes the tasks of multiple-f0, melody, vocal, and bass line estimation. Historically these problems have been approached separately, and only recently, using learning-based approaches. We present a multitask deep learning architecture that jointly estimates outputs for various tasks including multiple-f0, melody, vocal and bass line estimation, and is trained using a large, semi-automatically annotated dataset. We show that the multitask model outperforms its single-task counterparts, and explore the effect of various design decisions in our approach, and show that it performs better or at least competitively when compared against strong baseline methods.

Related

• DEEPF0: End-To-End Fundamental Frequency Estimation for Music and Speech Signals
• Multiple F0 Estimation in Vocal Ensembles using Convolutional Neural Networks
• Polyphonic Pitch Tracking with Deep Layered Learning
• Extract fundamental frequency based on CNN combined with PYIN
• Deep-Learning Architectures for Multi-Pitch Estimation: Towards Reliable Evaluation