2020/09/19 by Christopher Ick, Ick, Christopher, Vincent Lostanlen +1
Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Image Processing and 3D Reconstruction #Image Retrieval and Classification Techniques #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Music and Audio Processing #Sound (cs.SD)
paper · pdf · doi:10.48550/arxiv.2009.09321
openalex publication_date 2020/09/19 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28
Deep convolutional networks (convnets) show a remarkable ability to learn disentangled representations. In recent years, the generalization of deep learning to Lie groups beyond rigid motion in ℝn has allowed to build convnets over datasets with non-trivial symmetries, such as patterns over the surface of a sphere. However, one limitation of this approach is the need to explicitly define the Lie group underlying the desired invariance property before training the convnet. Whereas rotations on the sphere have a well-known symmetry group (SO(3)), the same cannot be said of many real-world factors of variability. For example, the disentanglement of pitch, intensity dynamics, and playing technique remains a challenging task in music information retrieval. This article proposes a machine learning method to discover a nonlinear transformation of the space ℝn which maps a collection of n-dimensional vectors (\boldsymbolxi)i onto a collection of target vectors (\boldsymbolyi)i. The key idea is to approximate every target \boldsymbolyi by a matrix--vector product of the form \boldsymbol\widetildeyi = \boldsymbolϕ(ti) \boldsymbolxi, where the matrix \boldsymbolϕ(ti) belongs to a one-parameter subgroup of GLn (ℝ). Crucially, the value of the parameter ti ∈ ℝ may change between data pairs (\boldsymbolxi, \boldsymbolyi) and does not need to be known in advance.