vix.ing · top · new · best · stats · spec

Sparse coding for multitask and transfer learning

2012/09/04 by Andreas Maurer, Maurer, Andreas, Massimiliano Pontil +3 · 1 citation
Computer Science · Engineering · #46N30 #68Q32 #68T05 #97C30 #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Gaussian Processes and Bayesian Inference #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Sparse and Compressive Sensing Techniques

paper · pdf · doi:10.48550/arxiv.1209.0738

openalex publication_date 2012/09/04 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

We investigate the use of sparse coding and dictionary learning in the context of multitask and transfer learning. The central assumption of our learning method is that the tasks parameters are well approximated by sparse linear combinations of the atoms of a dictionary on a high or infinite dimensional space. This assumption, together with the large quantity of available data in the multitask and transfer learning settings, allows a principled choice of the dictionary. We provide bounds on the generalization error of this approach, for both settings. Numerical experiments on one synthetic and two real datasets show the advantage of our method over single task learning, a previous method based on orthogonal and dense representation of the tasks and a related method learning task grouping.

Cited by

Related