Supervised Dictionary Learning

2008/09/18 by Julien Mairal, Mairal, Julien, Francis Bach +8 · 16 citations
Arts and Humanities · Computer Science · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Lexicography and Language Studies #Linguistics and Cultural Studies #Natural Language Processing Techniques #cs.CV

paper · pdf · doi:10.48550/arxiv.0809.3083

arxiv created 2008/09/18 · openalex publication_date 2008/09/18 · arxiv updated 2009/12/01 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

It is now well established that sparse signal models are well suited to restoration tasks and can effectively be learned from audio, image, and video data. Recent research has been aimed at learning discriminative sparse models instead of purely reconstructive ones. This paper proposes a new step in that direction, with a novel sparse representation for signals belonging to different classes in terms of a shared dictionary and multiple class-decision functions. The linear variant of the proposed model admits a simple probabilistic interpretation, while its most general variant admits an interpretation in terms of kernels. An optimization framework for learning all the components of the proposed model is presented, along with experimental results on standard handwritten digit and texture classification tasks.

Citations

• Least angle regression
• Sparse coding with an overcomplete basis set: A strategy employed by V1?
• Gradient-based learning applied to document recognition
• Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries
• rm K-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation

Cited by

• Non-Convex Self-Concordant Functions: Practical Algorithms and Complexity Analysis
• Learning Regularization Functionals for Inverse Problems: A Comparative Study
• Sparse Fine-Tuning of Transformers for Generative Tasks
• Interpretation Meets Safety: A Survey on Interpretation Methods and Tools for Improving LLM Safety
• Mechanistic Decomposition of Sentence Representations
• Local Shapley: Model-Induced Locality and Optimal Reuse in Data Valuation
• Learning Combinations of Sigmoids Through Gradient Estimation
• Supervised Dictionary Learning and Sparse Representation-A Review
• A Probabilistic Framework for Discriminative Dictionary Learning
• Online Convex Matrix Factorization with Representative Regions
• Sparse distributed localized gradient fused features of objects
• MonoLoss: A Training Objective for Interpretable Monosemantic Representations
• Linearized Kernel Dictionary Learning
• Deep Learning Meets Projective Clustering
• Discriminative Recurrent Sparse Auto-Encoders
• An improved analysis of the ER-SpUD dictionary learning algorithm

Related

• Supervised Dictionary Learning and Sparse Representation-A Review
• A Probabilistic Framework for Discriminative Dictionary Learning
• Dictionary Optimization for Block-Sparse Representations
• Separable Dictionary Learning
• Learning Sparse Adversarial Dictionaries For Multi-Class Audio Classification