Supervised Dictionary Learning
Julien Mairal, Francis Bach, Jean Ponce et al. · arXiv (Cornell University) · 2008
It is now well established that sparse signal models are well suited to restoration tasks and can effectively be learned from audio, image, and video data. Recent research has been aimed at learning discriminative sparse models instead of purely reconstructive ones. This paper proposes a new step in that direction, with a novel sparse representation for signals belonging to different classes in terms of a shared dictionary and multiple class-decision functions. The linear variant of the proposed model admits a simple probabilistic interpretation, while its most general variant admits an interpretation in terms of kernels. An optimization framework for learning all the components of the proposed model is presented, along with experimental results on standard handwritten digit and texture classification tasks.
Cited by 938 works. doi:10.48550/arxiv.0809.3083 Open-access PDF
Authors
References
- Gradient-based learning applied to document recognition
- Least angle regression
- Sparse coding with an overcomplete basis set: A strategy employed by V1?
- $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation
- Efficient Learning of Sparse Representations with an Energy-Based Model
- Robust Face Recognition via Sparse Representation
- Image Denoising Via Sparse and Redundant Representations Over Learned Dictionaries
- Self-taught learning
- Learning a Nonlinear Embedding by Preserving Class Neighbourhood Structure
- Object categorization by learned universal visual dictionary