ML p(r)ior | Trainlets: Dictionary Learning in High Dimensions

Trainlets: Dictionary Learning in High Dimensions

2016-01-31
Sparse representations has shown to be a very powerful model for real world signals, and has enabled the development of applications with notable performance. Combined with the ability to learn a dictionary from signal examples, sparsity-inspired algorithms are often achieving state-of-the-art results in a wide variety of tasks. Yet, these methods have traditionally been restricted to small dimensions mainly due to the computational constraints that the dictionary learning problem entails. In the context of image processing, this implies handling small image patches. In this work we show how to efficiently handle bigger dimensions and go beyond the small patches in sparsity-based signal and image processing methods. We build our approach based on a new cropped wavelet decomposition, which enables a multi-scale analysis with virtually no border effects. We then employ this as the base dictionary within a double sparsity model to enable the training of adaptive dictionaries. To cope with the increase of training data, while at the same time improving the training performance, we present an Online Sparse Dictionary Learning (OSDL) algorithm to train this model effectively, enabling it to handle millions of examples. This work shows that dictionary learning can be up-scaled to tackle a new level of signal dimensions, obtaining large adaptable atoms that we call trainlets.
PDF

Highlights - Most important sentences from the article

Login to like/save this paper, take notes and configure your recommendations

Related Articles

2016-10-27
1610.08606 | cs.CV

Despite the fact that different objects possess distinct class-specific features, they also usually … show more
PDF

Highlights - Most important sentences from the article

2016-01-31
1602.00310 | cs.CV

Despite the fact that different objects possess distinct class-specific features, they also usually … show more
PDF

Highlights - Most important sentences from the article

2017-01-04
1701.01000 | cs.LG

This paper considers the problem of simultaneously learning the Sensing Matrix and Sparsifying Dicti… show more
PDF

Highlights - Most important sentences from the article

2018-11-01

The Convolutional Sparse Coding (CSC) model has recently gained considerable traction in the signal … show more
PDF

Highlights - Most important sentences from the article

2017-05-09

Convolutional Sparse Coding (CSC) is an increasingly popular model in the signal and image processin… show more
PDF

Highlights - Most important sentences from the article

2018-12-04

In the last decade, traditional dictionary learning methods have been successfully applied to variou… show more
PDF

Highlights - Most important sentences from the article

2018-12-26
1812.10538 | eess.IV

Sparse coding techniques for image processing traditionally rely on a processing of small overlappin… show more
PDF

Highlights - Most important sentences from the article

2019-04-15
1904.06968 | cs.LG

In this letter, we propose a novel computationally efficient coupled dictionary learning method that… show more
PDF

Highlights - Most important sentences from the article

2015-11-16

Sparse representations using data dictionaries provide an efficient model particularly for signals t… show more
PDF

Highlights - Most important sentences from the article

2017-03-07

A method for online tensor dictionary learning is proposed. With the assumption of separable diction… show more
PDF

Highlights - Most important sentences from the article

2017-09-19
1709.06895 | eess.SP

We consider designing a robust structured sparse sensing matrix consisting of a sparse matrix with a… show more
PDF

Highlights - Most important sentences from the article

2018-08-03
1808.01316 | cs.CV

Recent works on adaptive sparse and on low-rank signal modeling have demonstrated their usefulness i… show more
PDF

Highlights - Most important sentences from the article

2018-09-06

Sparsity and low-rank models have been popular for reconstructing images and videos from limited or … show more
PDF

Highlights - Most important sentences from the article

2018-12-28
1812.10859 | cs.CV

Object Classification is a key direction of research in signal and image processing, computer vision… show more
PDF

Highlights - Most important sentences from the article

2016-04-16

Learning dictionaries suitable for sparse coding instead of using engineered bases has proven effect… show more
PDF

Highlights - Most important sentences from the article

2018-10-18

The problem of inpainting consists of filling missing or damaged regions in images and videos in suc… show more
PDF

Highlights - Most important sentences from the article