Efficient GPU Implementation for Single Block Orthogonal Dictionary Learning

12/16/2014

∙

Dictionary training for sparse representations involves dealing with large chunks of data and complex algorithms that determine time consuming implementations. SBO is an iterative dictionary learning algorithm based on constructing unions of orthonormal bases via singular value decomposition, that represents each data item through a single best fit orthobase. In this paper we present a GPGPU approach of implementing SBO in OpenCL. We provide a lock-free solution that ensures full-occupancy of the GPU by following the map-reduce model for the sparse-coding stage and by making use of the Partitioned Global Address Space (PGAS) model for developing parallel dictionary updates. The resulting implementation achieves a favourable trade-off between algorithm complexity and data representation quality compared to PAK-SVD which is the standard overcomplete dictionary learning approach. We present and discuss numerical results showing a significant acceleration of the execution time for the dictionary learning process.

READ FULL TEXT

Efficient GPU Implementation for Single Block Orthogonal Dictionary Learning

Denoising and Completion of 3D Data via Multidimensional Dictionary Learning

Compressive hyperspectral imaging via adaptive sampling and dictionary learning

Reduced Kernel Dictionary Learning

A Split-and-Merge Dictionary Learning Algorithm for Sparse Representation

Learning Hierarchical Sparse Representations using Iterative Dictionary Learning and Dimension Reduction

A Dictionary Learning Approach for Factorial Gaussian Models

Learning Simple Thresholded Features with Sparse Support Recovery

Efficient GPU Implementation for Single Block Orthogonal Dictionary Learning

Related Research

Denoising and Completion of 3D Data via Multidimensional Dictionary Learning

Compressive hyperspectral imaging via adaptive sampling and dictionary learning

Reduced Kernel Dictionary Learning

A Split-and-Merge Dictionary Learning Algorithm for Sparse Representation

Learning Hierarchical Sparse Representations using Iterative Dictionary Learning and Dimension Reduction

A Dictionary Learning Approach for Factorial Gaussian Models

Learning Simple Thresholded Features with Sparse Support Recovery