Conditional Sparse Coding and Grouped Multivariate Regression

06/27/2012
by   Min Xu, et al.
0

We study the problem of multivariate regression where the data are naturally grouped, and a regression matrix is to be estimated for each group. We propose an approach in which a dictionary of low rank parameter matrices is estimated across groups, and a sparse linear combination of the dictionary elements is estimated to form a model within each group. We refer to the method as conditional sparse coding since it is a coding procedure for the response vectors Y conditioned on the covariate vectors X. This approach captures the shared information across the groups while adapting to the structure within each group. It exploits the same intuition behind sparse coding that has been successfully developed in computer vision and computational neuroscience. We propose an algorithm for conditional sparse coding, analyze its theoretical properties in terms of predictive accuracy, and present the results of simulation and brain imaging experiments that compare the new technique to reduced rank regression.

READ FULL TEXT
research
11/24/2021

Dictionary-based Low-Rank Approximations and the Mixed Sparse Coding problem

Constrained tensor and matrix factorization models allow to extract inte...
research
01/09/2013

Nonparametric Reduced Rank Regression

We propose an approach to multivariate nonparametric regression that gen...
research
02/21/2019

A Dictionary-Based Generalization of Robust PCA Part I: Study of Theoretical Properties

We consider the decomposition of a data matrix assumed to be a superposi...
research
09/12/2017

Bridge the Gap Between Group Sparse Coding and Rank Minimization via Adaptive Dictionary Learning

Both sparse coding and rank minimization have led to great successes in ...
research
08/14/2023

An Inherent Trade-Off in Noisy Neural Communication with Rank-Order Coding

Rank-order coding, a form of temporal coding, has emerged as a promising...
research
02/28/2012

Fast approximations to structured sparse coding and applications to object classification

We describe a method for fast approximation of sparse coding. The input ...
research
03/18/2017

Deep Tensor Encoding

Learning an encoding of feature vectors in terms of an over-complete dic...

Please sign up or login with your details

Forgot password? Click here to reset