Simultaneous Safe Screening of Features and Samples in Doubly Sparse Modeling

02/08/2016
by   Atsushi Shibagaki, et al.
0

The problem of learning a sparse model is conceptually interpreted as the process of identifying active features/samples and then optimizing the model over them. Recently introduced safe screening allows us to identify a part of non-active features/samples. So far, safe screening has been individually studied either for feature screening or for sample screening. In this paper, we introduce a new approach for safely screening features and samples simultaneously by alternatively iterating feature and sample screening steps. A significant advantage of considering them simultaneously rather than individually is that they have a synergy effect in the sense that the results of the previous safe feature screening can be exploited for improving the next safe sample screening performances, and vice-versa. We first theoretically investigate the synergy effect, and then illustrate the practical advantage through intensive numerical experiments for problems with large numbers of features and samples.

READ FULL TEXT

page 14

page 15

page 18

research
01/27/2014

Safe Sample Screening for Support Vector Machines

Sparse classifiers such as the support vector machines (SVM) are efficie...
research
02/08/2021

Dynamic Sasvi: Strong Safe Screening for Norm-Regularized Least Squares

A recently introduced technique for a sparse optimization problem called...
research
04/23/2022

Distributed Dynamic Safe Screening Algorithms for Sparse Regularization

Distributed optimization has been widely used as one of the most efficie...
research
07/01/2023

Safe Screening for Unbalanced Optimal Transport

This paper introduces a framework that utilizes the Safe Screening techn...
research
02/12/2018

Safe Triplet Screening for Distance Metric Learning

We study safe screening for metric learning. Distance metric learning ca...
research
09/06/2020

Screening Rules and its Complexity for Active Set Identification

Screening rules were recently introduced as a technique for explicitly i...
research
12/01/2022

Enabling Fast Unit Commitment Constraint Screening via Learning Cost Model

Unit commitment (UC) are essential tools to transmission system operator...

Please sign up or login with your details

Forgot password? Click here to reset