A Convex Formulation for Learning Scale-Free Networks via Submodular Relaxation

07/10/2014
by   Aaron J. Defazio, et al.
0

A key problem in statistics and machine learning is the determination of network structure from data. We consider the case where the structure of the graph to be reconstructed is known to be scale-free. We show that in such cases it is natural to formulate structured sparsity inducing priors using submodular functions, and we use their Lovász extension to obtain a convex relaxation. For tractable classes such as Gaussian graphical models, this leads to a convex optimization problem that can be efficiently solved. We show that our method results in an improvement in the accuracy of reconstructed networks for synthetic data. We also show how our prior encourages scale-free reconstructions on a bioinfomatics dataset.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/26/2013

Structured Convex Optimization under Submodular Constraints

A number of discrete and continuous optimization problems in machine lea...
research
08/25/2010

Structured sparsity-inducing norms through submodular functions

Sparse methods for supervised learning aim at finding good linear predic...
research
03/07/2015

Learning Scale-Free Networks by Dynamic Node-Specific Degree Prior

Learning the network structure underlying data is an important problem i...
research
07/04/2012

A submodular-supermodular procedure with applications to discriminative structure learning

In this paper, we present an algorithm for minimizing the difference bet...
research
08/18/2020

Scalable Combinatorial Bayesian Optimization with Tractable Statistical models

We study the problem of optimizing expensive blackbox functions over com...
research
04/07/2014

Tyler's Covariance Matrix Estimator in Elliptical Models with Convex Structure

We address structured covariance estimation in elliptical distributions ...
research
12/07/2010

Shaping Level Sets with Submodular Functions

We consider a class of sparsity-inducing regularization terms based on s...

Please sign up or login with your details

Forgot password? Click here to reset