Fast inference of ill-posed problems within a convex space

In multiple scientific and technological applications we face the problem of having low dimensional data to be justified by a linear model defined in a high dimensional parameter space. The difference in dimensionality makes the problem ill-defined: the model is consistent with the data for many values of its parameters. The objective is to find the probability distribution of parameter values consistent with the data, a problem that can be cast as the exploration of a high dimensional convex polytope. In this work we introduce a novel algorithm to solve this problem efficiently. It provides results that are statistically indistinguishable from currently used numerical techniques while its running time scales linearly with the system size. We show that the algorithm performs robustly in many abstract and practical applications. As working examples we simulate the effects of restricting reaction fluxes on the space of feasible phenotypes of a genome scale E. Coli metabolic network and infer the traffic flow between origin and destination nodes in a real communication network.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/16/2018

Latent Projection BNNs: Avoiding weight-space pathologies by learning latent representations of neural network weights

While modern neural networks are making remarkable gains in terms of pre...
research
09/17/2020

Learning a Deep Part-based Representation by Preserving Data Distribution

Unsupervised dimensionality reduction is one of the commonly used techni...
research
11/18/2018

A Tracy-Widom Empirical Estimator For Valid P-values With High-Dimensional Datasets

Recent technological advances in many domains including both genomics an...
research
09/25/2020

Doubly Robust Semiparametric Inference Using Regularized Calibrated Estimation with High-dimensional Data

Consider semiparametric estimation where a doubly robust estimating func...
research
03/16/2016

Non-linear Dimensionality Regularizer for Solving Inverse Problems

Consider an ill-posed inverse problem of estimating causal factors from ...
research
02/27/2020

A Data Dependent Algorithm for Querying Earth Mover's Distance with Low Doubling Dimension

In this paper, we consider the following query problem: given two weight...
research
10/08/2019

Learning Parametric Constraints in High Dimensions from Demonstrations

We present a scalable algorithm for learning parametric constraints in h...

Please sign up or login with your details

Forgot password? Click here to reset