Perspective Maximum Likelihood-Type Estimation via Proximal Decomposition

05/16/2018
by   Patrick L. Combettes, et al.
0

We introduce an optimization model for maximum likelihood-type estimation (M-estimation) that generalizes a large class of existing statistical models, including Huber's concomitant M-estimation model, Owen's Huber/Berhu concomitant model, the scaled lasso, support vector machine regression, and penalized estimation with structured sparsity. The model, termed perspective M-estimation, leverages the observation that convex M-estimators with concomitant scale as well as various regularizers are instances of perspective functions. Such functions are amenable to proximal analysis, which leads to principled and provably convergent optimization algorithms via proximal splitting. Using a geometrical approach based on duality, we derive novel proximity operators for several perspective functions of interest. Numerical experiments on synthetic and real-world data illustrate the broad applicability of the proposed framework.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/12/2020

Gaussian Transforms Modeling and the Estimation of Distributional Regression Functions

Conditional distribution functions are important statistical objects for...
research
04/30/2020

One-Step Estimation With Scaled Proximal Methods

We study statistical estimators computed using iterative optimization me...
research
11/26/2022

Calculus rules for proximal ε-subdifferentials and inexact proximity operators for weakly convex functions

We investigate inexact proximity operators for weakly convex functions. ...
research
05/28/2018

Inference for ergodic diffusions plus noise

We research adaptive maximum likelihood-type estimation for an ergodic d...
research
02/18/2022

Signal Decomposition Using Masked Proximal Operators

We consider the well-studied problem of decomposing a vector time series...
research
12/27/2020

Doubly Stochastic Generative Arrivals Modeling

We propose a new framework named DS-WGAN that integrates the doubly stoc...
research
12/11/2019

Polar Alignment and Atomic Decomposition

Structured optimization uses a prescribed set of atoms to assemble a sol...

Please sign up or login with your details

Forgot password? Click here to reset