Towards the optimal construction of a loss function without spurious local minima for solving quadratic equations

09/27/2018
by   Zhenzhen Li, et al.
0

The problem of finding a vector x which obeys a set of quadratic equations |a_k^ x|^2=y_k, k=1,...,m, plays an important role in many applications. In this paper we consider the case when both x and a_k are real-valued vectors of length n. A new loss function is constructed for this problem, which combines the smooth quadratic loss function with an activation function. Under the Gaussian measurement model, we establish that with high probability the target solution x is the unique local minimizer (up to a global phase factor) of the new loss function provided m≳ n. Moreover, the loss function always has a negative directional curvature around its saddle points.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/20/2023

Interpolation property of shallow neural networks

We study the geometry of global minima of the loss landscape of overpara...
research
12/15/2021

The global landscape of phase retrieval I: perturbed amplitude models

A fundamental task in phase retrieval is to recover an unknown signal ∈ ...
research
02/07/2020

Ill-Posedness and Optimization Geometry for Nonlinear Neural Network Training

In this work we analyze the role nonlinear activation functions play at ...
research
06/28/2022

Diffeomorphic Registration using Sinkhorn Divergences

The diffeomorphic registration framework enables to define an optimal ma...
research
12/15/2021

The global landscape of phase retrieval II: quotient intensity models

A fundamental problem in phase retrieval is to reconstruct an unknown si...
research
03/25/2018

Local Quadratic Estimation of the Curvature in a Functional Single Index Model

The nonlinear effects of environmental variability on species abundance ...
research
05/26/2016

Solving Systems of Random Quadratic Equations via Truncated Amplitude Flow

This paper presents a new algorithm, termed truncated amplitude flow (TA...

Please sign up or login with your details

Forgot password? Click here to reset