On the Location of the Minimizer of the Sum of Strongly Convex Functions

The problem of finding the minimizer of a sum of convex functions is central to the field of distributed optimization. Thus, it is of interest to understand how that minimizer is related to the properties of the individual functions in the sum. In the case of single-dimensional strongly convex functions, it is easy to show that the minimizer lies in the interval bracketed by the smallest and largest minimizers of the set of functions. However, a similar characterization for multi-dimensional functions is not currently available. In this paper, we provide an upper bound on the region containing the minimizer of the sum of two strongly convex functions. We consider two scenarios with different constraints on the upper bound of the gradients of the functions. In the first scenario, the gradient constraint is imposed on the location of the potential minimizer, while in the second scenario, the gradient constraint is imposed on a given convex set in which the minimizers of two original functions are embedded. We characterize the boundaries of the regions containing the minimizer in both scenarios.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/20/2018

On the Location of the Minimizer of the Sum of Two Strongly Convex Functions

The problem of finding the minimizer of a sum of convex functions is cen...
research
03/27/2019

Convexly independent subsets of Minkowski sums of convex polygons

We show that there exist convex n-gons P and Q such that the largest con...
research
10/28/2022

Secure Distributed Optimization Under Gradient Attacks

In this paper, we study secure distributed optimization against arbitrar...
research
10/02/2014

A Lower Bound for the Optimization of Finite Sums

This paper presents a lower bound for optimizing a finite sum of n funct...
research
03/15/2021

DIPPA: An improved Method for Bilinear Saddle Point Problems

This paper studies bilinear saddle point problems min_xmax_y g(x) + x^⊤A...
research
06/05/2015

Improved SVRG for Non-Strongly-Convex or Sum-of-Non-Convex Objectives

Many classical algorithms are found until several years later to outlive...

Please sign up or login with your details

Forgot password? Click here to reset