Cardinality Minimization, Constraints, and Regularization: A Survey

06/17/2021
by   Andreas M. Tillmann, et al.
0

We survey optimization problems that involve the cardinality of variable vectors in constraints or the objective function. We provide a unified viewpoint on the general problem classes and models, and give concrete examples from diverse application fields such as signal and image processing, portfolio selection, or machine learning. The paper discusses general-purpose modeling techniques and broadly applicable as well as problem-specific exact and heuristic solution approaches. While our perspective is that of mathematical optimization, a main goal of this work is to reach out to and build bridges between the different communities in which cardinality optimization problems are frequently encountered. In particular, we highlight that modern mixed-integer programming, which is often regarded as impractical due to commonly unsatisfactory behavior of black-box solvers applied to generic problem formulations, can in fact produce provably high-quality or even optimal solutions for cardinality optimization problems, even in large-scale real-world settings. Achieving such performance typically draws on the merits of problem-specific knowledge that may stem from different fields of application and, e.g., shed light on structural properties of a model or its solutions, or lead to the development of efficient heuristics; we also provide some illustrative examples.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 3

03/06/2022

A Survey for Solving Mixed Integer Programming via Machine Learning

This paper surveys the trend of leveraging machine learning to solve mix...
10/08/2020

Black-Box Optimization Revisited: Improving Algorithm Selection Wizards through Massive Benchmarking

Existing studies in black-box optimization suffer from low generalizabil...
07/03/2019

A unified approach to mixed-integer optimization: Nonlinear formulations and scalable algorithms

We propose a unified framework to address a family of classical mixed-in...
12/22/2016

Solving Set Optimization Problems by Cardinality Optimization via Weak Constraints with an Application to Argumentation

Optimization - minimization or maximization - in the lattice of subsets ...
11/20/2021

Modeling Design and Control Problems Involving Neural Network Surrogates

We consider nonlinear optimization problems that involve surrogate model...
10/02/2020

Nonsmoothness in Machine Learning: specific structure, proximal identification, and applications

Nonsmoothness is often a curse for optimization; but it is sometimes a b...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.