Stochastic Package Queries in Probabilistic Databases

03/11/2021
by   Matteo Brucato, et al.
0

We provide methods for in-database support of decision making under uncertainty. Many important decision problems correspond to selecting a package (bag of tuples in a relational database) that jointly satisfy a set of constraints while minimizing some overall cost function; in most real-world problems, the data is uncertain. We provide methods for specifying – via a SQL extension – and processing stochastic package queries (SPQs), in order to solve optimization problems over uncertain data, right where the data resides. Prior work in stochastic programming uses Monte Carlo methods where the original stochastic optimization problem is approximated by a large deterministic optimization problem that incorporates many scenarios, i.e., sample realizations of the uncertain data values. For large database tables, however, a huge number of scenarios is required, leading to poor performance and, often, failure of the solver software. We therefore provide a novel SummarySearch algorithm that, instead of trying to solve a large deterministic problem, seamlessly approximates it via a sequence of smaller problems defined over carefully crafted summaries of the scenarios that accelerate convergence to a feasible and near-optimal solution. Experimental results on our prototype system show that SummarySearch can be orders of magnitude faster than prior methods at finding feasible and high-quality packages.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/06/2023

Scaling Package Queries to a Billion Tuples via Hierarchical Partitioning and Customized Optimization

A package query returns a package - a multiset of tuples - that maximize...
research
04/13/2023

Sample Average Approximation for Black-Box VI

We present a novel approach for black-box VI that bypasses the difficult...
research
10/22/2019

Parallel Stochastic Optimization Framework for Large-Scale Non-Convex Stochastic Problems

In this paper, we consider the problem of stochastic optimization, where...
research
05/29/2020

A Fully Dynamic Algorithm for k-Regret Minimizing Sets

Selecting a small set of representatives from a large database is import...
research
09/17/2020

Stochastic Optimization using Polynomial Chaos Expansions

Polynomial chaos based methods enable the efficient computation of outpu...
research
12/16/2019

Complexity of Stochastic Dual Dynamic Programming

Stochastic dual dynamic programming is a cutting plane type algorithm fo...
research
11/14/2022

Learning to Optimize with Stochastic Dominance Constraints

In real-world decision-making, uncertainty is important yet difficult to...

Please sign up or login with your details

Forgot password? Click here to reset