Dataset-On-Demand: Automatic View Search and Presentation for Data Discovery

11/26/2019
by   Raul Castro Fernandez, et al.
0

Many data problems are solved when the right view of a combination of datasets is identified. Finding such a view is challenging because of the many tables spread across many databases, data lakes, and cloud storage in modern organizations. Finding relevant tables, and identifying how to combine them is a difficult and time-consuming process that hampers users' productivity. In this paper, we describe Dataset-On-Demand (DoD), a system that lets users specify the schema of the view they want, and have the system find views for them. With many underlying data sources, the number of resulting views for any given query is high, and the burden of choosing the right one is onerous to users. DoD uses a new method, 4C, to reduce the size of the view choice space for users. 4C classifies views into 4 classes: compatible views are exactly the same, contained views present a subsumption relationship, complementary views are unionable, and contradictory views have incompatible values that indicate fundamental differences between views. These 4 classes permit different presentation strategies to reduce the total number of views a user must consider. We evaluate DoD on two key metrics of interest: its ability to reduce the size of the choice space, and the end to end performance. DoD finds all views within minutes, and reduces the number of views presented to users by 2-10x.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/03/2021

Niffler: A Reference Architecture and System Implementation for View Discovery over Pathless Table Collections by Example

Identifying a project-join view (PJ-view) over collections of tables is ...
research
05/19/2021

Automatic View Selection in Graph Databases

Recently, several works have studied the problem of view selection in gr...
research
10/27/2022

Re-looking at the View Update Problem

Relational databases have always had a means for creating a pseudo-table...
research
06/01/2020

Balancing expressiveness and inexpressiveness in view design

We study the design of data publishing mechanisms that allow a collectio...
research
04/28/2016

Streaming View Learning

An underlying assumption in conventional multi-view learning algorithms ...
research
11/14/2017

DataVizard: Recommending Visual Presentations for Structured Data

Selecting the appropriate visual presentation of the data such that it p...
research
05/27/2023

CRAN Task Views: The Next Generation

CRAN Task Views have been available on the Comprehensive R Archive Netwo...

Please sign up or login with your details

Forgot password? Click here to reset