DeepAI AI Chat
Log In Sign Up

Bridging BAD Islands: Declarative Data Sharing at Scale

01/06/2021
by   Xikui Wang, et al.
University of California, Irvine
University of California, Riverside
0

In many Big Data applications today, information needs to be actively shared between systems managed by different organizations. To enable sharing Big Data at scale, developers would have to create dedicated server programs and glue together multiple Big Data systems for scalability. Developing and managing such glued data sharing services requires a significant amount of work from developers. In our prior work, we developed a Big Active Data (BAD) system for enabling Big Data subscriptions and analytics with millions of subscribers. Based on that, we introduce a new mechanism for enabling the sharing of Big Data at scale declaratively so that developers can easily create and provide data sharing services using declarative statements and can benefit from an underlying scalable infrastructure. We show our implementation on top of the BAD system, explain the data sharing data flow among multiple systems, and present a prototype system with experimental results.

READ FULL TEXT

page 3

page 4

page 9

09/10/2020

Subscribing to Big Data at Scale

Today, data is being actively generated by a variety of devices, service...
05/25/2021

INSPIRE: The Entry Point to Europe's Big Geospatial Data Infrastructure

Initiated in 2007, the INSPIRE Directive has set a legal framework to cr...
02/22/2020

BAD to the Bone: Big Active Data at its Core

Virtually all of today's Big Data systems are passive in nature, respond...
10/17/2019

ConEx: Efficient Exploration of Big-Data System Configurations for Better Performance

Configuration space complexity makes the big-data software systems hard ...
06/13/2017

Fuzzy Recommendations in Marketing Campaigns

The population in Sweden is growing rapidly due to immigration. In this ...
07/26/2019

The demise of the filesystem and multi level service architecture

Many astronomy data centres still work on filesystems. Industry has move...