On Kubernetes-aided Federated Database Systems

11/01/2022
by   Zheng Li, et al.
0

Cloud computing has made federated database systems (FDBS) significantly more practical to implement than in the past. As part of a recent Web-based Geographic Information System (WebGIS) project, we are employing cloud-native technologies (from the container ecosystem) to develop a federated database (DB) infrastructure, to help manage and utilise the distributed and various geospatial data. Unfortunately, there seem to be inherent challenges and complexity of applying the container and Kubernetes technologies to building and running DB systems. Considering that most of the geospatial and theme data are pre-obtained and fixed in our WebGIS project, we decided to focus on the read-only user queries and still resort to Kubernetes to implement an FDBS instance to use. Unlike the de facto practices (e.g., using the StatefulSets mechanism, extending Kuberentes APIs, or employing KubeFed), our solution for Kubernetes-aided FDBS simplifies the tech stack by investigating the fractal object of federated data management, inclusively containerising DB instances, and using the lightweight Deployment mechanism to handle stateless DB containers. Overall, this research not only reveals an easy-to-implement approach to constructing read-only components in a fully-fledged FDBS, but also proposes and demonstrates a novel methodology for FDBS investigations.

READ FULL TEXT
research
07/11/2023

SparqLog: A System for Efficient Evaluation of SPARQL 1.1 Queries via Datalog [Experiment, Analysis and Benchmark]

Over the past decade, Knowledge Graphs have received enormous interest b...
research
03/29/2019

From DB-nets to Coloured Petri Nets with Priorities (Extended Version)

The recently introduced formalism of DB-nets has brought in a new concep...
research
08/28/2017

T-DB: Toward Fully Functional Transparent Encrypted Databases in DBaaS Framework

Individuals and organizations tend to migrate their data to clouds, espe...
research
03/03/2021

Long Live The Image: Container-Native Data Persistence in Production

Containerization plays a crucial role in the de facto technology stack f...
research
04/07/2020

DataFed: Towards Reproducible Research via Federated Data Management

The increasingly collaborative, globalized nature of scientific research...
research
04/13/2020

Distributed Resources for the Earth System Grid Advanced Management (DREAM)

The DREAM project was funded more than 3 years ago to design and impleme...
research
01/13/2020

Maintaining Data Integrity in Fog Computing Based Critical Infrastructure Systems

The evolution of the utilization of technologies in nearly all aspects o...

Please sign up or login with your details

Forgot password? Click here to reset