Technical Report: Developing a Working Data Hub

04/01/2020
by   Vijay Gadepally, et al.
0

Data forms a key component of any enterprise. The need for high quality and easy access to data is further amplified by organizations wishing to leverage machine learning or artificial intelligence for their operations. To this end, many organizations are building resources for managing heterogenous data, providing end-users with an organization wide view of available data, and acting as a centralized repository for data owned/collected by an organization. Very broadly, we refer to these class of techniques as a "data hub." While there is no clear definition of what constitutes a data hub, some of the key characteristics include: data catalog; links to data sets or owners of data sets or centralized data repository; basic ability to serve / visualize data sets; access control policies that ensure secure data access and respects policies of data owners; and computing capabilities tied with data hub infrastructure. Of course, developing such a data hub entails numerous challenges. This document provides background in databases, data management and outlines best practices and recommendations for developing and deploying a working data hub.

READ FULL TEXT

page 11

page 13

page 22

page 27

04/21/2022

Agile data management in NAV: A Case Study

To satisfy the need for analytical data in the development of digital se...
09/07/2020

Detecting Informal Organization Through Data Mining Techniques

One of the main topics in human resources management is the subject of i...
08/19/2021

Decentralized Policy Information Points for Multi-Domain Environments

Access control models have been developed to control authorized access t...
10/11/2017

Understanding Organizational Approach towards End User Privacy

End user privacy is a critical concern for all organizations that collec...
07/09/2020

Open Data Quality Evaluation: A Comparative Analysis of Open Data in Latvia

Nowadays open data is entering the mainstream - it is free available for...
01/03/2020

Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditing

Rising concern for the societal implications of artificial intelligence ...