DeepAI AI Chat
Log In Sign Up

A Vision for Semantically Enriched Data Science

by   Udayan Khurana, et al.
The University of Chicago

The recent efforts in automation of machine learning or data science has achieved success in various tasks such as hyper-parameter optimization or model selection. However, key areas such as utilizing domain knowledge and data semantics are areas where we have seen little automation. Data Scientists have long leveraged common sense reasoning and domain knowledge to understand and enrich data for building predictive models. In this paper we discuss important shortcomings of current data science and machine learning solutions. We then envision how leveraging "semantic" understanding and reasoning on data in combination with novel tools for data science automation can help with consistent and explainable data augmentation and transformation. Additionally, we discuss how semantics can assist data scientists in a new manner by helping with challenges related to trust, bias, and explainability in machine learning. Semantic annotation can also help better explore and organize large data sources.


A Survey on Semantics in Automated Data Science

Data Scientists leverage common sense reasoning and domain knowledge to ...

Data Science with Vadalog: Bridging Machine Learning and Reasoning

Following the recent successful examples of large technology companies, ...

Prediction Factory: automated development and collaborative evaluation of predictive models

In this paper, we present a data science automation system called Predic...

A compendium of data sources for data science, machine learning, and artificial intelligence

Recent advances in data science, machine learning, and artificial intell...

Augmented Data Science: Towards Industrialization and Democratization of Data Science

Conversion of raw data into insights and knowledge requires substantial ...

Machine Learning and Data Science approach towards trend and predictors analysis of CDC Mortality Data for the USA

The research on mortality is an active area of research for any country ...

One button machine for automating feature engineering in relational databases

Feature engineering is one of the most important and time consuming task...