A Data Quality-Driven View of MLOps

by   Cedric Renggli, et al.

Developing machine learning models can be seen as a process similar to the one established for traditional software development. A key difference between the two lies in the strong dependency between the quality of a machine learning model and the quality of the data used to train or perform evaluations. In this work, we demonstrate how different aspects of data quality propagate through various stages of machine learning development. By performing a joint analysis of the impact of well-known data quality dimensions and the downstream machine learning process, we show that different components of a typical MLOps pipeline can be efficiently designed, providing both a technical and theoretical perspective.


page 4

page 6


Aspirations and Practice of Model Documentation: Moving the Needle with Nudging and Traceability

Machine learning models have been widely developed, released, and adopte...

Preventing Machine Learning Poisoning Attacks Using Authentication and Provenance

Recent research has successfully demonstrated new types of data poisonin...

Link Quality Estimation using Machine Learning

Since the emergence of wireless communication networks, quality aspects ...

Quality of Data in Machine Learning

A common assumption exists according to which machine learning models im...

Bridge Data Center AI Systems with Edge Computing for Actionable Information Retrieval

Extremely high data rates at modern synchrotron and X-ray free-electron ...

A machine learning pipeline for aiding school identification from child trafficking images

Child trafficking in a serious problem around the world. Every year ther...