DeepAI AI Chat

Ensuring Dataset Quality for Machine Learning Certification

11/03/2020

∙

by Sylvaine Picard, et al.

∙

∙

In this paper, we address the problem of dataset quality in the context of Machine Learning (ML)-based critical systems. We briefly analyse the applicability of some existing standards dealing with data and show that the specificities of the ML context are neither properly captured nor taken into ac-count. As a first answer to this concerning situation, we propose a dataset specification and verification process, and apply it on a signal recognition system from the railway domain. In addi-tion, we also give a list of recommendations for the collection and management of datasets. This work is one step towards the dataset engineering process that will be required for ML to be used on safety critical systems.

Sylvaine Picard
8 publications
Camille Chapdelaine
4 publications
Cyril Cappi
3 publications
Laurent Gardes
4 publications
Eric Jenn
3 publications
Baptiste Lefèvre
3 publications
Thomas Soumarmon
2 publications

∙ 09/30/2022

Empowering the trustworthiness of ML-based critical systems through engineering activities

This paper reviews the entire engineering process of trustworthy Machine...

10 Juliette Mattioli, et al. ∙

∙ 09/28/2022

Toward Certification of Machine-Learning Systems for Low Criticality Airborne Applications

The exceptional progress in the field of machine learning (ML) in recent...

0 K. Dmitriev, et al. ∙

∙ 08/05/2018

Using Machine Learning Safely in Automotive Software: An Assessment and Adaption of Software Process Requirements in ISO 26262

The use of machine learning (ML) is on the rise in many sectors of softw...

0 Rick Salay, et al. ∙

∙ 03/02/2020

Towards Probability-based Safety Verification of Systems with Components from Machine Learning

Machine learning (ML) has recently created many new success stories. Hen...

0 Hermann Kaindl, et al. ∙

∙ 05/27/2020

SafeML: Safety Monitoring of Machine Learning Classifiers through Statistical Difference Measure

Ensuring safety and explainability of machine learning (ML) is a topic o...

60 Koorosh Aslansefat, et al. ∙

∙ 05/10/2019

Assuring the Machine Learning Lifecycle: Desiderata, Methods, and Challenges

Machine learning has evolved into an enabling technology for a wide rang...

0 Rob Ashmore, et al. ∙

∙ 11/08/2018

Satyam: Democratizing Groundtruth for Machine Vision

The democratization of machine learning (ML) has led to ML-based machine...

0 Hang Qiu, et al. ∙