Identifying Implementation Bugs in Machine Learning based Image Classifiers using Metamorphic Testing

08/16/2018
by   Anurag Dwarakanath, et al.
0

We have recently witnessed tremendous success of Machine Learning (ML) in practical applications. Computer vision, speech recognition and language translation have all seen a near human level performance. We expect, in the near future, most business applications will have some form of ML. However, testing such applications is extremely challenging and would be very expensive if we follow today's methodologies. In this work, we present an articulation of the challenges in testing ML based applications. We then present our solution approach, based on the concept of Metamorphic Testing, which aims to identify implementation bugs in ML based image classifiers. We have developed metamorphic relations for an application based on Support Vector Machine and a Deep Learning based application. Empirical validation showed that our approach was able to catch 71

READ FULL TEXT

Authors

page 2

07/13/2019

Metamorphic Testing of a Deep Learning based Forecaster

In this paper, we present the Metamorphic Testing of an in-use deep lear...
06/10/2021

Security testing using JUnit and Perl scripts

In this paper, I describe a recent practical experience where JUnit was ...
05/17/2020

Usage of Network Simulators in Machine-Learning-Assisted 5G/6G Networks

Without any doubt, Machine Learning (ML) will be an important driver of ...
05/28/2020

Machine Learning for recognition of minerals from multispectral data

Machine Learning (ML) has found several applications in spectroscopy, in...
12/22/2021

Classifier Data Quality: A Geometric Complexity Based Method for Automated Baseline And Insights Generation

Testing Machine Learning (ML) models and AI-Infused Applications (AIIAs)...
04/27/2020

GIMP-ML: Python Plugins for using Computer Vision Models in GIMP

This paper introduces GIMP-ML, a set of Python plugins for the widely po...
02/11/2018

Machine Learning and Evolutionary Computing for GUI-based Regression Testing

ReTest is a novel testing tool for Java applications with a graphical us...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.