Metamorphic Testing for Quality Assurance of Protein Function Prediction Tools

04/16/2019
by   Morteza Pourreza Shahri, et al.
0

Proteins are the workhorses of life and gaining insight on their functions is of paramount importance for applications such as drug design. However, the experimental validation of functions of proteins is highly-resource consuming. Therefore, recently, automated protein function prediction (AFP) using machine learning has gained significant interest. Many of these AFP tools are based on supervised learning models trained using existing gold-standard functional annotations, which are known to be incomplete. The main challenge associated with conducting systematic testing on AFP software is the lack of a test oracle, which determines passing or failing of a test case; unfortunately, due to the incompleteness of gold-standard data, the exact expected outcomes are not well defined for the AFP task. Thus, AFP tools face the oracle problem. In this work, we use metamorphic testing (MT) to test nine state-of-the-art AFP tools by defining a set of metamorphic relations (MRs) that apply input transformations to protein sequences. According to our results, we observe that several AFP tools fail all the test cases causing concerns over the quality of their predictions.

READ FULL TEXT

page 4

page 5

page 6

page 7

research
02/20/2018

Quality Assurance of Bioinformatics Software: A Case Study of Testing a Biomedical Text Processing Tool Using Metamorphic Testing

Bioinformatics software plays a very important role in making critical d...
research
11/22/2022

Application of property-based testing tools for metamorphic testing

Metamorphic testing (MT) is a general approach for the testing of a spec...
research
10/10/2019

Modeling of negative protein-protein interactions: methods and experiments

Protein-protein interactions (PPIs) are of fundamental importance for th...
research
08/05/2021

Using Metamorphic Relations to Verify and Enhance Artcode Classification

Software testing is often hindered where it is impossible or impractical...
research
11/09/2019

Accurate Protein Structure Prediction by Embeddings and Deep Learning Representations

Proteins are the major building blocks of life, and actuators of almost ...
research
04/15/2019

Fault Detection Effectiveness of Metamorphic Relations Developed for Testing Supervised Classifiers

In machine learning, supervised classifiers are used to obtain predictio...
research
06/11/2022

Testing Ocean Software with Metamorphic Testing

Advancing ocean science has a significant impact to the development of t...

Please sign up or login with your details

Forgot password? Click here to reset