An Interpretable Graph-based Mapping of Trustworthy Machine Learning Research

05/13/2021
by   Noemi Derzsy, et al.
0

There is an increasing interest in ensuring machine learning (ML) frameworks behave in a socially responsible manner and are deemed trustworthy. Although considerable progress has been made in the field of Trustworthy ML (TwML) in the recent past, much of the current characterization of this progress is qualitative. Consequently, decisions about how to address issues of trustworthiness and future research goals are often left to the interested researcher. In this paper, we present the first quantitative approach to characterize the comprehension of TwML research. We build a co-occurrence network of words using a web-scraped corpus of more than 7,000 peer-reviewed recent ML papers – consisting of papers both related and unrelated to TwML. We use community detection to obtain semantic clusters of words in this network that can infer relative positions of TwML topics. We propose an innovative fingerprinting algorithm to obtain probabilistic similarity scores for individual words, then combine them to give a paper-level relevance score. The outcomes of our analysis inform a number of interesting insights on advancing the field of TwML research.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/26/2019

The Application of Machine Learning Techniques for Predicting Results in Team Sport: A Review

Over the past two decades, Machine Learning (ML) techniques have been in...
research
01/08/2022

Machine Learning-Based Disease Diagnosis:A Bibliometric Analysis

Machine Learning (ML) has garnered considerable attention from researche...
research
07/26/2021

How to Certify Machine Learning Based Safety-critical Systems? A Systematic Literature Review

Context: Machine Learning (ML) has been at the heart of many innovations...
research
06/08/2020

The Big Picture: Ethical Considerations and Statistical Analysis of Industry Involvement in Machine Learning Research

It is commonly believed among the machine learning (ML) community that i...
research
09/06/2022

Use and Misuse of Machine Learning in Anthropology

Machine learning (ML), being now widely accessible to the research commu...
research
06/29/2021

The Values Encoded in Machine Learning Research

Machine learning (ML) currently exerts an outsized influence on the worl...
research
04/07/2023

AI Model Disgorgement: Methods and Choices

Responsible use of data is an indispensable part of any machine learning...

Please sign up or login with your details

Forgot password? Click here to reset