What Do You See in this Patient? Behavioral Testing of Clinical NLP Models

11/30/2021
by   Betty van Aken, et al.
0

Decision support systems based on clinical notes have the potential to improve patient care by pointing doctors towards overseen risks. Predicting a patient's outcome is an essential part of such systems, for which the use of deep neural networks has shown promising results. However, the patterns learned by these networks are mostly opaque and previous work revealed flaws regarding the reproduction of unintended biases. We thus introduce an extendable testing framework that evaluates the behavior of clinical outcome models regarding changes of the input. The framework helps to understand learned patterns and their influence on model decisions. In this work, we apply it to analyse the change in behavior with regard to the patient characteristics gender, age and ethnicity. Our evaluation of three current clinical NLP models demonstrates the concrete effects of these characteristics on the models' decisions. They show that model behavior varies drastically even when fine-tuned on the same data and that allegedly best-performing models have not always learned the most medically plausible patterns.

READ FULL TEXT

page 6

page 9

research
08/17/2022

Extracting Medication Changes in Clinical Narratives using Pre-trained Language Models

An accurate and detailed account of patient medications, including medic...
research
10/16/2022

This Patient Looks Like That Patient: Prototypical Networks for Interpretable Diagnosis Prediction from Clinical Text

The use of deep neural models for diagnosis prediction from clinical tex...
research
11/16/2021

Literature-Augmented Clinical Outcome Prediction

Predictive models for medical outcomes hold great promise for enhancing ...
research
12/06/2022

On the Importance of Clinical Notes in Multi-modal Learning for EHR Data

Understanding deep learning model behavior is critical to accepting mach...
research
11/30/2018

Time Aggregation and Model Interpretation for Deep Multivariate Longitudinal Patient Outcome Forecasting Systems in Chronic Ambulatory Care

Clinical data for ambulatory care, which accounts for 90 healthcare spen...
research
06/24/2019

A Logic-Based Learning Approach to Explore Diabetes Patient Behaviors

Type I Diabetes (T1D) is a chronic disease in which the body's ability t...
research
11/14/2017

Unsupervised patient representations from clinical notes with interpretable classification decisions

We have two main contributions in this work: 1. We explore the usage of ...

Please sign up or login with your details

Forgot password? Click here to reset