Can Current Explainability Help Provide References in Clinical Notes to Support Humans Annotate Medical Codes?

10/28/2022
by   Byung-Hak Kim, et al.
0

The medical codes prediction problem from clinical notes has received substantial interest in the NLP community, and several recent studies have shown the state-of-the-art (SOTA) code prediction results of full-fledged deep learning-based methods. However, most previous SOTA works based on deep learning are still in early stages in terms of providing textual references and explanations of the predicted codes, despite the fact that this level of explainability of the prediction outcomes is critical to gaining trust from professional medical coders. This raises the important question of how well current explainability methods apply to advanced neural network models such as transformers to predict correct codes and present references in clinical notes that support code prediction. First, we present an explainable Read, Attend, and Code (xRAC) framework and assess two approaches, attention score-based xRAC-ATTN and model-agnostic knowledge-distillation-based xRAC-KD, through simplified but thorough human-grounded evaluations with SOTA transformer-based model, RAC. We find that the supporting evidence text highlighted by xRAC-ATTN is of higher quality than xRAC-KD whereas xRAC-KD has potential advantages in production deployment scenarios. More importantly, we show for the first time that, given the current state of explainability methodologies, using the SOTA medical codes prediction system still requires the expertise and competencies of professional coders, even though its prediction accuracy is superior to that of human coders. This, we believe, is a very meaningful step toward developing explainable and accurate machine learning systems for fully autonomous medical code prediction from clinical notes.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/30/2022

Medical Codes Prediction from Clinical Notes: From Human Coders to Machines

Prediction of medical codes from clinical notes is a practical and essen...
research
07/10/2021

Read, Attend, and Code: Pushing the Limits of Medical Codes Prediction from Clinical Notes by Machines

Prediction of medical codes from clinical notes is both a practical and ...
research
10/29/2020

Explainable Automated Coding of Clinical Notes using Hierarchical Label-wise Attention Networks and Label Embedding Initialisation

Diagnostic or procedural coding of clinical notes aims to derive a coded...
research
02/15/2018

Explainable Prediction of Medical Codes from Clinical Text

Clinical notes are text documents that are created by clinicians for eac...
research
07/12/2021

Quantifying Explainability in NLP and Analyzing Algorithms for Performance-Explainability Tradeoff

The healthcare domain is one of the most exciting application areas for ...
research
02/07/2018

An Empirical Evaluation of Deep Learning for ICD-9 Code Assignment using MIMIC-III Clinical Notes

Code assignment is important on many levels in the modern hospital, from...
research
06/16/2023

Prototype Learning for Explainable Regression

The lack of explainability limits the adoption of deep learning models i...

Please sign up or login with your details

Forgot password? Click here to reset