Learning functional sections in medical conversations: iterative pseudo-labeling and human-in-the-loop approach

10/06/2022
by   Mengqian Wang, et al.
3

Medical conversations between patients and medical professionals have implicit functional sections, such as "history taking", "summarization", "education", and "care plan." In this work, we are interested in learning to automatically extract these sections. A direct approach would require collecting large amounts of expert annotations for this task, which is inherently costly due to the contextual inter-and-intra variability between these sections. This paper presents an approach that tackles the problem of learning to classify medical dialogue into functional sections without requiring a large number of annotations. Our approach combines pseudo-labeling and human-in-the-loop. First, we bootstrap using weak supervision with pseudo-labeling to generate dialogue turn-level pseudo-labels and train a transformer-based model, which is then applied to individual sentences to create noisy sentence-level labels. Second, we iteratively refine sentence-level labels using a cluster-based human-in-the-loop approach. Each iteration requires only a few dozen annotator decisions. We evaluate the results on an expert-annotated dataset of 100 dialogues and find that while our models start with 69.5 code used to perform all experiments described in this paper can be found here: https://github.com/curai/curai-research/tree/main/functional-sections.

READ FULL TEXT
research
11/15/2021

Adding more data does not always help: A study in medical conversation summarization with PEGASUS

Medical conversation summarization is integral in capturing information ...
research
10/16/2021

Pseudo-label refinement using superpixels for semi-supervised brain tumour segmentation

Training neural networks using limited annotations is an important probl...
research
05/24/2022

Unsupervised Learning of Hierarchical Conversation Structure

Human conversations can evolve in many different ways, creating challeng...
research
11/17/2021

MEDCOD: A Medically-Accurate, Emotive, Diverse, and Controllable Dialog System

We present MEDCOD, a Medically-Accurate, Emotive, Diverse, and Controlla...
research
07/04/2023

Query-based Video Summarization with Pseudo Label Supervision

Existing datasets for manually labelled query-based video summarization ...
research
09/01/2021

M^2-MedDialog: A Dataset and Benchmarks for Multi-domain Multi-service Medical Dialogues

Medical dialogue systems (MDSs) aim to assist doctors and patients with ...
research
04/04/2023

Dialogue-Contextualized Re-ranking for Medical History-Taking

AI-driven medical history-taking is an important component in symptom ch...

Please sign up or login with your details

Forgot password? Click here to reset