AI Assisted Annotator using Reinforcement Learning

10/02/2019
by   V. Ratna Saripalli, et al.
0

Healthcare data suffers from both noise and lack of ground truth. The cost of data increases as it is cleaned and annotated in healthcare. Unlike other data sets, medical data annotation, which is critical to accurate ground truth, requires medical domain expertise for a better patient outcome. In this work, we report on the use of reinforcement learning to mimic the decision making process of annotators for medical events, to automate annotation and labelling. The reinforcement agent learns to annotate alarm data based on annotations done by an expert. Our method shows promising results on medical alarm data sets. We trained DQN and A2C agents using the data from monitoring devices that is annotated by an expert. Initial results from these RL agents learning the expert annotation behavior is promising. The A2C agent performs better in terms of learning the sparse events in a given state, thereby choosing more right actions compared to DQN agent. To the best of our knowledge, this is the first reinforcement learning application for the automation of medical events annotation, which has far-reaching practical use.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/09/2021

Challenges for Reinforcement Learning in Healthcare

Many healthcare decisions involve navigating through a multitude of trea...
research
03/20/2022

Learning from Multiple Expert Annotators for Enhancing Anomaly Detection in Medical Image Analysis

Building an accurate computer-aided diagnosis system based on data-drive...
research
05/24/2023

Semantic Segmentation by Semantic Proportions

Semantic segmentation is a critical task in computer vision that aims to...
research
03/28/2020

Learning medical triage from clinicians using Deep Q-Learning

Medical Triage is of paramount importance to healthcare systems, allowin...
research
07/03/2020

A Conceptual Framework for Externally-influenced Agents: An Assisted Reinforcement Learning Review

A long-term goal of reinforcement learning agents is to be able to perfo...
research
06/25/2019

An Unsupervised Bayesian Neural Network for Truth Discovery

The problem of estimating event truths from conflicting agent opinions i...
research
06/11/2021

Interpreting Expert Annotation Differences in Animal Behavior

Hand-annotated data can vary due to factors such as subjective differenc...

Please sign up or login with your details

Forgot password? Click here to reset