A preliminary study on evaluating Consultation Notes with Post-Editing

04/09/2021
by   Francesco Moramarco, et al.
0

Automatic summarisation has the potential to aid physicians in streamlining clerical tasks such as note taking. But it is notoriously difficult to evaluate these systems and demonstrate that they are safe to be used in a clinical setting. To circumvent this issue, we propose a semi-automatic approach whereby physicians post-edit generated notes before submitting them. We conduct a preliminary study on the time saving of automatically generated consultation notes with post-editing. Our evaluators are asked to listen to mock consultations and to post-edit three generated notes. We time this and find that it is faster than writing the note from scratch. We present insights and lessons learnt from this experiment.

READ FULL TEXT
research
04/01/2022

Human Evaluation and Correlation with Automatic Metrics in Consultation Note Generation

In recent years, machine learning models have rapidly become better at g...
research
06/21/2023

The Cydoc smart patient intake form accelerates medical note writing

Purpose: This study evaluates the effect of Cydoc software tools on medi...
research
03/20/2019

Smart Edition of MIDI Files

We address the issue of editing musical performance data, in particular ...
research
07/31/2018

Manual Post-editing of Automatically Transcribed Speeches from the Icelandic Parliament - Althingi

The design objectives for an automatic transcription system are to produ...
research
02/20/2017

Post-edit Analysis of Collective Biography Generation

Text generation is increasingly common but often requires manual post-ed...
research
11/17/2022

Consultation Checklists: Standardising the Human Evaluation of Medical Note Generation

Evaluating automatically generated text is generally hard due to the inh...
research
04/02/2021

GAVIN: Gaze-Assisted Voice-Based Implicit Note-taking

Annotation is an effective reading strategy people often undertake while...

Please sign up or login with your details

Forgot password? Click here to reset