Leveraging Summary Guidance on Medical Report Summarization

02/08/2023
by   Yunqi Zhu, et al.
0

This study presents three deidentified large medical text datasets, named DISCHARGE, ECHO and RADIOLOGY, which contain 50K, 16K and 378K pairs of report and summary that are derived from MIMIC-III, respectively. We implement convincing baselines of automated abstractive summarization on the proposed datasets with pre-trained encoder-decoder language models, including BERT2BERT, T5-large and BART. Further, based on the BART model, we leverage the sampled summaries from the train set as prior knowledge guidance, for encoding additional contextual representations of the guidance with the encoder and enhancing the decoding representations in the decoder. The experimental results confirm the improvement of ROUGE scores and BERTScore made by the proposed method, outperforming the larger model T5-large.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/21/2020

Leveraging ParsBERT and Pretrained mT5 for Persian Abstractive Text Summarization

Text summarization is one of the most critical Natural Language Processi...
research
08/28/2018

Guided Neural Language Generation for Abstractive Summarization using Abstract Meaning Representation

Recent work on abstractive summarization has made progress with neural e...
research
04/16/2019

Positional Encoding to Control Output Sequence Length

Neural encoder-decoder models have been successful in natural language g...
research
04/26/2022

GypSum: Learning Hybrid Representations for Code Summarization

Code summarization with deep learning has been widely studied in recent ...
research
09/01/2022

Enhancing Semantic Understanding with Self-supervised Methods for Abstractive Dialogue Summarization

Contextualized word embeddings can lead to state-of-the-art performances...
research
06/28/2023

Leveraging GPT-4 for Food Effect Summarization to Enhance Product-Specific Guidance Development via Iterative Prompting

Food effect summarization from New Drug Application (NDA) is an essentia...
research
03/15/2023

FactReranker: Fact-guided Reranker for Faithful Radiology Report Summarization

Automatic radiology report summarization is a crucial clinical task, who...

Please sign up or login with your details

Forgot password? Click here to reset