Abstractive summarization of hospitalisation histories with transformer networks

04/05/2022
by   Alexander Yalunin, et al.
0

In this paper we present a novel approach to abstractive summarization of patient hospitalisation histories. We applied an encoder-decoder framework with Longformer neural network as an encoder and BERT as a decoder. Our experiments show improved quality on some summarization tasks compared with pointer-generator networks. We also conducted a study with experienced physicians evaluating the results of our model in comparison with PGN baseline and human-generated abstracts, which showed the effectiveness of our model.

READ FULL TEXT
research
11/08/2019

Resurrecting Submodularity in Neural Abstractive Summarization

Submodularity is a desirable property for a variety of objectives in sum...
research
12/31/2016

Cutting-off Redundant Repeating Generations for Neural Abstractive Summarization

This paper tackles the reduction of redundant repeating generation that ...
research
03/29/2020

Abstractive Text Summarization based on Language Model Conditioning and Locality Modeling

We explore to what extent knowledge about the pre-trained language model...
research
10/21/2020

Learning to Summarize Long Texts with Memory Compression and Transfer

We introduce Mem2Mem, a memory-to-memory mechanism for hierarchical recu...
research
08/19/2018

Adapting the Neural Encoder-Decoder Framework from Single to Multi-Document Summarization

Generating an abstract from a set of relevant documents remains challeng...
research
02/02/2023

Curriculum-Guided Abstractive Summarization

Recent Transformer-based summarization models have provided a promising ...
research
08/08/2022

Abstractive Meeting Summarization: A Survey

Recent advances in deep learning, and especially the invention of encode...

Please sign up or login with your details

Forgot password? Click here to reset