DeepAI
Log In Sign Up

Generating (Factual?) Narrative Summaries of RCTs: Experiments with Neural Multi-Document Summarization

08/25/2020
by   Byron C. Wallace, et al.
0

We consider the problem of automatically generating a narrative biomedical evidence summary from multiple trial reports. We evaluate modern neural models for abstractive summarization of relevant article abstracts from systematic reviews previously conducted by members of the Cochrane collaboration, using the authors conclusions section of the review abstract as our target. We enlist medical professionals to evaluate generated summaries, and we find that modern summarization systems yield consistently fluent and relevant synopses, but that they are not always factual. We propose new approaches that capitalize on domain-specific models to inform summarization, e.g., by explicitly demarcating snippets of inputs that convey key findings, and emphasizing the reports of large and high-quality trials. We find that these strategies modestly improve the factual accuracy of generated summaries. Finally, we propose a new method for automatically evaluating the factuality of generated narrative evidence syntheses using models that infer the directionality of reported findings.

READ FULL TEXT

page 1

page 2

page 3

page 4

05/14/2019

Ontology-Aware Clinical Abstractive Summarization

Automatically generating accurate summaries from clinical reports could ...
09/07/2019

On Extractive and Abstractive Neural Document Summarization with Transformer Language Models

We present a method to produce abstractive summaries of long documents t...
04/01/2022

Predicting Intervention Approval in Clinical Trials through Multi-Document Summarization

Clinical trials offer a fundamental opportunity to discover new treatmen...
04/13/2021

MS2: Multi-Document Summarization of Medical Studies

To assess the effectiveness of any medical intervention, researchers mus...
04/30/2020

Self-Supervised and Controlled Multi-Document Opinion Summarization

We address the problem of unsupervised abstractive summarization of coll...
11/15/2022

Toward expanding the scope of radiology report summarization to multiple anatomies and modalities

Radiology report summarization is a growing area of research. Given the ...
06/26/2019

User-Oriented Summaries Using a PSO Based Scoring Optimization Method

Automatic text summarization tools have a great impact on many fields, s...