Few-Shot Learning for Abstractive Multi-Document Opinion Summarization

04/30/2020
by   Arthur Bražinskas, et al.
7

Opinion summarization is an automatic creation of text reflecting subjective information expressed in multiple documents, such as user reviews of a product. The task is practically important and has attracted a lot of attention. However, due to a high cost of summary production, datasets large enough for training supervised models are lacking. Instead, the task has been traditionally approached with extractive methods that learn to select text fragments in an unsupervised or weakly-supervised way. Recently, it has been shown that abstractive summaries, potentially more fluent and better at reflecting conflicting information, can also be produced in an unsupervised fashion. However, these models, not being exposed to the actual summaries, fail to capture their essential properties. In this work, we show that even a handful of summaries is sufficient to bootstrap generation of the summary text with all expected properties, such as writing style, informativeness, fluency, and sentiment preservation. We start by training a language model to generate a new product review given available reviews of the product. The model is aware of the properties: it proceeds with first generating property values and then producing a review conditioned on them. We do not use any summaries in this stage and the property values are derived from reviews with no manual effort. In the second stage, we fine-tune the module predicting the property values on a few available summaries. This lets us switch the generator to the summarization mode. Our approach substantially outperforms previous extractive and abstractive methods in automatic and human evaluation.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/06/2019

Unsupervised Multi-Document Opinion Summarization as Copycat-Review Generation

Summarization of opinions is the process of automatically creating text ...
research
09/09/2021

Learning Opinion Summarizers by Selecting Informative Reviews

Opinion summarization has been traditionally approached with unsupervise...
research
08/27/2018

Summarizing Opinions: Aspect Extraction Meets Sentiment Prediction and They Are Both Weakly Supervised

We present a neural framework for opinion summarization from online prod...
research
04/21/2020

Unsupervised Opinion Summarization with Noising and Denoising

The supervised training of high-capacity models on large datasets contai...
research
12/21/2022

OpineSum: Entailment-based self-training for abstractive opinion summarization

A typical product or place often has hundreds of reviews, and summarizat...
research
04/30/2020

Self-Supervised and Controlled Multi-Document Opinion Summarization

We address the problem of unsupervised abstractive summarization of coll...
research
11/27/2022

Unsupervised Opinion Summarisation in the Wasserstein Space

Opinion summarisation synthesises opinions expressed in a group of docum...

Please sign up or login with your details

Forgot password? Click here to reset