A Pilot Study of Domain Adaptation Effect for Neural Abstractive Summarization

07/21/2017
by   Xinyu Hua, et al.
0

We study the problem of domain adaptation for neural abstractive summarization. We make initial efforts in investigating what information can be transferred to a new domain. Experimental results on news stories and opinion articles indicate that neural summarization model benefits from pre-training based on extractive summaries. We also find that the combination of in-domain and out-of-domain setup yields better summaries when in-domain data is insufficient. Further analysis shows that, the model is capable to select salient content even trained on out-of-domain data, but requires in-domain data to capture the style for a target domain.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/21/2021

AdaptSum: Towards Low-Resource Domain Adaptation for Abstractive Summarization

State-of-the-art abstractive summarization models generally rely on exte...
research
12/22/2021

Domain Adaptation with Pre-trained Transformers for Query Focused Abstractive Text Summarization

The Query Focused Text Summarization (QFTS) task aims at building system...
research
05/26/2023

Domain Aligned Prefix Averaging for Domain Generalization in Abstractive Summarization

Domain generalization is hitherto an underexplored area applied in abstr...
research
10/22/2022

Salience Allocation as Guidance for Abstractive Summarization

Abstractive summarization models typically learn to capture the salient ...
research
09/05/2019

Informative and Controllable Opinion Summarization

Opinion summarization is the task of automatically generating summaries ...
research
05/31/2023

Towards Flow Graph Prediction of Open-Domain Procedural Texts

Machine comprehension of procedural texts is essential for reasoning abo...
research
05/25/2022

Factorizing Content and Budget Decisions in Abstractive Summarization of Long Documents by Sampling Summary Views

We argue that disentangling content selection from the budget used to co...

Please sign up or login with your details

Forgot password? Click here to reset