SummVis: Interactive Visual Analysis of Models, Data, and Evaluation for Text Summarization

04/15/2021
by   Jesse Vig, et al.
21

Novel neural architectures, training strategies, and the availability of large-scale corpora haven been the driving force behind recent progress in abstractive text summarization. However, due to the black-box nature of neural models, uninformative evaluation metrics, and scarce tooling for model and data analysis, the true performance and failure modes of summarization models remain largely unknown. To address this limitation, we introduce SummVis, an open-source tool for visualizing abstractive summaries that enables fine-grained analysis of the models, data, and evaluation metrics associated with text summarization. Through its lexical and semantic visualizations, the tools offers an easy entry point for in-depth model prediction exploration across important dimensions such as factual consistency or abstractiveness. The tool together with several pre-computed model outputs is available at https://github.com/robustness-gym/summvis.

READ FULL TEXT

page 1

page 2

page 3

page 4

08/29/2021

SummerTime: Text Summarization Toolkit for Non-experts

Recent advances in summarization provide models that can generate summar...
07/24/2020

SummEval: Re-evaluating Summarization Evaluation

The scarcity of comprehensive up-to-date studies on evaluation metrics f...
04/30/2021

The Factual Inconsistency Problem in Abstractive Text Summarization: A Survey

Recently, various neural encoder-decoder models pioneered by Seq2Seq fra...
10/24/2020

Go Figure! A Meta Evaluation of Factuality in Summarization

Text generation models can generate factually inconsistent text containi...
06/03/2021

SimCLS: A Simple Framework for Contrastive Learning of Abstractive Summarization

In this paper, we present a conceptually simple while empirically powerf...
08/23/2019

Neural Text Summarization: A Critical Evaluation

Text summarization aims at compressing long documents into a shorter for...
12/07/2020

CX DB8: A queryable extractive summarizer and semantic search engine

Competitive Debate's increasingly technical nature has left competitors ...

Code Repositories

summvis

SummVis is an interactive visualization tool for text summarization.


view repo

buckyR

Organize information on scientific papers with R


view repo