ALIGNMEET: A Comprehensive Tool for Meeting Annotation, Alignment, and Evaluation

05/11/2022
by   Peter Polák, et al.
0

Summarization is a challenging problem, and even more challenging is to manually create, correct, and evaluate the summaries. The severity of the problem grows when the inputs are multi-party dialogues in a meeting setup. To facilitate the research in this area, we present ALIGNMEET, a comprehensive tool for meeting annotation, alignment, and evaluation. The tool aims to provide an efficient and clear interface for fast annotation while mitigating the risk of introducing errors. Moreover, we add an evaluation mode that enables a comprehensive quality evaluation of meeting minutes. To the best of our knowledge, there is no such tool available. We release the tool as open source. It is also directly installable from PyPI.

READ FULL TEXT
research
06/05/2022

Annotation Error Detection: Analyzing the Past and Present for a More Coherent Future

Annotated data is an essential ingredient in natural language processing...
research
09/01/2020

SuperPAL: Supervised Proposition ALignment for Multi-Document Summarization and Derivative Sub-Tasks

Multi-document summarization (MDS) is a challenging task, often decompos...
research
10/19/2016

A Robust 3D-2D Interactive Tool for Scene Segmentation and Annotation

Recent advances of 3D acquisition devices have enabled large-scale acqui...
research
11/10/2017

YEDDA: A Lightweight Collaborative Text Span Annotation Tool

In this paper, we introduce YEDDA, a lightweight but efficient open-sour...
research
04/24/2019

The VGG Image Annotator (VIA)

Manual image annotation, such as defining and labelling regions of inter...
research
01/30/2023

LongEval: Guidelines for Human Evaluation of Faithfulness in Long-form Summarization

While human evaluation remains best practice for accurately judging the ...

Please sign up or login with your details

Forgot password? Click here to reset