TeamTat: a collaborative text annotation tool

04/24/2020
by   Rezarta Islamaj, et al.
0

Manually annotated data is key to developing text-mining and information-extraction algorithms. However, human annotation requires considerable time, effort and expertise. Given the rapid growth of biomedical literature, it is paramount to build tools that facilitate speed and maintain expert quality. While existing text annotation tools may provide user-friendly interfaces to domain experts, limited support is available for image display, project management, and multi-user team annotation. In response, we developed TeamTat (teamtat.org), a web-based annotation tool (local setup available), equipped to manage team annotation projects engagingly and efficiently. TeamTat is a novel tool for managing multi-user, multi-label document annotation, reflecting the entire production life cycle. Project managers can specify annotation schema for entities and relations and select annotator(s) and distribute documents anonymously to prevent bias. Document input format can be plain text, PDF or BioC, (uploaded locally or automatically retrieved from PubMed or PMC), and output format is BioC with inline annotations. TeamTat displays figures from the full text for the annotators convenience. Multiple users can work on the same document independently in their workspaces, and the team manager can track task completion. TeamTat provides corpus-quality assessment via inter-annotator agreement statistics, and a user-friendly interface convenient for annotation review and inter-annotator disagreement resolution to improve corpus quality.

READ FULL TEXT

page 5

page 6

page 7

research
09/16/2021

SenTag: a Web-based Tool for Semantic Annotation of Textual Documents

In this work, we present SenTag, a lightweight web-based tool focused on...
research
07/18/2019

SLATE: A Super-Lightweight Annotation Tool for Experts

Many annotation tools have been developed, covering a wide variety of ta...
research
11/10/2017

YEDDA: A Lightweight Collaborative Text Span Annotation Tool

In this paper, we introduce YEDDA, a lightweight but efficient open-sour...
research
09/06/2021

LightTag: Text Annotation Platform

Text annotation tools assume that their user's goal is to create a label...
research
03/31/2023

LabelVizier: Interactive Validation and Relabeling for Technical Text Annotations

With the rapid accumulation of text data produced by data-driven techniq...
research
11/01/2017

Text Annotation Graphs: Annotating Complex Natural Language Phenomena

This paper introduces a new web-based software tool for annotating text,...
research
11/22/2017

TexT - Text Extractor Tool for Handwritten Document Transcription and Annotation

This paper presents a framework for semi-automatic transcription of larg...

Please sign up or login with your details

Forgot password? Click here to reset