SciAnnotate: A Tool for Integrating Weak Labeling Sources for Sequence Labeling

08/07/2022
by   Mengyang Liu, et al.
0

Weak labeling is a popular weak supervision strategy for Named Entity Recognition (NER) tasks, with the goal of reducing the necessity for hand-crafted annotations. Although there are numerous remarkable annotation tools for NER labeling, the subject of integrating weak labeling sources is still unexplored. We introduce a web-based tool for text annotation called SciAnnotate, which stands for scientific annotation tool. Compared to frequently used text annotation tools, our annotation tool allows for the development of weak labels in addition to providing a manual annotation experience. Our tool provides users with multiple user-friendly interfaces for creating weak labels. SciAnnotate additionally allows users to incorporate their own language models and visualize the output of their model for evaluation. In this study, we take multi-source weak label denoising as an example, we utilized a Bertifying Conditional Hidden Markov Model to denoise the weak label generated by our tool. We also evaluate our annotation tool against the dataset provided by Mysore which contains 230 annotated materials synthesis procedures. The results shows that a 53.7 time obtained AND a 1.6% increase in recall using weak label denoising. Online demo is available at https://sciannotate.azurewebsites.net/(demo account can be found in README), but we don't host a model server with it, please check the README in supplementary material for model server usage.

READ FULL TEXT
research
05/26/2021

BERTifying the Hidden Markov Model for Multi-Source Weakly Supervised Named Entity Recognition

We study the problem of learning a named entity recognition (NER) tagger...
research
02/22/2023

FiNER: Financial Named Entity Recognition Dataset and Weak-Supervision Model

The development of annotated datasets over the 21st century has helped u...
research
04/30/2020

Named Entity Recognition without Labelled Data: A Weak Supervision Approach

Named Entity Recognition (NER) performance often degrades rapidly when a...
research
01/21/2021

Validating Label Consistency in NER Data Annotation

Data annotation plays a crucial role in ensuring your named entity recog...
research
05/29/2023

Alfred: A System for Prompted Weak Supervision

Alfred is the first system for programmatic weak supervision (PWS) that ...
research
03/16/2020

Parallel sequence tagging for concept recognition

Motivation: Named Entity Recognition (NER) and Normalisation (NEN) are c...
research
12/16/2022

POTATO: The Portable Text Annotation Tool

We present POTATO, the Portable text annotation tool, a free, fully open...

Please sign up or login with your details

Forgot password? Click here to reset