Global Contentious Politics Database (GLOCON) Annotation Manuals

05/17/2022
by   Fırat Duruşan, et al.
0

The database creation utilized automated text processing tools that detect if a news article contains a protest event, locate protest information within the article, and extract pieces of information regarding the detected protest events. The basis of training and testing the automated tools is the GLOCON Gold Standard Corpus (GSC), which contains news articles from multiple sources from each focus country. The articles in the GSC were manually coded by skilled annotators in both classification and extraction tasks with the utmost accuracy and consistency that automated tool development demands. In order to assure these, the annotation manuals in this document lay out the rules according to which annotators code the news articles. Annotators refer to the manuals at all times for all annotation tasks and apply the rules that they contain. The content of the annotation manual is built on the general principles and standards of linguistic annotation laid out in other prominent annotation manuals such as ACE, CAMEO, and TimeML. These principles, however, have been adapted or rather modified heavily to accommodate the social scientific concepts and variables employed in the EMW project. The manual has been molded throughout a long trial and error process that accompanied the annotation of the GSC. It owes much of its current shape to the meticulous work and invaluable feedback provided by highly specialized teams of annotators, whose diligence and expertise greatly increased the quality of the corpus.

READ FULL TEXT
research
08/01/2020

Cross-context News Corpus for Protest Events related Knowledge Base Construction

We describe a gold standard corpus of protest events that comprise of va...
research
03/13/2019

SciLens: Evaluating the Quality of Scientific News Articles Using Social Media and Scientific Literature Indicators

This paper describes, develops, and validates SciLens, a method to evalu...
research
01/15/2021

Annotation of epidemiological information in animal disease-related news articles: guidelines

This paper describes a method for annotation of epidemiological informat...
research
05/31/2023

Automated Annotation with Generative AI Requires Validation

Generative large language models (LLMs) can be a powerful tool for augme...
research
02/08/2023

NewsComp: Facilitating Diverse News Reading through Comparative Annotation

To support efficient, balanced news consumption, merging articles from d...
research
06/14/2022

NewsEdits: A News Article Revision Dataset and a Document-Level Reasoning Challenge

News article revision histories provide clues to narrative and factual e...
research
03/24/2020

Investigating Software Usage in the Social Sciences: A Knowledge Graph Approach

Knowledge about the software used in scientific investigations is necess...

Please sign up or login with your details

Forgot password? Click here to reset