DeepAI AI Chat
Log In Sign Up

Overview of CLEF 2019 Lab ProtestNews: Extracting Protests from News in a Cross-context Setting

by   Ali Hürriyetoğlu, et al.
Koç University

We present an overview of the CLEF-2019 Lab ProtestNews on Extracting Protests from News in the context of generalizable natural language processing. The lab consists of document, sentence, and token level information classification and extraction tasks that were referred as task 1, task 2, and task 3 respectively in the scope of this lab. The tasks required the participants to identify protest relevant information from English local news at one or more aforementioned levels in a cross-context setting, which is cross-country in the scope of this lab. The training and development data were collected from India and test data was collected from India and China. The lab attracted 58 teams to participate in the lab. 12 and 9 of these teams submitted results and working notes respectively. We have observed neural networks yield the best results and the performance drops significantly for majority of the submissions in the cross-country setting, which is China.


page 1

page 2

page 3

page 4


WNUT-2020 Task 1 Overview: Extracting Entities and Relations from Wet Lab Protocols

This paper presents the results of the wet lab information extraction ta...

Overview of CheckThat! 2020: Automatic Identification and Verification of Claims in Social Media

We present an overview of the third edition of the CheckThat! Lab at CLE...

Extended Multilingual Protest News Detection – Shared Task 1, CASE 2021 and 2022

We report results of the CASE 2022 Shared Task 1 on Multilingual Protest...

Multitask Models for Supervised Protests Detection in Texts

The CLEF 2019 ProtestNews Lab tasks participants to identify text relati...

Overview of LiLAS 2021 – Living Labs for Academic Search

The Living Labs for Academic Search (LiLAS) lab aims to strengthen the c...

Fancy Man Lauches Zippo at WNUT 2020 Shared Task-1: A Bert Case Model for Wet Lab Entity Extraction

Automatic or semi-automatic conversion of protocols specifying steps in ...