Towards Linguistically Generalizable NLP Systems: A Workshop and Shared Task

11/04/2017
by   Allyson Ettinger, et al.
0

This paper presents a summary of the first Workshop on Building Linguistically Generalizable Natural Language Processing Systems, and the associated Build It Break It, The Language Edition shared task. The goal of this workshop was to bring together researchers in NLP and linguistics with a shared task aimed at testing the generalizability of NLP systems beyond the distributions of their training data. We describe the motivation, setup, and participation of the shared task, provide discussion of some highlighted results, and discuss lessons learned.

READ FULL TEXT
research
07/26/2017

Strawman: an Ensemble of Deep Bag-of-Ngrams for Sentiment Analysis

This paper describes a builder entry, named "strawman", to the sentence-...
research
05/12/2020

A Report on the 2020 Sarcasm Detection Shared Task

Figurative language analysis, such as sarcasm and irony detection has es...
research
04/27/2020

A Summary of the First Workshop on Language Technology for Language Documentation and Revitalization

Despite recent advances in natural language processing and other languag...
research
05/31/2023

Findings of the VarDial Evaluation Campaign 2023

This report presents the results of the shared tasks organized as part o...
research
12/04/2020

Data Processing and Annotation Schemes for FinCausal Shared Task

This document explains the annotation schemes used to label the data for...
research
05/11/2021

Towards transparency in NLP shared tasks

This article reports on a survey carried out across the Natural Language...
research
11/23/2022

A Report on the Euphemisms Detection Shared Task

This paper presents The Shared Task on Euphemism Detection for the Third...

Please sign up or login with your details

Forgot password? Click here to reset