research
∙
07/13/2023
Generating Benchmarks for Factuality Evaluation of Language Models
Before deploying a language model (LM) within a given domain, it is impo...
share
research
∙
05/24/2023
MuLER: Detailed and Scalable Reference-based Evaluation
We propose a novel methodology (namely, MuLER) that transforms any refer...
research
∙
02/16/2023
Evaluating and Improving the Coreference Capabilities of Machine Translation Models
Machine translation (MT) requires a wide range of linguistic capabilitie...
research
∙
02/09/2023
A Large-Scale Multilingual Study of Visual Constraints on Linguistic Selection of Descriptions
We present a large, multilingual study into how vision constrains lingui...
research
∙
12/21/2022
Parallel Context Windows Improve In-Context Learning of Large Language Models
For applications that require processing large amounts of text at infere...
research
∙
11/16/2022
Cognitive Simplification Operations Improve Text Simplification
Text Simplification (TS) is the task of converting a text into a form th...
research
∙
11/10/2022
DisentQA: Disentangling Parametric and Contextual Knowledge with Counterfactual Question Answering
Question answering models commonly have access to two sources of "knowle...
research
∙
10/25/2022
Topical Segmentation of Spoken Narratives: A Test Case on Holocaust Survivor Testimonies
The task of topical segmentation is well studied, but previous work has ...
research
∙
10/06/2022
Reinforcement Learning with Large Action Spaces for Neural Machine Translation
Applying Reinforcement learning (RL) following maximum likelihood estima...
research
∙
05/18/2022
PreQuEL: Quality Estimation of Machine Translation Outputs in Advance
We present the task of PreQuEL, Pre-(Quality-Estimation) Learning. A Pre...
research
∙
05/12/2022
A Computational Acquisition Model for Multimodal Word Categorization
Recent advances in self-supervised modeling of text and images open new ...
research
∙
05/11/2022
Some Grammatical Errors are Frequent, Others are Important
In Grammatical Error Correction, systems are evaluated by the number of ...
research
∙
05/01/2022
MRKL Systems: A modular, neuro-symbolic architecture that combines large language models, external knowledge sources and discrete reasoning
Huge language models (LMs) have ushered in a new era for AI, serving as ...
research
∙
10/13/2021
Semantics-aware Attention Improves Neural Machine Translation
The integration of syntactic structures into Transformer machine transla...
research
∙
10/09/2021
On the Relation between Syntactic Divergence and Zero-Shot Performance
We explore the link between the extent to which syntactic relations are ...
research
∙
10/06/2021
On Neurons Invariant to Sentence Structural Changes in Neural Machine Translation
To gain insight into the role neurons play, we study the activation patt...
research
∙
09/23/2021
Putting Words in BERT's Mouth: Navigating Contextualized Vector Spaces with Pseudowords
We present a method for exploring regions around individual points in a ...
research
∙
09/22/2021
Cross-linguistically Consistent Semantic and Syntactic Annotation of Child-directed Speech
While corpora of child speech and child-directed speech (CDS) have enabl...
research
∙
09/13/2021
The Grammar-Learning Trajectories of Neural Language Models
The learning trajectories of linguistic phenomena provide insight into t...
research
∙
06/01/2021
Part of Speech and Universal Dependency effects on English Arabic Machine Translation
In this research paper, I will elaborate on a method to evaluate machine...
research
∙
04/16/2021
Q^2: Evaluating Factual Consistency in Knowledge-Grounded Dialogues via Question Generation and Question Answering
Neural knowledge-grounded generative models for dialogue often produce c...
research
∙
04/13/2021
Mediators in Determining what Processing BERT Performs First
Probing neural models for the ability to perform downstream tasks using ...
research
∙
04/06/2021
SERRANT: a syntactic classifier for English Grammatical Error Types
SERRANT is a system and code for automatic classification of English gra...
research
∙
01/29/2021
Transition based Graph Decoder for Neural Machine Translation
While a number of works showed gains from incorporating source-side symb...
research
∙
12/31/2020
UCCA's Foundational Layer: Annotation Guidelines v2.1
This is the annotation manual for Universal Conceptual Cognitive Annotat...
research
∙
11/02/2020
Comparison by Conversion: Reverse-Engineering UCCA from Syntax and Lexical Semantics
Building robust natural language understanding systems will require a cl...
research
∙
10/21/2020
Classifying Syntactic Errors in Learner Language
We present a method for classifying syntactic errors in learner language...
research
∙
10/05/2020
PMI-Masking: Principled masking of correlated spans
Masking tokens uniformly at random constitutes a common flaw in the pret...
research
∙
05/07/2020
Fine-Grained Analysis of Cross-Linguistic Syntactic Divergences
The patterns in which the syntax of different languages converges and di...
research
∙
05/01/2020
Language (Re)modelling: Towards Embodied Language Understanding
While natural language understanding (NLU) is advancing rapidly, today's...
research
∙
09/19/2019
Made for Each Other: Broad-coverage Semantic Structures Meet Preposition Supersenses
Universal Conceptual Cognitive Annotation (UCCA; Abend and Rappoport, 20...
research
∙
09/15/2019
Automatically Extracting Challenge Sets for Non local Phenomena in Neural Machine Translation
We show that the state of the art Transformer Machine Translation(MT) mo...
research
∙
09/15/2019
Automatically Extracting Challenge Sets for Non-local Phenomena Neural Machine Translation
We show that the state-of-the-art Transformer MT model is not biased tow...
research
∙
07/03/2019
On the Weaknesses of Reinforcement Learning for Neural Machine Translation
Reinforcement learning (RL) is frequently used to increase performance i...
research
∙
06/03/2019
Semantically Constrained Multilayer Annotation: The Case of Coreference
We propose a coreference annotation scheme as a layer on top of the Univ...
research
∙
05/14/2019
The Language of Legal and Illegal Activity on the Darknet
The non-indexed parts of the Internet (the Darknet) have become a haven ...
research
∙
03/15/2019
Content Differences in Syntactic and Semantic Representations
Syntactic analysis plays an important role in semantic parsing, but the ...
research
∙
03/06/2019
SemEval 2019 Task 1: Cross-lingual Semantic Parsing with UCCA
We present the SemEval 2019 shared task on UCCA parsing in English, Germ...
research
∙
10/14/2018
BLEU is Not Suitable for the Evaluation of Text Simplification
BLEU is widely considered to be an informative metric for text-to-text g...
research
∙
10/11/2018
Simple and Effective Text Simplification Using Semantic and Neural Methods
Sentence splitting is a major simplification operator. Here we present a...
research
∙
10/11/2018
Semantic Structural Evaluation for Text Simplification
Current measures for evaluating text simplification systems focus on eva...
research
∙
08/28/2018
Universal Dependency Parsing with a General Transition-Based DAG Parser
This paper presents our experiments with applying TUPA to the CoNLL 2018...
research
∙
05/31/2018
SemEval 2019 Shared Task: Cross-lingual Semantic Parsing with UCCA - Call for Participation
We announce a shared task on UCCA parsing in English, German and French,...
research
∙
05/13/2018
Comprehensive Supersense Disambiguation of English Prepositions and Possessives
Semantic relations are often signaled with prepositional or possessive m...
research
∙
05/01/2018
Multitask Parsing Across Semantic Representations
The ability to consolidate information of different types is at the core...
research
∙
04/30/2018
Automatic Metric Validation for Grammatical Error Correction
Metric validation in Grammatical Error Correction (GEC) is currently don...
research
∙
04/11/2018
Reference-less Measure of Faithfulness for Grammatical Error Correction
We propose USim, a semantic measure for Grammatical Error Correction (G...
research
∙
04/07/2017
Adposition Supersenses v2
This document describes an inventory of 50 semantic labels designed to c...
research
∙
04/03/2017
A Transition-Based Directed Acyclic Graph Parser for UCCA
We present the first parser for UCCA, a cross-linguistically applicable ...
research
∙
06/30/2016