research
∙
08/22/2023
Efficient Benchmarking (of Language Models)
The increasing versatility of language models LMs has given rise to a ne...
share
research
∙
06/02/2023
Resolving Interference When Merging Models
Transfer learning - i.e., further fine-tuning a pre-trained model on a d...
research
∙
05/24/2023
MuLER: Detailed and Scalable Reference-based Evaluation
We propose a novel methodology (namely, MuLER) that transforms any refer...
research
∙
03/16/2023
Jump to Conclusions: Short-Cutting Transformers With Linear Transformations
Transformer-based language models (LMs) create hidden representations of...
research
∙
02/09/2023
Knowledge is a Region in Weight Space for Fine-tuned Language Models
Research on neural networks has largely focused on understanding a singl...
research
∙
01/27/2023
Call for Papers – The BabyLM Challenge: Sample-efficient pretraining on a developmentally plausible corpus
We present the call for papers for the BabyLM Challenge: Sample-efficien...
research
∙
12/02/2022
ColD Fusion: Collaborative Descent for Distributed Multitask Finetuning
Pretraining has been shown to scale well with compute, data size and dat...
research
∙
11/10/2022
DisentQA: Disentangling Parametric and Contextual Knowledge with Counterfactual Question Answering
Question answering models commonly have access to two sources of "knowle...
research
∙
10/31/2022
Where to start? Analyzing the potential value of intermediate models
Previous studies observed that finetuned models may be better base model...
research
∙
10/06/2022
Reinforcement Learning with Large Action Spaces for Neural Machine Translation
Applying Reinforcement learning (RL) following maximum likelihood estima...
research
∙
08/02/2022
Label Sleuth: From Unlabeled Text to a Classifier in a Few Hours
Text classification can be useful in many real-world scenarios, saving a...
research
∙
05/18/2022
PreQuEL: Quality Estimation of Machine Translation Outputs in Advance
We present the task of PreQuEL, Pre-(Quality-Estimation) Learning. A Pre...
research
∙
05/11/2022
Some Grammatical Errors are Frequent, Others are Important
In Grammatical Error Correction, systems are evaluated by the number of ...
research
∙
04/06/2022
Fusing finetuned models for better pretraining
Pretrained models are the standard starting point for training. This app...
research
∙
03/20/2022
Cluster Tune: Boost Cold Start Performance in Text Classification
In real-world scenarios, a text classification task often begins with a ...
research
∙
10/13/2021
Semantics-aware Attention Improves Neural Machine Translation
The integration of syntactic structures into Transformer machine transla...
research
∙
10/06/2021
On Neurons Invariant to Sentence Structural Changes in Neural Machine Translation
To gain insight into the role neurons play, we study the activation patt...
research
∙
09/13/2021
The Grammar-Learning Trajectories of Neural Language Models
The learning trajectories of linguistic phenomena provide insight into t...
research
∙
08/23/2021
ComSum: Commit Messages Summarization and Meaning Preservation
We present ComSum, a data set of 7 million commit messages for text summ...
research
∙
06/01/2021
Part of Speech and Universal Dependency effects on English Arabic Machine Translation
In this research paper, I will elaborate on a method to evaluate machine...
research
∙
04/16/2021
Q^2: Evaluating Factual Consistency in Knowledge-Grounded Dialogues via Question Generation and Question Answering
Neural knowledge-grounded generative models for dialogue often produce c...
research
∙
04/13/2021
Mediators in Determining what Processing BERT Performs First
Probing neural models for the ability to perform downstream tasks using ...
research
∙
04/08/2021
GrASP: A Library for Extracting and Exploring Human-Interpretable Textual Patterns
Data exploration is an important step of every data science and machine ...
research
∙
04/06/2021
SERRANT: a syntactic classifier for English Grammatical Error Types
SERRANT is a system and code for automatic classification of English gra...
research
∙
01/29/2021
Transition based Graph Decoder for Neural Machine Translation
While a number of works showed gains from incorporating source-side symb...
research
∙
10/21/2020
Classifying Syntactic Errors in Learner Language
We present a method for classifying syntactic errors in learner language...
research
∙
10/19/2020
Unsupervised Expressive Rules Provide Explainability and Assist Human Experts Grasping New Domains
Approaching new data can be quite deterrent; you do not know how your ca...
research
∙
11/25/2019
Corpus Wide Argument Mining – a Working Solution
One of the main tasks in argument mining is the retrieval of argumentati...
research
∙
09/15/2019
Automatically Extracting Challenge Sets for Non local Phenomena in Neural Machine Translation
We show that the state of the art Transformer Machine Translation(MT) mo...
research
∙
09/15/2019
Automatically Extracting Challenge Sets for Non-local Phenomena Neural Machine Translation
We show that the state-of-the-art Transformer MT model is not biased tow...
research
∙
07/21/2019
Are You Convinced? Choosing the More Convincing Evidence with a Siamese Network
With the advancement in argument detection, we suggest to pay more atten...
research
∙
07/03/2019
On the Weaknesses of Reinforcement Learning for Neural Machine Translation
Reinforcement learning (RL) is frequently used to increase performance i...
research
∙
06/10/2019
Learning to combine Grammatical Error Corrections
The field of Grammatical Error Correction (GEC) has produced various sys...
research
∙
05/14/2019
The Language of Legal and Illegal Activity on the Darknet
The non-indexed parts of the Internet (the Darknet) have become a haven ...
research
∙
03/06/2019
SemEval 2019 Task 1: Cross-lingual Semantic Parsing with UCCA
We present the SemEval 2019 shared task on UCCA parsing in English, Germ...
research
∙
05/31/2018
SemEval 2019 Shared Task: Cross-lingual Semantic Parsing with UCCA - Call for Participation
We announce a shared task on UCCA parsing in English, German and French,...
research
∙
04/30/2018
Inherent Biases in Reference-based Evaluation for Grammatical Error Correction and Text Simplification
The prevalent use of too few references for evaluating text-to-text gene...
research
∙
04/30/2018
Automatic Metric Validation for Grammatical Error Correction
Metric validation in Grammatical Error Correction (GEC) is currently don...
research
∙
04/11/2018
DORA The Explorer: Directed Outreaching Reinforcement Action-Selection
Exploration is a fundamental aspect of Reinforcement Learning, typically...
research
∙
04/11/2018