-
What Ingredients Make for an Effective Crowdsourcing Protocol for Difficult NLU Data Collection Tasks?
Crowdsourcing is widely used to create data for common natural language ...
06/01/2021 ∙ by Nikita Nangia, et al. ∙
0
∙
share
read it
-
Does Putting a Linguist in the Loop Improve NLU Data Collection?
Many crowdsourced NLP datasets contain systematic gaps and biases that a...
04/15/2021 ∙ by Alicia Parrish, et al. ∙
0
∙
share
read it
-
CLiMP: A Benchmark for Chinese Language Model Evaluation
Linguistically informed analyses of language models (LMs) contribute to ...
01/26/2021 ∙ by Beilei Xiang, et al. ∙
0
∙
share
read it
-
When Do You Need Billions of Words of Pretraining Data?
NLP is currently dominated by general-purpose pretrained language models...
11/10/2020 ∙ by Yian Zhang, et al. ∙
0
∙
share
read it
-
Learning Which Features Matter: RoBERTa Acquires a Preference for Linguistic Generalizations (Eventually)
One reason pretraining on self-supervised linguistic tasks is effective ...
10/11/2020 ∙ by Alex Warstadt, et al. ∙
0
∙
share
read it
-
Can neural networks acquire a structural bias from raw linguistic data?
We evaluate whether BERT, a widely used neural network for sentence proc...
07/14/2020 ∙ by Alex Warstadt, et al. ∙
0
∙
share
read it
-
Are Natural Language Inference Models IMPPRESsive? Learning IMPlicature and PRESupposition
Natural language inference (NLI) is an increasingly important task for n...
04/07/2020 ∙ by Paloma Jeretič, et al. ∙
0
∙
share
read it
-
BLiMP: A Benchmark of Linguistic Minimal Pairs for English
We introduce The Benchmark of Linguistic Minimal Pairs (shortened to BLi...
12/02/2019 ∙ by Alex Warstadt, et al. ∙
0
∙
share
read it
-
Investigating BERT's Knowledge of Language: Five Analysis Methods with NPIs
Though state-of-the-art sentence representation models can perform tasks...
09/05/2019 ∙ by Alex Warstadt, et al. ∙
0
∙
share
read it
-
Grammatical Analysis of Pretrained Sentence Encoders with Acceptability Judgments
Recent pretrained sentence encoders achieve state of the art results on ...
01/11/2019 ∙ by Alex Warstadt, et al. ∙
0
∙
share
read it
-
Verb Argument Structure Alternations in Word and Sentence Embeddings
Verbs occur in different syntactic environments, or frames. We investiga...
11/27/2018 ∙ by Katharina Kann, et al. ∙
0
∙
share
read it
-
Neural Network Acceptability Judgments
In this work, we explore the ability of artificial neural networks to ju...
05/31/2018 ∙ by Alex Warstadt, et al. ∙
0
∙
share
read it
