research
∙
03/21/2022
Word Order Does Matter (And Shuffled Language Models Know It)
Recent studies have shown that language models pretrained and/or fine-tu...
share
research
∙
10/17/2021
Schrödinger's Tree – On Syntax and Neural Language Models
In the last half-decade, the field of natural language processing (NLP) ...
research
∙
09/13/2021
Can Language Models Encode Perceptual Structure Without Grounding? A Case Study in Color
Pretrained language models have been shown to encode relational informat...
research
∙
01/26/2021
Attention Can Reflect Syntactic Structure (If You Let It)
Since the popularization of the Transformer as a general-purpose feature...
research
∙
05/25/2020
Køpsala: Transition-Based Graph Parsing via Efficient Training and Effective Encoding
We present Køpsala, the Copenhagen-Uppsala system for the Enhanced Unive...
research
∙
04/29/2020
Do Neural Language Models Show Preferences for Syntactic Formalisms?
Recent work on the interpretability of deep neural language models has c...
research
∙
09/01/2019
Higher-order Comparisons of Sentence Encoder Representations
Representational Similarity Analysis (RSA) is a technique developed by n...
research
∙
08/20/2019
Deep Contextualized Word Embeddings in Transition-Based and Graph-Based Dependency Parsing -- A Tale of Two Parsers Revisited
Transition-based and graph-based dependency parsers have previously been...
research
∙
08/29/2018