Inferring symmetry in natural language

10/16/2020
by   Chelsea Tanchip, et al.
0

We present a methodological framework for inferring symmetry of verb predicates in natural language. Empirical work on predicate symmetry has taken two main approaches. The feature-based approach focuses on linguistic features pertaining to symmetry. The context-based approach denies the existence of absolute symmetry but instead argues that such inference is context dependent. We develop methods that formalize these approaches and evaluate them against a novel symmetry inference sentence (SIS) dataset comprised of 400 naturalistic usages of literature-informed verbs spanning the spectrum of symmetry-asymmetry. Our results show that a hybrid transfer learning model that integrates linguistic features with contextualized language models most faithfully predicts the empirical data. Our work integrates existing approaches to symmetry in natural language and suggests how symmetry inference can improve systematicity in state-of-the-art language models.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/05/2020

Static Symmetry Breaking in Many-Sorted Finite Model Finding

Symmetry in finite model finding problems of many-sorted first-order log...
research
09/06/2010

Parameterized Complexity Results in Symmetry Breaking

Symmetry is a common feature of many combinatorial problems. Unfortunate...
research
09/19/2019

ASU at TextGraphs 2019 Shared Task: Explanation ReGeneration using Language Models and Iterative Re-Ranking

In this work we describe the system from Natural Language Processing gro...
research
04/30/2020

Pretraining on Non-linguistic Structure as a Tool for Analyzing Learning Bias in Language Models

We propose a novel methodology for analyzing the encoding of grammatical...
research
08/27/2018

Natural Language Inference with Hierarchical BiLSTM Max Pooling Architecture

Recurrent neural networks have proven to be very effective for natural l...
research
11/14/2022

SPE: Symmetrical Prompt Enhancement for Fact Probing

Pretrained language models (PLMs) have been shown to accumulate factual ...
research
08/20/2018

Detecting cognitive impairments by agreeing on interpretations of linguistic features

Linguistic features have shown promising applications for detecting vari...

Please sign up or login with your details

Forgot password? Click here to reset