Causal Effects of Linguistic Properties

10/24/2020
by   Reid Pryzant, et al.
0

We consider the problem of estimating the causal effects of linguistic properties on downstream outcomes. For example, does writing a complaint politely lead to a faster response time? How much will a positive product review increase sales? This paper focuses on two challenges related to the problem. First, we formalize the causal quantity of interest as the effect of a writer's intent, and establish the assumptions necessary to identify this from observational data. Second, in practice we only have access to noisy proxies for these linguistic properties—e.g., predictions from classifiers and lexicons. We propose an estimator for this setting and prove that its bias is bounded when we perform an adjustment for the text. The method leverages (1) a pre-trained language model (BERT) to adjust for the text, and (2) distant supervision to improve the quality of noisy proxies. We show that our algorithm produces better causal estimates than related methods on two datasets: predicting the effect of music review sentiment on sales, and complaint politeness on response time.

READ FULL TEXT

page 1

page 2

page 3

page 4

03/03/2020

Differentiable Causal Backdoor Discovery

Discovering the causal effect of a decision is critical to nearly all fo...
03/06/2020

Estimation of causal effects with small data under implicit functional constraints

We consider the problem of estimating causal effects of interventions fr...
10/05/2020

Linguistic Profiling of a Neural Language Model

In this paper we investigate the linguistic knowledge learned by a Neura...
05/29/2019

Using Text Embeddings for Causal Inference

We address causal inference with text documents. For example, does addin...
06/13/2022

Estimating Causal Effects Under Image Confounding Bias with an Application to Poverty in Africa

Observational studies of causal effects require adjustment for confoundi...
06/10/2019

Estimating Causal Effects of Tone in Online Debates

Statistical methods applied to social media posts shed light on the dyna...
08/20/2022

Data-Driven Causal Effect Estimation Based on Graphical Causal Modelling: A Survey

In many fields of scientific research and real-world applications, unbia...