Causal Knowledge Extraction from Scholarly Papers in Social Sciences

by   Victor Zitian Chen, et al.

The scale and scope of scholarly articles today are overwhelming human researchers who seek to timely digest and synthesize knowledge. In this paper, we seek to develop natural language processing (NLP) models to accelerate the speed of extraction of relationships from scholarly papers in social sciences, identify hypotheses from these papers, and extract the cause-and-effect entities. Specifically, we develop models to 1) classify sentences in scholarly documents in business and management as hypotheses (hypothesis classification), 2) classify these hypotheses as causal relationships or not (causality classification), and, if they are causal, 3) extract the cause and effect entities from these hypotheses (entity extraction). We have achieved high performance for all the three tasks using different modeling techniques. Our approach may be generalizable to scholarly documents in a wide range of social sciences, as well as other types of textual materials.



There are no comments yet.


page 5


Machine Reading of Hypotheses for Organizational Research Reviews and Pre-trained Models via R Shiny App for Non-Programmers

The volume of scientific publications in organizational research becomes...

Causal-BERT : Language models for causality detection between events expressed in text

Causality understanding between events is a critical natural language pr...

Towards Causality Extraction from Requirements

System behavior is often based on causal relations between certain event...

Causal Inference in Natural Language Processing: Estimation, Prediction, Interpretation and Beyond

A fundamental goal of scientific research is to learn about causal relat...

Knowledge-based Extraction of Cause-Effect Relations from Biomedical Text

We propose a knowledge-based approach for extraction of Cause-Effect (CE...

Improving Model Robustness Using Causal Knowledge

For decades, researchers in fields, such as the natural and social scien...

Extracting Qualitative Causal Structure with Transformer-Based NLP

Qualitative causal relationships compactly express the direction, depend...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.