A Cross-Domain Evaluation of Approaches for Causal Knowledge Extraction

08/07/2023
by   Anik Saha, et al.
0

Causal knowledge extraction is the task of extracting relevant causes and effects from text by detecting the causal relation. Although this task is important for language understanding and knowledge discovery, recent works in this domain have largely focused on binary classification of a text segment as causal or non-causal. In this regard, we perform a thorough analysis of three sequence tagging models for causal knowledge extraction and compare it with a span based approach to causality extraction. Our experiments show that embeddings from pre-trained language models (e.g. BERT) provide a significant performance boost on this task compared to previous state-of-the-art models with complex architectures. We observe that span based models perform better than simple sequence tagging models based on BERT across all 4 data sets from diverse domains with different types of cause-effect phrases.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/19/2022

UniCausal: Unified Benchmark and Model for Causal Text Mining

Current causal text mining datasets vary in objectives, data coverage, a...
research
08/22/2020

Applications of BERT Based Sequence Tagging Models on Chinese Medical Text Attributes Extraction

We convert the Chinese medical text attributes extraction task into a se...
research
12/20/2022

Pre-trained Language Models for Keyphrase Generation: A Thorough Empirical Study

Neural models that do not rely on pre-training have excelled in the keyp...
research
04/28/2023

Causal Reasoning and Large Language Models: Opening a New Frontier for Causality

The causal capabilities of large language models (LLMs) is a matter of s...
research
03/25/2021

Predicting Directionality in Causal Relations in Text

In this work, we test the performance of two bidirectional transformer-b...
research
07/28/2022

Measuring Causal Effects of Data Statistics on Language Model's `Factual' Predictions

Large amounts of training data are one of the major reasons for the high...
research
05/03/2023

Causality-aware Concept Extraction based on Knowledge-guided Prompting

Concepts benefit natural language understanding but are far from complet...

Please sign up or login with your details

Forgot password? Click here to reset