DeepAI AI Chat
Log In Sign Up

Transfer Learning for Causal Sentence Detection

by   Manolis Kyriakakis, et al.
Athens University of Economics and Business

We consider the task of detecting sentences that express causality, as a step towards mining causal relations from texts. To bypass the scarcity of causal instances in relation extraction datasets, we exploit transfer learning, namely ELMO and BERT, using a bidirectional GRU with self-attention ( BIGRUATT ) as a baseline. We experiment with both generic public relation extraction datasets and a new biomedical causal sentence detection dataset, a subset of which we make publicly available. We find that transfer learning helps only in very small datasets. With larger datasets, BIGRUATT reaches a performance plateau, then larger datasets and transfer learning do not help.


page 1

page 2

page 3

page 4


Experiments on transfer learning architectures for biomedical relation extraction

Relation extraction (RE) consists in identifying and structuring automat...

A Practical Approach towards Causality Mining in Clinical Text using Active Transfer Learning

Objective: Causality mining is an active research area, which requires t...

Joint Learning-based Causal Relation Extraction from Biomedical Literature

Causal relation extraction of biomedical entities is one of the most com...

BERT-GT: Cross-sentence n-ary relation extraction with BERT and Graph Transformer

A biomedical relation statement is commonly expressed in multiple senten...

Element Intervention for Open Relation Extraction

Open relation extraction aims to cluster relation instances referring to...

Predicting Directionality in Causal Relations in Text

In this work, we test the performance of two bidirectional transformer-b...

Automatic Extraction of Causal Relations from Natural Language Texts: A Comprehensive Survey

Automatic extraction of cause-effect relationships from natural language...