"When they say weed causes depression, but it's your fav antidepressant": Knowledge-aware Attention Framework for Relationship Extraction

09/21/2020
by   Shweta Yadav, et al.
0

With the increasing legalization of medical and recreational use of cannabis, more research is needed to understand the association between depression and consumer behavior related to cannabis consumption. Big social media data has potential to provide deeper insights about these associations to public health analysts. In this interdisciplinary study, we demonstrate the value of incorporating domain-specific knowledge in the learning process to identify the relationships between cannabis use and depression. We develop an end-to-end knowledge infused deep learning framework (Gated-K-BERT) that leverages the pre-trained BERT language representation model and domain-specific declarative knowledge source (Drug Abuse Ontology (DAO)) to jointly extract entities and their relationship using gated fusion sharing mechanism. Our model is further tailored to provide more focus to the entities mention in the sentence through entity-position aware attention layer, where ontology is used to locate the target entities position. Experimental results show that inclusion of the knowledge-aware attentive representation in association with BERT can extract the cannabis-depression relationship with better coverage in comparison to the state-of-the-art relation extractor.

READ FULL TEXT

page 1

page 2

page 3

page 4

02/01/2021

"Is depression related to cannabis?": A knowledge-infused model for Entity and Relation Extraction with Limited Supervision

With strong marketing advocacy of the benefits of cannabis use for impro...
04/09/2021

KI-BERT: Infusing Knowledge Context for Better Language and Domain Understanding

Contextualized entity representations learned by state-of-the-art deep l...
05/20/2019

Enriching Pre-trained Language Model with Entity Information for Relation Classification

Relation classification is an important NLP task to extract relations be...
04/18/2021

Knowledge Graph Anchored Information-Extraction for Domain-Specific Insights

The growing quantity and complexity of data pose challenges for humans t...
01/05/2018

Ontology-based Approach for Semantic Data Extraction from Social Big Data: State-of-the-art and Research Directions

A challenge of managing and extracting useful knowledge from social medi...
05/13/2018

An attention-based Bi-GRU-CapsNet model for hypernymy detection between compound entities

Named entities which composed of multiple continuous words frequently oc...