Subsentence Extraction from Text Using Coverage-Based Deep Learning Language Models

04/20/2021
by   JongYoon Lim, et al.
17

Sentiment prediction remains a challenging and unresolved task in various research fields, including psychology, neuroscience, and computer science. This stems from its high degree of subjectivity and limited input sources that can effectively capture the actual sentiment. This can be even more challenging with only text-based input. Meanwhile, the rise of deep learning and an unprecedented large volume of data have paved the way for artificial intelligence to perform impressively accurate predictions or even human-level reasoning. Drawing inspiration from this, we propose a coverage-based sentiment and subsentence extraction system that estimates a span of input text and recursively feeds this information back to the networks. The predicted subsentence consists of auxiliary information expressing a sentiment. This is an important building block for enabling vivid and epic sentiment delivery (within the scope of this paper) and for other natural language processing tasks such as text summarisation and Q A. Our approach outperforms the state-of-the-art approaches by a large margin in subsentence prediction (i.e., Average Jaccard scores from 0.72 to 0.89). For the evaluation, we designed rigorous experiments consisting of 24 ablation studies. Finally, our learned lessons are returned to the community by sharing software packages and a public dataset that can reproduce the results presented in this paper.

READ FULL TEXT

page 2

page 6

page 7

page 9

page 10

page 14

page 15

page 16

research
08/13/2017

Leveraging Sparse and Dense Feature Combinations for Sentiment Classification

Neural networks are one of the most popular approaches for many natural ...
research
11/26/2022

A Survey of Text Representation Methods and Their Genealogy

In recent years, with the advent of highly scalable artificial-neural-ne...
research
10/29/2022

Sentiment Classification of Code-Switched Text using Pre-trained Multilingual Embeddings and Segmentation

With increasing globalization and immigration, various studies have esti...
research
11/10/2019

Generalizing Natural Language Analysis through Span-relation Representations

A large number of natural language processing tasks exist to analyze syn...
research
12/04/2018

Practical Text Classification With Large Pre-Trained Language Models

Multi-emotion sentiment classification is a natural language processing ...
research
03/14/2021

A `Sourceful' Twist: Emoji Prediction Based on Sentiment, Hashtags and Application Source

We widely use emojis in social networking to heighten, mitigate or negat...
research
08/25/2020

Contextualized moral inference

Developing moral awareness in intelligent systems has shifted from a top...

Please sign up or login with your details

Forgot password? Click here to reset