Sentiment Analysis for Reinforcement Learning

10/05/2020
by   Ameet Deshpande, et al.
0

While reinforcement learning (RL) has been successful in natural language processing (NLP) domains such as dialogue generation and text-based games, it typically faces the problem of sparse rewards that leads to slow or no convergence. Traditional methods that use text descriptions to extract only a state representation ignore the feedback inherently present in them. In text-based games, for example, descriptions like "Good Job! You ate the food" indicate progress, and descriptions like "You entered a new room" indicate exploration. Positive and negative cues like these can be converted to rewards through sentiment analysis. This technique converts the sparse reward problem into a dense one, which is easier to solve. Furthermore, this can enable reinforcement learning without rewards, in which the agent learns entirely from these intrinsic sentiment rewards. This framework is similar to intrinsic motivation, where the environment does not necessarily provide the rewards, but the agent analyzes and realizes them by itself. We find that providing dense rewards in text-based games using sentiment analysis improves performance under some conditions.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/05/2019

Using Natural Language for Reward Shaping in Reinforcement Learning

Recent reinforcement learning (RL) approaches have shown strong performa...
research
07/30/2020

PixL2R: Guiding Reinforcement Learning Using Natural Language by Mapping Pixels to Rewards

Reinforcement learning (RL), particularly in sparse reward settings, oft...
research
02/21/2023

Potential-based reward shaping for learning to play text-based adventure games

Text-based games are a popular testbed for language-based reinforcement ...
research
05/18/2017

Feature Control as Intrinsic Motivation for Hierarchical Reinforcement Learning

The problem of sparse rewards is one of the hardest challenges in contem...
research
06/29/2018

TextWorld: A Learning Environment for Text-based Games

We introduce TextWorld, a sandbox learning environment for the training ...
research
11/26/2019

Natural Language Generation Using Reinforcement Learning with External Rewards

We propose an approach towards natural language generation using a bidir...
research
06/12/2020

How to Avoid Being Eaten by a Grue: Structured Exploration Strategies for Textual Worlds

Text-based games are long puzzles or quests, characterized by a sequence...

Please sign up or login with your details

Forgot password? Click here to reset