DeepAI AI Chat
Log In Sign Up

Task-Oriented Language Grounding for Language Input with Multiple Sub-Goals of Non-Linear Order

by   Vladislav Kurenkov, et al.

In this work, we analyze the performance of general deep reinforcement learning algorithms for a task-oriented language grounding problem, where language input contains multiple sub-goals and their order of execution is non-linear. We generate a simple instructional language for the GridWorld environment, that is built around three language elements (order connectors) defining the order of execution: one linear - "comma" and two non-linear - "but first", "but before". We apply one of the deep reinforcement learning baselines - Double DQN with frame stacking and ablate several extensions such as Prioritized Experience Replay and Gated-Attention architecture. Our results show that the introduction of non-linear order connectors improves the success rate on instructions with a higher number of sub-goals in 2-3 times, but it still does not exceed 20 Gated-Attention provides no competitive advantage against concatenation in this setting. Source code and experiments' results are available at


page 1

page 2

page 3

page 4


Gated-Attention Architectures for Task-Oriented Language Grounding

To perform tasks specified by natural language instructions, autonomous ...

Attention Based Natural Language Grounding by Navigating Virtual Environment

In this work, we focus on the problem of grounding language by training ...

Grounding Hindsight Instructions in Multi-Goal Reinforcement Learning for Robotics

This paper focuses on robotic reinforcement learning with sparse rewards...

Task-Oriented Grasp Prediction with Visual-Language Inputs

To perform household tasks, assistive robots receive commands in the for...

Dynamic Attention Networks for Task Oriented Grounding

In order to successfully perform tasks specified by natural language ins...

Automatic Noise Filtering with Dynamic Sparse Training in Deep Reinforcement Learning

Tomorrow's robots will need to distinguish useful information from noise...

Non-linear interlinkages and key objectives amongst the Paris Agreement and the Sustainable Development Goals

The United Nations' ambitions to combat climate change and prosper human...