Collecting Interactive Multi-modal Datasets for Grounded Language Understanding

11/12/2022
by   Shrestha Mohanty, et al.
0

Human intelligence can remarkably adapt quickly to new tasks and environments. Starting from a very young age, humans acquire new skills and learn how to solve new tasks either by imitating the behavior of others or by following provided natural language instructions. To facilitate research which can enable similar capabilities in machines, we made the following contributions (1) formalized the collaborative embodied agent using natural language task; (2) developed a tool for extensive and scalable data collection; and (3) collected the first dataset for interactive grounded language understanding.

READ FULL TEXT

page 2

page 8

research
05/05/2022

Interactive Grounded Language Understanding in a Collaborative Environment: IGLU 2021

Human intelligence has the remarkable ability to quickly adapt to new ta...
research
05/18/2023

Transforming Human-Centered AI Collaboration: Redefining Embodied Agents Capabilities through Interactive Grounded Language Instructions

Human intelligence's adaptability is remarkable, allowing us to adjust t...
research
03/10/2020

Ecological Semantics: Programming Environments for Situated Language Understanding

Large-scale natural language understanding (NLU) systems have made impre...
research
05/27/2022

IGLU 2022: Interactive Grounded Language Understanding in a Collaborative Environment at NeurIPS 2022

Human intelligence has the remarkable ability to adapt to new tasks and ...
research
10/13/2021

NeurIPS 2021 Competition IGLU: Interactive Grounded Language Understanding in a Collaborative Environment

Human intelligence has the remarkable ability to adapt to new tasks and ...
research
04/21/2023

Improving Grounded Language Understanding in a Collaborative Environment by Interacting with Agents Through Help Feedback

Many approaches to Natural Language Processing (NLP) tasks often treat t...
research
11/14/2022

UGIF: UI Grounded Instruction Following

New smartphone users have difficulty engaging with it and often use only...

Please sign up or login with your details

Forgot password? Click here to reset