GRILLBot: An Assistant for Real-World Tasks with Neural Semantic Parsing and Graph-Based Representations

08/31/2022
by   Carlos Gemmell, et al.
0

GRILLBot is the winning system in the 2022 Alexa Prize TaskBot Challenge, moving towards the next generation of multimodal task assistants. It is a voice assistant to guide users through complex real-world tasks in the domains of cooking and home improvement. These are long-running and complex tasks that require flexible adjustment and adaptation. The demo highlights the core aspects, including a novel Neural Decision Parser for contextualized semantic parsing, a new "TaskGraph" state representation that supports conditional execution, knowledge-grounded chit-chat, and automatic enrichment of tasks with images and videos.

READ FULL TEXT

page 3

page 4

research
09/16/2020

Grounded Adaptation for Zero-shot Executable Semantic Parsing

We propose Grounded Adaptation for Zero-shot Executable Semantic Parsing...
research
05/31/2018

SemEval 2019 Shared Task: Cross-lingual Semantic Parsing with UCCA - Call for Participation

We announce a shared task on UCCA parsing in English, German and French,...
research
04/03/2017

A Transition-Based Directed Acyclic Graph Parser for UCCA

We present the first parser for UCCA, a cross-linguistically applicable ...
research
07/02/2019

Neural Semantic Parsing with Anonymization for Command Understanding in General-Purpose Service Robots

Service robots are envisioned to undertake a wide range of tasks at the ...
research
10/01/2021

Self-Attentive Constituency Parsing for UCCA-based Semantic Parsing

Semantic parsing provides a way to extract the semantic structure of a t...
research
09/26/2017

Object-oriented Neural Programming (OONP) for Document Understanding

We propose Object-oriented Neural Programming (OONP), a framework for se...
research
09/10/2019

Core Semantic First: A Top-down Approach for AMR Parsing

We introduce a novel scheme for parsing a piece of text into its Abstrac...

Please sign up or login with your details

Forgot password? Click here to reset