Generating Instructions at Different Levels of Abstraction

10/08/2020
by   Arne Köhn, et al.
0

When generating technical instructions, it is often convenient to describe complex objects in the world at different levels of abstraction. A novice user might need an object explained piece by piece, while for an expert, talking about the complex object (e.g. a wall or railing) directly may be more succinct and efficient. We show how to generate building instructions at different levels of abstraction in Minecraft. We introduce the use of hierarchical planning to this end, a method from AI planning which can capture the structure of complex objects neatly. A crowdsourcing evaluation shows that the choice of abstraction level matters to users, and that an abstraction strategy which balances low-level and high-level object descriptions compares favorably to ones which don't.

READ FULL TEXT
research
03/10/2021

ELLA: Exploration through Learned Language Abstraction

Building agents capable of understanding language instructions is critic...
research
07/31/2020

DeepVA: Bridging Cognition and Computation through Semantic Interaction and Deep Learning

This paper examines how deep learning (DL) representations, in contrast ...
research
06/05/2021

Visual communication of object concepts at different levels of abstraction

People can produce drawings of specific entities (e.g., Garfield), as we...
research
05/07/2016

Matching models across abstraction levels with Gaussian Processes

Biological systems are often modelled at different levels of abstraction...
research
12/02/2021

Neurosymbolic Systems of Perception Cognition: The Role of Attention

A cognitive architecture aimed at cumulative learning must provide the n...
research
02/11/2022

CLIPasso: Semantically-Aware Object Sketching

Abstraction is at the heart of sketching due to the simple and minimal n...
research
01/03/2014

ConceptVision: A Flexible Scene Classification Framework

We introduce ConceptVision, a method that aims for high accuracy in cate...

Please sign up or login with your details

Forgot password? Click here to reset