Rearrangement: A Challenge for Embodied AI

11/03/2020
by   Dhruv Batra, et al.
2

We describe a framework for research and evaluation in Embodied AI. Our proposal is based on a canonical task: Rearrangement. A standard task can focus the development of new techniques and serve as a source of trained models that can be transferred to other settings. In the rearrangement task, the goal is to bring a given physical environment into a specified state. The goal state can be specified by object poses, by images, by a description in language, or by letting the agent experience the environment in the goal state. We characterize rearrangement scenarios along different axes and describe metrics for benchmarking rearrangement performance. To facilitate research and exploration, we present experimental testbeds of rearrangement scenarios in four different simulation environments. We anticipate that other datasets will be released and new simulation platforms will be built to support training of rearrangement agents and their deployment on physical systems.

READ FULL TEXT

page 2

page 3

page 6

page 7

page 9

page 13

page 19

page 21

research
06/23/2020

ObjectNav Revisited: On Evaluation of Embodied Agents Navigating to Objects

We revisit the problem of Object-Goal Navigation (ObjectNav). In its sim...
research
08/05/2023

Physics-Based Task Generation Through Causal Sequence of Physical Interactions

Performing tasks in a physical environment is a crucial yet challenging ...
research
03/03/2023

NovPhy: A Testbed for Physical Reasoning in Open-world Environments

Due to the emergence of AI systems that interact with the physical envir...
research
04/06/2022

Software Testing, AI and Robotics (STAIR) Learning Lab

In this paper we presented the Software Testing, AI and Robotics (STAIR)...
research
06/11/2022

SAIBench: Benchmarking AI for Science

Scientific research communities are embracing AI-based solutions to targ...
research
08/06/2021

BEHAVIOR: Benchmark for Everyday Household Activities in Virtual, Interactive, and Ecological Environments

We introduce BEHAVIOR, a benchmark for embodied AI with 100 activities i...
research
04/01/2022

Traversability, Reconfiguration, and Reachability in the Gadget Framework

Consider an agent traversing a graph of "gadgets", each with local state...

Please sign up or login with your details

Forgot password? Click here to reset