An Exploration of Embodied Visual Exploration

Embodied computer vision considers perception for robots in general, unstructured environments. Of particular importance is the embodied visual exploration problem: how might a robot equipped with a camera scope out a new environment? Despite the progress thus far, many basic questions pertinent to this problem remain unanswered: (i) What does it mean for an agent to explore its environment well? (ii) Which methods work well, and under which assumptions and environmental settings? (iii) Where do current approaches fall short, and where might future work seek to improve? Seeking answers to these questions, we perform a thorough empirical study of four state-of-the-art paradigms on two photorealistic simulated 3D environments. We present a taxonomy of key exploration methods and a standard framework for benchmarking visual exploration algorithms. Our experimental results offer insights, and suggest new performance metrics and baselines for future work in visual exploration.

READ FULL TEXT

page 2

page 4

page 7

research
01/15/2019

Learning Autonomous Exploration and Mapping with Semantic Vision

We address the problem of autonomous exploration and mapping for a mobil...
research
03/30/2023

coExplore: Combining multiple rankings for multi-robot exploration

Multi-robot exploration is a field which tackles the challenge of explor...
research
07/05/2007

The Cyborg Astrobiologist: Porting from a wearable computer to the Astrobiology Phone-cam

We have used a simple camera phone to significantly improve an `explorat...
research
08/06/2019

Benchmarking Bonus-Based Exploration Methods on the Arcade Learning Environment

This paper provides an empirical evaluation of recently developed explor...
research
08/10/2020

GRIMGEP: Learning Progress for Robust Goal Sampling in Visual Deep Reinforcement Learning

Autonomous agents using novelty based goal exploration are often efficie...
research
01/24/2023

Effective Baselines for Multiple Object Rearrangement Planning in Partially Observable Mapped Environments

Many real-world tasks, from house-cleaning to cooking, can be formulated...
research
07/27/2023

How Good is Google Bard's Visual Understanding? An Empirical Study on Open Challenges

Google's Bard has emerged as a formidable competitor to OpenAI's ChatGPT...

Please sign up or login with your details

Forgot password? Click here to reset