FindView: Precise Target View Localization Task for Look Around Agents

03/16/2023
by   Haruya Ishikawa, et al.
0

With the increase in demands for service robots and automated inspection, agents need to localize in its surrounding environment to achieve more natural communication with humans by shared contexts. In this work, we propose a novel but straightforward task of precise target view localization for look around agents called the FindView task. This task imitates the movements of PTZ cameras or user interfaces for 360 degree mediums, where the observer must "look around" to find a view that exactly matches the target. To solve this task, we introduce a rule-based agent that heuristically finds the optimal view and a policy learning agent that employs reinforcement learning to learn by interacting with the 360 degree scene. Through extensive evaluations and benchmarks, we conclude that learned methods have many advantages, in particular precise localization that is robust to corruption and can be easily deployed in novel scenes.

READ FULL TEXT

page 3

page 5

page 12

page 13

research
07/30/2020

Searching Collaborative Agents for Multi-plane Localization in 3D Ultrasound

3D ultrasound (US) is widely used due to its rich diagnostic information...
research
03/15/2022

Object Manipulation via Visual Target Localization

Object manipulation is a critical skill required for Embodied AI agents ...
research
09/14/2021

GALOPP: Multi-Agent Deep Reinforcement Learning For Persistent Monitoring With Localization Constraints

Persistently monitoring a region under localization and communication co...
research
12/08/2020

Active Visual Localization in Partially Calibrated Environments

Humans can robustly localize themselves without a map after they get los...
research
09/08/2022

Aerial View Goal Localization with Reinforcement Learning

With an increased amount and availability of unmanned aerial vehicles (U...
research
09/17/2021

Realistic PointGoal Navigation via Auxiliary Losses and Information Bottleneck

We propose a novel architecture and training paradigm for training reali...

Please sign up or login with your details

Forgot password? Click here to reset