Next-Best-View Estimation based on Deep Reinforcement Learning for Active Object Classification

10/13/2021
by   Christian Korbach, et al.
10

The presentation and analysis of image data from a single viewpoint are often not sufficient to solve a task. Several viewpoints are necessary to obtain more information. The next-best-view problem attempts to find the optimal viewpoint with the greatest information gain for the underlying task. In this work, a robot arm holds an object in its end-effector and searches for a sequence of next-best-view to explicitly identify the object. We use Soft Actor-Critic (SAC), a method of deep reinforcement learning, to learn these next-best-views for a specific set of objects. The evaluation shows that an agent can learn to determine an object pose to which the robot arm should move an object. This leads to a viewpoint that provides a more accurate prediction to distinguish such an object from other objects better. We make the code publicly available for the scientific community and for reproducibility.

READ FULL TEXT

page 1

page 5

page 7

research
07/22/2019

Agent Modeling as Auxiliary Task for Deep Reinforcement Learning

In this paper we explore how actor-critic methods in deep reinforcement ...
research
11/27/2020

Real-time Active Vision for a Humanoid Soccer Robot Using Deep Reinforcement Learning

In this paper, we present an active vision method using a deep reinforce...
research
08/02/2021

Active Perception for Ambiguous Objects Classification

Recent visual pose estimation and tracking solutions provide notable res...
research
08/01/2017

Best Viewpoint Tracking for Camera Mounted on Robotic Arm with Dynamic Obstacles

The problem of finding a next best viewpoint for 3D modeling or scene ma...
research
11/29/2022

Autotuning PID control using Actor-Critic Deep Reinforcement Learning

This work is an exploratory research concerned with determining in what ...
research
11/20/2018

Reinforcement Learning of Active Vision forManipulating Objects under Occlusions

We consider artificial agents that learn to jointly control their grippe...
research
05/10/2023

Sequence-Agnostic Multi-Object Navigation

The Multi-Object Navigation (MultiON) task requires a robot to localize ...

Please sign up or login with your details

Forgot password? Click here to reset