Multi-Target Active Object Tracking with Monte Carlo Tree Search and Target Motion Modeling

05/07/2022
by   Zheng Chen, et al.
14

In this work, we are dedicated to multi-target active object tracking (AOT), where there are multiple targets as well as multiple cameras in the environment. The goal is maximize the overall target coverage of all cameras. Previous work makes a strong assumption that each camera is fixed in a location and only allowed to rotate, which limits its application. In this work, we relax the setting by allowing all cameras to both move along the boundary lines and rotate. In our setting, the action space becomes much larger, which leads to much higher computational complexity to identify the optimal action. To this end, we propose to leverage the action selection from multi-agent reinforcement learning (MARL) network to prune the search tree of Monte Carlo Tree Search (MCTS) method, so as to find the optimal action more efficiently. Besides, we model the motion of the targets to predict the future position of the targets, which makes a better estimation of the future environment state in the MCTS process. We establish a multi-target 2D environment to simulate the sports games, and experimental results demonstrate that our method can effectively improve the target coverage.

READ FULL TEXT
research
02/22/2022

Coordinate-Aligned Multi-Camera Collaboration for Active Multi-Object Tracking

Active Multi-Object Tracking (AMOT) is a task where cameras are controll...
research
12/14/2019

Active Object Tracking using Context Estimation: Handling Occlusions and Detecting Missing Targets

When performing visual servoing or object tracking tasks, active sensor ...
research
01/15/2020

Pose-Assisted Multi-Camera Collaboration for Active Object Tracking

Active Object Tracking (AOT) is crucial to many visionbased applications...
research
09/18/2021

Hierarchical Policy for Non-prehensile Multi-object Rearrangement with Deep Reinforcement Learning and Monte Carlo Tree Search

Non-prehensile multi-object rearrangement is a robotic task of planning ...
research
10/25/2020

Learning Multi-Agent Coordination for Enhancing Target Coverage in Directional Sensor Networks

Maximum target coverage by adjusting the orientation of distributed sens...
research
12/18/2021

Space Non-cooperative Object Active Tracking with Deep Reinforcement Learning

Active visual tracking of space non-cooperative object is significant fo...
research
05/23/2023

L-SA: Learning Under-Explored Targets in Multi-Target Reinforcement Learning

Tasks that involve interaction with various targets are called multi-tar...

Please sign up or login with your details

Forgot password? Click here to reset