Multi-Stage Monte Carlo Tree Search for Non-Monotone Object Rearrangement Planning in Narrow Confined Environments

05/26/2023
by   Hanwen Ren, et al.
0

Non-monotone object rearrangement planning in confined spaces such as cabinets and shelves is a widely occurring but challenging problem in robotics. Both the robot motion and the available regions for object relocation are highly constrained because of the limited space. This work proposes a Multi-Stage Monte Carlo Tree Search (MS-MCTS) method to solve non-monotone object rearrangement planning problems in confined spaces. Our approach decouples the complex problem into simpler subproblems using an object stage topology. A subgoal-focused tree expansion algorithm that jointly considers the high-level planning and the low-level robot motion is designed to reduce the search space and better guide the search process. By fitting the task into the MCTS paradigm, our method produces optimistic solutions by balancing exploration and exploitation. The experiments demonstrate that our method outperforms the existing methods regarding the planning time, the number of steps, and the total move distance. Moreover, we deploy our MS-MCTS to a real-world robot system and verify its performance in different confined environments.

READ FULL TEXT

page 1

page 7

research
09/18/2021

Hierarchical Policy for Non-prehensile Multi-object Rearrangement with Deep Reinforcement Learning and Monte Carlo Tree Search

Non-prehensile multi-object rearrangement is a robotic task of planning ...
research
01/07/2022

A Multi-Behavior Planning Framework for Robot Guide

The guiding task of a mobile robot requires not only human-aware navigat...
research
01/28/2021

Uniform Object Rearrangement: From Complete Monotone Primitives to Efficient Non-Monotone Informed Search

Object rearrangement is a widely-applicable and challenging task for rob...
research
06/13/2020

Fault Tolerant Free Gait and Footstep Planning for Hexapod Robot Based on Monte-Carlo Tree

Legged robots can pass through complex field environments by selecting g...
research
07/04/2023

Monotone Cubic B-Splines

We present a method for fitting monotone curves using cubic B-splines wi...
research
11/24/2020

Stochastic Motion Planning under Partial Observability for Mobile Robots with Continuous Range Measurements

In this paper, we address the problem of stochastic motion planning unde...
research
04/20/2021

Neural Tree Expansion for Multi-Robot Planning in Non-Cooperative Environments

We present a self-improving, neural tree expansion method for multi-robo...

Please sign up or login with your details

Forgot password? Click here to reset