Efficient Object Manipulation Planning with Monte Carlo Tree Search

06/17/2022
by   Huaijiang Zhu, et al.
0

This paper presents an efficient approach to object manipulation planning using Monte Carlo Tree Search (MCTS) to find contact sequences and an efficient ADMM-based trajectory optimization algorithm to evaluate the dynamic feasibility of candidate contact sequences. To accelerate MCTS, we propose a methodology to learn a goal-conditioned policy-value network used to direct the search towards promising nodes. Further, manipulation-specific heuristics enable to drastically reduce the search space. Systematic object manipulation experiments in a physics simulator demonstrate the efficiency of our approach. In particular, our approach scales favorably for long manipulation sequences thanks to the learned policy-value network, significantly improving planning success rate.

READ FULL TEXT
research
07/01/2023

Enhancing Dexterity in Robotic Manipulation via Hierarchical Contact Exploration

We present a hierarchical planning framework for dexterous robotic manip...
research
07/14/2022

Parallel Monte Carlo Tree Search with Batched Rigid-body Simulations for Speeding up Long-Horizon Episodic Robot Planning

We propose a novel Parallel Monte Carlo tree search with Batched Simulat...
research
07/24/2020

Monte-Carlo Tree Search as Regularized Policy Optimization

The combination of Monte-Carlo tree search (MCTS) with deep reinforcemen...
research
03/08/2023

Monte-Carlo Tree Search with Prioritized Node Expansion for Multi-Goal Task Planning

Task planning for robots is computationally challenging due to the combi...
research
06/08/2023

Habits of Mind: Reusing Action Sequences for Efficient Planning

When we exercise sequences of actions, their execution becomes more flue...
research
06/28/2022

Left Heavy Tails and the Effectiveness of the Policy and Value Networks in DNN-based best-first search for Sokoban Planning

Despite the success of practical solvers in various NP-complete domains ...
research
10/30/2017

Stable Prehensile Pushing: In-Hand Manipulation with Alternating Sticking Contacts

This paper presents an approach to in-hand manipulation planning that ex...

Please sign up or login with your details

Forgot password? Click here to reset