Stackelberg Meta-Learning for Strategic Guidance in Multi-Robot Trajectory Planning

11/23/2022
by   Yuhan Zhao, et al.
0

Guided cooperation is a common task in many multi-agent teaming applications. The planning of the cooperation is difficult when the leader robot has incomplete information about the follower, and there is a need to learn, customize, and adapt the cooperation plan online. To this end, we develop a learning-based Stackelberg game-theoretic framework to address this challenge to achieve optimal trajectory planning for heterogeneous robots. We first formulate the guided trajectory planning problem as a dynamic Stackelberg game and design the cooperation plans using open-loop Stackelberg equilibria. We leverage meta-learning to deal with the unknown follower in the game and propose a Stackelberg meta-learning framework to create online adaptive trajectory guidance plans, where the leader robot learns a meta-best-response model from a prescribed set of followers offline and then fast adapts to a specific online trajectory guidance task using limited learning data. We use simulations in three different scenarios to elaborate on the effectiveness of our framework. Comparison with other learning approaches and no guidance cases show that our framework provides a more time- and data-efficient planning method in trajectory guidance tasks.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/03/2022

Stackelberg Strategic Guidance for Heterogeneous Robots Collaboration

In this study, we explore the application of game theory, in particular ...
research
12/15/2020

Accelerating Distributed Online Meta-Learning via Multi-Agent Collaboration under Limited Communication

Online meta-learning is emerging as an enabling technique for achieving ...
research
07/18/2021

Distributed Planning for Serving Cooperative Tasks with Time Windows: A Game Theoretic Approach

We study distributed planning for multi-robot systems to provide optimal...
research
04/30/2022

Learning Mixed Strategies in Trajectory Games

In multi-agent settings, game theory is a natural framework for describi...
research
10/08/2021

Offline Meta-Reinforcement Learning for Industrial Insertion

Reinforcement learning (RL) can in principle make it possible for robots...
research
01/12/2019

Adaptive Guidance with Reinforcement Meta-Learning

This paper proposes a novel adaptive guidance system developed using rei...
research
04/23/2020

Hierarchical Needs Based Self-Adaptive Framework For Cooperative Multi-Robot System

Research in multi-robot and swarm systems has seen significant interest ...

Please sign up or login with your details

Forgot password? Click here to reset