Programming and Deployment of Autonomous Swarms using Multi-Agent Reinforcement Learning

05/21/2021
by   Jayson Boubin, et al.
0

Autonomous systems (AS) carry out complex missions by continuously observing the state of their surroundings and taking actions toward a goal. Swarms of AS working together can complete missions faster and more effectively than single AS alone. To build swarms today, developers handcraft their own software for storing, aggregating, and learning from observations. We present the Fleet Computer, a platform for developing and managing swarms. The Fleet Computer provides a programming paradigm that simplifies multi-agent reinforcement learning (MARL) – an emerging class of algorithms that coordinate swarms of agents. Using just two programmer-provided functions Map() and Eval(), the Fleet Computer compiles and deploys swarms and continuously updates the reinforcement learning models that govern actions. To conserve compute resources, the Fleet Computer gives priority scheduling to models that contribute to effective actions, drawing a novel link between online learning and resource management. We developed swarms for unmanned aerial vehicles (UAV) in agriculture and for video analytics on urban traffic. Compared to individual AS, our swarms achieved speedup of 4.4X using 4 UAV and 62X using 130 video cameras. Compared to a competing approach for building swarms that is widely used in practice, our swarms were 3X more effective, using 3.9X less energy.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 3

04/04/2022

Optimising Energy Efficiency in UAV-Assisted Networks using Deep Reinforcement Learning

In this letter, we study the energy efficiency (EE) optimisation of unma...
01/15/2022

Cooperative Multi-Agent Deep Reinforcement Learning for Reliable Surveillance via Autonomous Multi-UAV Control

CCTV-based surveillance using unmanned aerial vehicles (UAVs) is conside...
05/13/2022

Distributed Transmission Control for Wireless Networks using Multi-Agent Reinforcement Learning

We examine the problem of transmission control, i.e., when to transmit, ...
11/21/2021

Renewable energy integration and microgrid energy trading using multi-agent deep reinforcement learning

In this paper, multi-agent reinforcement learning is used to control a h...
03/15/2022

An Introduction to Multi-Agent Reinforcement Learning and Review of its Application to Autonomous Mobility

Many scenarios in mobility and traffic involve multiple different agents...
03/20/2018

Cooperative and Distributed Reinforcement Learning of Drones for Field Coverage

This paper proposed a distributed Multi-Agent Reinforcement Learning (MA...
09/02/2019

Approximate Query Processing on Autonomous Cameras

Surveillance IoT cameras are becoming autonomous: they operate on batter...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.