Reducing the Deployment-Time Inference Control Costs of Deep Reinforcement Learning Agents via an Asymmetric Architecture

05/30/2021
by   Chin-Jui Chang, et al.
0

Deep reinforcement learning (DRL) has been demonstrated to provide promising results in several challenging decision making and control tasks. However, the required inference costs of deep neural networks (DNNs) could prevent DRL from being applied to mobile robots which cannot afford high energy-consuming computations. To enable DRL methods to be affordable in such energy-limited platforms, we propose an asymmetric architecture that reduces the overall inference costs via switching between a computationally expensive policy and an economic one. The experimental results evaluated on a number of representative benchmark suites for robotic control tasks demonstrate that our method is able to reduce the inference costs while retaining the agent's overall performance.

READ FULL TEXT

page 4

page 5

research
08/11/2021

Does Explicit Prediction Matter in Energy Management Based on Deep Reinforcement Learning?

As a model-free optimization and decision-making method, deep reinforcem...
research
10/16/2019

Creativity in Robot Manipulation with Deep Reinforcement Learning

Deep Reinforcement Learning (DRL) has emerged as a powerful control tech...
research
03/04/2022

Cloud-Edge Training Architecture for Sim-to-Real Deep Reinforcement Learning

Deep reinforcement learning (DRL) is a promising approach to solve compl...
research
05/30/2022

RLx2: Training a Sparse Deep Reinforcement Learning Model from Scratch

Training deep reinforcement learning (DRL) models usually requires high ...
research
06/24/2023

Action Q-Transformer: Visual Explanation in Deep Reinforcement Learning with Encoder-Decoder Model using Action Query

The excellent performance of Transformer in supervised learning has led ...
research
07/22/2023

Active Control of Flow over Rotating Cylinder by Multiple Jets using Deep Reinforcement Learning

The real power of artificial intelligence appears in reinforcement learn...
research
08/23/2020

Adaptive and Multiple Time-scale Eligibility Traces for Online Deep Reinforcement Learning

Deep reinforcement learning (DRL) is one of the promising approaches to ...

Please sign up or login with your details

Forgot password? Click here to reset