RL-Controller: a reinforcement learning framework for active structural control

To maintain structural integrity and functionality during the designed life cycle of a structure, engineers are expected to accommodate for natural hazards as well as operational load levels. Active control systems are an efficient solution for structural response control when a structure is subjected to unexpected extreme loads. However, development of these systems through traditional means is limited by their model dependent nature. Recent advancements in adaptive learning methods, in particular, reinforcement learning (RL), for real-time decision making problems, along with rapid growth in high-performance computational resources, help structural engineers to transform the classic model-based active control problem to a purely data-driven one. In this paper, we present a novel RL-based approach for designing active controllers by introducing RL-Controller, a flexible and scalable simulation environment. The RL-Controller includes attributes and functionalities that are defined to model active structural control mechanisms in detail. We show that the proposed framework is easily trainable for a five story benchmark building with 65 (ISD) when subjected to strong ground motions. In a comparative study with LQG active control method, we demonstrate that the proposed model-free algorithm learns more optimal actuator forcing strategies that yield higher performance, e.g., 25 prior information about the mechanical properties of the system.

READ FULL TEXT

page 1

page 3

research
11/27/2022

BEAR: Physics-Principled Building Environment for Control and Reinforcement Learning

Recent advancements in reinforcement learning algorithms have opened doo...
research
04/26/2023

Reinforcement Learning with Partial Parametric Model Knowledge

We adapt reinforcement learning (RL) methods for continuous control to b...
research
02/25/2020

Model-Based Reinforcement Learning for Physical Systems Without Velocity and Acceleration Measurements

In this paper, we propose a derivative-free model learning framework for...
research
12/29/2020

Reinforcement Learning for Control of Valves

This paper compares reinforcement learning (RL) with PID (proportional-i...
research
10/20/2021

Transferring Reinforcement Learning for DC-DC Buck Converter Control via Duty Ratio Mapping: From Simulation to Implementation

Reinforcement learning (RL) control approach with application into power...
research
02/23/2022

Comparative analysis of machine learning methods for active flow control

Machine learning frameworks such as Genetic Programming (GP) and Reinfor...

Please sign up or login with your details

Forgot password? Click here to reset