Autonomous Control of a Line Follower Robot Using a Q-Learning Controller

01/23/2020
by   Sepehr Saadatmand, et al.
2

In this paper, a MIMO simulated annealing SA based Q learning method is proposed to control a line follower robot. The conventional controller for these types of robots is the proportional P controller. Considering the unknown mechanical characteristics of the robot and uncertainties such as friction and slippery surfaces, system modeling and controller designing can be extremely challenging. The mathematical modeling for the robot is presented in this paper, and a simulator is designed based on this model. The basic Q learning methods are based pure exploitation and the epsilon-greedy methods, which help exploration, can harm the controller performance after learning completion by exploring nonoptimal actions. The simulated annealing based Q learning method tackles this drawback by decreasing the exploration rate when the learning increases. The simulation and experimental results are provided to evaluate the effectiveness of the proposed controller.

READ FULL TEXT

page 1

page 5

page 6

research
04/14/2021

Adaptive Neuro-Fuzzy Control of a Spherical Rolling Robot Using Sliding-Mode-Control-Theory-Based Online Learning Algorithm

As a model is only an abstraction of the real system, unmodeled dynamics...
research
12/29/2020

An LQR-assisted Control Algorithm for an Under-actuated In-pipe Robot in Water Distribution Systems

To address the operational challenges of in-pipe robots in large pipes o...
research
12/20/2018

Modeling and Robust Attitude Controller Design for a Small Size Helicopter

This paper addresses the design and application controller for a small-s...
research
08/06/2019

Design, Modeling, and Control of Norma: a Slider & Pendulum-Driven Spherical Robot

This paper discusses the design, modeling, and control of Norma, a novel...
research
04/22/2022

A Data-Efficient Model-Based Learning Framework for the Closed-Loop Control of Continuum Robots

Traditional dynamic models of continuum robots are in general computatio...
research
09/01/2023

Vision-aided nonlinear control framework for shake table tests

The structural response under the earthquake excitations can be simulate...

Please sign up or login with your details

Forgot password? Click here to reset