Learning Low-Correlation GPS Spreading Codes with a Policy Gradient Algorithm

01/08/2021
by   Tara Yasmin Mina, et al.
13

With the birth of the next-generation GPS III constellation and the upcoming launch of the Navigation Technology Satellite-3 (NTS-3) testing platform to explore future technologies for GPS, we are indeed entering a new era of satellite navigation. Correspondingly, it is time to revisit the design methods of the GPS spreading code families. In this work, we develop a Gaussian policy gradient-based reinforcement learning algorithm which constructs high-quality families of spreading code sequences. We demonstrate the ability of our algorithm to achieve better mean-squared auto- and cross-correlation than well-chosen families of equal-length Gold codes and Weil codes. Furthermore, we compare our algorithm with an analogous genetic algorithm implementation assigned the same code evaluation metric. To the best of the authors' knowledge, this is the first work to explore using a machine learning / reinforcement learning approach to design navigation spreading codes.

READ FULL TEXT

page 1

page 7

research
01/22/2022

Bag of Tricks for Natural Policy Gradient Reinforcement Learning

Natural policy gradient methods are popular reinforcement learning metho...
research
05/28/2021

Joint Optimization of Multi-Objective Reinforcement Learning with Policy Gradient Based Algorithm

Many engineering problems have multiple objectives, and the overall aim ...
research
05/20/2023

On First-Order Meta-Reinforcement Learning with Moreau Envelopes

Meta-Reinforcement Learning (MRL) is a promising framework for training ...
research
11/03/2017

Genetic Policy Optimization

Genetic algorithms have been widely used in many practical optimization ...
research
03/28/2020

Obstacle Avoidance and Navigation Utilizing Reinforcement Learning with Reward Shaping

In this paper, we investigate the obstacle avoidance and navigation prob...
research
01/03/2022

A Case Study Analysis for Designing a Lunar Navigation Satellite System with Time-Transfer from Earth-GPS

Recently, there has been a growing interest in the use of a SmallSat pla...
research
07/29/2022

Phase Code Discovery for Pulse Compression Radar: A Genetic Algorithm Approach

Discovering sequences with desired properties has long been an interesti...

Please sign up or login with your details

Forgot password? Click here to reset