Decision Making for Autonomous Vehicles

04/27/2023
by   Xinchen Li, et al.
0

This paper is on decision making of autonomous vehicles for handling roundabouts. The round intersection is introduced first followed by the Markov Decision Processes (MDP), the Partially Observable Markov Decision Processes (POMDP) and the Object Oriented Partially Observable Markov Decision Process (OOPOMDP). The Partially Observable Monte-Carlo Planning algorihtm (POMCP) algorithm is introduced and OOPOMDP is applied to decision making for autonomous vehicles in round intersections. Decision making is formulated as a POMDP problem and the penalty function is formulated and set followed by improvement of decision making with policy prediction. The augmented objective state and policy based state transition is introduced simulations are used to demonstrate the effectiveness of the proposed method.

READ FULL TEXT

page 36

page 39

page 40

page 42

research
01/30/2013

Planning with Partially Observable Markov Decision Processes: Advances in Exact Solution Method

There is much interest in using partially observable Markov decision pro...
research
06/05/2012

A Mixed Observability Markov Decision Process Model for Musical Pitch

Partially observable Markov decision processes have been widely used to ...
research
02/05/2020

Does the Markov Decision Process Fit the Data: Testing for the Markov Property in Sequential Decision Making

The Markov assumption (MA) is fundamental to the empirical validity of r...
research
06/27/2023

Learning non-Markovian Decision-Making from State-only Sequences

Conventional imitation learning assumes access to the actions of demonst...
research
01/13/2020

POPCORN: Partially Observed Prediction COnstrained ReiNforcement Learning

Many medical decision-making settings can be framed as partially observe...
research
10/19/2019

Optimal Immunization Policy Using Dynamic Programming

Decisions in public health are almost always made in the context of unce...
research
10/15/2018

Machine Self-Confidence in Autonomous Systems via Meta-Analysis of Decision Processes

Algorithmic assurances from advanced autonomous systems assist human use...

Please sign up or login with your details

Forgot password? Click here to reset