RADACS: Towards Higher-Order Reasoning using Action Recognition in Autonomous Vehicles

09/28/2022
by   Alex Zhuang, et al.
0

When applied to autonomous vehicle settings, action recognition can help enrich an environment model's understanding of the world and improve plans for future action. Towards these improvements in autonomous vehicle decision-making, we propose in this work a novel two-stage online action recognition system, termed RADACS. RADACS formulates the problem of active agent detection and adapts ideas about actor-context relations from human activity recognition in a straightforward two-stage pipeline for action detection and classification. We show that our proposed scheme can outperform the baseline on the ICCV2021 Road Challenge dataset and by deploying it on a real vehicle platform, we demonstrate how a higher-order understanding of agent actions in an environment can improve decisions on a real autonomous vehicle.

READ FULL TEXT

page 2

page 6

research
06/28/2018

Human Action Recognition and Prediction: A Survey

Derived from rapid advances in computer vision and machine learning, vid...
research
04/01/2023

DOAD: Decoupled One Stage Action Detection Network

Localizing people and recognizing their actions from videos is a challen...
research
03/20/2020

Explainable Object-induced Action Decision for Autonomous Vehicles

A new paradigm is proposed for autonomous driving. The new paradigm lies...
research
07/30/2018

Action Detection from a Robot-Car Perspective

We present the new Road Event and Activity Detection (READ) dataset, des...
research
12/14/2020

Online Action Recognition

Recognition in planning seeks to find agent intentions, goals or activit...
research
01/13/2021

Video action recognition for lane-change classification and prediction of surrounding vehicles

In highway scenarios, an alert human driver will typically anticipate ea...
research
12/14/2018

Conversational Intent Understanding for Passengers in Autonomous Vehicles

Understanding passenger intents and extracting relevant slots are import...

Please sign up or login with your details

Forgot password? Click here to reset