Single Shot Multitask Pedestrian Detection and Behavior Prediction

by   Prateek Agrawal, et al.

Detecting and predicting the behavior of pedestrians is extremely crucial for self-driving vehicles to plan and interact with them safely. Although there have been several research works in this area, it is important to have fast and memory efficient models such that it can operate in embedded hardware in these autonomous machines. In this work, we propose a novel architecture using spatial-temporal multi-tasking to do camera based pedestrian detection and intention prediction. Our approach significantly reduces the latency by being able to detect and predict all pedestrians' intention in a single shot manner while also being able to attain better accuracy by sharing features with relevant object level information and interactions.



There are no comments yet.


page 5


Autonomous Driving among Many Pedestrians: Models and Algorithms

Driving among a dense crowd of pedestrians is a major challenge for auto...

Pedestrian Intention Prediction: A Multi-task Perspective

In order to be globally deployed, autonomous cars must guarantee the saf...

Early warning of pedestrians and cyclists

State-of-the-art motor vehicles are able to break for pedestrians in an ...

What gaze behavior do pedestrians take in interactions when they do not understand the intention of an automated vehicle?

This study focuses on establishing an external human-machine interface (...

Small-scale Pedestrian Detection Based on Somatic Topology Localization and Temporal Feature Aggregation

A critical issue in pedestrian detection is to detect small-scale object...

Pedestrian Behavior Prediction via Multitask Learning and Categorical Interaction Modeling

Pedestrian behavior prediction is one of the major challenges for intell...

Fast Estimating Pedestrian Moving State Based on Single 2D Body Pose by Shallow Neural Network

Crossing or Not-Crossing (C/NC) problem is important to autonomous vehic...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.