Optical Flow for Autonomous Driving: Applications, Challenges and Improvements

01/11/2023
by   Shihao Shen, et al.
0

Optical flow estimation is a well-studied topic for automated driving applications. Many outstanding optical flow estimation methods have been proposed, but they become erroneous when tested in challenging scenarios that are commonly encountered. Despite the increasing use of fisheye cameras for near-field sensing in automated driving, there is very limited literature on optical flow estimation with strong lens distortion. Thus we propose and evaluate training strategies to improve a learning-based optical flow algorithm by leveraging the only existing fisheye dataset with optical flow ground truth. While trained with synthetic data, the model demonstrates strong capabilities to generalize to real world fisheye data. The other challenge neglected by existing state-of-the-art algorithms is low light. We propose a novel, generic semi-supervised framework that significantly boosts performances of existing methods in such conditions. To the best of our knowledge, this is the first approach that explicitly handles optical flow estimation in low light.

READ FULL TEXT

page 1

page 3

page 4

page 5

page 6

research
02/02/2022

CSFlow: Learning Optical Flow via Cross Strip Correlation for Autonomous Driving

Optical flow estimation is an essential task in self-driving systems, wh...
research
07/29/2023

Freespace Optical Flow Modeling for Automated Driving

Optical flow and disparity are two informative visual features for auton...
research
02/27/2022

PanoFlow: Learning Optical Flow for Panoramic Images

Optical flow estimation is a basic task in self-driving and robotics sys...
research
11/17/2018

Optical Flow Dataset and Benchmark for Visual Crowd Analysis

The performance of optical flow algorithms greatly depends on the specif...
research
09/29/2022

Self-Configurable Stabilized Real-Time Detection Learning for Autonomous Driving Applications

Guaranteeing real-time and accurate object detection simultaneously is p...
research
07/08/2022

Complementing Brightness Constancy with Deep Networks for Optical Flow Prediction

State-of-the-art methods for optical flow estimation rely on deep learni...
research
09/14/2022

INV-Flow2PoseNet: Light-Resistant Rigid Object Pose from Optical Flow of RGB-D Images using Images, Normals and Vertices

This paper presents a novel architecture for simultaneous estimation of ...

Please sign up or login with your details

Forgot password? Click here to reset