End-to-end Lane Shape Prediction with Transformers

11/09/2020
by   Ruijin Liu, et al.
11

Lane detection, the process of identifying lane markings as approximated curves, is widely used for lane departure warning and adaptive cruise control in autonomous vehicles. The popular pipeline that solves it in two steps—feature extraction plus post-processing, while useful, is too inefficient and flawed in learning the global context and lanes' long and thin structures. To tackle these issues, we propose an end-to-end method that directly outputs parameters of a lane shape model, using a network built with a transformer to learn richer structures and context. The lane shape model is formulated based on road structures and camera pose, providing physical interpretation for parameters of network output. The transformer models non-local interactions with a self-attention mechanism to capture slender structures and global context. The proposed method is validated on the TuSimple benchmark and shows state-of-the-art accuracy with the most lightweight model size and fastest speed. Additionally, our method shows excellent adaptability to a challenging self-collected lane detection dataset, showing its powerful deployment potential in real applications. Codes are available at https://github.com/liuruijin17/LSTR.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

page 7

page 8

page 9

10/22/2020

Keep your Eyes on the Lane: Attention-guided Lane Detection

Modern lane detection methods have achieved remarkable performances in c...
02/14/2021

Robust Lane Detection via Expanded Self Attention

The image-based lane detection algorithm is one of the key technologies ...
08/02/2019

Learning Lightweight Lane Detection CNNs by Self Attention Distillation

Training deep models for lane detection is challenging due to the very s...
02/01/2019

End-to-end Lane Detection through Differentiable Least-Squares Fitting

Lane detection is typically tackled with a two-step pipeline in which a ...
03/18/2022

Laneformer: Object-aware Row-Column Transformers for Lane Detection

We present Laneformer, a conceptually simple yet powerful transformer-ba...
03/04/2022

Rethinking Efficient Lane Detection via Curve Modeling

This paper presents a novel parametric curve-based method for lane detec...
03/29/2022

Eigenlanes: Data-Driven Lane Descriptors for Structurally Diverse Lanes

A novel algorithm to detect road lanes in the eigenlane space is propose...

Code Repositories

LSTR

This is an official repository of End-to-end Lane Shape Prediction with Transformers.


view repo

transform-culane

transform-culane 修改了它的backbone


view repo