LYTNet: A Convolutional Neural Network for Real-Time Pedestrian Traffic Lights and Zebra Crossing Recognition for the Visually Impaired

07/23/2019
by   Samuel Yu, et al.
7

Currently, the visually impaired rely on either a sighted human, guide dog, or white cane to safely navigate. However, the training of guide dogs is extremely expensive, and canes cannot provide essential information regarding the color of traffic lights and direction of crosswalks. In this paper, we propose a deep learning based solution that provides information regarding the traffic light mode and the position of the zebra crossing. Previous solutions that utilize machine learning only provide one piece of information and are mostly binary: only detecting red or green lights. The proposed convolutional neural network, LYTNet, is designed for comprehensiveness, accuracy, and computational efficiency. LYTNet delivers both of the two most important pieces of information for the visually impaired to cross the road. We provide five classes of pedestrian traffic lights rather than the commonly seen three or four, and a direction vector representing the midline of the zebra crossing that is converted from the 2D image plane to real-world positions. We created our own dataset of pedestrian traffic lights containing over 5000 photos taken at hundreds of intersections in Shanghai. The experiments carried out achieve a classification accuracy of 94 frame rate of 20 frames per second when testing the network on an iPhone 7 with additional post-processing steps.

READ FULL TEXT

page 4

page 5

page 8

page 10

research
09/14/2019

Street Crossing Aid Using Light-weight CNNs for the Visually Impaired

In this paper, we address an issue that the visually impaired commonly f...
research
09/16/2019

Virtual Guide Dog: Next Generation Pedestrian Signal for the Visually Impaired

Accessible pedestrian signal (APS) was proposed as a mean to achieve the...
research
11/15/2022

A Dataset and Model for Crossing Indian Roads

Roads in medium-sized Indian towns often have lots of traffic but no (or...
research
08/08/2022

Predicting Pedestrian Crosswalk Behavior Using Convolutional Neural Networks

A common yet potentially dangerous task is the act of crossing the stree...
research
08/16/2021

Flying Guide Dog: Walkable Path Discovery for the Visually Impaired Utilizing Drones and Transformer-based Semantic Segmentation

Lacking the ability to sense ambient environments effectively, blind and...
research
02/16/2022

Luminous Zebra Crossing, Intelligent Zebra Crossing

1.Application background: With the development of social economy and th...
research
06/20/2022

Guardian Angel: A Novel Walking Aid for the Visually Impaired

This work introduces Guardian Angel, an Android App that assists visuall...

Please sign up or login with your details

Forgot password? Click here to reset