Deep Learning based Wearable Assistive System for Visually Impaired People

08/09/2019
by   Yimin Lin, et al.
8

In this paper, we propose a deep learning based assistive system to improve the environment perception experience of visually impaired (VI). The system is composed of a wearable terminal equipped with an RGBD camera and an earphone, a powerful processor mainly for deep learning inferences and a smart phone for touch-based interaction. A data-driven learning approach is proposed to predict safe and reliable walkable instructions using RGBD data and the established semantic map. This map is also used to help VI understand their 3D surrounding objects and layout through well-designed touchscreen interactions. The quantitative and qualitative experimental results show that our learning based obstacle avoidance approach achieves excellent results in both indoor and outdoor datasets with low-lying obstacles. Meanwhile, user studies have also been carried out in various scenarios and showed the improvement of VI's environment perception experience with our system.

READ FULL TEXT

page 4

page 6

research
04/30/2019

Wearable Travel Aid for Environment Perception and Navigation of Visually Impaired People

This paper presents a wearable assistive device with the shape of a pair...
research
07/20/2020

Can we cover navigational perception needs of the visually impaired by panoptic segmentation?

Navigational perception for visually impaired people has been substantia...
research
12/21/2022

An RFID-Based Assistive Glove to Help the Visually Impaired

Recent studies have focused on facilitating perception and outdoor navig...
research
09/27/2017

Smart Guiding Glasses for Visually Impaired People in Indoor Environment

To overcome the travelling difficulty for the visually impaired group, t...
research
10/04/2021

Deep Learning Approach Protecting Privacy in Camera-Based Critical Applications

Many critical applications rely on cameras to capture video footage for ...

Please sign up or login with your details

Forgot password? Click here to reset