Printed Texts Tracking and Following for a Finger-Wearable Electro-Braille System Through Opto-electrotactile Feedback

by   Mehdi Rahimi, et al.

This paper presents our recent development on a portable and refreshable text reading and sensory substitution system for the blind or visually impaired (BVI), called Finger-eye. The system mainly consists of an opto-text processing unit and a compact electro-tactile based display that can deliver text-related electrical signals to the fingertip skin through a wearable and Braille-dot patterned electrode array and thus delivers the electro-stimulation based Braille touch sensations to the fingertip. To achieve the goal of aiding BVI to read any text not written in Braille through this portable system, in this work, a Rapid Optical Character Recognition (R-OCR) method is firstly developed for real-time processing text information based on a Fisheye imaging device mounted at the finger-wearable electro-tactile display. This allows real-time translation of printed text to electro-Braille along with natural movement of user's fingertip as if reading any Braille display or book. More importantly, an electro-tactile neuro-stimulation feedback mechanism is proposed and incorporated with the R-OCR method, which facilitates a new opto-electrotactile feedback based text line tracking control approach that enables text line following by user fingertip during reading. Multiple experiments were designed and conducted to test the ability of blindfolded participants to read through and follow the text line based on the opto-electrotactile-feedback method. The experiments show that as the result of the opto-electrotactile-feedback, the users were able to maintain their fingertip within a 2mm distance of the text while scanning a text line. This research is a significant step to aid the BVI users with a portable means to translate and follow to read any printed text to Braille, whether in the digital realm or physically, on any surface.



There are no comments yet.



Stroke-Based Cursive Character Recognition

Human eye can see and read what is written or displayed either in natura...

Tiger:Wearable Glasses for the 20-20-20 Rule to Alleviate Computer Vision Syndrome

We propose Tiger, an eyewear system for helping users follow the 20-20-2...

Braille to Text Translation for Bengali Language: A Geometric Approach

Braille is the only system to visually impaired people for reading and w...

BrailleBand: Blind Support Haptic Wearable Band for Communication using Braille Language

Visually impaired people are neglected from many modern communication an...

Formalizing line editors in Coq

Text editors represent one of the fundamental tools that writers use - s...

Formalizing text editors in Coq

Text editors represent one of the fundamental tools that writers use – s...

Smart Summarizer for Blind People

In today's world, time is a very important resource. In our busy lives, ...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.