SimplerVoice: A Key Message & Visual Description Generator System for Illiteracy

11/03/2018
by   Minh N. B. Nguyen, et al.
2

We introduce SimplerVoice: a key message and visual description generator system to help low-literate adults navigate the information-dense world with confidence, on their own. SimplerVoice can automatically generate sensible sentences describing an unknown object, extract semantic meanings of the object usage in the form of a query string, then, represent the string as multiple types of visual guidance (pictures, pictographs, etc.). We demonstrate SimplerVoice system in a case study of generating grocery products' manuals through a mobile application. To evaluate, we conducted a user study on SimplerVoice's generated description in comparison to the information interpreted by users from other methods: the original product package and search engines' top result, in which SimplerVoice achieved the highest performance score: 4.82 on 5-point mean opinion score scale. Our result shows that SimplerVoice is able to provide low-literate end-users with simple yet informative components to help them understand how to use the grocery products, and that the system may potentially provide benefits in other real-world use cases

READ FULL TEXT

page 5

page 6

page 7

research
02/15/2023

A Case Study on Designing Evaluations of ML Explanations with Simulated User Studies

When conducting user studies to ascertain the usefulness of model explan...
research
06/05/2022

Use-Case-Grounded Simulations for Explanation Evaluation

A growing body of research runs human subject evaluations to study wheth...
research
10/20/2022

ObSynth: An Interactive Synthesis System for Generating Object Models from Natural Language Specifications

We introduce ObSynth, an interactive system leveraging the domain knowle...
research
07/15/2019

Ranking sentences from product description & bullets for better search

Products in an ecommerce catalog contain information-rich fields like de...
research
03/19/2020

Foldover Features for Dynamic Object Behavior Description in Microscopic Videos

Behavior description is conducive to the analysis of tiny objects, simil...
research
09/15/2023

Explaining Search Result Stances to Opinionated People

People use web search engines to find information before forming opinion...
research
06/20/2023

GenPlot: Increasing the Scale and Diversity of Chart Derendering Data

Vertical bars, horizontal bars, dot, scatter, and line plots provide a d...

Please sign up or login with your details

Forgot password? Click here to reset