Fine-Grained Product Class Recognition for Assisted Shopping

10/14/2015
by   Marian George, et al.
0

Assistive solutions for a better shopping experience can improve the quality of life of people, in particular also of visually impaired shoppers. We present a system that visually recognizes the fine-grained product classes of items on a shopping list, in shelves images taken with a smartphone in a grocery store. Our system consists of three components: (a) We automatically recognize useful text on product packaging, e.g., product name and brand, and build a mapping of words to product classes based on the large-scale GroceryProducts dataset. When the user populates the shopping list, we automatically infer the product class of each entered word. (b) We perform fine-grained product class recognition when the user is facing a shelf. We discover discriminative patches on product packaging to differentiate between visually similar product classes and to increase the robustness against continuous changes in product design. (c) We continuously improve the recognition accuracy through active learning. Our experiments show the robustness of the proposed method against cross-domain challenges, and the scalability to an increasing number of products with minimal re-training.

READ FULL TEXT

page 2

page 4

page 5

research
08/24/2020

Products-10K: A Large-scale Product Recognition Dataset

With the rapid development of electronic commerce, the way of shopping h...
research
05/09/2015

Subset Feature Learning for Fine-Grained Category Classification

Fine-grained categorisation has been a challenging problem due to small ...
research
07/13/2021

eProduct: A Million-Scale Visual Search Benchmark to Address Product Recognition Challenges

Large-scale product recognition is one of the major applications of comp...
research
06/10/2020

Towards Robust Fine-grained Recognition by Maximal Separation of Discriminative Features

Adversarial attacks have been widely studied for general classification ...
research
10/03/2018

A deep learning pipeline for product recognition in store shelves

Recognition of grocery products in store shelves poses peculiar challeng...
research
10/03/2018

A deep learning pipeline for product recognition on store shelves

Recognition of grocery products in store shelves poses peculiar challeng...
research
02/19/2021

Scaling Creative Inspiration with Fine-Grained Functional Facets of Product Ideas

Web-scale repositories of products, patents and scientific papers offer ...

Please sign up or login with your details

Forgot password? Click here to reset