Online Continual Learning For Visual Food Classification

08/15/2021
by   Jiangpeng He, et al.
0

Food image classification is challenging for real-world applications since existing methods require static datasets for training and are not capable of learning from sequentially available new food images. Online continual learning aims to learn new classes from data stream by using each new data only once without forgetting the previously learned knowledge. However, none of the existing works target food image analysis, which is more difficult to learn incrementally due to its high intra-class variation with the unbalanced and unpredictable characteristics of future food class distribution. In this paper, we address these issues by introducing (1) a novel clustering based exemplar selection algorithm to store the most representative data belonging to each learned food for knowledge replay, and (2) an effective online learning regime using balanced training batch along with the knowledge distillation on augmented exemplars to maintain the model performance on all learned classes. Our method is evaluated on a challenging large scale food image database, Food-1K, by varying the number of newly added food classes. Our results show significant improvements compared with existing state-of-the-art online continual learning methods, showing great potential to achieve lifelong learning for food image classification in real world.

READ FULL TEXT

page 3

page 8

research
07/01/2023

Long-Tailed Continual Learning For Visual Food Recognition

Deep learning based food recognition has achieved remarkable progress in...
research
01/12/2023

Online Class-Incremental Learning For Real-World Food Classification

Online Class-Incremental Learning (OCIL) aims to continuously learn new ...
research
02/11/2022

Exemplar-free Online Continual Learning

Targeted for real world scenarios, online continual learning aims to lea...
research
04/08/2018

Personalized Classifier for Food Image Recognition

Currently, food image recognition tasks are evaluated against fixed data...
research
05/26/2022

Continual Learning for Visual Search with Backward Consistent Feature Embedding

In visual search, the gallery set could be incrementally growing and add...
research
03/30/2020

Incremental Learning In Online Scenario

Modern deep learning approaches have achieved great success in many visi...
research
08/18/2023

Online Class Incremental Learning on Stochastic Blurry Task Boundary via Mask and Visual Prompt Tuning

Continual learning aims to learn a model from a continuous stream of dat...

Please sign up or login with your details

Forgot password? Click here to reset