DeepAI AI Chat
Log In Sign Up

Large Scale Visual Food Recognition

03/30/2021
by   Weiqing Min, et al.
0

Food recognition plays an important role in food choice and intake, which is essential to the health and well-being of humans. It is thus of importance to the computer vision community, and can further support many food-oriented vision and multimodal tasks. Unfortunately, we have witnessed remarkable advancements in generic visual recognition for released large-scale datasets, yet largely lags in the food domain. In this paper, we introduce Food2K, which is the largest food recognition dataset with 2,000 categories and over 1 million images.Compared with existing food recognition datasets, Food2K bypasses them in both categories and images by one order of magnitude, and thus establishes a new challenging benchmark to develop advanced models for food visual representation learning. Furthermore, we propose a deep progressive region enhancement network for food recognition, which mainly consists of two components, namely progressive local feature learning and region feature enhancement. The former adopts improved progressive training to learn diverse and complementary local features, while the latter utilizes self-attention to incorporate richer context with multiple scales into local features for further local feature enhancement. Extensive experiments on Food2K demonstrate the effectiveness of our proposed method. More importantly, we have verified better generalization ability of Food2K in various tasks, including food recognition, food image retrieval, cross-modal recipe retrieval, food detection and segmentation. Food2K can be further explored to benefit more food-relevant tasks including emerging and more complex ones (e.g., nutritional understanding of food), and the trained models on Food2K can be expected as backbones to improve the performance of more food-relevant tasks. We also hope Food2K can serve as a large scale fine-grained visual recognition benchmark.

READ FULL TEXT

page 4

page 5

page 6

page 8

page 9

page 14

page 15

08/13/2020

ISIA Food-500: A Dataset for Large-Scale Food Recognition via Stacked Global-Local Attention Network

Food recognition has received more and more attention in the multimedia ...
03/04/2021

Nutrition5k: Towards Automatic Nutritional Understanding of Generic Food

Understanding the nutritional content of food from visual data is a chal...
10/14/2018

Recipe1M: A Dataset for Learning Cross-Modal Embeddings for Cooking Recipes and Food Images

In this paper, we introduce Recipe1M, a new large-scale, structured corp...
05/12/2021

A Large-Scale Benchmark for Food Image Segmentation

Food image segmentation is a critical and indispensible task for develop...
01/22/2018

Food recognition and recipe analysis: integrating visual content, context and external knowledge

The central role of food in our individual and social life, combined wit...
06/28/2021

The Food Recognition Benchmark: Using DeepLearning to Recognize Food on Images

The automatic recognition of food on images has numerous interesting app...
01/10/2023

From Plate to Prevention: A Dietary Nutrient-aided Platform for Health Promotion in Singapore

Singapore has been striving to improve the provision of healthcare servi...