Vision-Based Food Analysis for Automatic Dietary Assessment

08/06/2021
by   Wei Wang, et al.
12

Background: Maintaining a healthy diet is vital to avoid health-related issues, e.g., undernutrition, obesity and many non-communicable diseases. An indispensable part of the health diet is dietary assessment. Traditional manual recording methods are burdensome and contain substantial biases and errors. Recent advances in Artificial Intelligence, especially computer vision technologies, have made it possible to develop automatic dietary assessment solutions, which are more convenient, less time-consuming and even more accurate to monitor daily food intake. Scope and approach: This review presents one unified Vision-Based Dietary Assessment (VBDA) framework, which generally consists of three stages: food image analysis, volume estimation and nutrient derivation. Vision-based food analysis methods, including food recognition, detection and segmentation, are systematically summarized, and methods of volume estimation and nutrient derivation are also given. The prosperity of deep learning makes VBDA gradually move to an end-to-end implementation, which applies food images to a single network to directly estimate the nutrition. The recently proposed end-to-end methods are also discussed. We further analyze existing dietary assessment datasets, indicating that one large-scale benchmark is urgently needed, and finally highlight key challenges and future trends for VBDA. Key findings and conclusions: After thorough exploration, we find that multi-task end-to-end deep learning approaches are one important trend of VBDA. Despite considerable research progress, many challenges remain for VBDA due to the meal complexity. We also provide the latest ideas for future development of VBDA, e.g., fine-grained food analysis and accurate volume estimation. This survey aims to encourage researchers to propose more practical solutions for VBDA.

READ FULL TEXT

page 3

page 4

page 5

page 11

research
06/10/2017

Deep Learning-Based Food Calorie Estimation Method in Dietary Assessment

Obesity treatment requires obese patients to record all food intakes per...
research
08/03/2023

An End-to-end Food Portion Estimation Framework Based on Shape Reconstruction from Monocular Image

Dietary assessment is a key contributor to monitoring health status. Exi...
research
06/21/2021

A Review of the Vision-based Approaches for Dietary Assessment

Dietary-related problems such as obesity are a growing concern in todays...
research
06/07/2019

An Artificial Intelligence-Based System for Nutrient Intake Assessment of Hospitalised Patients

Regular nutrient intake monitoring in hospitalised patients plays a crit...
research
03/18/2020

An Artificial Intelligence-Based System to Assess Nutrient Intake for Hospitalised Patients

Regular monitoring of nutrient intake in hospitalised patients plays a c...
research
01/12/2017

Two-view 3D Reconstruction for Food Volume Estimation

The increasing prevalence of diet-related chronic diseases coupled with ...
research
09/12/2023

AI4Food-NutritionFW: A Novel Framework for the Automatic Synthesis and Analysis of Eating Behaviours

Nowadays millions of images are shared on social media and web platforms...

Please sign up or login with your details

Forgot password? Click here to reset