MyFood: A Food Segmentation and Classification System to Aid Nutritional Monitoring

by   Charles N. C. Freitas, et al.

The absence of food monitoring has contributed significantly to the increase in the population's weight. Due to the lack of time and busy routines, most people do not control and record what is consumed in their diet. Some solutions have been proposed in computer vision to recognize food images, but few are specialized in nutritional monitoring. This work presents the development of an intelligent system that classifies and segments food presented in images to help the automatic monitoring of user diet and nutritional intake. This work shows a comparative study of state-of-the-art methods for image classification and segmentation, applied to food recognition. In our methodology, we compare the FCN, ENet, SegNet, DeepLabV3+, and Mask RCNN algorithms. We build a dataset composed of the most consumed Brazilian food types, containing nine classes and a total of 1250 images. The models were evaluated using the following metrics: Intersection over Union, Sensitivity, Specificity, Balanced Precision, and Positive Predefined Value. We also propose an system integrated into a mobile application that automatically recognizes and estimates the nutrients in a meal, assisting people with better nutritional monitoring. The proposed solution showed better results than the existing ones in the market. The dataset is publicly available at the following link



There are no comments yet.


page 1

page 2

page 4

page 5


Can a CNN Recognize Catalan Diet?

Nowadays, we can find several diseases related to the unhealthy diet hab...

Leveraging Context to Support Automated Food Recognition in Restaurants

The pervasiveness of mobile cameras has resulted in a dramatic increase ...

The Food Recognition Benchmark: Using DeepLearning to Recognize Food on Images

The automatic recognition of food on images has numerous interesting app...

Fully-Automatic Semantic Segmentation for Food Intake Tracking in Long-Term Care Homes

Malnutrition impacts quality of life and places annually-recurring burde...

Scraping Social Media Photos Posted in Kenya and Elsewhere to Detect and Analyze Food Types

Monitoring population-level changes in diet could be useful for educatio...

Wide-Slice Residual Networks for Food Recognition

Food diary applications represent a tantalizing market. Such application...

Bite-Weight Estimation Using Commercial Ear Buds

While automatic tracking and measuring of our physical activity is a wel...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.