Cluttered Food Grasping with Adaptive Fingers and Synthetic-Data Trained Object Detection

by   Avinash Ummadisingu, et al.

The food packaging industry handles an immense variety of food products with wide-ranging shapes and sizes, even within one kind of food. Menus are also diverse and change frequently, making automation of pick-and-place difficult. A popular approach to bin-picking is to first identify each piece of food in the tray by using an instance segmentation method. However, human annotations to train these methods are unreliable and error-prone since foods are packed close together with unclear boundaries and visual similarity making separation of pieces difficult. To address this problem, we propose a method that trains purely on synthetic data and successfully transfers to the real world using sim2real methods by creating datasets of filled food trays using high-quality 3d models of real pieces of food for the training instance segmentation models. Another concern is that foods are easily damaged during grasping. We address this by introducing two additional methods – a novel adaptive finger mechanism to passively retract when a collision occurs, and a method to filter grasps that are likely to cause damage to neighbouring pieces of food during a grasp. We demonstrate the effectiveness of the proposed method on several kinds of real foods.


page 1

page 3

page 5

page 6


Deep Learning based Food Instance Segmentation using Synthetic Data

In the process of intelligently segmenting foods in images using deep ne...

Target-mass Grasping of Entangled Food using Pre-grasping Post-grasping

Food packing industries typically use seasonal ingredients with immense ...

Uncertainty-Aware Self-Supervised Target-Mass Grasping of Granular Foods

Food packing industry workers typically pick a target amount of food by ...

Incremental Learning on Food Instance Segmentation

Food instance segmentation is essential to estimate the serving size of ...

Object Detection in Indian Food Platters using Transfer Learning with YOLOv4

Object detection is a well-known problem in computer vision. Despite thi...

Unsupervised foreign object detection based on dual-energy absorptiometry in the food industry

X-ray imaging is a widely used technique for non-destructive inspection ...

Automotive Parts Assessment: Applying Real-time Instance-Segmentation Models to Identify Vehicle Parts

The problem of automated car damage assessment presents a major challeng...

Please sign up or login with your details

Forgot password? Click here to reset