Learning Bimanual Scooping Policies for Food Acquisition

11/26/2022
by   Jennifer Grannen, et al.
0

A robotic feeding system must be able to acquire a variety of foods. Prior bite acquisition works consider single-arm spoon scooping or fork skewering, which do not generalize to foods with complex geometries and deformabilities. For example, when acquiring a group of peas, skewering could smoosh the peas while scooping without a barrier could result in chasing the peas on the plate. In order to acquire foods with such diverse properties, we propose stabilizing food items during scooping using a second arm, for example, by pushing peas against the spoon with a flat surface to prevent dispersion. The added stabilizing arm can lead to new challenges. Critically, this arm should stabilize the food scene without interfering with the acquisition motion, which is especially difficult for easily breakable high-risk food items like tofu. These high-risk foods can break between the pusher and spoon during scooping, which can lead to food waste falling out of the spoon. We propose a general bimanual scooping primitive and an adaptive stabilization strategy that enables successful acquisition of a diverse set of food geometries and physical properties. Our approach, CARBS: Coordinated Acquisition with Reactive Bimanual Scooping, learns to stabilize without impeding task progress by identifying high-risk foods and robustly scooping them using closed-loop visual feedback. We find that CARBS is able to generalize across food shape, size, and deformability and is additionally able to manipulate multiple food items simultaneously. CARBS achieves 87.0 25.8 16.2 https://sites.google.com/view/bimanualscoop-corl22/home .

READ FULL TEXT

page 2

page 4

page 12

page 13

page 14

page 15

research
06/05/2019

Robot-Assisted Feeding: Generalizing Skewering Strategies across Food Items on a Realistic Plate

A robot-assisted feeding system must successfully acquire many different...
research
08/19/2019

Adaptive Robot-Assisted Feeding: An Online Learning Framework for Acquiring Previously-Unseen Food Items

Successful robot-assisted feeding requires bite acquisition of a wide va...
research
01/06/2021

Playing with Food: Learning Food Item Representations through Interactive Exploration

A key challenge in robotic food manipulation is modeling the material pr...
research
08/19/2019

Learning from failures in robot-assisted feeding: Using online learning to develop manipulation strategies for bite acquisition

Successful robot-assisted feeding requires bite acquisition of a wide va...
research
09/27/2019

Leveraging Multimodal Haptic Sensory Data for Robust Cutting

Cutting is a common form of manipulation when working with divisible obj...
research
01/11/2022

Acquisition and Representation of User Preferences Guided by an Ontology

Our food preferences guide our food choices and in turn affect our perso...

Please sign up or login with your details

Forgot password? Click here to reset