Don't Forget to Buy Milk: Contextually Aware Grocery Reminder Household Robot

07/19/2022
by   Ali Ayub, et al.
0

Assistive robots operating in household environments would require items to be available in the house to perform assistive tasks. However, when these items run out, the assistive robot must remind its user to buy the missing items. In this paper, we present a computational architecture that can allow a robot to learn personalized contextual knowledge of a household through interactions with its user. The architecture can then use the learned knowledge to make predictions about missing items from the household over a long period of time. The architecture integrates state-of-the-art perceptual learning algorithms, cognitive models of memory encoding and learning, a reasoning module for predicting missing items from the household, and a graphical user interface (GUI) to interact with the user. The architecture is integrated with the Fetch mobile manipulator robot and validated in a large indoor environment with multiple contexts and objects. Our experimental results show that the robot can adapt to an environment by learning contextual knowledge through interactions with its user. The robot can also use the learned knowledge to correctly predict missing items over multiple weeks and it is robust against sensory and perceptual errors.

READ FULL TEXT

page 4

page 5

research
06/30/2023

A Personalized Household Assistive Robot that Learns and Creates New Breakfast Options through Human-Robot Interaction

For robots to assist users with household tasks, they must first learn a...
research
07/07/2021

Maintaining a Reliable World Model using Action-aware Perceptual Anchoring

Reliable perception is essential for robots that interact with the world...
research
03/16/2021

Cognitive architecture aided by working-memory for self-supervised multi-modal humans recognition

The ability to recognize human partners is an important social skill to ...
research
06/12/2017

DAC-h3: A Proactive Robot Cognitive Architecture to Acquire and Express Knowledge About the World and the Self

This paper introduces a cognitive architecture for a humanoid robot to e...
research
08/20/2018

What Stands-in for a Missing Tool? A Prototypical Grounded Knowledge-based Approach to Tool Substitution

When a robot is operating in a dynamic environment, it cannot be assumed...
research
06/09/2020

ToolNet: Using Commonsense Generalization for Predicting Tool Use for Robot Plan Synthesis

A robot working in a physical environment (like home or factory) needs t...
research
05/05/2021

TANGO: Commonsense Generalization in Predicting Tool Interactions for Mobile Manipulators

Robots assisting us in factories or homes must learn to make use of obje...

Please sign up or login with your details

Forgot password? Click here to reset