Commonsense Spatial Reasoning for Visually Intelligent Agents

04/01/2021
by   Agnese Chiatti, et al.
0

Service robots are expected to reliably make sense of complex, fast-changing environments. From a cognitive standpoint, they need the appropriate reasoning capabilities and background knowledge required to exhibit human-like Visual Intelligence. In particular, our prior work has shown that the ability to reason about spatial relations between objects in the world is a key requirement for the development of Visually Intelligent Agents. In this paper, we present a framework for commonsense spatial reasoning which is tailored to real-world robotic applications. Differently from prior approaches to qualitative spatial reasoning, the proposed framework is robust to variations in the robot's viewpoint and object orientation. The spatial relations in the proposed framework are also mapped to the types of commonsense predicates used to describe typical object configurations in English. In addition, we also show how this formally-defined framework can be implemented in a concrete spatial database.

READ FULL TEXT
research
07/26/2016

Grounding Dynamic Spatial Relations for Embodied (Robot) Interaction

This paper presents a computational model of the processing of dynamic s...
research
03/15/2022

Things not Written in Text: Exploring Spatial Commonsense from Visual Signals

Spatial commonsense, the knowledge about spatial position and relationsh...
research
07/21/2023

How to Tidy Up a Table: Fusing Visual and Semantic Commonsense Reasoning for Robotic Tasks with Vague Objectives

Vague objectives in many real-life scenarios pose long-standing challeng...
research
03/13/2020

Towards a Framework for Visual Intelligence in Service Robotics: Epistemic Requirements and Gap Analysis

A key capability required by service robots operating in real-world, dyn...
research
03/31/2020

SPARE3D: A Dataset for SPAtial REasoning on Three-View Line Drawings

Spatial reasoning is an important component of human intelligence. We ca...
research
10/15/2022

A User Interface for Sense-making of the Reasoning Process while Interacting with Robots

As knowledge graph has the potential to bridge the gap between commonsen...
research
10/27/2020

Fit to Measure: Reasoning about Sizes for Robust Object Recognition

Service robots can help with many of our daily tasks, especially in thos...

Please sign up or login with your details

Forgot password? Click here to reset