Deep Semantic Abstractions of Everyday Human Activities: On Commonsense Representations of Human Interactions

10/10/2017
by   Jakob Suchan, et al.
0

We propose a deep semantic characterization of space and motion categorically from the viewpoint of grounding embodied human-object interactions. Our key focus is on an ontological model that would be adept to formalisation from the viewpoint of commonsense knowledge representation, relational learning, and qualitative reasoning about space and motion in cognitive robotics settings. We demonstrate key aspects of the space & motion ontology and its formalization as a representational framework in the backdrop of select examples from a dataset of everyday activities. Furthermore, focussing on human-object interaction data obtained from RGBD sensors, we also illustrate how declarative (spatio-temporal) reasoning in the (constraint) logic programming family may be performed with the developed deep semantic abstractions.

READ FULL TEXT

page 3

page 5

page 6

page 9

research
09/15/2017

Commonsense Scene Semantics for Cognitive Robotics: Towards Grounding Embodied Visuo-Locomotive Interactions

We present a commonsense, qualitative model for the semantic grounding o...
research
08/13/2015

Talking about the Moving Image: A Declarative Model for Image Schema Based Embodied Perception Grounding and Language Generation

We present a general theory and corresponding declarative model for the ...
research
06/22/2013

Cognitive Interpretation of Everyday Activities: Toward Perceptual Narrative Based Visuo-Spatial Scene Interpretation

We position a narrative-centred computational model for high-level knowl...
research
09/06/2022

Reconstructing Action-Conditioned Human-Object Interactions Using Commonsense Knowledge Priors

We present a method for inferring diverse 3D models of human-object inte...
research
08/12/2020

We Have So Much In Common: Modeling Semantic Relational Set Abstractions in Videos

Identifying common patterns among events is a key ability in human and m...
research
12/28/2020

Commonsense Visual Sensemaking for Autonomous Driving: On Generalised Neurosymbolic Online Abduction Integrating Vision and Semantics

We demonstrate the need and potential of systematically integrated visio...
research
12/03/2018

Selected Qualitative Spatio-temporal Calculi Developed for Constraint Reasoning: A Review

In this article a few of the qualitative spatio-temporal knowledge repre...

Please sign up or login with your details

Forgot password? Click here to reset