Contextual Reasoning for Scene Generation (Technical Report)

05/03/2023
by   Loris Bozzato, et al.
0

We present a continuation to our previous work, in which we developed the MR-CKR framework to reason with knowledge overriding across contexts organized in multi-relational hierarchies. Reasoning is realized via ASP with algebraic measures, allowing for flexible definitions of preferences. In this paper, we show how to apply our theoretical work to real autonomous-vehicle scene data. Goal of this work is to apply MR-CKR to the problem of generating challenging scenes for autonomous vehicle learning. In practice, most of the scene data for AV learning models common situations, thus it might be difficult to capture cases where a particular situation occurs (e.g. partial occlusions of a crossing pedestrian). The MR-CKR model allows for data organization exploiting the multi-dimensionality of such data (e.g., temporal and spatial). Reasoning over multiple contexts enables the verification and configuration of scenes, using the combination of different scene ontologies. We describe a framework for semantically guided data generation, based on a combination of MR-CKR and Algebraic Measures. The framework is implemented in a proof-of-concept prototype exemplifying some cases of scene generation.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/06/2021

Reasoning on Multi-Relational Contextual Hierarchies via Answer Set Programming with Algebraic Measures

Dealing with context dependent knowledge has led to different formalizat...
research
02/03/2020

Towards Accurate Vehicle Behaviour Classification With Multi-Relational Graph Convolutional Networks

Understanding on-road vehicle behaviour from a temporal sequence of sens...
research
10/14/2022

SQA3D: Situated Question Answering in 3D Scenes

We propose a new task to benchmark scene understanding of embodied agent...
research
08/18/2020

Tackling the Unannotated: Scene Graph Generation with Bias-Reduced Models

Predicting a scene graph that captures visual entities and their interac...
research
02/25/2021

Unfounded Sets for Disjunctive Hybrid MKNF Knowledge Bases

Combining the closed-world reasoning of answer set programming (ASP) wit...
research
07/20/2021

Learning MR-Sort Models from Non-Monotone Data

The Majority Rule Sorting (MR-Sort) method assigns alternatives evaluate...
research
11/22/2019

Design and Autonomous Stabilization of a Ballistically Launched Multirotor

Aircraft that can launch ballistically and then convert to autonomous, f...

Please sign up or login with your details

Forgot password? Click here to reset