VGStore: A Multimodal Extension to SPARQL for Querying RDF Scene Graph

09/07/2022
by   Yanzeng Li, et al.
3

Semantic Web technology has successfully facilitated many RDF models with rich data representation methods. It also has the potential ability to represent and store multimodal knowledge bases such as multimodal scene graphs. However, most existing query languages, especially SPARQL, barely explore the implicit multimodal relationships like semantic similarity, spatial relations, etc. We first explored this issue by organizing a large-scale scene graph dataset, namely Visual Genome, in the RDF graph database. Based on the proposed RDF-stored multimodal scene graph, we extended SPARQL queries to answer questions containing relational reasoning about color, spatial, etc. Further demo (i.e., VGStore) shows the effectiveness of customized queries and displaying multimodal data.

READ FULL TEXT
research
02/26/2019

Learning Latent Scene-Graph Representations for Referring Relationships

Understanding the semantics of complex visual scenes often requires anal...
research
07/16/2018

Visual Graphs from Motion (VGfM): Scene understanding with object geometry reasoning

Recent approaches on visual scene understanding attempt to build a scene...
research
12/04/2022

Query-Driven Knowledge Base Completion using Multimodal Path Fusion over Multimodal Knowledge Graph

Over the past few years, large knowledge bases have been constructed to ...
research
03/17/2022

MuKEA: Multimodal Knowledge Extraction and Accumulation for Knowledge-based Visual Question Answering

Knowledge-based visual question answering requires the ability of associ...
research
09/19/2016

On Support Relations and Semantic Scene Graphs

Scene understanding is a popular and challenging topic in both computer ...
research
06/09/2023

SNeL: A Structured Neuro-Symbolic Language for Entity-Based Multimodal Scene Understanding

In the evolving landscape of artificial intelligence, multimodal and Neu...
research
02/07/2022

DeepSSN: a deep convolutional neural network to assess spatial scene similarity

Spatial-query-by-sketch is an intuitive tool to explore human spatial kn...

Please sign up or login with your details

Forgot password? Click here to reset