Aligning Visual and Lexical Semantics

12/13/2022
by   Fausto Giunchiglia, et al.
0

We discuss two kinds of semantics relevant to Computer Vision (CV) systems - Visual Semantics and Lexical Semantics. While visual semantics focus on how humans build concepts when using vision to perceive a target reality, lexical semantics focus on how humans build concepts of the same target reality through the use of language. The lack of coincidence between visual and lexical semantics, in turn, has a major impact on CV systems in the form of the Semantic Gap Problem (SGP). The paper, while extensively exemplifying the lack of coincidence as above, introduces a general, domain-agnostic methodology to enforce alignment between visual and lexical semantics.

READ FULL TEXT
research
04/26/2021

Towards Visual Semantics

In Visual Semantics we study how humans build mental representations, i....
research
11/16/2020

Comparative Probing of Lexical Semantics Theories for Cognitive Plausibility and Technological Usefulness

Lexical semantics theories differ in advocating that the meaning of word...
research
05/09/2023

Egocentric Hierarchical Visual Semantics

We are interested in aligning how people think about objects and what ma...
research
09/10/2018

A case for deep learning in semantics

Pater's target article builds a persuasive case for establishing stronge...
research
06/16/2020

The Role of Verb Semantics in Hungarian Verb-Object Order

Hungarian is often referred to as a discourse-configurational language, ...
research
11/22/2020

Employing distributional semantics to organize task-focused vocabulary learning

How can a learner systematically prepare for reading a book they are int...
research
06/29/2017

Frame-Based Continuous Lexical Semantics through Exponential Family Tensor Factorization and Semantic Proto-Roles

We study how different frame annotations complement one another when lea...

Please sign up or login with your details

Forgot password? Click here to reset