From Modal to Multimodal Ambiguities: a Classification Approach

04/04/2017
by   Maria Chiara Caschera, et al.
0

This paper deals with classifying ambiguities for Multimodal Languages. It evolves the classifications and the methods of the literature on ambiguities for Natural Language and Visual Language, empirically defining an original classification of ambiguities for multimodal interaction using a linguistic perspective. This classification distinguishes between Semantic and Syntactic multimodal ambiguities and their subclasses, which are intercepted using a rule-based method implemented in a software module. The experimental results have achieved an accuracy of the obtained classification compared to the expected one, which are defined by the human judgment, of 94.6 semantic ambiguities classes, and 92.1

READ FULL TEXT
research
03/25/2017

Learning to Predict: A Fast Re-constructive Method to Generate Multimodal Embeddings

Integrating visual and linguistic information into a single multimodal r...
research
08/14/2020

A Multimodal Late Fusion Model for E-Commerce Product Classification

The cataloging of product listings is a fundamental problem for most e-c...
research
09/10/2021

Predicting emergent linguistic compositions through time: Syntactic frame extension via multimodal chaining

Natural language relies on a finite lexicon to express an unbounded set ...
research
05/02/2023

Early Classifying Multimodal Sequences

Often pieces of information are received sequentially over time. When di...
research
02/24/2021

Automatic Meter Classification of Kurdish Poems

Most of the classic texts in Kurdish literature are poems. Knowing the m...
research
06/08/2023

Dealing with Semantic Underspecification in Multimodal NLP

Intelligent systems that aim at mastering language as humans do must dea...
research
01/30/2020

Introducing the diagrammatic mode

In this article, we propose a multimodal perspective to diagrammatic rep...

Please sign up or login with your details

Forgot password? Click here to reset