Comparatives, Quantifiers, Proportions: A Multi-Task Model for the Learning of Quantities from Vision

04/13/2018
by   Sandro Pezzelle, et al.
0

The present work investigates whether different quantification mechanisms (set comparison, vague quantification, and proportional estimation) can be jointly learned from visual scenes by a multi-task computational model. The motivation is that, in humans, these processes underlie the same cognitive, non-symbolic ability, which allows an automatic estimation and comparison of set magnitudes. We show that when information about lower-complexity tasks is available, the higher-level proportional task becomes more accurate than when performed in isolation. Moreover, the multi-task model is able to generalize to unseen combinations of target/non-target objects. Consistently with behavioral evidence showing the interference of absolute number in the proportional task, the multi-task model no longer works when asked to provide the number of target objects in the scene.

READ FULL TEXT

page 4

page 7

page 9

research
04/23/2022

Exploring the Role of Task Transferability in Large-Scale Multi-Task Learning

Recent work has found that multi-task training with a large number of di...
research
02/17/2017

Be Precise or Fuzzy: Learning the Meaning of Cardinals and Quantifiers from Vision

People can refer to quantities in a visual scene by using either exact c...
research
06/25/2021

Generative Modeling for Multi-task Visual Learning

Generative modeling has recently shown great promise in computer vision,...
research
06/17/2022

Cross-task Attention Mechanism for Dense Multi-task Learning

Multi-task learning has recently become a promising solution for a compr...
research
05/24/2018

Basket Completion with Multi-task Determinantal Point Processes

Determinantal point processes (DPPs) have received significant attention...
research
06/18/2019

LTG-Oslo Hierarchical Multi-task Network: The importance of negation for document-level sentiment in Spanish

This paper details LTG-Oslo team's participation in the sentiment track ...
research
05/07/2023

Joint Analog Encoder Design for Multi-Task Oriented Wireless Communication

In this paper we study multi-task oriented communication system via stud...

Please sign up or login with your details

Forgot password? Click here to reset