research
∙
07/03/2023
Fixing confirmation bias in feature attribution methods via semantic match
Feature attribution methods have become a staple method to disentangle t...
share
research
∙
06/08/2023
Dealing with Semantic Underspecification in Multimodal NLP
Intelligent systems that aim at mastering language as humans do must dea...
research
∙
05/31/2023
Speaking the Language of Your Listener: Audience-Aware Adaptation via Plug-and-Play Theory of Mind
Dialogue participants may have varying levels of knowledge about the top...
research
∙
02/14/2023
A Psycholinguistic Analysis of BERT's Representations of Compounds
This work studies the semantic representations learned by BERT for compo...
research
∙
11/09/2020
Generating Image Descriptions via Sequential Cross-Modal Alignment Guided by Human Gaze
When speakers describe an image, they tend to look at objects before men...
research
∙
11/09/2020
Refer, Reuse, Reduce: Generating Subsequent References in Visual and Conversational Contexts
Dialogue participants often refer to entities or situations repeatedly w...
research
∙
08/27/2019
Is the Red Square Big? MALeViC: Modeling Adjectives Leveraging Visual Contexts
This work aims at modeling how the meaning of gradable adjectives of siz...
research
∙
09/12/2018
The Wisdom of MaSSeS: Majority, Subjectivity, and Semantic Similarity in the Evaluation of VQA
We introduce MASSES, a simple evaluation metric for the task of Visual Q...
research
∙
06/01/2018
Some of Them Can be Guessed! Exploring the Effect of Linguistic Context in Predicting Quantifiers
We study the role of linguistic context in predicting quantifiers (`few'...
research
∙
04/13/2018
Comparatives, Quantifiers, Proportions: A Multi-Task Model for the Learning of Quantities from Vision
The present work investigates whether different quantification mechanism...
research
∙
05/03/2017
FOIL it! Find One mismatch between Image and Language caption
In this paper, we aim to understand whether current language and vision ...
research
∙
04/10/2017
Pay Attention to Those Sets! Learning Quantification from Images
Major advances have recently been made in merging language and vision re...
research
∙
02/17/2017
Be Precise or Fuzzy: Learning the Meaning of Cardinals and Quantifiers from Vision
People can refer to quantities in a visual scene by using either exact c...
research
∙
06/20/2016