research
∙
09/20/2023
The Scenario Refiner: Grounding subjects in images at the morphological level
Derivationally related words, such as "runner" and "running", exhibit se...
share
research
∙
07/06/2023
Contrast Is All You Need
In this study, we analyze data-scarce classification scenarios, where av...
research
∙
04/28/2023
Interpreting Vision and Language Generative Models with Semantic Visual Priors
When applied to Image-to-text models, interpretability methods often pro...
research
∙
02/23/2023
HL Dataset: Grounding High-Level Linguistic Concepts in Vision
Current captioning datasets, focus on object-centric captions, describin...
research
∙
11/09/2022
Understanding Cross-modal Interactions in V L Models that Generate Scene Descriptions
Image captioning models tend to describe images in an object-centric way...
research
∙
05/24/2022
Face2Text revisited: Improved data set and baseline results
Current image description generation models do not transfer well to the ...
research
∙
05/21/2022
Pre-training Data Quality and Quantity for a Low-Resource Language: New Corpus and BERT Models for Maltese
Multilingual language models such as mBERT have seen impressive cross-li...
research
∙
12/14/2021
VALSE: A Task-Independent Benchmark for Vision and Language Models Centered on Linguistic Phenomena
We propose VALSE (Vision And Language Structured Evaluation), a novel be...
research
∙
11/15/2021
Data Augmentation for Speech Recognition in Maltese: A Low-Resource Perspective
Developing speech technologies is a challenge for low-resource languages...
research
∙
09/15/2021
What Vision-Language Models `See' when they See Scenes
Images can be described in terms of the objects they contain, or in term...
research
∙
09/14/2021
On the Language-specificity of Multilingual BERT and the Impact of Fine-tuning
Recent work has shown evidence that the knowledge acquired by multilingu...
research
∙
01/05/2021
On the interaction of automatic evaluation and task framing in headline style transfer
An ongoing debate in the NLG community concerns the best way to evaluate...
research
∙
12/22/2020
Seeing past words: Testing the cross-modal capabilities of pretrained V L models
We investigate the ability of general-purpose pretrained vision and lang...
research
∙
11/16/2020
Datasets and Models for Authorship Attribution on Italian Personal Writings
Existing research on Authorship Attribution (AA) focuses on texts for wh...
research
∙
10/27/2020
Unmasking Contextual Stereotypes: Measuring and Mitigating BERT's Gender Bias
Contextualized word embeddings have been replacing standard embeddings a...
research
∙
08/14/2020
Annotating for Hate Speech: The MaNeCo Corpus and Some Input from Critical Discourse Analysis
This paper presents a novel scheme for the annotation of hate speech in ...
research
∙
08/13/2020
MASRI-HEADSET: A Maltese Corpus for Speech Recognition
Maltese, the national language of Malta, is spoken by approximately 500,...
research
∙
11/09/2019
On Architectures for Including Visual Information in Neural Language Models for Image Description
A neural language model can be conditioned into generating descriptions ...
research
∙
09/21/2019
Visuallly Grounded Generation of Entailments from Premises
Natural Language Inference (NLI) is the task of determining the semantic...
research
∙
07/16/2019
You Write Like You Eat: Stylistic variation as a predictor of social stratification
Inspired by Labov's seminal work on stylistic variation as a function of...
research
∙
01/01/2019
Transfer learning from language models to image caption generators: Better models may not transfer better
When designing a neural caption generator, a convolutional neural networ...
research
∙
10/12/2018
Quantifying the amount of visual information used by neural caption generators
This paper addresses the sensitivity of neural image caption generators ...
research
∙
10/12/2018
Pre-gen metrics: Predicting caption quality metrics without generating captions
Image caption generation systems are typically evaluated against referen...
research
∙
09/30/2018
Specificity measures and reference
In this paper we study empirically the validity of measures of referenti...
research
∙
09/07/2018
Meteorologists and Students: A resource for language grounding of geographical descriptors
We present a data resource which can be useful for research purposes on ...
research
∙
08/10/2018
Making effective use of healthcare data using data-to-text technology
Healthcare organizations are in a continuous effort to improve health ou...
research
∙
06/14/2018
Grounded Textual Entailment
Capturing semantic relations between sentences, such as entailment, is a...
research
∙
03/10/2018
Face2Text: Collecting an Annotated Image Description Corpus for the Generation of Rich Face Descriptions
The past few years have witnessed renewed interest in NLP tasks at the i...
research
∙
08/07/2017
What is the Role of Recurrent Neural Networks (RNNs) in an Image Caption Generator?
In neural image captioning systems, a recurrent neural network (RNN) is ...
research
∙
03/30/2017
An Empirical Approach for Modeling Fuzzy Geographical Descriptors
We present a novel heuristic approach that defines fuzzy geographical de...
research
∙
03/29/2017
Survey of the State of the Art in Natural Language Generation: Core tasks, applications and evaluation
This paper surveys the current state of the art in Natural Language Gene...
research
∙
03/27/2017
Where to put the Image in an Image Caption Generator
When a neural language model is used for caption generation, the image i...
research
∙
03/25/2017