Desmond Elliott

The Role of Syntactic Planning in Compositional Image Captioning

Image captioning has focused on generalizing to images drawn from the sa...
01/28/2021 ∙ by Emanuele Bugliarello, et al. ∙ 14 ∙ share

read it
Multimodal Pretraining Unmasked: Unifying the Vision and Language BERTs

Large-scale pretraining and task-specific fine-tuning is now the standar...
11/30/2020 ∙ by Emanuele Bugliarello, et al. ∙ 12 ∙ share

read it
Multimodal Speech Recognition with Unstructured Audio Masking

Visual context has been shown to be useful for automatic speech recognit...
10/16/2020 ∙ by Tejas Srinivasan, et al. ∙ 16 ∙ share

read it
Textual Supervision for Visually Grounded Spoken Language Understanding

Visually-grounded models of spoken language understanding extract semant...
10/06/2020 ∙ by Bertrand Higy, et al. ∙ 0 ∙ share

read it
Fine-Grained Grounding for Multimodal Speech Recognition

Multimodal automatic speech recognition systems integrate information fr...
10/05/2020 ∙ by Tejas Srinivasan, et al. ∙ 0 ∙ share

read it
CompGuessWhat?!: A Multi-task Evaluation Framework for Grounded Language Learning

Approaches to Grounded Language Learning typically focus on a single tas...
06/03/2020 ∙ by Alessandro Suglia, et al. ∙ 13 ∙ share

read it
The Sensitivity of Language Models and Humans to Winograd Schema Perturbations

Large-scale pretrained language models are the major driving force behin...
05/04/2020 ∙ by Mostafa Abdou, et al. ∙ 0 ∙ share

read it
Multimodal Machine Translation through Visuals and Speech

Multimodal machine translation involves drawing information from more th...
11/28/2019 ∙ by Umut Sulubacak, et al. ∙ 0 ∙ share

read it
Bootstrapping Disjoint Datasets for Multilingual Multimodal Representation Learning

Recent work has highlighted the advantage of jointly learning grounded s...
11/09/2019 ∙ by Akos Kadar, et al. ∙ 0 ∙ share

read it
Compositional Generalization in Image Captioning

Image captioning models are usually evaluated on their ability to descri...
09/10/2019 ∙ by Mitja Nikolaus, et al. ∙ 0 ∙ share

read it
Cross-lingual Visual Verb Sense Disambiguation

Recent work has shown that visual context improves cross-lingual sense d...
04/10/2019 ∙ by Spandana Gella, et al. ∙ 0 ∙ share

read it
How2: A Large-scale Dataset for Multimodal Language Understanding

In this paper, we introduce How2, a multimodal collection of instruction...
11/01/2018 ∙ by Ramon Sanabria, et al. ∙ 0 ∙ share

read it
Lessons learned in multilingual grounded language learning

Recent work has shown how to learn better visual-semantic embeddings by ...
09/20/2018 ∙ by Akos Kadar, et al. ∙ 0 ∙ share

read it
Findings of the Second Shared Task on Multimodal Machine Translation and Multilingual Image Description

We present the results from the second shared task on multimodal machine...
10/19/2017 ∙ by Desmond Elliott, et al. ∙ 0 ∙ share

read it
Cross-linguistic differences and similarities in image descriptions

Automatic image description systems are commonly trained and evaluated o...
07/06/2017 ∙ by Emiel van Miltenburg, et al. ∙ 0 ∙ share

read it
Imagination improves Multimodal Translation

We decompose multimodal translation into two sub-tasks: learning to tran...
05/11/2017 ∙ by Desmond Elliott, et al. ∙ 0 ∙ share

read it
Room for improvement in automatic image description: an error analysis

In recent years we have seen rapid and significant progress in automatic...
04/13/2017 ∙ by Emiel van Miltenburg, et al. ∙ 0 ∙ share

read it
Pragmatic factors in image description: the case of negations

We provide a qualitative analysis of the descriptions containing negatio...
06/20/2016 ∙ by Emiel van Miltenburg, et al. ∙ 0 ∙ share

read it
Multi30K: Multilingual English-German Image Descriptions

We introduce the Multi30K dataset to stimulate multilingual multimodal r...
05/02/2016 ∙ by Desmond Elliott, et al. ∙ 0 ∙ share

read it
Automatic Description Generation from Images: A Survey of Models, Datasets, and Evaluation Measures

Automatic description generation from natural images is a challenging pr...
01/15/2016 ∙ by Raffaella Bernardi, et al. ∙ 0 ∙ share

read it
Multilingual Image Description with Neural Sequence Models

In this paper we present an approach to multi-language image description...
10/15/2015 ∙ by Desmond Elliott, et al. ∙ 0 ∙ share

read it

Desmond Elliott

Featured Co-authors

Ryan Cotterell

Anders Søgaard

Florian Metze

Lucia Specia

Yonatan Belinkov

Oliver Lemon

Jörg Tiedemann

Barbara Plank

Loïc Barrault

Frank Keller

Ozan Caglayan

The Role of Syntactic Planning in Compositional Image Captioning

Multimodal Pretraining Unmasked: Unifying the Vision and Language BERTs

Multimodal Speech Recognition with Unstructured Audio Masking

Textual Supervision for Visually Grounded Spoken Language Understanding

Fine-Grained Grounding for Multimodal Speech Recognition

CompGuessWhat?!: A Multi-task Evaluation Framework for Grounded Language Learning

The Sensitivity of Language Models and Humans to Winograd Schema Perturbations

Multimodal Machine Translation through Visuals and Speech

Bootstrapping Disjoint Datasets for Multilingual Multimodal Representation Learning

Compositional Generalization in Image Captioning

Cross-lingual Visual Verb Sense Disambiguation

How2: A Large-scale Dataset for Multimodal Language Understanding

Lessons learned in multilingual grounded language learning

Findings of the Second Shared Task on Multimodal Machine Translation and Multilingual Image Description

Cross-linguistic differences and similarities in image descriptions

Imagination improves Multimodal Translation

Room for improvement in automatic image description: an error analysis

Pragmatic factors in image description: the case of negations

Multi30K: Multilingual English-German Image Descriptions

Automatic Description Generation from Images: A Survey of Models, Datasets, and Evaluation Measures

Multilingual Image Description with Neural Sequence Models