b'Radu Soricut'

research

∙ 08/14/2023

CausalLM is not optimal for in-context learning

Recent empirical evidence indicates that transformer based in-context le...

0 Nan Ding, et al. ∙

research

∙ 07/28/2023

RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control

We study how vision-language models trained on Internet-scale data can b...

0 Anthony Brohan, et al. ∙

research

∙ 02/22/2023

Connecting Vision and Language with Video Localized Narratives

We propose Video Localized Narratives, a new form of multimodal video an...

0 Paul Voigtlaender, et al. ∙

research

∙ 11/22/2022

Improving Robust Generalization by Direct PAC-Bayesian Bound Minimization

Recent research in robust optimization has shown an overfitting-like phe...

0 Zifan Wang, et al. ∙

research

∙ 09/14/2022

PaLI: A Jointly-Scaled Multilingual Language-Image Model

Effective scaling and a flexible task interface enable large language mo...

6 Xi Chen, et al. ∙

research

∙ 09/12/2022

PreSTU: Pre-Training for Scene-Text Understanding

The ability to read and reason about texts in an image is often lacking ...

0 Jihyung Kil, et al. ∙

research

∙ 09/12/2022

Towards Multi-Lingual Visual Question Answering

Visual Question Answering (VQA) has been primarily studied through the l...

0 Soravit Changpinyo, et al. ∙

research

∙ 05/25/2022

Crossmodal-3600: A Massively Multilingual Multimodal Evaluation Dataset

Research in massively multilingual image captioning has been severely ha...

0 Ashish V. Thapliyal, et al. ∙

research

∙ 05/04/2022

All You May Need for VQA are Image Captions

Visual Question Answering (VQA) has benefited from increasingly sophisti...

0 Soravit Changpinyo, et al. ∙

research

∙ 04/18/2022

End-to-end Dense Video Captioning as Sequence Generation

Dense video captioning aims to identify the events of interest in an inp...

3 Wanrong Zhu, et al. ∙

research

∙ 03/10/2022

PACTran: PAC-Bayesian Metrics for Estimating the Transferability of Pretrained Models to Classification Tasks

With the increasing abundance of pretrained models in recent years, the ...

0 Nan Ding, et al. ∙

research

∙ 07/25/2021

H-Transformer-1D: Fast One-Dimensional Hierarchical Attention for Sequences

We describe an efficient hierarchical method to compute attention in the...

0 Zhenhai Zhu, et al. ∙

research

∙ 05/28/2021

Bridging the Gap Between Practice and PAC-Bayes Theory in Few-Shot Meta-Learning

Despite recent advances in its theoretical understanding, there still re...

0 Nan Ding, et al. ∙

research

∙ 02/17/2021

Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual Concepts

The availability of large-scale image captioning and visual question ans...

0 Soravit Changpinyo, et al. ∙

research

∙ 02/09/2021

Telling the What while Pointing the Where: Fine-grained Mouse Trace and Language Supervision for Improved Image Retrieval

Existing image retrieval systems use text queries to provide a natural a...

0 Soravit Changpinyo, et al. ∙

research

∙ 12/04/2020

Understanding Guided Image Captioning Performance across Domains

Image captioning models generally lack the capability to take into accou...

6 Edwin G. Ng, et al. ∙

research

∙ 11/10/2020

Multimodal Pretraining for Dense Video Captioning

Learning specific hands-on skills such as cooking, car maintenance, and ...

1 Gabriel Huang, et al. ∙

research

∙ 10/13/2020

Improving Text Generation Evaluation with Batch Centering and Tempered Word Mover Distance

Recent advances in automatic evaluation metrics for text have shown that...

0 Xi Chen, et al. ∙

research

∙ 10/07/2020

TeaForN: Teacher-Forcing with N-grams

Sequence generation models trained with teacher-forcing suffer from issu...

0 Sebastian Goodman, et al. ∙

research

∙ 09/29/2020

Attention that does not Explain Away

Models based on the Transformer architecture have achieved better accura...

0 Nan Ding, et al. ∙

research

∙ 09/10/2020

Weakly Supervised Content Selection for Improved Image Captioning

Image captioning involves identifying semantic concepts in the scene and...

3 Khyathi Raghavi Chandu, et al. ∙

research

∙ 06/15/2020

Multi-Image Summarization: Textual Summary from a Set of Cohesive Images

Multi-sentence summarization is a well studied problem in NLP, while gen...

0 Nicholas Trieu, et al. ∙

research

∙ 05/01/2020

Cross-modal Language Generation using Pivot Stabilization for Web-scale Language Coverage

Cross-modal language generation tasks such as image captioning are direc...

0 Ashish V. Thapliyal, et al. ∙

research

∙ 04/29/2020

Beyond Instructional Videos: Probing for More Diverse Visual-Textual Grounding on YouTube

Pretraining from unlabelled web videos has quickly become the de-facto m...

4 Jack Hessel, et al. ∙

research

∙ 12/06/2019

Connecting Vision and Language with Localized Narratives

We propose Localized Narratives, an efficient way to collect image capti...

16 Jordi Pont-Tuset, et al. ∙

research

∙ 11/21/2019

Reinforcing an Image Caption Generator Using Off-Line Human Feedback

Human ratings are currently the most accurate way to assess the quality ...

0 Paul Hongsuck Seo, et al. ∙

research

∙ 10/07/2019

A Case Study on Combining ASR and Visual Features for Generating Instructional Video Captions

Instructional videos get high-traffic on video sharing platforms, and pr...

0 Jack Hessel, et al. ∙

research

∙ 09/26/2019

ALBERT: A Lite BERT for Self-supervised Learning of Language Representations

Increasing model size when pretraining natural language representations ...

11 Zhenzhong Lan, et al. ∙

research

∙ 09/23/2019

Multi-stage Pretraining for Abstractive Summarization

Neural models for abstractive summarization tend to achieve the best per...

0 Sebastian Goodman, et al. ∙

research

∙ 09/08/2019

Quality Estimation for Image Captions Based on Large-scale Human Evaluations

Automatic image captioning has improved significantly in the last few ye...

0 Tomer Levinboim, et al. ∙

research

∙ 09/04/2019

Decoupled Box Proposal and Featurization with Ultrafine-Grained Semantic Labels Improve Image Captioning and Visual Question Answering

Object detection plays an important role in current solutions to vision ...

0 Soravit Changpinyo, et al. ∙

research

∙ 06/20/2019

Informative Image Captioning with External Sources of Information

An image caption should fluently present the essential information in a ...

0 Sanqiang Zhao, et al. ∙

research

∙ 04/11/2018

SHAPED: Shared-Private Encoder-Decoder for Text Style Adaptation

Supervised training of abstractive language generation models results in...

0 Ye Zhang, et al. ∙

research

∙ 12/22/2016

Understanding Image and Text Simultaneously: a Dual Vision-Language Machine Comprehension Task

We introduce a new multi-modal task for computer systems, posed as a com...

0 Nan Ding, et al. ∙

research

∙ 12/14/2016

Multilingual Word Embeddings using Multigraphs

We present a family of neural-network--inspired models for computing con...

0 Radu Soricut, et al. ∙

research

∙ 12/13/2016

Building Large Machine Reading-Comprehension Datasets using Paragraph Vectors

We present a dual contribution to the task of machine reading-comprehens...

0 Radu Soricut, et al. ∙

research

∙ 12/16/2015

Morpho-syntactic Lexicon Generation Using Graph-based Semi-supervised Learning

Morpho-syntactic lexicons provide information about the morphological an...

0 Manaal Faruqui, et al. ∙

Radu Soricut

Featured Co-authors