b'Mohit Bansal'

research

∙ 07/25/2022

WinoGAViL: Gamified Association Benchmark to Challenge Vision-and-Language Models

While vision-and-language models perform well on tasks such as visual qu...

Yonatan Bitton, et al. ∙

research

∙ 07/08/2022

CoSIm: Commonsense Reasoning for Counterfactual Scene Imagination

As humans, we can modify our assumptions about a scene by imagining alte...

Hyounghun Kim, et al. ∙

research

∙ 07/08/2022

SETSum: Summarization and Visualization of Student Evaluations of Teaching

Student Evaluations of Teaching (SETs) are widely used in colleges and u...

Yinuo Hu, et al. ∙

research

∙ 07/05/2022

CLEAR: Improving Vision-Language Navigation with Cross-Lingual, Environment-Agnostic Representations

Vision-and-Language Navigation (VLN) tasks require an agent to navigate ...

Jialu Li, et al. ∙

research

∙ 06/30/2022

Masked Part-Of-Speech Model: Does Modeling Long Context Help Unsupervised POS-tagging?

Previous Part-Of-Speech (POS) induction models usually assume certain in...

Xiang Zhou, et al. ∙

research

∙ 06/22/2022

VisFIS: Visual Feature Importance Supervision with Right-for-the-Right-Reason Objectives

Many past works aim to improve visual reasoning in models by supervising...

Zhuofan Ying, et al. ∙

research

∙ 06/13/2022

LST: Ladder Side-Tuning for Parameter and Memory Efficient Transfer Learning

Fine-tuning large pre-trained models on downstream tasks has been adopte...

Yi-Lin Sung, et al. ∙

research

∙ 06/07/2022

Revealing Single Frame Bias for Video-and-Language Learning

Training an effective video-and-language model intuitively requires mult...

Jie Lei, et al. ∙

research

∙ 05/26/2022

Fine-grained Image Captioning with CLIP Reward

Modern image captioning models are usually trained with text similarity ...

Jaemin Cho, et al. ∙

research

∙ 05/22/2022

Language Models with Image Descriptors are Strong Few-Shot Video-Language Learners

The goal of this work is to build flexible video-language models that ca...

Zhenhailong Wang, et al. ∙

research

∙ 05/18/2022

On the Limits of Evaluating Embodied Agent Model Generalization Using Validation Sets

Natural language guided embodied task completion is a challenging proble...

Hyounghun Kim, et al. ∙

research

∙ 05/16/2022

FactPEGASUS: Factuality-Aware Pre-training and Fine-tuning for Abstractive Summarization

We present FactPEGASUS, an abstractive summarization model that addresse...

David Wan, et al. ∙

research

∙ 05/11/2022

Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learning

Few-shot in-context learning (ICL) enables pre-trained language models t...

Haokun Liu, et al. ∙

research

∙ 05/04/2022

Efficient Few-Shot Fine-Tuning for Opinion Summarization

Abstractive summarization models are typically pre-trained on large amou...

Arthur Bražinskas, et al. ∙

research

∙ 04/29/2022

How Robust is Neural Machine Translation to Language Imbalance in Multilingual Tokenizer Training?

A multilingual tokenizer is a fundamental component of multilingual neur...

Shiyue Zhang, et al. ∙

research

∙ 04/25/2022

How can NLP Help Revitalize Endangered Languages? A Case Study and Roadmap for the Cherokee Language

More than 43 language loss currently occurs at an accelerated rate becau...

Shiyue Zhang, et al. ∙

research

∙ 04/13/2022

FactGraph: Evaluating Factuality in Summarization with Semantic Graph Representations

Despite recent improvements in abstractive summarization, most current a...

Leonardo F. R. Ribeiro, et al. ∙

research

∙ 04/11/2022

Explanation Graph Generation via Pre-trained Language Models: An Empirical Study with Contrastive Learning

Pre-trained sequence-to-sequence language models have led to widespread ...

Swarnadeep Saha, et al. ∙

research

∙ 04/06/2022

ECLIPSE: Efficient Long-range Video Retrieval using Sight and Sound

We introduce an audiovisual method for long-range text-to-video retrieva...

Yan-Bo Lin, et al. ∙

research

∙ 03/29/2022

EnvEdit: Environment Editing for Vision-and-Language Navigation

In Vision-and-Language Navigation (VLN), an agent needs to navigate thro...

Jialu Li, et al. ∙

research

∙ 03/14/2022

GrIPS: Gradient-free, Edit-based Instruction Search for Prompting Large Language Models

Providing natural language instructions in prompts is a useful new parad...

Archiki Prasad, et al. ∙

research

∙ 03/10/2022

LoopITR: Combining Dual and Cross Encoder Architectures for Image-Text Retrieval

Dual encoders and cross encoders have been widely used for image-text re...

Jie Lei, et al. ∙

research

∙ 02/24/2022

CAISE: Conversational Agent for Image Search and Editing

Demand for image editing has been increasing as users' desire for expres...

Hyounghun Kim, et al. ∙

research

∙ 02/08/2022

DALL-Eval: Probing the Reasoning Skills and Social Biases of Text-to-Image Generative Transformers

Generating images from textual descriptions has gained a lot of attentio...

Jaemin Cho, et al. ∙

research

∙ 12/20/2021

MuMuQA: Multimedia Multi-Hop News Question Answering via Cross-Media Knowledge Extraction and Grounding

Recently, there has been an increasing interest in building question ans...

Revanth Gangi Reddy, et al. ∙

research

∙ 12/16/2021

Learning and Analyzing Generation Order for Undirected Sequence Models

Undirected neural sequence models have achieved performance competitive ...

Yichen Jiang, et al. ∙

research

∙ 12/16/2021

A Proposition-Level Clustering Approach for Multi-Document Summarization

Text clustering methods were traditionally incorporated into multi-docum...

Ori Ernst, et al. ∙

research

∙ 12/13/2021

VL-Adapter: Parameter-Efficient Transfer Learning for Vision-and-Language Tasks

Recently, fine-tuning language models pre-trained on large text corpora ...

Yi-Lin Sung, et al. ∙

research

∙ 12/08/2021

MLP Architectures for Vision-and-Language Modeling: An Empirical Study

We initiate the first empirical study on the use of MLP architectures fo...

Yixin Nie, et al. ∙

research

∙ 11/26/2021

Do Language Models Have Beliefs? Methods for Detecting, Updating, and Visualizing Model Beliefs

Do language models have beliefs about the world? Dennett (1995) famously...

Peter Hase, et al. ∙

research

∙ 11/01/2021

Low-Cost Algorithmic Recourse for Users With Uncertain Cost Functions

The problem of identifying algorithmic recourse for people affected by m...

Prateek Yadav, et al. ∙

research

∙ 10/21/2021

Integrating Visuospatial, Linguistic and Commonsense Structure into Story Visualization

While much research has been done in text-to-image synthesis, little wor...

Adyasha Maharana, et al. ∙

research

∙ 09/30/2021

Inducing Transformer's Compositional Generalization Ability via Auxiliary Sequence Prediction Tasks

Systematic compositionality is an essential mechanism in human language,...

Yichen Jiang, et al. ∙

research

∙ 09/23/2021

iFacetSum: Coreference-based Interactive Faceted Summarization for Multi-Document Exploration

We introduce iFacetSum, a web application for exploring topical document...

Eran Hirsch, et al. ∙

research

∙ 09/23/2021

Finding a Balanced Degree of Automation for Summary Evaluation

Human evaluation for summarization tasks is reliable but brings in issue...

Shiyue Zhang, et al. ∙

research

∙ 07/30/2021

MTVR: Multilingual Moment Retrieval in Videos

We introduce mTVR, a large-scale multilingual video moment retrieval dat...

Jie Lei, et al. ∙

research

∙ 07/30/2021

ChrEnTranslate: Cherokee-English Machine Translation Demo with Quality Estimation and Corrective Feedback

We introduce ChrEnTranslate, an online machine translation demonstration...

Shiyue Zhang, et al. ∙

research

∙ 07/30/2021

EmailSum: Abstractive Email Thread Summarization

Recent years have brought about an interest in the challenging task of s...

Shiyue Zhang, et al. ∙

research

∙ 07/20/2021

QVHighlights: Detecting Moments and Highlights in Videos via Natural Language Queries

Detecting customized moments and highlights from videos given natural la...

Jie Lei, et al. ∙

research

∙ 07/13/2021

How Much Can CLIP Benefit Vision-and-Language Tasks?

Most existing Vision-and-Language (V L) models rely on pre-trained vis...

Sheng Shen, et al. ∙

research

∙ 07/06/2021

VidLanKD: Improving Language Understanding via Video-Distilled Knowledge Transfer

Since visual perception can give rich information beyond text descriptio...

Zineng Tang, et al. ∙

research

∙ 06/21/2021

VIMPAC: Video Pre-Training via Masked Token Prediction and Contrastive Learning

Video understanding relies on perceiving the global content and modeling...

Hao Tan, et al. ∙

research

∙ 06/16/2021

Disentangling Online Chats with DAG-Structured LSTMs

Many modern messaging systems allow fast and synchronous textual communi...

Duccio Pappadopulo, et al. ∙

research

∙ 06/14/2021

An Empirical Survey of Data Augmentation for Limited Data Learning in NLP

NLP has achieved great progress in the past decade through the use of ne...

Jiaao Chen, et al. ∙

research

∙ 06/08/2021

VALUE: A Multi-Task Benchmark for Video-and-Language Understanding Evaluation

Most existing video-and-language (VidL) research focuses on a single dat...

Linjie Li, et al. ∙

research

∙ 06/02/2021

multiPRover: Generating Multiple Proofs for Improved Interpretability in Rule Reasoning

We focus on a type of linguistic formal reasoning where the goal is to r...

Swarnadeep Saha, et al. ∙

research

∙ 06/02/2021

Enriching Transformers with Structured Tensor-Product Representations for Abstractive Summarization

Abstractive summarization, the task of generating a concise summary of i...

Yichen Jiang, et al. ∙

research

∙ 06/01/2021

Search Methods for Sufficient, Socially-Aligned Feature Importance Explanations with In-Distribution Counterfactuals

Feature importance (FI) estimates are a popular form of explanation, and...

Peter Hase, et al. ∙

research

∙ 05/20/2021

Improving Generation and Evaluation of Visual Stories via Semantic Consistency

Story visualization is an under-explored task that falls at the intersec...

Adyasha Maharana, et al. ∙

research

∙ 04/20/2021

Identify, Align, and Integrate: Matching Knowledge Graphs to Commonsense Reasoning Tasks

Integrating external knowledge into commonsense reasoning tasks has show...

Lisa Bauer, et al. ∙

Mohit Bansal

Featured Co-authors