b'Mohit Bansal'

QVHighlights: Detecting Moments and Highlights in Videos via Natural Language Queries

Detecting customized moments and highlights from videos given natural la...
07/20/2021 ∙ by Jie Lei, et al. ∙ 11 ∙ share

read it
How Much Can CLIP Benefit Vision-and-Language Tasks?

Most existing Vision-and-Language (V L) models rely on pre-trained vis...
07/13/2021 ∙ by Sheng Shen, et al. ∙ 7 ∙ share

read it
VidLanKD: Improving Language Understanding via Video-Distilled Knowledge Transfer

Since visual perception can give rich information beyond text descriptio...
07/06/2021 ∙ by Zineng Tang, et al. ∙ 3 ∙ share

read it
VIMPAC: Video Pre-Training via Masked Token Prediction and Contrastive Learning

Video understanding relies on perceiving the global content and modeling...
06/21/2021 ∙ by Hao Tan, et al. ∙ 8 ∙ share

read it
Disentangling Online Chats with DAG-Structured LSTMs

Many modern messaging systems allow fast and synchronous textual communi...
06/16/2021 ∙ by Duccio Pappadopulo, et al. ∙ 44 ∙ share

read it
An Empirical Survey of Data Augmentation for Limited Data Learning in NLP

NLP has achieved great progress in the past decade through the use of ne...
06/14/2021 ∙ by Jiaao Chen, et al. ∙ 30 ∙ share

read it
VALUE: A Multi-Task Benchmark for Video-and-Language Understanding Evaluation

Most existing video-and-language (VidL) research focuses on a single dat...
06/08/2021 ∙ by Linjie Li, et al. ∙ 3 ∙ share

read it
multiPRover: Generating Multiple Proofs for Improved Interpretability in Rule Reasoning

We focus on a type of linguistic formal reasoning where the goal is to r...
06/02/2021 ∙ by Swarnadeep Saha, et al. ∙ 10 ∙ share

read it
Enriching Transformers with Structured Tensor-Product Representations for Abstractive Summarization

Abstractive summarization, the task of generating a concise summary of i...
06/02/2021 ∙ by Yichen Jiang, et al. ∙ 13 ∙ share

read it
Search Methods for Sufficient, Socially-Aligned Feature Importance Explanations with In-Distribution Counterfactuals

Feature importance (FI) estimates are a popular form of explanation, and...
06/01/2021 ∙ by Peter Hase, et al. ∙ 7 ∙ share

read it
Improving Generation and Evaluation of Visual Stories via Semantic Consistency

Story visualization is an under-explored task that falls at the intersec...
05/20/2021 ∙ by Adyasha Maharana, et al. ∙ 15 ∙ share

read it
Identify, Align, and Integrate: Matching Knowledge Graphs to Commonsense Reasoning Tasks

Integrating external knowledge into commonsense reasoning tasks has show...
04/20/2021 ∙ by Lisa Bauer, et al. ∙ 6 ∙ share

read it
Hidden Biases in Unreliable News Detection Datasets

Automatic unreliable news detection is a research problem with great pot...
04/20/2021 ∙ by Xiang Zhou, et al. ∙ 7 ∙ share

read it
Improving Cross-Modal Alignment in Vision Language Navigation via Syntactic Information

Vision language navigation is the task that requires an agent to navigat...
04/19/2021 ∙ by Jialu Li, et al. ∙ 10 ∙ share

read it
Distributed NLI: Learning to Predict Human Opinion Distributions for Language Reasoning

We introduce distributed NLI, a new NLU task with a goal to predict the ...
04/18/2021 ∙ by Xiang Zhou, et al. ∙ 10 ∙ share

read it
ExplaGraphs: An Explanation Graph Generation Task for Structured Commonsense Reasoning

Recent commonsense-reasoning tasks are typically discriminative in natur...
04/15/2021 ∙ by Swarnadeep Saha, et al. ∙ 14 ∙ share

read it
FixMyPose: Pose Correctional Captioning and Retrieval

Interest in physical therapy and individual exercises such as yoga/dance...
04/04/2021 ∙ by Hyounghun Kim, et al. ∙ 3 ∙ share

read it
Improving and Simplifying Pattern Exploiting Training

Recently, pre-trained language models (LMs) have achieved strong perform...
03/22/2021 ∙ by Derek Tam, et al. ∙ 8 ∙ share

read it
Dual Reinforcement-Based Specification Generation for Image De-Rendering

Advances in deep learning have led to promising progress in inferring gr...
03/02/2021 ∙ by Ramakanth Pasunuru, et al. ∙ 8 ∙ share

read it
Data Augmentation for Abstractive Query-Focused Multi-Document Summarization

The progress in Query-focused Multi-Document Summarization (QMDS) has be...
03/02/2021 ∙ by Ramakanth Pasunuru, et al. ∙ 2 ∙ share

read it
Less is More: ClipBERT for Video-and-Language Learning via Sparse Sampling

The canonical approach to video-and-language learning (e.g., video quest...
02/11/2021 ∙ by Jie Lei, et al. ∙ 2 ∙ share

read it
Unifying Vision-and-Language Tasks via Text Generation

Existing methods for vision-and-language learning typically require desi...
02/04/2021 ∙ by Jaemin Cho, et al. ∙ 38 ∙ share

read it
When Can Models Learn From Explanations? A Formal Framework for Understanding the Roles of Explanation Data

Many methods now exist for conditioning model outputs on task instructio...
02/03/2021 ∙ by Peter Hase, et al. ∙ 9 ∙ share

read it
Robustness Gym: Unifying the NLP Evaluation Landscape

Despite impressive performance on standard benchmarks, deep neural netwo...
01/13/2021 ∙ by Karan Goel, et al. ∙ 2 ∙ share

read it
FastIF: Scalable Influence Functions for Efficient Model Interpretation and Debugging

Influence functions approximate the 'influences' of training data-points...
12/31/2020 ∙ by Han Guo, et al. ∙ 9 ∙ share

read it
I like fish, especially dolphins: Addressing Contradictions in Dialogue Modeling

To quantify how well natural language understanding models can capture c...
12/24/2020 ∙ by Yixin Nie, et al. ∙ 7 ∙ share

read it
To what extent do human explanations of model behavior align with actual model behavior?

Given the increasingly prominent role NLP models (will) play in our live...
12/24/2020 ∙ by Grusha Prasad, et al. ∙ 9 ∙ share

read it
ArraMon: A Joint Navigation-Assembly Instruction Interpretation Task in Dynamic Environments

For embodied agents, navigation is an important ability but not an isola...
11/15/2020 ∙ by Hyounghun Kim, et al. ∙ 3 ∙ share

read it
DORB: Dynamically Optimizing Multiple Rewards with Bandits

Policy gradients-based reinforcement learning has proven to be a promisi...
11/15/2020 ∙ by Ramakanth Pasunuru, et al. ∙ 4 ∙ share

read it
HoVer: A Dataset for Many-Hop Fact Extraction And Claim Verification

We introduce HoVer (HOppy VERification), a dataset for many-hop evidence...
11/05/2020 ∙ by Yichen Jiang, et al. ∙ 4 ∙ share

read it
ConjNLI: Natural Language Inference Over Conjunctive Sentences

Reasoning about conjuncts in conjunctive sentences is important for a de...
10/20/2020 ∙ by Swarnadeep Saha, et al. ∙ 15 ∙ share

read it
What is More Likely to Happen Next? Video-and-Language Future Event Prediction

Given a video with aligned dialogue, people can often infer what is more...
10/15/2020 ∙ by Jie Lei, et al. ∙ 3 ∙ share

read it
Vokenization: Improving Language Understanding with Contextualized, Visual-Grounded Supervision

Humans learn language by listening, speaking, writing, reading, and also...
10/14/2020 ∙ by Hao Tan, et al. ∙ 3 ∙ share

read it
ChrEn: Cherokee-English Machine Translation for Endangered Language Revitalization

Cherokee is a highly endangered Native American language spoken by the C...
10/09/2020 ∙ by Shiyue Zhang, et al. ∙ 8 ∙ share

read it
Leakage-Adjusted Simulatability: Can Models Generate Non-Trivial Explanations of Their Behavior in Natural Language?

Data collection for natural language (NL) understanding tasks has increa...
10/08/2020 ∙ by Peter Hase, et al. ∙ 7 ∙ share

read it
What Can We Learn from Collective Human Opinions on Natural Language Inference Data?

Despite the subjective nature of many NLP tasks, most NLU evaluations ha...
10/07/2020 ∙ by Yixin Nie, et al. ∙ 4 ∙ share

read it
Evaluating Interactive Summarization: an Expansion-Based Framework

Allowing users to interact with multi-document summarizers is a promisin...
09/17/2020 ∙ by Ori Shapira, et al. ∙ 0 ∙ share

read it
SuperPAL: Supervised Proposition ALignment for Multi-Document Summarization and Derivative Sub-Tasks

Multi-document summarization (MDS) is a challenging task, often decompos...
09/01/2020 ∙ by Ori Ernst, et al. ∙ 0 ∙ share

read it
Dense-Caption Matching and Frame-Selection Gating for Temporal Localization in VideoQA

Videos convey rich information. Dynamic spatio-temporal relationships be...
05/13/2020 ∙ by Hyounghun Kim, et al. ∙ 24 ∙ share

read it
MART: Memory-Augmented Recurrent Transformer for Coherent Video Paragraph Captioning

Generating multi-sentence descriptions for videos is one of the most cha...
05/11/2020 ∙ by Jie Lei, et al. ∙ 1 ∙ share

read it
Towards Robustifying NLI Models Against Lexical Dataset Biases

While deep learning models are making fast progress on the task of Natur...
05/10/2020 ∙ by Xiang Zhou, et al. ∙ 0 ∙ share

read it
Diagnosing the Environment Bias in Vision-and-Language Navigation

Vision-and-Language Navigation (VLN) requires an agent to follow natural...
05/06/2020 ∙ by Yubo Zhang, et al. ∙ 4 ∙ share

read it
Evaluating Explainable AI: Which Algorithmic Explanations Help Users Predict Model Behavior?

Algorithmic approaches to interpreting machine learning models have prol...
05/04/2020 ∙ by Peter Hase, et al. ∙ 98 ∙ share

read it
The Curse of Performance Instability in Analysis Datasets: Consequences, Source, and Suggestions

We find that the performance of state-of-the-art models on Natural Langu...
04/28/2020 ∙ by Xiang Zhou, et al. ∙ 0 ∙ share

read it
Adversarial Augmentation Policy Search for Domain and Cross-Lingual Generalization in Reading Comprehension

Reading comprehension models often overfit to nuances of training datase...
04/13/2020 ∙ by Adyasha Maharana, et al. ∙ 25 ∙ share

read it
TVR: A Large-Scale Dataset for Video-Subtitle Moment Retrieval

We introduce a new multimodal retrieval task - TV show Retrieval (TVR), ...
01/24/2020 ∙ by Jie Lei, et al. ∙ 8 ∙ share

read it
ManyModalQA: Modality Disambiguation and QA over Diverse Inputs

We present a new multimodal question answering challenge, ManyModalQA, i...
01/22/2020 ∙ by Darryl Hannan, et al. ∙ 18 ∙ share

read it
Modality-Balanced Models for Visual Dialogue

The Visual Dialog task requires a model to exploit both image and conver...
01/17/2020 ∙ by Hyounghun Kim, et al. ∙ 22 ∙ share

read it
AvgOut: A Simple Output-Probability Measure to Eliminate Dull Responses

Many sequence-to-sequence dialogue models tend to generate safe, uninfor...
01/15/2020 ∙ by Tong Niu, et al. ∙ 0 ∙ share

read it
Multi-Source Domain Adaptation for Text Classification via DistanceNet-Bandits

Domain adaptation performance of a learning algorithm on a target domain...
01/13/2020 ∙ by Han Guo, et al. ∙ 10 ∙ share

read it

Mohit Bansal

Featured Co-authors