Devi Parikh

verfied profile

∙ 0 followers
Facebook ∙ Georgia Institute of Technology ∙ Virginia Polytechnic Institute and State University

Associate Professor School of Interactive Computing at Georgia Tech and Research Scientist at Facebook AI Research (FAIR)

Featured Co-authors

Yoshua Bengio
342 publications
Jianfeng Gao
148 publications
Trevor Darrell
141 publications
Ruslan Salakhutdinov
137 publications
Raquel Urtasun
128 publications
Alan Yuille
119 publications
Caiming Xiong
119 publications
Richard Socher
109 publications
Dhruv Batra
102 publications
Jitendra Malik
98 publications
Joelle Pineau
97 publications

VX2TEXT: End-to-End Learning of Video-Based Text Generation From Multimodal Inputs

We present Vx2Text, a framework for text generation from multimodal inpu...
01/28/2021 ∙ by Xudong Lin, et al. ∙ 6 ∙ share

read it
Object-Centric Diagnosis of Visual Reasoning

When answering questions about an image, it not only needs knowing what ...
12/21/2020 ∙ by Jianwei Yang, et al. ∙ 1 ∙ share

read it
Creative Sketch Generation

Sketching or doodling is a popular creative activity that people engage ...
11/19/2020 ∙ by Songwei Ge, et al. ∙ 11 ∙ share

read it
Where Are You? Localization from Embodied Dialog

We present Where Are You? (WAY), a dataset of 6k dialogs in which two h...
11/16/2020 ∙ by Meera Hahn, et al. ∙ 14 ∙ share

read it
Sim-to-Real Transfer for Vision-and-Language Navigation

We study the challenging problem of releasing a robot in a previously un...
11/07/2020 ∙ by Peter Anderson, et al. ∙ 3 ∙ share

read it
SOrT-ing VQA Models : Contrastive Gradient Learning for Improved Consistency

Recent research in Visual Question Answering (VQA) has revealed state-of...
10/20/2020 ∙ by Sameer Dharur, et al. ∙ 9 ∙ share

read it
The Open Catalyst 2020 (OC20) Dataset and Community Challenges

Catalyst discovery and optimization is key to solving many societal and ...
10/20/2020 ∙ by Lowik Chanussot, et al. ∙ 37 ∙ share

read it
An Introduction to Electrocatalyst Design using Machine Learning for Renewable Energy Storage

Scalable and cost-effective solutions to renewable energy storage are es...
10/14/2020 ∙ by C. Lawrence Zitnick, et al. ∙ 16 ∙ share

read it
Contrast and Classify: Alternate Training for Robust VQA

Recent Visual Question Answering (VQA) models have shown impressive perf...
10/13/2020 ∙ by Yash Kant, et al. ∙ 2 ∙ share

read it
Integrating Egocentric Localization for More Realistic Point-Goal Navigation Agents

Recent work has presented embodied agents that can navigate to point-goa...
09/07/2020 ∙ by Samyak Datta, et al. ∙ 1 ∙ share

read it
Dialog without Dialog Data: Learning Visual Dialog Agents from VQA Data

Can we develop visually grounded dialog agents that can efficiently adap...
07/24/2020 ∙ by Michael Cogswell, et al. ∙ 6 ∙ share

read it
Spatially Aware Multimodal Transformers for TextVQA

Textual cues are essential for everyday tasks like buying groceries and ...
07/23/2020 ∙ by Yash Kant, et al. ∙ 11 ∙ share

read it
Seeing the Un-Scene: Learning Amodal Semantic Maps for Room Navigation

We introduce a learning-based approach for room navigation using semanti...
07/20/2020 ∙ by Medhini Narasimhan, et al. ∙ 2 ∙ share

read it
Neuro-Symbolic Generative Art: A Preliminary Study

There are two classes of generative art approaches: neural, where a deep...
07/04/2020 ∙ by Gunjan Aggarwal, et al. ∙ 8 ∙ share

read it
Feel The Music: Automatically Generating A Dance For An Input Song

We present a general computational approach that enables a machine to ge...
06/21/2020 ∙ by Purva Tendulkar, et al. ∙ 77 ∙ share

read it
Exploring Crowd Co-creation Scenarios for Sketches

As a first step towards studying the ability of human crowds and machine...
05/15/2020 ∙ by Devi Parikh, et al. ∙ 2 ∙ share

read it
Improving Vision-and-Language Navigation with Image-Text Pairs from the Web

Following a navigation instruction such as 'Walk down the stairs and sto...
04/30/2020 ∙ by Arjun Majumdar, et al. ∙ 10 ∙ share

read it
Are we pretraining it right? Digging deeper into visio-linguistic pretraining

Numerous recent works have proposed pretraining generic visio-linguistic...
04/19/2020 ∙ by Amanpreet Singh, et al. ∙ 1 ∙ share

read it
Predicting A Creator's Preferences In, and From, Interactive Generative Art

As a lay user creates an art piece using an interactive generative art t...
03/03/2020 ∙ by Devi Parikh, et al. ∙ 92 ∙ share

read it
SQuINTing at VQA Models: Interrogating VQA Models with Sub-Questions

Existing VQA datasets contain questions with varying levels of complexit...
01/20/2020 ∙ by Ramprasaath R. Selvaraju, et al. ∙ 44 ∙ share

read it
Large-scale Pretraining for Visual Dialog: A Simple State-of-the-Art Baseline

Prior work in visual dialog has focused on training deep neural models o...
12/05/2019 ∙ by Vishvak Murahari, et al. ∙ 16 ∙ share

read it
12-in-1: Multi-Task Vision and Language Representation Learning

Much of vision-and-language research focuses on a small but diverse set ...
12/05/2019 ∙ by Jiasen Lu, et al. ∙ 22 ∙ share

read it
Decentralized Distributed PPO: Solving PointGoal Navigation

We present Decentralized Distributed Proximal Policy Optimization (DD-PP...
11/01/2019 ∙ by Erik Wijmans, et al. ∙ 45 ∙ share

read it
Improving Generative Visual Dialog by Answering Diverse Questions

Prior work on training generative Visual Dialog models with reinforcemen...
09/23/2019 ∙ by Vishvak Murahari, et al. ∙ 18 ∙ share

read it
ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Tasks

We present ViLBERT (short for Vision-and-Language BERT), a model for lea...
08/06/2019 ∙ by Jiasen Lu, et al. ∙ 9 ∙ share

read it
Unsupervised Discovery of Decision States for Transfer in Reinforcement Learning

We present a hierarchical reinforcement learning (HRL) or options framew...
07/24/2019 ∙ by Nirbhay Modhe, et al. ∙ 17 ∙ share

read it
Chasing Ghosts: Instruction Following as Bayesian State Tracking

A visually-grounded navigation instruction can be interpreted as a seque...
07/03/2019 ∙ by Peter Anderson, et al. ∙ 3 ∙ share

read it
RUBi: Reducing Unimodal Biases in Visual Question Answering

Visual Question Answering (VQA) is the task of answering questions about...
06/24/2019 ∙ by Rémi Cadene, et al. ∙ 10 ∙ share

read it
SplitNet: Sim2Sim and Task2Task Transfer for Embodied Visual Navigation

We propose SplitNet, a method for decoupling visual perception and polic...
05/18/2019 ∙ by Daniel Gordon, et al. ∙ 0 ∙ share

read it
Fashion++: Minimal Edits for Outfit Improvement

Given an outfit, what small changes would most improve its fashionabilit...
04/19/2019 ∙ by Wei-Lin Hsiao, et al. ∙ 4 ∙ share

read it
Emergence of Compositional Language with Deep Generational Transmission

Consider a collaborative task that requires communication. Two agents ar...
04/19/2019 ∙ by Michael Cogswell, et al. ∙ 12 ∙ share

read it
Towards VQA Models that can Read

Studies have shown that a dominant class of questions asked by visually ...
04/18/2019 ∙ by Amanpreet Singh, et al. ∙ 12 ∙ share

read it
Counterfactual Visual Explanations

A counterfactual query is typically of the form 'For situation X, why wa...
04/16/2019 ∙ by Yash Goyal, et al. ∙ 24 ∙ share

read it
Embodied Visual Recognition

Passive visual systems typically fail to recognize objects in the amodal...
04/09/2019 ∙ by Jianwei Yang, et al. ∙ 22 ∙ share

read it
Embodied Question Answering in Photorealistic Environments with Point Cloud Perception

To help bridge the gap between internet vision-style problems and the go...
04/06/2019 ∙ by Erik Wijmans, et al. ∙ 12 ∙ share

read it
Habitat: A Platform for Embodied AI Research

We present Habitat, a new platform for research in embodied artificial i...
04/02/2019 ∙ by Manolis Savva, et al. ∙ 58 ∙ share

read it
Align2Ground: Weakly Supervised Phrase Grounding Guided by Image-Caption Alignment

We address the problem of grounding free-form textual phrases by using w...
03/27/2019 ∙ by Samyak Datta, et al. ∙ 0 ∙ share

read it
Trick or TReAT: Thematic Reinforcement for Artistic Typography

An approach to make text visually appealing and memorable is semantic re...
03/19/2019 ∙ by Purva Tendulkar, et al. ∙ 23 ∙ share

read it
Lemotif: Abstract Visual Depictions of your Emotional States in Life

We present Lemotif. Lemotif generates a motif for your emotional life. Y...
03/18/2019 ∙ by Devi Parikh, et al. ∙ 20 ∙ share

read it
CLEVR-Dialog: A Diagnostic Dataset for Multi-Round Reasoning in Visual Dialog

Visual Dialog is a multimodal task of answering a sequence of questions ...
03/07/2019 ∙ by Satwik Kottur, et al. ∙ 18 ∙ share

read it
Learning Dynamics Model in Reinforcement Learning by Incorporating the Long Term Future

In model-based reinforcement learning, the agent interleaves between mod...
03/05/2019 ∙ by Nan Rosemary Ke, et al. ∙ 14 ∙ share

read it
Probabilistic Neural-symbolic Models for Interpretable Visual Question Answering

We propose a new class of probabilistic neural-symbolic models, that hav...
02/21/2019 ∙ by Ramakrishna Vedantam, et al. ∙ 25 ∙ share

read it
Cycle-Consistency for Robust Visual Question Answering

Despite significant progress in Visual Question Answering over the years...
02/15/2019 ∙ by Meet Shah, et al. ∙ 14 ∙ share

read it
Taking a HINT: Leveraging Explanations to Make Vision and Language Models More Grounded

Many vision and language models suffer from poor visual grounding - ofte...
02/11/2019 ∙ by Ramprasaath R. Selvaraju, et al. ∙ 26 ∙ share

read it
Embodied Multimodal Multitask Learning

Recent efforts on training visual navigation agents conditioned on langu...
02/04/2019 ∙ by Devendra Singh Chaplot, et al. ∙ 36 ∙ share

read it
Audio-Visual Scene-Aware Dialog

We introduce the task of scene-aware dialog. Given a follow-up question ...
01/25/2019 ∙ by Huda Alamri, et al. ∙ 48 ∙ share

read it
Response to "Visual Dialogue without Vision or Dialogue" (Massiceti et al., 2018)

In a recent workshop paper, Massiceti et al. presented a baseline model ...
01/16/2019 ∙ by Abhishek Das, et al. ∙ 12 ∙ share

read it
Dialog System Technology Challenge 7

This paper introduces the Seventh Dialog System Technology Challenges (D...
01/11/2019 ∙ by Koichiro Yoshino, et al. ∙ 0 ∙ share

read it
nocaps: novel object captioning at scale

Image captioning models have achieved impressive results on datasets con...
12/20/2018 ∙ by Harsh Agrawal, et al. ∙ 46 ∙ share

read it
Do Explanations make VQA Models more Predictable to a Human?

A rich line of research attempts to make deep neural networks more trans...
10/29/2018 ∙ by Arjun Chandrasekaran, et al. ∙ 13 ∙ share

read it