Devi Parikh

verfied profile

∙ 0 followers
Facebook ∙ Georgia Institute of Technology ∙ Virginia Polytechnic Institute and State University

Associate Professor School of Interactive Computing at Georgia Tech and Research Scientist at Facebook AI Research (FAIR)

Featured Co-authors

Yoshua Bengio
330 publications
Trevor Darrell
134 publications
Jianfeng Gao
131 publications
Ruslan Salakhutdinov
126 publications
Alan Yuille
101 publications
Richard Socher
100 publications
Dhruv Batra
92 publications
Caiming Xiong
90 publications
Jitendra Malik
89 publications
Joelle Pineau
87 publications
Pushmeet Kohli
81 publications

Integrating Egocentric Localization for More Realistic Point-Goal Navigation Agents

Recent work has presented embodied agents that can navigate to point-goa...
09/07/2020 ∙ by Samyak Datta, et al. ∙ 1 ∙ share

read it
Dialog without Dialog Data: Learning Visual Dialog Agents from VQA Data

Can we develop visually grounded dialog agents that can efficiently adap...
07/24/2020 ∙ by Michael Cogswell, et al. ∙ 6 ∙ share

read it
Spatially Aware Multimodal Transformers for TextVQA

Textual cues are essential for everyday tasks like buying groceries and ...
07/23/2020 ∙ by Yash Kant, et al. ∙ 11 ∙ share

read it
Seeing the Un-Scene: Learning Amodal Semantic Maps for Room Navigation

We introduce a learning-based approach for room navigation using semanti...
07/20/2020 ∙ by Medhini Narasimhan, et al. ∙ 2 ∙ share

read it
Neuro-Symbolic Generative Art: A Preliminary Study

There are two classes of generative art approaches: neural, where a deep...
07/04/2020 ∙ by Gunjan Aggarwal, et al. ∙ 8 ∙ share

read it
Feel The Music: Automatically Generating A Dance For An Input Song

We present a general computational approach that enables a machine to ge...
06/21/2020 ∙ by Purva Tendulkar, et al. ∙ 77 ∙ share

read it
Exploring Crowd Co-creation Scenarios for Sketches

As a first step towards studying the ability of human crowds and machine...
05/15/2020 ∙ by Devi Parikh, et al. ∙ 2 ∙ share

read it
Improving Vision-and-Language Navigation with Image-Text Pairs from the Web

Following a navigation instruction such as 'Walk down the stairs and sto...
04/30/2020 ∙ by Arjun Majumdar, et al. ∙ 10 ∙ share

read it
Are we pretraining it right? Digging deeper into visio-linguistic pretraining

Numerous recent works have proposed pretraining generic visio-linguistic...
04/19/2020 ∙ by Amanpreet Singh, et al. ∙ 1 ∙ share

read it
Predicting A Creator's Preferences In, and From, Interactive Generative Art

As a lay user creates an art piece using an interactive generative art t...
03/03/2020 ∙ by Devi Parikh, et al. ∙ 92 ∙ share

read it
SQuINTing at VQA Models: Interrogating VQA Models with Sub-Questions

Existing VQA datasets contain questions with varying levels of complexit...
01/20/2020 ∙ by Ramprasaath R. Selvaraju, et al. ∙ 44 ∙ share

read it
Large-scale Pretraining for Visual Dialog: A Simple State-of-the-Art Baseline

Prior work in visual dialog has focused on training deep neural models o...
12/05/2019 ∙ by Vishvak Murahari, et al. ∙ 16 ∙ share

read it
12-in-1: Multi-Task Vision and Language Representation Learning

Much of vision-and-language research focuses on a small but diverse set ...
12/05/2019 ∙ by Jiasen Lu, et al. ∙ 22 ∙ share

read it
Decentralized Distributed PPO: Solving PointGoal Navigation

We present Decentralized Distributed Proximal Policy Optimization (DD-PP...
11/01/2019 ∙ by Erik Wijmans, et al. ∙ 45 ∙ share

read it
Improving Generative Visual Dialog by Answering Diverse Questions

Prior work on training generative Visual Dialog models with reinforcemen...
09/23/2019 ∙ by Vishvak Murahari, et al. ∙ 18 ∙ share

read it
ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Tasks

We present ViLBERT (short for Vision-and-Language BERT), a model for lea...
08/06/2019 ∙ by Jiasen Lu, et al. ∙ 9 ∙ share

read it
Unsupervised Discovery of Decision States for Transfer in Reinforcement Learning

We present a hierarchical reinforcement learning (HRL) or options framew...
07/24/2019 ∙ by Nirbhay Modhe, et al. ∙ 17 ∙ share

read it
Chasing Ghosts: Instruction Following as Bayesian State Tracking

A visually-grounded navigation instruction can be interpreted as a seque...
07/03/2019 ∙ by Peter Anderson, et al. ∙ 3 ∙ share

read it
RUBi: Reducing Unimodal Biases in Visual Question Answering

Visual Question Answering (VQA) is the task of answering questions about...
06/24/2019 ∙ by Rémi Cadene, et al. ∙ 10 ∙ share

read it
SplitNet: Sim2Sim and Task2Task Transfer for Embodied Visual Navigation

We propose SplitNet, a method for decoupling visual perception and polic...
05/18/2019 ∙ by Daniel Gordon, et al. ∙ 0 ∙ share

read it
Fashion++: Minimal Edits for Outfit Improvement

Given an outfit, what small changes would most improve its fashionabilit...
04/19/2019 ∙ by Wei-Lin Hsiao, et al. ∙ 4 ∙ share

read it
Emergence of Compositional Language with Deep Generational Transmission

Consider a collaborative task that requires communication. Two agents ar...
04/19/2019 ∙ by Michael Cogswell, et al. ∙ 12 ∙ share

read it
Towards VQA Models that can Read

Studies have shown that a dominant class of questions asked by visually ...
04/18/2019 ∙ by Amanpreet Singh, et al. ∙ 12 ∙ share

read it
Counterfactual Visual Explanations

A counterfactual query is typically of the form 'For situation X, why wa...
04/16/2019 ∙ by Yash Goyal, et al. ∙ 24 ∙ share

read it
Embodied Visual Recognition

Passive visual systems typically fail to recognize objects in the amodal...
04/09/2019 ∙ by Jianwei Yang, et al. ∙ 22 ∙ share

read it
Embodied Question Answering in Photorealistic Environments with Point Cloud Perception

To help bridge the gap between internet vision-style problems and the go...
04/06/2019 ∙ by Erik Wijmans, et al. ∙ 12 ∙ share

read it
Habitat: A Platform for Embodied AI Research

We present Habitat, a new platform for research in embodied artificial i...
04/02/2019 ∙ by Manolis Savva, et al. ∙ 58 ∙ share

read it
Align2Ground: Weakly Supervised Phrase Grounding Guided by Image-Caption Alignment

We address the problem of grounding free-form textual phrases by using w...
03/27/2019 ∙ by Samyak Datta, et al. ∙ 0 ∙ share

read it
Trick or TReAT: Thematic Reinforcement for Artistic Typography

An approach to make text visually appealing and memorable is semantic re...
03/19/2019 ∙ by Purva Tendulkar, et al. ∙ 23 ∙ share

read it
Lemotif: Abstract Visual Depictions of your Emotional States in Life

We present Lemotif. Lemotif generates a motif for your emotional life. Y...
03/18/2019 ∙ by Devi Parikh, et al. ∙ 20 ∙ share

read it
CLEVR-Dialog: A Diagnostic Dataset for Multi-Round Reasoning in Visual Dialog

Visual Dialog is a multimodal task of answering a sequence of questions ...
03/07/2019 ∙ by Satwik Kottur, et al. ∙ 18 ∙ share

read it
Learning Dynamics Model in Reinforcement Learning by Incorporating the Long Term Future

In model-based reinforcement learning, the agent interleaves between mod...
03/05/2019 ∙ by Nan Rosemary Ke, et al. ∙ 14 ∙ share

read it
Probabilistic Neural-symbolic Models for Interpretable Visual Question Answering

We propose a new class of probabilistic neural-symbolic models, that hav...
02/21/2019 ∙ by Ramakrishna Vedantam, et al. ∙ 24 ∙ share

read it
Cycle-Consistency for Robust Visual Question Answering

Despite significant progress in Visual Question Answering over the years...
02/15/2019 ∙ by Meet Shah, et al. ∙ 14 ∙ share

read it
Taking a HINT: Leveraging Explanations to Make Vision and Language Models More Grounded

Many vision and language models suffer from poor visual grounding - ofte...
02/11/2019 ∙ by Ramprasaath R. Selvaraju, et al. ∙ 26 ∙ share

read it
Embodied Multimodal Multitask Learning

Recent efforts on training visual navigation agents conditioned on langu...
02/04/2019 ∙ by Devendra Singh Chaplot, et al. ∙ 36 ∙ share

read it
Audio-Visual Scene-Aware Dialog

We introduce the task of scene-aware dialog. Given a follow-up question ...
01/25/2019 ∙ by Huda Alamri, et al. ∙ 48 ∙ share

read it
Response to "Visual Dialogue without Vision or Dialogue" (Massiceti et al., 2018)

In a recent workshop paper, Massiceti et al. presented a baseline model ...
01/16/2019 ∙ by Abhishek Das, et al. ∙ 12 ∙ share

read it
Dialog System Technology Challenge 7

This paper introduces the Seventh Dialog System Technology Challenges (D...
01/11/2019 ∙ by Koichiro Yoshino, et al. ∙ 0 ∙ share

read it
nocaps: novel object captioning at scale

Image captioning models have achieved impressive results on datasets con...
12/20/2018 ∙ by Harsh Agrawal, et al. ∙ 46 ∙ share

read it
Do Explanations make VQA Models more Predictable to a Human?

A rich line of research attempts to make deep neural networks more trans...
10/29/2018 ∙ by Arjun Chandrasekaran, et al. ∙ 13 ∙ share

read it
TarMAC: Targeted Multi-Agent Communication

We explore a collaborative multi-agent reinforcement learning setting wh...
10/26/2018 ∙ by Abhishek Das, et al. ∙ 22 ∙ share

read it
Neural Modular Control for Embodied Question Answering

We present a modular approach for learning policies for navigation over ...
10/26/2018 ∙ by Abhishek Das, et al. ∙ 6 ∙ share

read it
Visual Curiosity: Learning to Ask Questions to Learn Visual Recognition

In an open-world setting, it is inevitable that an intelligent agent (e....
10/01/2018 ∙ by Jianwei Yang, et al. ∙ 20 ∙ share

read it
Visual Coreference Resolution in Visual Dialog using Neural Module Networks

Visual dialog entails answering a series of questions grounded in an ima...
09/06/2018 ∙ by Satwik Kottur, et al. ∙ 0 ∙ share

read it
Choose Your Neuron: Incorporating Domain Knowledge through Neuron-Importance

Individual neurons in convolutional neural networks supervised for image...
08/08/2018 ∙ by Ramprasaath R. Selvaraju, et al. ∙ 16 ∙ share

read it
Graph R-CNN for Scene Graph Generation

We propose a novel scene graph generation model called Graph R-CNN, that...
08/01/2018 ∙ by Jianwei Yang, et al. ∙ 6 ∙ share

read it
Pythia v0.1: the Winning Entry to the VQA Challenge 2018

This document describes Pythia v0.1, the winning entry from Facebook AI ...
07/26/2018 ∙ by Yu Jiang, et al. ∙ 12 ∙ share

read it
Talk the Walk: Navigating New York City through Grounded Dialogue

We introduce "Talk The Walk", the first large-scale dialogue dataset gro...
07/09/2018 ∙ by Harm de Vries, et al. ∙ 14 ∙ share

read it
End-to-End Audio Visual Scene-Aware Dialog using Multimodal Attention-Based Video Features

Dialog systems need to understand dynamic visual scenes in order to have...
06/21/2018 ∙ by Chiori Hori, et al. ∙ 0 ∙ share

read it