Dhruv Batra

is this you? claim profile

∙ 0 followers
Facebook ∙ Georgia Institute of Technology ∙ Virginia Polytechnic Institute and State University

Assistant Professor School of Interactive Computing (Georgia Tech) and Research Scientist (Facebook AI Research)

Auxiliary Tasks Speed Up Learning PointGoal Navigation

PointGoal Navigation is an embodied task that requires agents to navigat...
07/09/2020 ∙ by Joel Ye, et al. ∙ 4 ∙ share

read it
ObjectNav Revisited: On Evaluation of Embodied Agents Navigating to Objects

We revisit the problem of Object-Goal Navigation (ObjectNav). In its sim...
06/23/2020 ∙ by Dhruv Batra, et al. ∙ 34 ∙ share

read it
Improving Vision-and-Language Navigation with Image-Text Pairs from the Web

Following a navigation instruction such as 'Walk down the stairs and sto...
04/30/2020 ∙ by Arjun Majumdar, et al. ∙ 10 ∙ share

read it
Beyond the Nav-Graph: Vision-and-Language Navigation in Continuous Environments

We develop a language-guided navigation task set in a continuous 3D envi...
04/06/2020 ∙ by Jacob Krantz, et al. ∙ 3 ∙ share

read it
Analyzing Visual Representations in Embodied Navigation Tasks

Recent advances in deep reinforcement learning require a large amount of...
03/12/2020 ∙ by Erik Wijmans, et al. ∙ 7 ∙ share

read it
Are We Making Real Progress in Simulated Environments? Measuring the Sim2Real Gap in Embodied Visual Navigation

Does progress in simulation translate to progress in robotics? Specifica...
12/13/2019 ∙ by Abhishek Kadian, et al. ∙ 37 ∙ share

read it
Large-scale Pretraining for Visual Dialog: A Simple State-of-the-Art Baseline

Prior work in visual dialog has focused on training deep neural models o...
12/05/2019 ∙ by Vishvak Murahari, et al. ∙ 16 ∙ share

read it
Decentralized Distributed PPO: Solving PointGoal Navigation

We present Decentralized Distributed Proximal Policy Optimization (DD-PP...
11/01/2019 ∙ by Erik Wijmans, et al. ∙ 45 ∙ share

read it
Improving Generative Visual Dialog by Answering Diverse Questions

Prior work on training generative Visual Dialog models with reinforcemen...
09/23/2019 ∙ by Vishvak Murahari, et al. ∙ 18 ∙ share

read it
Sequential Latent Spaces for Modeling the Intention During Diverse Image Captioning

Diverse and accurate vision+language modeling is an important goal to re...
08/22/2019 ∙ by Jyoti Aneja, et al. ∙ 12 ∙ share

read it
ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Tasks

We present ViLBERT (short for Vision-and-Language BERT), a model for lea...
08/06/2019 ∙ by Jiasen Lu, et al. ∙ 9 ∙ share

read it
Unsupervised Discovery of Decision States for Transfer in Reinforcement Learning

We present a hierarchical reinforcement learning (HRL) or options framew...
07/24/2019 ∙ by Nirbhay Modhe, et al. ∙ 17 ∙ share

read it
Chasing Ghosts: Instruction Following as Bayesian State Tracking

A visually-grounded navigation instruction can be interpreted as a seque...
07/03/2019 ∙ by Peter Anderson, et al. ∙ 3 ∙ share

read it
The Replica Dataset: A Digital Replica of Indoor Spaces

We introduce Replica, a dataset of 18 highly photo-realistic 3D indoor s...
06/13/2019 ∙ by Julian Straub, et al. ∙ 4 ∙ share

read it
SplitNet: Sim2Sim and Task2Task Transfer for Embodied Visual Navigation

We propose SplitNet, a method for decoupling visual perception and polic...
05/18/2019 ∙ by Daniel Gordon, et al. ∙ 0 ∙ share

read it
Emergence of Compositional Language with Deep Generational Transmission

Consider a collaborative task that requires communication. Two agents ar...
04/19/2019 ∙ by Michael Cogswell, et al. ∙ 12 ∙ share

read it
Towards VQA Models that can Read

Studies have shown that a dominant class of questions asked by visually ...
04/18/2019 ∙ by Amanpreet Singh, et al. ∙ 12 ∙ share

read it
Counterfactual Visual Explanations

A counterfactual query is typically of the form 'For situation X, why wa...
04/16/2019 ∙ by Yash Goyal, et al. ∙ 24 ∙ share

read it
Multi-Target Embodied Question Answering

Embodied Question Answering (EQA) is a relatively new task where an agen...
04/09/2019 ∙ by Licheng Yu, et al. ∙ 6 ∙ share

read it
Embodied Visual Recognition

Passive visual systems typically fail to recognize objects in the amodal...
04/09/2019 ∙ by Jianwei Yang, et al. ∙ 22 ∙ share

read it
Embodied Question Answering in Photorealistic Environments with Point Cloud Perception

To help bridge the gap between internet vision-style problems and the go...
04/06/2019 ∙ by Erik Wijmans, et al. ∙ 12 ∙ share

read it
Habitat: A Platform for Embodied AI Research

We present Habitat, a new platform for research in embodied artificial i...
04/02/2019 ∙ by Manolis Savva, et al. ∙ 58 ∙ share

read it
CLEVR-Dialog: A Diagnostic Dataset for Multi-Round Reasoning in Visual Dialog

Visual Dialog is a multimodal task of answering a sequence of questions ...
03/07/2019 ∙ by Satwik Kottur, et al. ∙ 18 ∙ share

read it
Learning Dynamics Model in Reinforcement Learning by Incorporating the Long Term Future

In model-based reinforcement learning, the agent interleaves between mod...
03/05/2019 ∙ by Nan Rosemary Ke, et al. ∙ 14 ∙ share

read it
Probabilistic Neural-symbolic Models for Interpretable Visual Question Answering

We propose a new class of probabilistic neural-symbolic models, that hav...
02/21/2019 ∙ by Ramakrishna Vedantam, et al. ∙ 24 ∙ share

read it
Taking a HINT: Leveraging Explanations to Make Vision and Language Models More Grounded

Many vision and language models suffer from poor visual grounding - ofte...
02/11/2019 ∙ by Ramprasaath R. Selvaraju, et al. ∙ 26 ∙ share

read it
EvalAI: Towards Better Evaluation Systems for AI Agents

We introduce EvalAI, an open source platform for evaluating and comparin...
02/10/2019 ∙ by Deshraj Yadav, et al. ∙ 24 ∙ share

read it
Embodied Multimodal Multitask Learning

Recent efforts on training visual navigation agents conditioned on langu...
02/04/2019 ∙ by Devendra Singh Chaplot, et al. ∙ 36 ∙ share

read it
Audio-Visual Scene-Aware Dialog

We introduce the task of scene-aware dialog. Given a follow-up question ...
01/25/2019 ∙ by Huda Alamri, et al. ∙ 48 ∙ share

read it
Response to "Visual Dialogue without Vision or Dialogue" (Massiceti et al., 2018)

In a recent workshop paper, Massiceti et al. presented a baseline model ...
01/16/2019 ∙ by Abhishek Das, et al. ∙ 12 ∙ share

read it
Dialog System Technology Challenge 7

This paper introduces the Seventh Dialog System Technology Challenges (D...
01/11/2019 ∙ by Koichiro Yoshino, et al. ∙ 0 ∙ share

read it
nocaps: novel object captioning at scale

Image captioning models have achieved impressive results on datasets con...
12/20/2018 ∙ by Harsh Agrawal, et al. ∙ 46 ∙ share

read it
Fabrik: An Online Collaborative Neural Network Editor

We present Fabrik, an online neural network editor that provides tools t...
10/27/2018 ∙ by Utsav Garg, et al. ∙ 0 ∙ share

read it
TarMAC: Targeted Multi-Agent Communication

We explore a collaborative multi-agent reinforcement learning setting wh...
10/26/2018 ∙ by Abhishek Das, et al. ∙ 22 ∙ share

read it
Neural Modular Control for Embodied Question Answering

We present a modular approach for learning policies for navigation over ...
10/26/2018 ∙ by Abhishek Das, et al. ∙ 6 ∙ share

read it
Visual Curiosity: Learning to Ask Questions to Learn Visual Recognition

In an open-world setting, it is inevitable that an intelligent agent (e....
10/01/2018 ∙ by Jianwei Yang, et al. ∙ 20 ∙ share

read it
Visual Coreference Resolution in Visual Dialog using Neural Module Networks

Visual dialog entails answering a series of questions grounded in an ima...
09/06/2018 ∙ by Satwik Kottur, et al. ∙ 0 ∙ share

read it
Choose Your Neuron: Incorporating Domain Knowledge through Neuron-Importance

Individual neurons in convolutional neural networks supervised for image...
08/08/2018 ∙ by Ramprasaath R. Selvaraju, et al. ∙ 16 ∙ share

read it
Graph R-CNN for Scene Graph Generation

We propose a novel scene graph generation model called Graph R-CNN, that...
08/01/2018 ∙ by Jianwei Yang, et al. ∙ 6 ∙ share

read it
Pythia v0.1: the Winning Entry to the VQA Challenge 2018

This document describes Pythia v0.1, the winning entry from Facebook AI ...
07/26/2018 ∙ by Yu Jiang, et al. ∙ 12 ∙ share

read it
Talk the Walk: Navigating New York City through Grounded Dialogue

We introduce "Talk The Walk", the first large-scale dialogue dataset gro...
07/09/2018 ∙ by Harm de Vries, et al. ∙ 14 ∙ share

read it
End-to-End Audio Visual Scene-Aware Dialog using Multimodal Attention-Based Video Features

Dialog systems need to understand dynamic visual scenes in order to have...
06/21/2018 ∙ by Chiori Hori, et al. ∙ 0 ∙ share

read it
Learn from Your Neighbor: Learning Multi-modal Mappings from Sparse Annotations

Many structured prediction problems (particularly in vision and language...
06/08/2018 ∙ by Ashwin Kalyan, et al. ∙ 8 ∙ share

read it
Audio Visual Scene-Aware Dialog (AVSD) Challenge at DSTC7

Scene-aware dialog systems will be able to have conversations with users...
06/01/2018 ∙ by Huda Alamri, et al. ∙ 0 ∙ share

read it
Neural-Guided Deductive Search for Real-Time Program Synthesis from Examples

Synthesizing user-intended programs from a small number of input-output ...
04/03/2018 ∙ by Ashwin J. Vijayakumar, et al. ∙ 0 ∙ share

read it
Neural Baby Talk

We introduce a novel framework for image captioning that can produce nat...
03/27/2018 ∙ by Jiasen Lu, et al. ∙ 0 ∙ share

read it
CoDraw: Visual Dialog for Collaborative Drawing

In this work, we propose a goal-driven collaborative task that contains ...
12/15/2017 ∙ by Jin-Hwa Kim, et al. ∙ 0 ∙ share

read it
Don't Just Assume; Look and Answer: Overcoming Priors for Visual Question Answering

A number of studies have found that today's Visual Question Answering (V...
12/01/2017 ∙ by Aishwarya Agrawal, et al. ∙ 0 ∙ share

read it
Embodied Question Answering

We present a new AI task -- Embodied Question Answering (EmbodiedQA) -- ...
11/30/2017 ∙ by Abhishek Das, et al. ∙ 0 ∙ share

read it
Evaluating Visual Conversational Agents via Cooperative Human-AI Games

As AI continues to advance, human-AI teams are inevitable. However, prog...
08/17/2017 ∙ by Prithvijit Chattopadhyay, et al. ∙ 0 ∙ share

read it

Dhruv Batra

Featured Co-authors