Dhruv Batra

is this you? claim profile

∙ 0 followers
Facebook ∙ Georgia Institute of Technology ∙ Virginia Polytechnic Institute and State University

Assistant Professor School of Interactive Computing (Georgia Tech) and Research Scientist (Facebook AI Research)

Integrating Egocentric Localization for More Realistic Point-Goal Navigation Agents

Recent work has presented embodied agents that can navigate to point-goa...
09/07/2020 ∙ by Samyak Datta, et al. ∙ 1 ∙ share

read it
Dialog without Dialog Data: Learning Visual Dialog Agents from VQA Data

Can we develop visually grounded dialog agents that can efficiently adap...
07/24/2020 ∙ by Michael Cogswell, et al. ∙ 6 ∙ share

read it
Spatially Aware Multimodal Transformers for TextVQA

Textual cues are essential for everyday tasks like buying groceries and ...
07/23/2020 ∙ by Yash Kant, et al. ∙ 11 ∙ share

read it
Seeing the Un-Scene: Learning Amodal Semantic Maps for Room Navigation

We introduce a learning-based approach for room navigation using semanti...
07/20/2020 ∙ by Medhini Narasimhan, et al. ∙ 2 ∙ share

read it
Auxiliary Tasks Speed Up Learning PointGoal Navigation

PointGoal Navigation is an embodied task that requires agents to navigat...
07/09/2020 ∙ by Joel Ye, et al. ∙ 4 ∙ share

read it
ObjectNav Revisited: On Evaluation of Embodied Agents Navigating to Objects

We revisit the problem of Object-Goal Navigation (ObjectNav). In its sim...
06/23/2020 ∙ by Dhruv Batra, et al. ∙ 34 ∙ share

read it
Improving Vision-and-Language Navigation with Image-Text Pairs from the Web

Following a navigation instruction such as 'Walk down the stairs and sto...
04/30/2020 ∙ by Arjun Majumdar, et al. ∙ 10 ∙ share

read it
Beyond the Nav-Graph: Vision-and-Language Navigation in Continuous Environments

We develop a language-guided navigation task set in a continuous 3D envi...
04/06/2020 ∙ by Jacob Krantz, et al. ∙ 3 ∙ share

read it
Analyzing Visual Representations in Embodied Navigation Tasks

Recent advances in deep reinforcement learning require a large amount of...
03/12/2020 ∙ by Erik Wijmans, et al. ∙ 7 ∙ share

read it
Are We Making Real Progress in Simulated Environments? Measuring the Sim2Real Gap in Embodied Visual Navigation

Does progress in simulation translate to progress in robotics? Specifica...
12/13/2019 ∙ by Abhishek Kadian, et al. ∙ 37 ∙ share

read it
Large-scale Pretraining for Visual Dialog: A Simple State-of-the-Art Baseline

Prior work in visual dialog has focused on training deep neural models o...
12/05/2019 ∙ by Vishvak Murahari, et al. ∙ 16 ∙ share

read it
Decentralized Distributed PPO: Solving PointGoal Navigation

We present Decentralized Distributed Proximal Policy Optimization (DD-PP...
11/01/2019 ∙ by Erik Wijmans, et al. ∙ 45 ∙ share

read it
Improving Generative Visual Dialog by Answering Diverse Questions

Prior work on training generative Visual Dialog models with reinforcemen...
09/23/2019 ∙ by Vishvak Murahari, et al. ∙ 18 ∙ share

read it
Sequential Latent Spaces for Modeling the Intention During Diverse Image Captioning

Diverse and accurate vision+language modeling is an important goal to re...
08/22/2019 ∙ by Jyoti Aneja, et al. ∙ 12 ∙ share

read it
ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Tasks

We present ViLBERT (short for Vision-and-Language BERT), a model for lea...
08/06/2019 ∙ by Jiasen Lu, et al. ∙ 9 ∙ share

read it
Unsupervised Discovery of Decision States for Transfer in Reinforcement Learning

We present a hierarchical reinforcement learning (HRL) or options framew...
07/24/2019 ∙ by Nirbhay Modhe, et al. ∙ 17 ∙ share

read it
Chasing Ghosts: Instruction Following as Bayesian State Tracking

A visually-grounded navigation instruction can be interpreted as a seque...
07/03/2019 ∙ by Peter Anderson, et al. ∙ 3 ∙ share

read it
The Replica Dataset: A Digital Replica of Indoor Spaces

We introduce Replica, a dataset of 18 highly photo-realistic 3D indoor s...
06/13/2019 ∙ by Julian Straub, et al. ∙ 4 ∙ share

read it
SplitNet: Sim2Sim and Task2Task Transfer for Embodied Visual Navigation

We propose SplitNet, a method for decoupling visual perception and polic...
05/18/2019 ∙ by Daniel Gordon, et al. ∙ 0 ∙ share

read it
Emergence of Compositional Language with Deep Generational Transmission

Consider a collaborative task that requires communication. Two agents ar...
04/19/2019 ∙ by Michael Cogswell, et al. ∙ 12 ∙ share

read it
Towards VQA Models that can Read

Studies have shown that a dominant class of questions asked by visually ...
04/18/2019 ∙ by Amanpreet Singh, et al. ∙ 12 ∙ share

read it
Counterfactual Visual Explanations

A counterfactual query is typically of the form 'For situation X, why wa...
04/16/2019 ∙ by Yash Goyal, et al. ∙ 24 ∙ share

read it
Multi-Target Embodied Question Answering

Embodied Question Answering (EQA) is a relatively new task where an agen...
04/09/2019 ∙ by Licheng Yu, et al. ∙ 6 ∙ share

read it
Embodied Visual Recognition

Passive visual systems typically fail to recognize objects in the amodal...
04/09/2019 ∙ by Jianwei Yang, et al. ∙ 22 ∙ share

read it
Embodied Question Answering in Photorealistic Environments with Point Cloud Perception

To help bridge the gap between internet vision-style problems and the go...
04/06/2019 ∙ by Erik Wijmans, et al. ∙ 12 ∙ share

read it
Habitat: A Platform for Embodied AI Research

We present Habitat, a new platform for research in embodied artificial i...
04/02/2019 ∙ by Manolis Savva, et al. ∙ 58 ∙ share

read it
CLEVR-Dialog: A Diagnostic Dataset for Multi-Round Reasoning in Visual Dialog

Visual Dialog is a multimodal task of answering a sequence of questions ...
03/07/2019 ∙ by Satwik Kottur, et al. ∙ 18 ∙ share

read it
Learning Dynamics Model in Reinforcement Learning by Incorporating the Long Term Future

In model-based reinforcement learning, the agent interleaves between mod...
03/05/2019 ∙ by Nan Rosemary Ke, et al. ∙ 14 ∙ share

read it
Probabilistic Neural-symbolic Models for Interpretable Visual Question Answering

We propose a new class of probabilistic neural-symbolic models, that hav...
02/21/2019 ∙ by Ramakrishna Vedantam, et al. ∙ 24 ∙ share

read it
Taking a HINT: Leveraging Explanations to Make Vision and Language Models More Grounded

Many vision and language models suffer from poor visual grounding - ofte...
02/11/2019 ∙ by Ramprasaath R. Selvaraju, et al. ∙ 26 ∙ share

read it
EvalAI: Towards Better Evaluation Systems for AI Agents

We introduce EvalAI, an open source platform for evaluating and comparin...
02/10/2019 ∙ by Deshraj Yadav, et al. ∙ 24 ∙ share

read it
Embodied Multimodal Multitask Learning

Recent efforts on training visual navigation agents conditioned on langu...
02/04/2019 ∙ by Devendra Singh Chaplot, et al. ∙ 36 ∙ share

read it
Audio-Visual Scene-Aware Dialog

We introduce the task of scene-aware dialog. Given a follow-up question ...
01/25/2019 ∙ by Huda Alamri, et al. ∙ 48 ∙ share

read it
Response to "Visual Dialogue without Vision or Dialogue" (Massiceti et al., 2018)

In a recent workshop paper, Massiceti et al. presented a baseline model ...
01/16/2019 ∙ by Abhishek Das, et al. ∙ 12 ∙ share

read it
Dialog System Technology Challenge 7

This paper introduces the Seventh Dialog System Technology Challenges (D...
01/11/2019 ∙ by Koichiro Yoshino, et al. ∙ 0 ∙ share

read it
nocaps: novel object captioning at scale

Image captioning models have achieved impressive results on datasets con...
12/20/2018 ∙ by Harsh Agrawal, et al. ∙ 46 ∙ share

read it
Fabrik: An Online Collaborative Neural Network Editor

We present Fabrik, an online neural network editor that provides tools t...
10/27/2018 ∙ by Utsav Garg, et al. ∙ 0 ∙ share

read it
TarMAC: Targeted Multi-Agent Communication

We explore a collaborative multi-agent reinforcement learning setting wh...
10/26/2018 ∙ by Abhishek Das, et al. ∙ 22 ∙ share

read it
Neural Modular Control for Embodied Question Answering

We present a modular approach for learning policies for navigation over ...
10/26/2018 ∙ by Abhishek Das, et al. ∙ 6 ∙ share

read it
Visual Curiosity: Learning to Ask Questions to Learn Visual Recognition

In an open-world setting, it is inevitable that an intelligent agent (e....
10/01/2018 ∙ by Jianwei Yang, et al. ∙ 20 ∙ share

read it
Visual Coreference Resolution in Visual Dialog using Neural Module Networks

Visual dialog entails answering a series of questions grounded in an ima...
09/06/2018 ∙ by Satwik Kottur, et al. ∙ 0 ∙ share

read it
Choose Your Neuron: Incorporating Domain Knowledge through Neuron-Importance

Individual neurons in convolutional neural networks supervised for image...
08/08/2018 ∙ by Ramprasaath R. Selvaraju, et al. ∙ 16 ∙ share

read it
Graph R-CNN for Scene Graph Generation

We propose a novel scene graph generation model called Graph R-CNN, that...
08/01/2018 ∙ by Jianwei Yang, et al. ∙ 6 ∙ share

read it
Pythia v0.1: the Winning Entry to the VQA Challenge 2018

This document describes Pythia v0.1, the winning entry from Facebook AI ...
07/26/2018 ∙ by Yu Jiang, et al. ∙ 12 ∙ share

read it
Talk the Walk: Navigating New York City through Grounded Dialogue

We introduce "Talk The Walk", the first large-scale dialogue dataset gro...
07/09/2018 ∙ by Harm de Vries, et al. ∙ 14 ∙ share

read it
End-to-End Audio Visual Scene-Aware Dialog using Multimodal Attention-Based Video Features

Dialog systems need to understand dynamic visual scenes in order to have...
06/21/2018 ∙ by Chiori Hori, et al. ∙ 0 ∙ share

read it
Learn from Your Neighbor: Learning Multi-modal Mappings from Sparse Annotations

Many structured prediction problems (particularly in vision and language...
06/08/2018 ∙ by Ashwin Kalyan, et al. ∙ 8 ∙ share

read it
Audio Visual Scene-Aware Dialog (AVSD) Challenge at DSTC7

Scene-aware dialog systems will be able to have conversations with users...
06/01/2018 ∙ by Huda Alamri, et al. ∙ 0 ∙ share

read it
Neural-Guided Deductive Search for Real-Time Program Synthesis from Examples

Synthesizing user-intended programs from a small number of input-output ...
04/03/2018 ∙ by Ashwin J. Vijayakumar, et al. ∙ 0 ∙ share

read it
Neural Baby Talk

We introduce a novel framework for image captioning that can produce nat...
03/27/2018 ∙ by Jiasen Lu, et al. ∙ 0 ∙ share

read it

Dhruv Batra

Featured Co-authors