research
∙
06/20/2023
HomeRobot: Open-Vocabulary Mobile Manipulation
HomeRobot (noun): An affordable compliant robot that navigates homes and...
share
research
∙
06/16/2023
Neural Priming for Sample-Efficient Adaptation
We propose Neural Priming, a technique for adapting large pretrained mod...
research
∙
06/13/2023
Galactic: Scaling End-to-End Reinforcement Learning for Rearrangement at 100k Steps-Per-Second
We present Galactic, a large-scale simulation and reinforcement-learning...
research
∙
04/24/2023
Moving Forward by Moving Backward: Embedding Action Impact over Action Semantics
A common assumption when training embodied agents is that the impact of ...
research
∙
04/05/2023
ENTL: Embodied Navigation Trajectory Learner
We propose Embodied Navigation Trajectory Learner (ENTL), a method for e...
research
∙
04/03/2023
Navigating to Objects Specified by Images
Images are a convenient way to specify which particular object instance ...
research
∙
01/10/2023
Neural Radiance Field Codebooks
Compositional representations of the world are a promising step towards ...
research
∙
11/18/2022
Ask4Help: Learning to Leverage an Expert for Embodied Tasks
Embodied AI agents continue to become more capable every year with the a...
research
∙
06/17/2022
Unified-IO: A Unified Model for Vision, Language, and Multi-Modal Tasks
We propose Unified-IO, a model that performs a large variety of AI tasks...
research
∙
06/17/2022
What do navigation agents learn about their environment?
Today's state of the art visual navigation agents typically consist of l...
research
∙
06/14/2022
ProcTHOR: Large-Scale Embodied AI Using Procedural Generation
Massive datasets and high-capacity models have driven many recent advanc...
research
∙
06/03/2022
A-OKVQA: A Benchmark for Visual Question Answering using World Knowledge
The Visual Question Answering (VQA) task aspires to provide a meaningful...
research
∙
03/31/2022
Continuous Scene Representations for Embodied AI
We propose Continuous Scene Representations (CSR), a scene representatio...
research
∙
03/15/2022
Object Manipulation via Visual Target Localization
Object manipulation is a critical skill required for Embodied AI agents ...
research
∙
02/14/2022
ASC me to Do Anything: Multi-task Training for Embodied AI
Embodied AI has seen steady progress across a diverse set of independent...
research
∙
02/01/2022
Interactron: Embodied Adaptive Object Detection
Over the years various methods have been proposed for the problem of obj...
research
∙
11/18/2021
Simple but Effective: CLIP Embeddings for Embodied AI
Contrastive language image pretraining (CLIP) encoders have been shown t...
research
∙
06/08/2021
RobustNav: Towards Benchmarking Robustness in Embodied Navigation
As an attempt towards assessing the robustness of embodied navigation ag...
research
∙
06/02/2021
Container: Context Aggregation Network
Convolutional neural networks (CNNs) are ubiquitous in computer vision, ...
research
∙
06/01/2021
PIGLeT: Language Grounding Through Neuro-Symbolic Interaction in a 3D World
We propose PIGLeT: a model that learns physical commonsense knowledge th...
research
∙
04/28/2021
Pushing it out of the Way: Interactive Visual Navigation
We have observed significant progress in visual navigation for embodied ...
research
∙
04/22/2021
ManipulaTHOR: A Framework for Visual Object Manipulation
The domain of Embodied AI has recently witnessed substantial progress, p...
research
∙
03/30/2021
Visual Room Rearrangement
There has been a significant recent progress in the field of Embodied AI...
research
∙
03/25/2021
Contrasting Contrastive Self-Supervised Representation Learning Models
In the past few years, we have witnessed remarkable breakthroughs in sel...
research
∙
03/23/2021
Multi-Modal Answer Validation for Knowledge-Based VQA
The problem of knowledge-based visual question answering involves answer...
research
∙
12/06/2020
MOCA: A Modular Object-Centric Approach for Interactive Instruction Following
Performing simple household tasks based on language directives is very n...
research
∙
11/03/2020
Rearrangement: A Challenge for Embodied AI
We describe a framework for research and evaluation in Embodied AI. Our ...
research
∙
10/16/2020
What Can You Learn from Your Muscles? Learning Visual Representation from Human Interactions
Learning effective representations of visual data that generalize to a v...
research
∙
08/28/2020
AllenAct: A Framework for Embodied AI Research
The domain of Embodied AI, in which agents learn to complete tasks throu...
research
∙
06/23/2020
ObjectNav Revisited: On Evaluation of Embodied Agents Navigating to Objects
We revisit the problem of Object-Goal Navigation (ObjectNav). In its sim...
research
∙
06/16/2020
Learning About Objects by Learning to Interact with Them
Much of the remarkable progress in computer vision has been focused arou...
research
∙
04/22/2020
Visual Commonsense Graphs: Reasoning about the Dynamic Context of a Still Image
Even from a single frame of a still image, people can reason about the d...
research
∙
04/14/2020
RoboTHOR: An Open Simulation-to-Real Embodied AI Platform
Visual recognition ecosystems (e.g. ImageNet, Pascal, COCO) have undenia...
research
∙
12/17/2019
Artificial Agents Learn Flexible Visual Representations by Playing a Hiding Game
The ubiquity of embodied gameplay, observed in a wide variety of animal ...
research
∙
12/04/2019
Visual Reaction: Learning to Play Catch with Your Drone
In this paper we address the problem of visual reaction: the task of int...
research
∙
12/03/2019
ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Tasks
We present ALFRED (Action Learning From Realistic Environments and Direc...
research
∙
05/31/2019
OK-VQA: A Visual Question Answering Benchmark Requiring External Knowledge
Visual Question Answering (VQA) in its ideal form lets us study reasonin...
research
∙
03/06/2019
AAAI-2019 Workshop on Games and Simulations for Artificial Intelligence
This volume represents the accepted submissions from the AAAI-2019 Works...
research
∙
12/03/2018
Learning to Learn How to Learn: Self-Adaptive Visual Navigation Using Meta-Learning
Learning is an inherently continuous phenomenon. When humans learn a new...
research
∙
10/15/2018
Visual Semantic Navigation using Scene Priors
How do humans navigate to target objects in novel scenes? Do we use the ...
research
∙
07/18/2018
On Evaluation of Embodied Navigation Agents
Skillful mobile operation in three-dimensional environments is a primary...
research
∙
03/28/2018
Who Let The Dogs Out? Modeling Dog Behavior From Visual Data
We introduce the task of directly modeling a visually intelligent agent....
research
∙
12/14/2017
AI2-THOR: An Interactive 3D Environment for Visual AI
We introduce The House Of inteRactions (THOR), a framework for visual AI...
research
∙
05/23/2017
Visual Semantic Planning using Deep Successor Representations
A crucial capability of real-world intelligent agents is their ability t...
research
∙
03/29/2017
SeGAN: Segmenting and Generating the Invisible
Objects often occlude each other in scenes; Inferring their appearance b...
research
∙
01/10/2017
See the Glass Half Full: Reasoning about Liquid Containers, their Volume and Content
Humans have rich understanding of liquid containers and their contents; ...
research
∙
09/16/2016
Target-driven Visual Navigation in Indoor Scenes using Deep Reinforcement Learning
Two less addressed issues of deep reinforcement learning are (1) lack of...
research
∙
03/17/2016
"What happens if..." Learning to Predict the Effect of Forces in Images
What happens if one pushes a cup sitting on a table toward the edge of t...
research
∙
11/12/2015
Newtonian Image Understanding: Unfolding the Dynamics of Objects in Static Images
In this paper, we study the challenging problem of predicting the dynami...
research
∙
04/10/2015