research
∙
09/11/2023
Multi3DRefer: Grounding Text Description to Multiple 3D Objects
We introduce the task of localizing a flexible number of objects in real...
share
research
∙
06/20/2023
Habitat Synthetic Scenes Dataset (HSSD-200): An Analysis of 3D Scene Scale and Realism Tradeoffs for ObjectGoal Navigation
We contribute the Habitat Synthetic Scene Dataset, a dataset of 211 high...
research
∙
05/29/2023
Evaluating 3D Shape Analysis Methods for Robustness to Rotation Invariance
This paper analyzes the robustness of recent 3D shape descriptors to SO(...
research
∙
04/07/2023
Reduce, Reuse, Recycle: Modular Multi-Object Navigation
Our work focuses on the Multi-Object Navigation (MultiON) task, where an...
research
∙
12/01/2022
Exploiting Socially-Aware Tasks for Embodied Social Navigation
Learning how to navigate among humans in an occluded and spatially const...
research
∙
09/30/2022
Understanding Pure CLIP Guidance for Voxel Grid NeRF Models
We explore the task of text to 3D object generation using CLIP. Specific...
research
∙
09/12/2022
Articulated 3D Human-Object Interactions from RGB Videos: An Empirical Analysis of Approaches and Challenges
Human-object interactions with articulated objects are common in everyda...
research
∙
03/30/2022
OPD: Single-view 3D Openable Part Detection
We address the task of predicting what parts of an object can open and h...
research
∙
01/19/2022
TriCoLo: Trimodal Contrastive Loss for Fine-grained Text to Shape Retrieval
Recent work on contrastive losses for learning joint embeddings over mul...
research
∙
12/10/2021
Roominoes: Generating Novel 3D Floor Plans From Existing 3D Rooms
Realistic 3D indoor scene datasets have enabled significant recent progr...
research
∙
10/12/2021
Interpretation of Emergent Communication in Heterogeneous Collaborative Embodied Agents
Communication between embodied AI agents has received increasing attenti...
research
∙
09/30/2021
Language-Aligned Waypoint (LAW) Supervision for Vision-and-Language Navigation in Continuous Environments
In the Vision-and-Language Navigation (VLN) task an embodied agent navig...
research
∙
09/16/2021
Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AI
We present the Habitat-Matterport 3D (HM3D) dataset. HM3D is a large-sca...
research
∙
06/11/2021
Mirror3D: Depth Refinement for Mirror Surfaces
Despite recent progress in depth sensing and 3D reconstruction, mirror s...
research
∙
06/09/2021
Plan2Scene: Converting Floorplans to 3D Scenes
We address the task of converting a floorplan and a set of associated ph...
research
∙
12/07/2020
MultiON: Benchmarking Semantic Map Memory using Multi-Object Navigation
Navigation tasks in photorealistic 3D environments are challenging becau...
research
∙
11/03/2020
Rearrangement: A Challenge for Embodied AI
We describe a framework for research and evaluation in Embodied AI. Our ...
research
∙
03/19/2020
SAPIEN: A SimulAted Part-based Interactive ENvironment
Building home assistant robots has long been a pursuit for vision and ro...
research
∙
12/18/2019
ScanRefer: 3D Object Localization in RGB-D Scans using Natural Language
We introduce the new task of 3D object localization in RGB-D scans using...
research
∙
12/06/2018
PartNet: A Large-scale Benchmark for Fine-grained and Hierarchical Part-level 3D Object Understanding
We present PartNet: a consistent, large-scale dataset of 3D objects anno...
research
∙
11/27/2018
Scan2CAD: Learning CAD Model Alignment in RGB-D Scans
We present Scan2CAD, a novel data-driven method that learns to align cle...
research
∙
03/22/2018
Text2Shape: Generating Shapes from Natural Language by Learning Joint Embeddings
We present a method for generating colored 3D shapes from natural langua...
research
∙
12/12/2017
Im2Pano3D: Extrapolating 360 Structure and Semantics Beyond the Field of View
We present Im2Pano3D, a convolutional neural network that generates a de...
research
∙
12/11/2017
MINOS: Multimodal Indoor Simulator for Navigation in Complex Environments
We present MINOS, a simulator designed to support the development of mul...
research
∙
04/07/2017
Learning Where to Look: Data-Driven Viewpoint Set Selection for 3D Scenes
The use of rendered images, whether from completely synthetic datasets o...
research
∙
02/28/2017
SceneSuggest: Context-driven 3D Scene Design
We present SceneSuggest: an interactive 3D scene design system providing...
research
∙
02/28/2017
SceneSeer: 3D Scene Design with Natural Language
Designing 3D scenes is currently a creative task that requires significa...
research
∙
11/28/2016
Semantic Scene Completion from a Single Depth Image
This paper focuses on semantic scene completion, a task for producing a ...
research
∙
03/15/2016
Evaluating the word-expert approach for Named-Entity Disambiguation
Named Entity Disambiguation (NED) is the task of linking a named-entity ...
research
∙
12/09/2015