Multiple Thinking Achieving Meta-Ability Decoupling for Object Navigation

02/03/2023
by   Ronghao Dang, et al.
0

We propose a meta-ability decoupling (MAD) paradigm, which brings together various object navigation methods in an architecture system, allowing them to mutually enhance each other and evolve together. Based on the MAD paradigm, we design a multiple thinking (MT) model that leverages distinct thinking to abstract various meta-abilities. Our method decouples meta-abilities from three aspects: input, encoding, and reward while employing the multiple thinking collaboration (MTC) module to promote mutual cooperation between thinking. MAD introduces a novel qualitative and quantitative interpretability system for object navigation. Through extensive experiments on AI2-Thor and RoboTHOR, we demonstrate that our method outperforms state-of-the-art (SOTA) methods on both typical and zero-shot object navigation tasks.

READ FULL TEXT
research
03/23/2022

Pre-training to Match for Unified Low-shot Relation Extraction

Low-shot relation extraction (RE) aims to recognize novel relations with...
research
01/30/2023

ESC: Exploration with Soft Commonsense Constraints for Zero-shot Object Navigation

The ability to accurately locate and navigate to a specific object is a ...
research
03/06/2023

Can an Embodied Agent Find Your "Cat-shaped Mug"? LLM-Based Zero-Shot Object Navigation

We present LGX, a novel algorithm for Object Goal Navigation in a "langu...
research
06/15/2022

Zero-shot object goal visual navigation

Object goal visual navigation is a challenging task that aims to guide a...
research
08/18/2023

Meta-ZSDETR: Zero-shot DETR with Meta-learning

Zero-shot object detection aims to localize and recognize objects of uns...
research
09/20/2023

Discuss Before Moving: Visual Language Navigation via Multi-expert Discussions

Visual language navigation (VLN) is an embodied task demanding a wide ra...
research
01/06/2022

Balancing Generalization and Specialization in Zero-shot Learning

Zero-Shot Learning (ZSL) aims to transfer classification capability from...

Please sign up or login with your details

Forgot password? Click here to reset