AnyLoc: Towards Universal Visual Place Recognition

08/01/2023
by   Nikhil Keetha, et al.
0

Visual Place Recognition (VPR) is vital for robot localization. To date, the most performant VPR approaches are environment- and task-specific: while they exhibit strong performance in structured environments (predominantly urban driving), their performance degrades severely in unstructured environments, rendering most approaches brittle to robust real-world deployment. In this work, we develop a universal solution to VPR – a technique that works across a broad range of structured and unstructured environments (urban, outdoors, indoors, aerial, underwater, and subterranean environments) without any re-training or fine-tuning. We demonstrate that general-purpose feature representations derived from off-the-shelf self-supervised models with no VPR-specific training are the right substrate upon which to build such a universal VPR solution. Combining these derived features with unsupervised feature aggregation enables our suite of methods, AnyLoc, to achieve up to 4X significantly higher performance than existing approaches. We further obtain a 6 these features, uncovering unique domains which encapsulate datasets from similar environments. Our detailed experiments and analysis lay a foundation for building VPR solutions that may be deployed anywhere, anytime, and across anyview. We encourage the readers to explore our project page and interactive demos: https://anyloc.github.io/.

READ FULL TEXT

page 1

page 3

page 6

research
03/08/2022

Tune your Place Recognition: Self-Supervised Domain Calibration via Robust SLAM

Visual place recognition techniques based on deep learning, which have i...
research
11/23/2022

Wild-Places: A Large-Scale Dataset for Lidar Place Recognition in Unstructured Natural Environments

Many existing datasets for lidar place recognition are solely representa...
research
09/19/2023

AV-SUPERB: A Multi-Task Evaluation Benchmark for Audio-Visual Representation Models

Audio-visual representation learning aims to develop systems with human-...
research
09/17/2023

Sim-to-Real Deep Reinforcement Learning with Manipulators for Pick-and-place

When transferring a Deep Reinforcement Learning model from simulation to...
research
11/26/2018

Universal Semi-Supervised Semantic Segmentation

In recent years, the need for semantic segmentation has arisen across se...
research
10/16/2022

1st Place Solution in Google Universal Images Embedding

This paper presents the 1st place solution for the Google Universal Imag...
research
12/11/2020

Exploiting Behavioral Consistence for Universal User Representation

User modeling is critical for developing personalized services in indust...

Please sign up or login with your details

Forgot password? Click here to reset