CoReS: Compatible Representations via Stationarity

by   Niccolo Biondi, et al.

In this paper, we propose a novel method to learn internal feature representation models that are compatible with previously learned ones. Compatible features enable for direct comparison of old and new learned features, allowing them to be used interchangeably over time. This eliminates the need for visual search systems to extract new features for all previously seen images in the gallery-set when sequentially upgrading the representation model. Extracting new features is typically quite expensive or infeasible in the case of very large gallery-sets and/or real time systems (i.e., face-recognition systems, social networks, life-long learning systems, robotics and surveillance systems). Our approach, called Compatible Representations via Stationarity (CoReS), achieves compatibility by encouraging stationarity to the learned representation model without relying on previously learned models. Stationarity allows features' statistical properties not to change under time shift so that the current learned features are inter-operable with the old ones. We evaluate single and sequential multi-model upgrading in growing large-scale training datasets and we show that our method improves the state-of-the-art in achieving compatible features by a large margin. In particular, upgrading ten times with training data taken from CASIA-WebFace and evaluating in Labeled Face in the Wild (LFW), we obtain a 49% increase in measuring the average number of times compatibility is achieved, which is a 544% relative improvement over previous state-of-the-art.



page 8

page 9

page 12

page 14


Towards Backward-Compatible Representation Learning

We propose a way to learn visual features that are compatible with previ...

Towards Universal Backward-Compatible Representation Learning

Conventional model upgrades for visual search systems require offline re...

Neighborhood Consensus Contrastive Learning for Backward-Compatible Representation

In object re-identification (ReID), the development of deep learning tec...

Training Neural Networks to Produce Compatible Features

This paper makes a first step towards compatible and hence reusable netw...

Dual-Tuning: Joint Prototype Transfer and Structure Regularization for Compatible Feature Learning

Visual retrieval system faces frequent model update and deployment. It i...

Switchable Representation Learning Framework with Self-compatibility

Real-world visual search systems involve deployments on multiple platfor...

Learning with Feature Evolvable Streams

Learning with streaming data has attracted much attention during the pas...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.