Lifelong Metric Learning

05/03/2017
by   Gan Sun, et al.
0

The state-of-the-art online learning approaches are only capable of learning the metric for predefined tasks. In this paper, we consider lifelong learning problem to mimic "human learning", i.e., endowing a new capability to the learned metric for a new task from new online samples and incorporating previous experiences and knowledge. Therefore, we propose a new metric learning framework: lifelong metric learning (LML), which only utilizes the data of the new task to train the metric model while preserving the original capabilities. More specifically, the proposed LML maintains a common subspace for all learned metrics, named lifelong dictionary, transfers knowledge from the common subspace to each new metric task with task-specific idiosyncrasy, and redefines the common subspace over time to maximize performance across all metric tasks. For model optimization, we apply online passive aggressive optimization algorithm to solve the proposed LML framework, where the lifelong dictionary and task-specific partition are optimized alternatively and consecutively. Finally, we evaluate our approach by analyzing several multi-task metric learning datasets. Extensive experimental results demonstrate effectiveness and efficiency of the proposed framework.

READ FULL TEXT

page 2

page 7

research
04/15/2014

Sparse Compositional Metric Learning

We propose a new approach for metric learning by framing it as learning ...
research
04/05/2018

Large Scale Local Online Similarity/Distance Learning Framework based on Passive/Aggressive

Similarity/Distance measures play a key role in many machine learning, p...
research
03/06/2019

Representative Task Self-selection for Flexible Clustered Lifelong Learning

Consider the lifelong learning paradigm whose objective is to learn a se...
research
02/09/2018

Adversarial Metric Learning

In the past decades, intensive efforts have been put to design various l...
research
04/08/2019

Heterogeneous Multi-task Metric Learning across Multiple Domains

Distance metric learning (DML) plays a crucial role in diverse machine l...
research
09/16/2023

Universal Metric Learning with Parameter-Efficient Transfer Learning

A common practice in metric learning is to train and test an embedding m...
research
08/21/2021

Metric Learning in Multilingual Sentence Similarity Measurement for Document Alignment

Document alignment techniques based on multilingual sentence representat...

Please sign up or login with your details

Forgot password? Click here to reset