DeepAI AI Chat
Log In Sign Up

The Structure Transfer Machine Theory and Applications

04/01/2018
by   Baochang Zhang, et al.
Beihang University
0

Representation learning is a fundamental but challenging problem, especially when the distribution of data is unknown. We propose a new representation learning method, termed Structure Transfer Machine (STM), which enables feature learning process to converge at the representation expectation in a probabilistic way. We theoretically show that such an expected value of the representation (mean) is achievable if the manifold structure can be transferred from the data space to the feature space. The resulting structure regularization term, named manifold loss, is incorporated into the loss function of the typical deep learning pipeline. The STM architecture is constructed to enforce the learned deep representation to satisfy the intrinsic manifold structure from the data, which results in robust features that suit various application scenarios, such as digit recognition, image classification and object tracking. Compared to state-of-the-art CNN architectures, we achieve the better results on several commonly used benchmarks[The source code is available. https://github.com/stmstmstm/stm ].

READ FULL TEXT

page 1

page 2

page 3

page 4

08/05/2021

Instance Similarity Learning for Unsupervised Feature Representation

In this paper, we propose an instance similarity learning (ISL) method f...
06/13/2021

Atlas Based Representation and Metric Learning on Manifolds

We explore the use of a topological manifold, represented as a collectio...
11/01/2022

Augmentation Invariant Manifold Learning

Data augmentation is a widely used technique and an essential ingredient...
11/20/2022

Font Representation Learning via Paired-glyph Matching

Fonts can convey profound meanings of words in various forms of glyphs. ...
03/06/2020

Probability Weighted Compact Feature for Domain Adaptive Retrieval

Domain adaptive image retrieval includes single-domain retrieval and cro...
10/28/2017

Label Embedding Network: Learning Label Representation for Soft Training of Deep Networks

We propose a method, called Label Embedding Network, which can learn lab...
08/06/2021

Dual-Tuning: Joint Prototype Transfer and Structure Regularization for Compatible Feature Learning

Visual retrieval system faces frequent model update and deployment. It i...