Image Alignment in Unseen Domains via Domain Deep Generalization

05/28/2019
by   Thanh-Dat Truong, et al.
0

Image alignment across domains has recently become one of the realistic and popular topics in the research community. In this problem, a deep learning-based image alignment method is usually trained on an available largescale database. During the testing steps, this trained model is deployed on unseen images collected under different camera conditions and modalities. The delivered deep network models are unable to be updated, adapted or fine-tuned in these scenarios. Thus, recent deep learning techniques, e.g. domain adaptation, feature transferring, and fine-tuning, are unable to be deployed. This paper presents a novel deep learning based approach to tackle the problem of across unseen modalities. The proposed network is then applied to image alignment as an illustration. The proposed approach is designed as an end-to-end deep convolutional neural network to optimize the deep models to improve the performance. The proposed network has been evaluated in digit recognition when the model is trained on MNIST and then tested on unseen domain MNIST-M. Finally, the proposed method is benchmarked in image alignment problem when training on RGB images and testing on Depth and X-Ray images.

READ FULL TEXT

page 2

page 6

research
05/28/2019

Recognition in Unseen Domains: Domain Generalization via Universal Non-volume Preserving Models

Recognition across domains has recently become an active topic in the re...
research
12/09/2018

Beyond Domain Adaptation: Unseen Domain Encapsulation via Universal Non-volume Preserving Models

Recognition across domains has recently become an active topic in the re...
research
10/25/2022

On Fine-Tuned Deep Features for Unsupervised Domain Adaptation

Prior feature transformation based approaches to Unsupervised Domain Ada...
research
10/18/2022

Using Language to Extend to Unseen Domains

It is expensive to collect training data for every possible domain that ...
research
03/21/2018

Domain Adaptation for Ear Recognition Using Deep Convolutional Neural Networks

In this paper, we have extensively investigated the unconstrained ear re...
research
05/19/2022

Learning-based AC-OPF Solvers on Realistic Network and Realistic Loads

Deep learning approaches for the Alternating Current-Optimal Power Flow ...
research
06/01/2022

IDANI: Inference-time Domain Adaptation via Neuron-level Interventions

Large pre-trained models are usually fine-tuned on downstream task data,...

Please sign up or login with your details

Forgot password? Click here to reset