Perspective Transformation Layer

by   Nishan Khatri, et al.

Incorporating geometric transformations that reflect the relative position changes between an observer and an object into computer vision and deep learning models has attracted much attention in recent years. However, the existing proposals mainly focus on affine transformations that cannot fully show viewpoint changes. Furthermore, current solutions often apply a neural network module to learn a single transformation matrix, which ignores the possibility for various viewpoints and creates extra to-be-trained module parameters. In this paper, a layer (PT layer) is proposed to learn the perspective transformations that not only model the geometries in affine transformation but also reflect the viewpoint changes. In addition, being able to be directly trained with gradient descent like traditional layers such as convolutional layers, a single proposed PT layer can learn an adjustable number of multiple viewpoints without training extra module parameters. The experiments and evaluations confirm the superiority of the proposed PT layer.



There are no comments yet.


page 2

page 4

page 5

page 6


Similarity and Matching of Neural Network Representations

We employ a toolset – dubbed Dr. Frankenstein – to analyse the similarit...

A concise parametrisation of affine transformation

Good parametrisations of affine transformations are essential to interpo...

Modularized Morphing of Neural Networks

In this work we study the problem of network morphism, an effective lear...

HyperNets and their application to learning spatial transformations

In this paper we propose a conceptual framework for higher-order artific...

Top-down Flow Transformer Networks

We study the deformation fields of feature maps across convolutional net...

Towards end-to-end F0 voice conversion based on Dual-GAN with convolutional wavelet kernels

This paper presents a end-to-end framework for the F0 transformation in ...

Non-Parametric Transformation Networks

ConvNets have been very effective in many applications where it is requi...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.