Semi-supervised Viewpoint Estimation with Geometry-aware Conditional Generation

04/02/2021
by   Octave Mariotti, et al.
0

There is a growing interest in developing computer vision methods that can learn from limited supervision. In this paper, we consider the problem of learning to predict camera viewpoints, where obtaining ground-truth annotations are expensive and require special equipment, from a limited number of labeled images. We propose a semi-supervised viewpoint estimation method that can learn to infer viewpoint information from unlabeled image pairs, where two images differ by a viewpoint change. In particular our method learns to synthesize the second image by combining the appearance from the first one and viewpoint from the second one. We demonstrate that our method significantly improves the supervised techniques, especially in the low-label regime and outperforms the state-of-the-art semi-supervised methods.

READ FULL TEXT

page 12

page 14

research
04/03/2018

Unsupervised Geometry-Aware Representation for 3D Human Pose Estimation

Modern 3D human pose estimation techniques rely on deep networks, which ...
research
12/01/2022

ViewNet: Unsupervised Viewpoint Estimation from Conditional Generation

Understanding the 3D world without supervision is currently a major chal...
research
08/21/2021

SSR: Semi-supervised Soft Rasterizer for single-view 2D to 3D Reconstruction

Recent work has made significant progress in learning object meshes with...
research
11/06/2021

Order-Guided Disentangled Representation Learning for Ulcerative Colitis Classification with Limited Labels

Ulcerative colitis (UC) classification, which is an important task for e...
research
12/01/2022

ViewNeRF: Unsupervised Viewpoint Estimation Using Category-Level Neural Radiance Fields

We introduce ViewNeRF, a Neural Radiance Field-based viewpoint estimatio...
research
08/29/2022

Progressive Self-Distillation for Ground-to-Aerial Perception Knowledge Transfer

We study a practical yet hasn't been explored problem: how a drone can p...
research
07/03/2018

Viewpoint Estimation-Insights & Model

This paper addresses the problem of viewpoint estimation of an object in...

Please sign up or login with your details

Forgot password? Click here to reset