Birds of a Feather: Capturing Avian Shape Models from Images

05/19/2021
by   Yufu Wang, et al.
0

Animals are diverse in shape, but building a deformable shape model for a new species is not always possible due to the lack of 3D data. We present a method to capture new species using an articulated template and images of that species. In this work, we focus mainly on birds. Although birds represent almost twice the number of species as mammals, no accurate shape model is available. To capture a novel species, we first fit the articulated template to each training sample. By disentangling pose and shape, we learn a shape space that captures variation both among species and within each species from image evidence. We learn models of multiple species from the CUB dataset, and contribute new species-specific and multi-species shape models that are useful for downstream reconstruction tasks. Using a low-dimensional embedding, we show that our learned 3D shape space better reflects the phylogenetic relationships among birds than learned perceptual features.

READ FULL TEXT

page 1

page 4

page 8

research
08/20/2019

Three-D Safari: Learning to Estimate Zebra Pose, Shape, and Texture from Images "In the Wild"

We present the first method to perform automatic 3D pose, shape and text...
research
09/28/2016

Deep Multi-Species Embedding

Understanding how species are distributed across landscapes over time is...
research
06/18/2021

hSMAL: Detailed Horse Shape and Pose Reconstruction for Motion Pattern Recognition

In this paper we present our preliminary work on model-based behavioral ...
research
04/11/2018

Discovering the Elite Hypervolume by Leveraging Interspecies Correlation

Evolution has produced an astonishing diversity of species, each filling...
research
03/29/2022

BARC: Learning to Regress 3D Dog Shape from Images by Exploiting Breed Information

Our goal is to recover the 3D shape and pose of dogs from a single image...
research
03/08/2022

Data fusion of distance sampling and capture-recapture data

Species distribution models (SDMs) are increasingly used in ecology, bio...

Please sign up or login with your details

Forgot password? Click here to reset