NRST: Non-rigid Surface Tracking from Monocular Video

07/06/2021
by   Marc Habermann, et al.
21

We propose an efficient method for non-rigid surface tracking from monocular RGB videos. Given a video and a template mesh, our algorithm sequentially registers the template non-rigidly to each frame. We formulate the per-frame registration as an optimization problem that includes a novel texture term specifically tailored towards tracking objects with uniform texture but fine-scale structure, such as the regular micro-structural patterns of fabric. Our texture term exploits the orientation information in the micro-structures of the objects, e.g., the yarn patterns of fabrics. This enables us to accurately track uniformly colored materials that have these high frequency micro-structures, for which traditional photometric terms are usually less effective. The results demonstrate the effectiveness of our method on both general textured non-rigid objects and monochromatic fabrics.

READ FULL TEXT

page 2

page 7

page 9

page 10

page 11

page 12

research
09/22/2020

MonoClothCap: Towards Temporally Coherent Clothing Capture from Monocular RGB Video

We present a method to capture temporally coherent dynamic clothing defo...
research
04/19/2012

Dynamic Template Tracking and Recognition

In this paper we address the problem of tracking non-rigid objects whose...
research
10/05/2018

ReTiCaM: Real-time Human Performance Capture from Monocular Video

We present the first real-time human performance capture approach that r...
research
04/30/2020

Levitating Rigid Objects with Hidden Support Structures

We propose a novel algorithm to efficiently generate hidden structures t...
research
12/19/2016

Exploring Structure for Long-Term Tracking of Multiple Objects in Sports Videos

In this paper, we propose a novel approach for exploiting structural rel...
research
09/03/2020

Mononizing Binocular Videos

This paper presents the idea ofmono-nizingbinocular videos and a frame-w...
research
04/30/2021

Differentiable Event Stream Simulator for Non-Rigid 3D Tracking

This paper introduces the first differentiable simulator of event stream...

Please sign up or login with your details

Forgot password? Click here to reset