Multi-View Inpainting for RGB-D Sequence

11/22/2018
by   Feiran Li, et al.
0

In this work we propose a novel approach to remove undesired objects from RGB-D sequences captured with freely moving cameras, which enables static 3D reconstruction. Our method jointly uses existing information from multiple frames as well as generates new one via inpainting techniques. We use balanced rules to select source frames; local homography based image warping method for alignment and Markov random field (MRF) based approach for combining existing information. For the left holes, we employ exemplar based multi-view inpainting method to deal with the color image and coherently use it as guidance to complete the depth correspondence. Experiments show that our approach is qualified for removing the undesired objects and inpainting the holes.

READ FULL TEXT

page 3

page 7

page 8

research
12/22/2022

Removing Objects From Neural Radiance Fields

Neural Radiance Fields (NeRFs) are emerging as a ubiquitous scene repres...
research
10/14/2021

RGB-D Image Inpainting Using Generative Adversarial Network with a Late Fusion Approach

Diminished reality is a technology that aims to remove objects from vide...
research
01/21/2020

Deep Depth Prior for Multi-View Stereo

It was recently shown that the structure of convolutional neural network...
research
10/12/2022

Point Cloud Scene Completion with Joint Color and Semantic Estimation from Single RGB-D Image

We present a deep reinforcement learning method of progressive view inpa...
research
04/07/2023

Clutter Detection and Removal in 3D Scenes with View-Consistent Inpainting

Removing clutter from scenes is essential in many applications, ranging ...
research
02/23/2018

Adaptive specular reflection detection and inpainting in colonoscopy video frames

Colonoscopy video frames might be contaminated by bright spots with unsa...
research
03/10/2019

Deep Reinforcement Learning of Volume-guided Progressive View Inpainting for 3D Point Scene Completion from a Single Depth Image

We present a deep reinforcement learning method of progressive view inpa...

Please sign up or login with your details

Forgot password? Click here to reset