Online Adaptation through Meta-Learning for Stereo Depth Estimation

04/17/2019
by   Zhenyu Zhang, et al.
0

In this work, we tackle the problem of online adaptation for stereo depth estimation, that consists in continuously adapting a deep network to a target video recordedin an environment different from that of the source training set. To address this problem, we propose a novel Online Meta-Learning model with Adaption (OMLA). Our proposal is based on two main contributions. First, to reducethe domain-shift between source and target feature distributions we introduce an online feature alignment procedurederived from Batch Normalization. Second, we devise a meta-learning approach that exploits feature alignment forfaster convergence in an online learning setting. Additionally, we propose a meta-pre-training algorithm in order toobtain initial network weights on the source dataset whichfacilitate adaptation on future data streams. Experimentally, we show that both OMLA and meta-pre-training helpthe model to adapt faster to a new environment. Our proposal is evaluated on the wellestablished KITTI dataset,where we show that our online method is competitive withstate of the art algorithms trained in a batch setting.

READ FULL TEXT

page 3

page 9

research
02/01/2022

Fully Online Meta-Learning Without Task Boundaries

While deep networks can learn complex functions such as classifiers, det...
research
04/09/2020

Online Meta-Learning for Multi-Source and Semi-Supervised Domain Adaptation

Domain adaptation (DA) is the topical problem of adapting models from la...
research
04/05/2019

Learning to Adapt for Stereo

Real world applications of stereo depth estimation require models that a...
research
07/21/2022

MetaComp: Learning to Adapt for Online Depth Completion

Relying on deep supervised or self-supervised learning, previous methods...
research
07/27/2022

PointFix: Learning to Fix Domain Bias for Robust Online Stereo Adaptation

Online stereo adaptation tackles the domain shift problem, caused by dif...
research
06/14/2020

Provably Efficient Model-based Policy Adaptation

The high sample complexity of reinforcement learning challenges its use ...
research
07/10/2020

Continual Adaptation for Deep Stereo

Depth estimation from stereo images is carried out with unmatched result...

Please sign up or login with your details

Forgot password? Click here to reset