Temporal Attentive Alignment for Large-Scale Video Domain Adaptation

07/30/2019
by   Min-Hung Chen, et al.
0

Although various image-based domain adaptation (DA) techniques have been proposed in recent years, domain shift in videos is still not well-explored. Most previous works only evaluate performance on small-scale datasets which are saturated. Therefore, we first propose two largescale video DA datasets with much larger domain discrepancy: UCF-HMDB_full and Kinetics-Gameplay. Second, we investigate different DA integration methods for videos, and show that simultaneously aligning and learning temporal dynamics achieves effective alignment even without sophisticated DA methods. Finally, we propose Temporal Attentive Adversarial Adaptation Network (TA3N), which explicitly attends to the temporal dynamics using domain discrepancy for more effective domain alignment, achieving state-of-the-art performance on four video DA datasets (e.g. 7.9 UCF", and 10.3 released at http://github.com/cmhungsteve/TA3N.

READ FULL TEXT

page 1

page 13

research
05/26/2019

Temporal Attentive Alignment for Video Domain Adaptation

Although various image-based domain adaptation (DA) techniques have been...
research
05/26/2022

Pick up the PACE: Fast and Simple Domain Adaptation via Ensemble Pseudo-Labeling

Domain Adaptation (DA) has received widespread attention from deep learn...
research
03/20/2020

Action Segmentation with Joint Self-Supervised Temporal Domain Adaptation

Despite the recent progress of fully-supervised action segmentation tech...
research
03/31/2021

DA-DETR: Domain Adaptive Detection Transformer by Hybrid Attention

The prevalent approach in domain adaptive object detection adopts a two-...
research
07/11/2021

Aligning Correlation Information for Domain Adaptation in Action Recognition

Domain adaptation (DA) approaches address domain shift and enable networ...
research
05/21/2020

ESAM: Discriminative Domain Adaptation with Non-Displayed Items to Improve Long-Tail Performance

Most of ranking models are trained only with displayed items (most are h...
research
12/21/2018

Multi-component Image Translation for Deep Domain Generalization

Domain adaption (DA) and domain generalization (DG) are two closely rela...

Please sign up or login with your details

Forgot password? Click here to reset