Winning the CVPR'2021 Kinetics-GEBD Challenge: Contrastive Learning Approach

06/22/2021
by   Hyolim Kang, et al.
0

Generic Event Boundary Detection (GEBD) is a newly introduced task that aims to detect "general" event boundaries that correspond to natural human perception. In this paper, we introduce a novel contrastive learning based approach to deal with the GEBD. Our intuition is that the feature similarity of the video snippet would significantly vary near the event boundaries, while remaining relatively the same in the remaining part of the video. In our model, Temporal Self-similarity Matrix (TSM) is utilized as an intermediate representation which takes on a role as an information bottleneck. With our model, we achieved significant performance boost compared to the given baselines. Our code is available at https://github.com/hello-jinwoo/LOVEU-CVPR2021.

READ FULL TEXT
research
11/29/2021

UBoCo : Unsupervised Boundary Contrastive Learning for Generic Event Boundary Detection

Generic Event Boundary Detection (GEBD) is a newly suggested video under...
research
07/03/2022

Exploiting Context Information for Generic Event Boundary Captioning

Generic Event Boundary Captioning (GEBC) aims to generate three sentence...
research
06/17/2022

Masked Autoencoders for Generic Event Boundary Detection CVPR'2022 Kinetics-GEBD Challenge

Generic Event Boundary Detection (GEBD) tasks aim at detecting generic, ...
research
04/24/2023

A Benchmark for Cycling Close Pass Near Miss Event Detection from Video Streams

Cycling is a healthy and sustainable mode of transport. However, interac...
research
01/14/2022

Boundary-aware Self-supervised Learning for Video Scene Segmentation

Self-supervised learning has drawn attention through its effectiveness i...
research
06/17/2023

A New Perspective for Shuttlecock Hitting Event Detection

This article introduces a novel approach to shuttlecock hitting event de...
research
07/01/2021

Generic Event Boundary Detection Challenge at CVPR 2021 Technical Report: Cascaded Temporal Attention Network (CASTANET)

This report presents the approach used in the submission of Generic Even...

Please sign up or login with your details

Forgot password? Click here to reset