Deep Feature Flow for Video Recognition

11/23/2016
by   Xizhou Zhu, et al.
0

Deep convolutional neutral networks have achieved great success on image recognition tasks. Yet, it is non-trivial to transfer the state-of-the-art image recognition networks to videos as per-frame evaluation is too slow and unaffordable. We present deep feature flow, a fast and accurate framework for video recognition. It runs the expensive convolutional sub-network only on sparse key frames and propagates their deep feature maps to other frames via a flow field. It achieves significant speedup as flow computation is relatively fast. The end-to-end training of the whole architecture significantly boosts the recognition accuracy. Deep feature flow is flexible and general. It is validated on two recent large scale video datasets. It makes a large step towards practical video recognition.

READ FULL TEXT

page 2

page 4

page 9

page 10

research
04/16/2018

Towards High Performance Video Object Detection for Mobiles

Despite the recent success of video object detection on Desktop GPUs, it...
research
03/25/2021

Real-Time and Accurate Object Detection in Compressed Video by Long Short-term Feature Aggregation

Video object detection is a fundamental problem in computer vision and h...
research
02/27/2018

Recurrent Residual Module for Fast Inference in Videos

Deep convolutional neural networks (CNNs) have made impressive progress ...
research
11/05/2019

Deep Flow Collaborative Network for Online Visual Tracking

The deep learning-based visual tracking algorithms such as MDNet achieve...
research
12/23/2014

Deep Networks With Large Output Spaces

Deep neural networks have been extremely successful at various image, sp...
research
03/08/2022

DeltaCNN: End-to-End CNN Inference of Sparse Frame Differences in Videos

Convolutional neural network inference on video data requires powerful h...
research
09/04/2014

Very Deep Convolutional Networks for Large-Scale Image Recognition

In this work we investigate the effect of the convolutional network dept...

Please sign up or login with your details

Forgot password? Click here to reset