Enhanced 3D convolutional networks for crowd counting

08/12/2019
by   Zhikang Zou, et al.
0

Recently, convolutional neural networks (CNNs) are the leading defacto method for crowd counting. However, when dealing with video datasets, CNN-based methods still process each video frame independently, thus ignoring the powerful temporal information between consecutive frames. In this work, we propose a novel architecture termed as "temporal channel-aware" (TCA) block, which achieves the capability of exploiting the temporal interdependencies among video sequences. Specifically, we incorporate 3D convolution kernels to encode local spatio-temporal features. Furthermore, the global contextual information is encoded into modulation weights which adaptively recalibrate channel-aware feature responses. With the local and global context combined, the proposed block enhances the discriminative ability of the feature representations and contributes to more precise results in diverse scenes. By stacking TCA blocks together, we obtain the deep trainable architecture called enhanced 3D convolutional networks (E3D). The experiments on three benchmark datasets show that the proposed method delivers state-of-the-art performance. To verify the generality, an extended experiment is conducted on a vehicle dataset TRANCOS and our approach beats previous methods by large margins.

READ FULL TEXT
research
07/25/2017

Spatiotemporal Modeling for Crowd Counting in Videos

Region of Interest (ROI) crowd counting can be formulated as a regressio...
research
06/13/2019

Learning Spatio-Temporal Representation with Local and Global Diffusion

Convolutional Neural Networks (CNN) have been regarded as a powerful cla...
research
03/11/2020

GAST-Net: Graph Attention Spatio-temporal Convolutional Networks for 3D Human Pose Estimation in Video

3D pose estimation in video can benefit greatly from both temporal and s...
research
08/10/2019

SCAR: Spatial-/Channel-wise Attention Regression Networks for Crowd Counting

Recently, crowd counting is a hot topic in crowd analysis. Many CNN-base...
research
09/07/2019

Exploring Temporal Differences in 3D Convolutional Neural Networks

Traditional 3D convolutions are computationally expensive, memory intens...
research
06/23/2021

Region-Aware Network: Model Human's Top-Down Visual Perception Mechanism for Crowd Counting

Background noise and scale variation are common problems that have been ...
research
07/29/2017

FCN-rLSTM: Deep Spatio-Temporal Neural Networks for Vehicle Counting in City Cameras

In this paper, we develop deep spatio-temporal neural networks to sequen...

Please sign up or login with your details

Forgot password? Click here to reset