Dynamic texture recognition using time-causal and time-recursive spatio-temporal receptive fields

10/13/2017
by   Ylva Jansson, et al.
0

This work presents a first evaluation of using spatio-temporal receptive fields from a recently proposed time-causal spatio-temporal scale-space framework as primitives for video analysis. We propose a new family of video descriptors based on regional statistics of spatio-temporal receptive field responses and evaluate this approach on the problem of dynamic texture recognition. Our approach generalises a previously used method, based on joint histograms of receptive field responses, from the spatial to the spatio-temporal domain and from object recognition to dynamic texture recognition. The time-recursive formulation enables computationally efficient time-causal recognition. The experimental evaluation demonstrates competitive performance compared to state-of-the-art. Especially, it is shown that binary versions of our dynamic texture descriptors achieve improved performance compared to a large range of similar methods using different primitives either handcrafted or learned from data. Further, our qualitative and quantitative investigation into parameter choices and the use of different sets of receptive fields highlights the robustness and flexibility of our approach. Together, these results support the descriptive power of this family of time-causal spatio-temporal receptive fields, validate our approach for dynamic texture recognition and point towards the possibility of designing a range of video analysis methods based on these new time-causal spatio-temporal primitives.

READ FULL TEXT

page 4

page 5

page 7

page 9

page 10

page 15

page 16

page 20

research
04/07/2015

Separable time-causal and time-recursive spatio-temporal receptive fields

We present an improved model and theory for time-causal and time-recursi...
research
04/10/2015

Time-causal and time-recursive spatio-temporal receptive fields

We present an improved model and theory for time-causal and time-recursi...
research
08/17/2021

Estimating smooth and sparse neural receptive fields with a flexible spline basis

Spatio-temporal receptive field (STRF) models are frequently used to app...
research
03/25/2013

Spatio-Temporal Covariance Descriptors for Action and Gesture Recognition

We propose a new action and gesture recognition method based on spatio-t...
research
04/11/2017

Online Video Deblurring via Dynamic Temporal Blending Network

State-of-the-art video deblurring methods are capable of removing non-un...
research
01/09/2017

Temporal scale selection in time-causal scale space

When designing and developing scale selection mechanisms for generating ...
research
10/15/2019

Being the center of attention: A Person-Context CNN framework for Personality Recognition

This paper proposes a novel study on personality recognition using video...

Please sign up or login with your details

Forgot password? Click here to reset