Dense scale selection over space, time and space-time

09/25/2017
by   Tony Lindeberg, et al.
0

Scale selection methods based on local extrema over scale of scale-normalized derivatives have been primarily developed to be applied sparsely --- at image points where the magnitude of a scale-normalized differential expression additionally assumes local extrema over the domain where the data are defined. This paper presents a methodology for performing dense scale selection, so that hypotheses about local characteristic scales in images, temporal signals and video can be computed at every image point and every time moment. A critical problem when designing mechanisms for dense scale selection is that the scale at which scale-normalized differential entities assume local extrema over scale can be strongly dependent on the local order of the locally dominant differential structure. To address this problem, we propose a methodology where local extrema over scale are detected of a quasi quadrature measure involving scale-space derivatives up to order two and propose two independent mechanisms to reduce the phase dependency of the local scale estimates by: (i) introducing a second layer of post-smoothing prior to the detection of local extrema over scale and (ii) performing local phase compensation based on a model of the phase dependency of the local scale estimates depending on the relative strengths between first- vs. second-order differential structure. This general methodology is applied over three types of domains: (i) spatial images, (ii) temporal signals and (iii) spatio-temporal video. Experiments show that the proposed methodology leads to intuitively reasonable results with local scale estimates that reflect variations in the characteristic scales of locally dominant structures over space and time.

READ FULL TEXT

page 14

page 15

page 20

page 25

page 26

page 27

research
01/09/2017

Temporal scale selection in time-causal scale space

When designing and developing scale selection mechanisms for generating ...
research
04/10/2015

Time-causal and time-recursive spatio-temporal receptive fields

We present an improved model and theory for time-causal and time-recursi...
research
09/14/2021

A space-time multiscale method for parabolic problems

We present a space-time multiscale method for a parabolic model problem ...
research
05/29/2019

Provably scale-covariant hierarchical continuous networks based on scale-normalized differential expressions coupled in cascade

This article presents a theory for constructing continuous hierarchical ...
research
10/13/2022

Sparse in Space and Time: Audio-visual Synchronisation with Trainable Selectors

The objective of this paper is audio-visual synchronisation of general v...
research
03/16/2017

Anisotropic-Scale Junction Detection and Matching for Indoor Images

Junctions play an important role in the characterization of local geomet...

Please sign up or login with your details

Forgot password? Click here to reset