DeepAI AI Chat
Log In Sign Up

Frequency Cam: Imaging Periodic Signals in Real-Time

by   Bernd Pfrommer, et al.

Due to their high temporal resolution and large dynamic range event cameras are uniquely suited for the analysis of time-periodic signals in an image. In this work we present an efficient and fully asynchronous event camera algorithm for detecting the fundamental frequency at which image pixels flicker. The algorithm employs a second-order digital infinite impulse response (IIR) filter to perform an approximate per-pixel brightness reconstruction and is more robust to high-frequency noise than the baseline method we compare to. We further demonstrate that using the falling edge of the signal leads to more accurate period estimates than the rising edge, and that for certain signals interpolating the zero-level crossings can further increase accuracy. Our experiments find that the outstanding capabilities of the camera in detecting frequencies up to 64kHz for a single pixel do not carry over to full sensor imaging as readout bandwidth limitations become a serious obstacle. This suggests that a hardware implementation closer to the sensor will allow for greatly improved frequency imaging. We discuss the important design parameters for fullsensor frequency imaging and present Frequency Cam, an open-source implementation as a ROS node that can run on a single core of a laptop CPU at more than 50 million events per second. It produces results that are qualitatively very similar to those obtained from the closed source vibration analysis module in Prophesee's Metavision Toolkit. The code for Frequency Cam and a demonstration video can be found at


page 2

page 12


An asynchronous event-based algorithm for periodic signals

In this paper, we present a simple event-oriented algorithm for detectio...

Continuous-time Intensity Estimation Using Event Cameras

Event cameras provide asynchronous, data-driven measurements of local te...

High Frequency, High Accuracy Pointing onboard Nanosats using Neuromorphic Event Sensing and Piezoelectric Actuation

As satellites become smaller, the ability to maintain stable pointing de...

Count-Free Single-Photon 3D Imaging with Race Logic

Single-photon cameras (SPCs) have emerged as a promising technology for ...

Edge Detection for Event Cameras using Intra-pixel-area Events

In this work, we propose an edge detection algorithm by estimating a lif...

Within-Camera Multilayer Perceptron DVS Denoising

In-camera event denoising reduces the data rate of event cameras by filt...

Lensless Photography with only an image sensor

Photography usually requires optics in conjunction with a recording devi...

Code Repositories


frequency cam: detecting and visualizing frequencies with an event based camera

view repo