Neural Implicit Event Generator for Motion Tracking

11/06/2021
by   Mana Masuda, et al.
0

We present a novel framework of motion tracking from event data using implicit expression. Our framework use pre-trained event generation MLP named implicit event generator (IEG) and does motion tracking by updating its state (position and velocity) based on the difference between the observed event and generated event from the current state estimate. The difference is computed implicitly by the IEG. Unlike the conventional explicit approach, which requires dense computation to evaluate the difference, our implicit approach realizes efficient state update directly from sparse event data. Our sparse algorithm is especially suitable for mobile robotics applications where computational resources and battery life are limited. To verify the effectiveness of our method on real-world data, we applied it to the AR marker tracking application. We have confirmed that our framework works well in real-world environments in the presence of noise and background clutter.

READ FULL TEXT

page 1

page 4

page 5

research
04/07/2023

Event-based Camera Tracker by ∇t NeRF

When a camera travels across a 3D world, only a fraction of pixel value ...
research
03/12/2018

Event-based Moving Object Detection and Tracking

Event-based vision sensors, such as the Dynamic Vision Sensor (DVS), are...
research
05/24/2021

luvHarris: A Practical Corner Detector for Event-cameras

There have been a number of corner detection methods proposed for event ...
research
02/28/2023

Tracking Fast by Learning Slow: An Event-based Speed Adaptive Hand Tracker Leveraging Knowledge in RGB Domain

3D hand tracking methods based on monocular RGB videos are easily affect...
research
09/28/2021

Motion Deblurring with Real Events

In this paper, we propose an end-to-end learning framework for event-bas...
research
11/19/2018

Event-Based Features Selection and Tracking from Intertwined Estimation of Velocity and Generative Contours

This paper presents a new event-based method for detecting and tracking ...
research
01/15/2019

Parameter Estimation in Abruptly Changing Dynamic Environments

Many real-life dynamical systems change abruptly followed by almost stat...

Please sign up or login with your details

Forgot password? Click here to reset