EgoCap: Egocentric Marker-less Motion Capture with Two Fisheye Cameras (Extended Abstract)

12/31/2016
by   Helge Rhodin, et al.
0

Marker-based and marker-less optical skeletal motion-capture methods use an outside-in arrangement of cameras placed around a scene, with viewpoints converging on the center. They often create discomfort by possibly needed marker suits, and their recording volume is severely restricted and often constrained to indoor scenes with controlled backgrounds. We therefore propose a new method for real-time, marker-less and egocentric motion capture which estimates the full-body skeleton pose from a lightweight stereo pair of fisheye cameras that are attached to a helmet or virtual-reality headset. It combines the strength of a new generative pose estimation framework for fisheye views with a ConvNet-based body-part detector trained on a new automatically annotated and augmented dataset. Our inside-in method captures full-body motion in general indoor and outdoor scenes, and also crowded scenes.

READ FULL TEXT
research
09/23/2016

EgoCap: Egocentric Marker-less Motion Capture with Two Fisheye Cameras

Marker-based and marker-less optical skeletal motion-capture methods use...
research
08/30/2019

Motion Capture from Pan-Tilt Cameras with Unknown Orientation

In sports, such as alpine skiing, coaches would like to know the speed a...
research
08/12/2023

EgoPoser: Robust Real-Time Ego-Body Pose Estimation in Large Scenes

Full-body ego-pose estimation from head and hand poses alone has become ...
research
05/25/2016

Real-Time Human Motion Capture with Multiple Depth Cameras

Commonly used human motion capture systems require intrusive attachment ...
research
07/28/2016

General Automatic Human Shape and Motion Capture Using Volumetric Contour Cues

Markerless motion capture algorithms require a 3D body with properly per...
research
06/10/2023

3D reconstruction using Structure for Motion

We are working towards 3D reconstruction of indoor spaces using a pair o...

Please sign up or login with your details

Forgot password? Click here to reset