Multi-view data capture using edge-synchronised mobiles

05/07/2020
by   Matteo Bortolon, et al.
0

Multi-view data capture permits free-viewpoint video (FVV) content creation. To this end, several users must capture video streams, calibrated in both time and pose, framing the same object/scene, from different viewpoints. New-generation network architectures (e.g. 5G) promise lower latency and larger bandwidth connections supported by powerful edge computing, properties that seem ideal for reliable FVV capture. We have explored this possibility, aiming to remove the need for bespoke synchronisation hardware when capturing a scene from multiple viewpoints, making it possible through off-the-shelf mobiles. We propose a novel and scalable data capture architecture that exploits edge resources to synchronise and harvest frame captures. We have designed an edge computing unit that supervises the relaying of timing triggers to and from multiple mobiles, in addition to synchronising frame harvesting. We empirically show the benefits of our edge computing unit by analysing latencies and show the quality of 3D reconstruction outputs against an alternative and popular centralised solution based on Unity3D.

READ FULL TEXT

page 2

page 7

research
09/07/2021

Smart Traffic Monitoring System using Computer Vision and Edge Computing

Traffic management systems capture tremendous video data and leverage ad...
research
06/23/2021

Revisiting the Arguments for Edge Computing Research

This article argues that low latency, high bandwidth, device proliferati...
research
11/12/2021

Serverless Platforms on the Edge: A Performance Analysis

The exponential growth of Internet of Things (IoT) has given rise to a n...
research
06/12/2018

Opportunistic Edge Computing: Concepts, Opportunities and Research Challenges

The growing need for low-latency access to computing resources has motiv...
research
03/22/2018

To Edge or Not to Edge?

Edge computing caters to a wide range of use cases from latency sensitiv...
research
04/04/2023

End-to-End Latency Optimization of Multi-view 3D Reconstruction for Disaster Response

In order to plan rapid response during disasters, first responder agenci...
research
07/17/2020

Klessydra-T: Designing Vector Coprocessors for Multi-Threaded Edge-Computing Cores

Convolutional computation kernels are fundamental to today's edge comput...

Please sign up or login with your details

Forgot password? Click here to reset