Imitation-Based Active Camera Control with Deep Convolutional Neural Network

12/11/2020
by   Christos Kyrkou, et al.
4

The increasing need for automated visual monitoring and control for applications such as smart camera surveillance, traffic monitoring, and intelligent environments, necessitates the improvement of methods for visual active monitoring. Traditionally, the active monitoring task has been handled through a pipeline of modules such as detection, filtering, and control. In this paper we frame active visual monitoring as an imitation learning problem to be solved in a supervised manner using deep learning, to go directly from visual information to camera movement in order to provide a satisfactory solution by combining computer vision and control. A deep convolutional neural network is trained end-to-end as the camera controller that learns the entire processing pipeline needed to control a camera to follow multiple targets and also estimate their density from a single image. Experimental results indicate that the proposed solution is robust to varying conditions and is able to achieve better monitoring performance both in terms of number of targets monitored as well as in monitoring time than traditional approaches, while reaching up to 25 FPS. Thus making it a practical and affordable solution for multi-target active monitoring in surveillance and smart-environment applications.

READ FULL TEXT

page 2

page 4

page 8

page 9

research
07/28/2021

C^3Net: End-to-End deep learning for efficient real-time visual active camera control

The need for automated real-time visual systems in applications such as ...
research
07/03/2022

Traffic-Net: 3D Traffic Monitoring Using a Single CameraTraffic-Net: 3D Traffic Monitoring Using a Single Camera

Computer Vision has played a major role in Intelligent Transportation Sy...
research
12/14/2018

Imitation Learning for End to End Vehicle Longitudinal Control with Forward Camera

In this paper we present a complete study of an end-to-end imitation lea...
research
12/03/2020

LookOut! Interactive Camera Gimbal Controller for Filming Long Takes

The job of a camera operator is more challenging, and potentially danger...
research
09/19/2012

Decision-Theoretic Coordination and Control for Active Multi-Camera Surveillance in Uncertain, Partially Observable Environments

A central problem of surveillance is to monitor multiple targets moving ...
research
05/14/2023

Optimizing Forest Fire Prevention: Intelligent Scheduling Algorithms for Drone-Based Surveillance System

Given the importance of forests and their role in maintaining the ecolog...

Please sign up or login with your details

Forgot password? Click here to reset