Argus++: Robust Real-time Activity Detection for Unconstrained Video Streams with Overlapping Cube Proposals

01/14/2022
by   Lijun Yu, et al.
0

Activity detection is one of the attractive computer vision tasks to exploit the video streams captured by widely installed cameras. Although achieving impressive performance, conventional activity detection algorithms are usually designed under certain constraints, such as using trimmed and/or object-centered video clips as inputs. Therefore, they failed to deal with the multi-scale multi-instance cases in real-world unconstrained video streams, which are untrimmed and have large field-of-views. Real-time requirements for streaming analysis also mark brute force expansion of them unfeasible. To overcome these issues, we propose Argus++, a robust real-time activity detection system for analyzing unconstrained video streams. The design of Argus++ introduces overlapping spatio-temporal cubes as an intermediate concept of activity proposals to ensure coverage and completeness of activity detection through over-sampling. The overall system is optimized for real-time processing on standalone consumer-level hardware. Extensive experiments on different surveillance and driving scenarios demonstrated its superior performance in a series of activity detection benchmarks, including CVPR ActivityNet ActEV 2021, NIST ActEV SDL UF/KF, TRECVID ActEV 2020/2021, and ICCV ROAD 2021.

READ FULL TEXT
research
08/07/2018

Dynamic Temporal Pyramid Network: A Closer Look at Multi-Scale Modeling for Activity Detection

Recognizing instances at different scales simultaneously is a fundamenta...
research
03/28/2023

Real-time Multi-person Eyeblink Detection in the Wild for Untrimmed Video

Real-time eyeblink detection in the wild can widely serve for fatigue de...
research
06/24/2017

Large-Scale Mapping of Human Activity using Geo-Tagged Videos

This paper is the first work to perform spatio-temporal mapping of human...
research
04/23/2020

Gabriella: An Online System for Real-Time Activity Detection in Untrimmed Surveillance Videos

Activity detection in surveillance videos is a difficult problem due to ...
research
08/03/2016

Challenges in video based object detection in maritime scenario using computer vision

This paper discusses the technical challenges in maritime image processi...
research
08/19/2022

Real-Time Robust Video Object Detection System Against Physical-World Adversarial Attacks

DNN-based video object detection (VOD) powers autonomous driving and vid...
research
07/20/2020

Inter-Homines: Distance-Based Risk Estimation for Human Safety

In this document, we report our proposal for modeling the risk of possib...

Please sign up or login with your details

Forgot password? Click here to reset