Multi-Modal Video Forensic Platform for Investigating Post-Terrorist Attack Scenarios

04/02/2020
by   Alexander Schindler, et al.
0

The forensic investigation of a terrorist attack poses a significant challenge to the investigative authorities, as often several thousand hours of video footage must be viewed. Large scale Video Analytic Platforms (VAP) assist law enforcement agencies (LEA) in identifying suspects and securing evidence. Current platforms focus primarily on the integration of different computer vision methods and thus are restricted to a single modality. We present a video analytic platform that integrates visual and audio analytic modules and fuses information from surveillance cameras and video uploads from eyewitnesses. Videos are analyzed according their acoustic and visual content. Specifically, Audio Event Detection is applied to index the content according to attack-specific acoustic concepts. Audio similarity search is utilized to identify similar video sequences recorded from different perspectives. Visual object detection and tracking are used to index the content according to relevant concepts. Innovative user-interface concepts are introduced to harness the full potential of the heterogeneous results of the analytical modules, allowing investigators to more quickly follow-up on leads and eyewitness reports.

READ FULL TEXT

page 2

page 3

research
11/28/2018

Large Scale Audio-Visual Video Analytics Platform for Forensic Investigations of Terroristic Attacks

The forensic investigation of a terrorist attack poses a huge challenge ...
research
01/11/2019

Analyzing Periodicity and Saliency for Adult Video Detection

Content-based adult video detection plays an important role in preventin...
research
06/05/2023

Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding

We present Video-LLaMA, a multi-modal framework that empowers Large Lang...
research
05/06/2023

HateMM: A Multi-Modal Dataset for Hate Video Classification

Hate speech has become one of the most significant issues in modern soci...
research
09/07/2018

Synesthesia: Detecting Screen Content via Remote Acoustic Side Channels

We show that subtle acoustic noises emanating from within computer scree...
research
02/12/2022

Audio-Visual Fusion Layers for Event Type Aware Video Recognition

Human brain is continuously inundated with the multisensory information ...
research
09/21/2021

VPN: Video Provenance Network for Robust Content Attribution

We present VPN - a content attribution method for recovering provenance ...

Please sign up or login with your details

Forgot password? Click here to reset