LiveSeg: Unsupervised Multimodal Temporal Segmentation of Long Livestream Videos

10/12/2022
by   Jielin Qiu, et al.
0

Livestream videos have become a significant part of online learning, where design, digital marketing, creative painting, and other skills are taught by experienced experts in the sessions, making them valuable materials. However, Livestream tutorial videos are usually hours long, recorded, and uploaded to the Internet directly after the live sessions, making it hard for other people to catch up quickly. An outline will be a beneficial solution, which requires the video to be temporally segmented according to topics. In this work, we introduced a large Livestream video dataset named MultiLive, and formulated the temporal segmentation of the long Livestream videos (TSLLV) task. We propose LiveSeg, an unsupervised Livestream video temporal Segmentation solution, which takes advantage of multimodal features from different domains. Our method achieved a 16.8% F1-score performance improvement compared with the state-of-the-art method.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/09/2022

Efficient Search of Live-Coding Screencasts from Online Videos

Programming videos on the Internet are valuable resources for learning p...
research
08/22/2023

MEGA: Multimodal Alignment Aggregation and Distillation For Cinematic Video Segmentation

Previous research has studied the task of segmenting cinematic videos in...
research
11/30/2022

Rethinking Causality-driven Robot Tool Segmentation with Temporal Constraints

Purpose: Vision-based robot tool segmentation plays a fundamental role i...
research
09/20/2023

Revisiting Kernel Temporal Segmentation as an Adaptive Tokenizer for Long-form Video Understanding

While most modern video understanding models operate on short-range clip...
research
08/24/2022

Visual Subtitle Feature Enhanced Video Outline Generation

With the tremendously increasing number of videos, there is a great dema...
research
10/17/2021

Temporally stable video segmentation without video annotations

Temporally consistent dense video annotations are scarce and hard to col...
research
10/29/2022

Unsupervised Audio-Visual Lecture Segmentation

Over the last decade, online lecture videos have become increasingly pop...

Please sign up or login with your details

Forgot password? Click here to reset