Visualizing Semantic Structures of Sequential Data by Learning Temporal Dependencies

01/20/2019
by   Kyoung-Woon On, et al.
0

While conventional methods for sequential learning focus on interaction between consecutive inputs, we suggest a new method which captures composite semantic flows with variable-length dependencies. In addition, the semantic structures within given sequential data can be interpreted by visualizing temporal dependencies learned from the method. The proposed method, called Temporal Dependency Network (TDN), represents a video as a temporal graph whose node represents a frame of the video and whose edge represents the temporal dependency between two frames of a variable distance. The temporal dependency structure of semantic is discovered by learning parameterized kernels of graph convolutional methods. We evaluate the proposed method on the large-scale video dataset, Youtube-8M. By visualizing the temporal dependency structures as experimental results, we show that the suggested method can find the temporal dependency structures of video semantic.

READ FULL TEXT
research
07/03/2019

Compositional Structure Learning for Sequential Video Data

Conventional sequential learning methods such as Recurrent Neural Networ...
research
01/17/2020

Cut-Based Graph Learning Networks to Discover Compositional Structure of Sequential Video Data

Conventional sequential learning methods such as Recurrent Neural Networ...
research
09/06/2018

YouTube-VOS: A Large-Scale Video Object Segmentation Benchmark

Learning long-term spatial-temporal features are critical for many video...
research
10/12/2021

Video Is Graph: Structured Graph Module for Video Action Recognition

In the field of action recognition, video clips are always treated as or...
research
10/25/2019

Learning to Localize Temporal Events in Large-scale Video Data

We address temporal localization of events in large-scale video data, in...
research
09/09/2019

Forecaster: A Graph Transformer for Forecasting Spatial and Time-Dependent Data

Spatial and time-dependent data is of interest in many applications. Thi...
research
11/21/2022

Neural Dependencies Emerging from Learning Massive Categories

This work presents two astonishing findings on neural networks learned f...

Please sign up or login with your details

Forgot password? Click here to reset