Semantically-informed Hierarchical Event Modeling

12/20/2022
by   Shubhashis Roy Dipta, et al.
0

Prior work has shown that coupling sequential latent variable models with semantic ontological knowledge can improve the representational capabilities of event modeling approaches. In this work, we present a novel, doubly hierarchical, semi-supervised event modeling framework that provides structural hierarchy while also accounting for ontological hierarchy. Our approach consists of multiple layers of structured latent variables, where each successive layer compresses and abstracts the previous layers. We guide this compression through the injection of structured ontological knowledge that is defined at the type level of events: importantly, our model allows for partial injection of semantic knowledge and it does not depend on observing instances at any particular level of the semantic ontology. Across two different datasets and four different evaluation metrics, we demonstrate that our approach is able to out-perform the previous state-of-the-art approaches, demonstrating the benefits of structured and semantic hierarchical knowledge for event modeling.

READ FULL TEXT
research
05/24/2022

RevUp: Revise and Update Information Bottleneck for Event Representation

In machine learning, latent variables play a key role to capture the und...
research
10/09/2020

Event Representation with Sequential, Semi-Supervised Discrete Variables

Within the context of event modeling and understanding, we propose a new...
research
04/27/2019

Improved Conditional VRNNs for Video Prediction

Predicting future frames for a video sequence is a challenging generativ...
research
08/28/2018

Hierarchical Quantized Representations for Script Generation

Scripts define knowledge about how everyday scenarios (such as going to ...
research
02/27/2017

Learning Hierarchical Features from Generative Models

Deep neural networks have been shown to be very successful at learning f...
research
09/21/2013

Latent Fisher Discriminant Analysis

Linear Discriminant Analysis (LDA) is a well-known method for dimensiona...
research
12/21/2022

Automatic Semantic Modeling for Structural Data Source with the Prior Knowledge from Knowledge Base

A critical step in sharing semantic content online is to map the structu...

Please sign up or login with your details

Forgot password? Click here to reset