Self-Attentive Hawkes Processes

07/17/2019
by   Qiang Zhang, et al.
0

Asynchronous events on the continuous time domain, e.g., social media actions and stock transactions, occur frequently in the world. The ability to recognize occurrence patterns of event sequences is crucial to predict which typeof events will happen next and when. A de facto standard mathematical framework to do this is the Hawkes process. In order to enhance expressivity of multivariate Hawkes processes, conventional statistical methods and deep recurrent networks have been employed to modify its intensity function. The former is highly interpretable and requires small size of training data but relies on correct model design while the latter has less dependency on prior knowledge and is more powerful in capturing complicated patterns. We leverage pros and cons of these models and propose a self-attentive Hawkes process(SAHP). The proposed method adapts self-attention to fit the intensity function of Hawkes processes. This design has two benefits:(1) compared with conventional statistical methods, the SAHP is more powerful to identify complicated dependency relationships between temporal events; (2)compared with deep recurrent networks, the self-attention mechanism is able to capture longer historical information, and is more interpretable because the learnt attention weight tensor shows contributions of each historical event. Experiments on four real-world datasets demonstrate the effectiveness of the proposed method.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/17/2020

Deep Attention Spatio-Temporal Point Processes

We present a novel attention-based sequential model for mutually depende...
research
08/21/2017

A Tutorial on Hawkes Processes for Events in Social Media

This chapter provides an accessible introduction for point processes, an...
research
11/28/2019

Self-attention with Functional Time Representation Learning

Sequential modelling with self-attention has achieved cutting edge perfo...
research
09/15/2019

Temporal Self-Attention Network for Medical Concept Embedding

In longitudinal electronic health records (EHRs), the event records of a...
research
10/01/2022

HyperHawkes: Hypernetwork based Neural Temporal Point Process

Temporal point process serves as an essential tool for modeling time-to-...
research
05/28/2023

Short-term Temporal Dependency Detection under Heterogeneous Event Dynamic with Hawkes Processes

Many event sequence data exhibit mutually exciting or inhibiting pattern...
research
12/29/2021

Temporal Attention Augmented Transformer Hawkes Process

In recent years, mining the knowledge from asynchronous sequences by Haw...

Please sign up or login with your details

Forgot password? Click here to reset