PHD-GIFs: Personalized Highlight Detection for Automatic GIF Creation

04/18/2018
by   Ana García del Molino, et al.
0

Highlight detection models are typically trained to identify cues that make visual content appealing or interesting for the general public, with the objective of reducing a video to such moments. However, the "interestingness" of a video segment or image is subjective. Thus, such highlight models provide results of limited relevance for the individual user. On the other hand, training one model per user is inefficient and requires large amounts of personal information which is typically not available. To overcome these limitations, we present a global ranking model which conditions on each particular user's interests. Rather than training one model per user, our model is personalized via its inputs, which allows it to effectively adapt its predictions, given only a few user-specific examples. To train this model, we create a large-scale dataset of users and the GIFs they created, giving us an accurate indication of their interests. Our experiments show that using the user history substantially improves the prediction accuracy. On our test set of 850 videos, our model improves the recall by 8 highlight detectors. Furthermore, our method proves more precise than the user-agnostic baselines even with just one person-specific example.

READ FULL TEXT

page 1

page 3

page 6

research
07/19/2020

Adaptive Video Highlight Detection by Learning from User History

Recently, there is an increasing interest in highlight detection researc...
research
09/04/2021

PR-Net: Preference Reasoning for Personalized Video Highlight Detection

Personalized video highlight detection aims to shorten a long video to i...
research
03/03/2019

Less is More: Learning Highlight Detection from Video Duration

Highlight detection has the potential to significantly ease video browsi...
research
05/24/2020

Learning to Transfer Graph Embeddings for Inductive Graph based Recommendation

With the increasing availability of videos, how to edit them and present...
research
02/18/2021

Multi-Interest-Aware User Modeling for Large-Scale Sequential Recommendations

Precise user modeling is critical for online personalized recommendation...
research
02/11/2021

Audiovisual Highlight Detection in Videos

In this paper, we test the hypothesis that interesting events in unstruc...
research
03/02/2021

The Personalization Paradox: the Conflict between Accurate User Models and Personalized Adaptive Systems

Personalized adaptation technology has been adopted in a wide range of d...

Please sign up or login with your details

Forgot password? Click here to reset