DeepAI AI Chat
Log In Sign Up

Self-paced Learning for Weakly Supervised Evidence Discovery in Multimedia Event Search

by   Mengyi Liu, et al.
Carnegie Mellon University

Multimedia event detection has been receiving increasing attention in recent years. Besides recognizing an event, the discovery of evidences (which is refered to as "recounting") is also crucial for user to better understand the searching result. Due to the difficulty of evidence annotation, only limited supervision of event labels are available for training a recounting model. To deal with the problem, we propose a weakly supervised evidence discovery method based on self-paced learning framework, which follows a learning process from easy "evidences" to gradually more complex ones, and simultaneously exploit more and more positive evidence samples from numerous weakly annotated video segments. Moreover, to evaluate our method quantitatively, we also propose two metrics, PctOverlap and F1-score, for measuring the performance of evidence localization specifically. The experiments are conducted on a subset of TRECVID MED dataset and demonstrate the promising results obtained by our method.


page 2

page 6

page 8


CELNet: Evidence Localization for Pathology Images using Weakly Supervised Learning

Despite deep convolutional neural networks boost the performance of imag...

Temporal Label-Refinement for Weakly-Supervised Audio-Visual Event Localization

Audio-Visual Event Localization (AVEL) is the task of temporally localiz...

Weakly-Supervised Temporal Localization via Occurrence Count Learning

We propose a novel model for temporal detection and localization which a...

(Machine) Learning to Do More with Less

Determining the best method for training a machine learning algorithm is...

Cross-media Structured Common Space for Multimedia Event Extraction

We introduce a new task, MultiMedia Event Extraction (M2E2), which aims ...

Specifying nonspecific evidence

In an earlier article [J. Schubert, On nonspecific evidence, Int. J. Int...