Semi-supervised estimation of event temporal length for cell event detection

09/22/2019
by   Ha Tran Hong Phan, et al.
0

Cell event detection in cell videos is essential for monitoring of cellular behavior over extended time periods. Deep learning methods have shown great success in the detection of cell events for their ability to capture more discriminative features of cellular processes compared to traditional methods. In particular, convolutional long short-term memory (LSTM) models, which exploits the changes in cell events observable in video sequences, is the state-of-the-art for mitosis detection in cell videos. However, their limitations are the determination of the input sequence length, which is often performed empirically, and the need for a large annotated training dataset which is expensive to prepare. We propose a novel semi-supervised method of optimal length detection for mitosis detection with two key contributions: (i) an unsupervised step for learning the spatial and temporal locations of cells in their normal stage and approximating the distribution of temporal lengths of cell events and, (ii) a step of inferring, from that distribution, an optimal input sequence length and a minimal number of annotated frames for training a LSTM model for each particular video. We evaluated our method in detecting mitosis in densely packed stem cells in a phase-contrast microscopy videos. Our experimental data prove that increasing the input sequence length of LSTM can lead to a decrease in performance. Our results also show that by approximating the optimal input sequence length of the tested video, a model trained with only 18 annotated frames achieved F1-scores of 0.880-0.907, which are 10 higher than those of other published methods with a full set of 110 training annotated frames.

READ FULL TEXT

page 12

page 13

research
09/07/2017

An unsupervised long short-term memory neural network for event detection in cell videos

We propose an automatic unsupervised cell event detection and classifica...
research
05/31/2021

STEP: Spatial-Temporal Network Security Event Prediction

Network security events prediction helps network operators to take respo...
research
04/27/2020

Spatial-Temporal Mitosis Detection in Phase-Contrast Microscopy via Likelihood Map Estimation by 3DCNN

Automated mitotic detection in time-lapse phasecontrast microscopy provi...
research
11/28/2020

Movement Tracks for the Automatic Detection of Fish Behavior in Videos

Global warming is predicted to profoundly impact ocean ecosystems. Fish ...
research
06/04/2018

A Cascade of 2.5D CNN and LSTM Network for Mitotic Cell Detection in 4D Microscopy Image

In recent years, intravital skin imaging has been used in mammalian skin...
research
12/16/2021

Search for temporal cell segmentation robustness in phase-contrast microscopy videos

Studying cell morphology changes in time is critical to understanding ce...
research
03/16/2019

Ontology Based Global and Collective Motion Patterns for Event Classification in Basketball Videos

In multi-person videos, especially team sport videos, a semantic event i...

Please sign up or login with your details

Forgot password? Click here to reset