Cross-Classification Clustering: An Efficient Multi-Object Tracking Technique for 3-D Instance Segmentation in Connectomics

by   Yaron Meirovitch, et al.

Pixel-accurate tracking of objects is a key element in many computer vision applications, often solved by iterated individual object tracking or instance segmentation followed by object matching. Here we introduce cross-classification clustering (3C), a new technique that simultaneously tracks all objects in an image stack. The key idea in cross-classification is to efficiently turn a clustering problem into a classification problem by running a logarithmic number of independent classifications, letting the cross-labeling of these classifications uniquely classify each pixel to the object labels. We apply the 3C mechanism to achieve state-of-the-art accuracy in connectomics - nanoscale mapping of the brain from electron microscopy volumes. Our reconstruction system introduces an order of magnitude scalability improvement over the best current methods for neuronal reconstruction, and can be seamlessly integrated within existing single-object tracking methods like Google's flood-filling networks to improve their performance. This scalability is crucial for the real-world deployment of connectomics pipelines, as the best performing existing techniques require computing infrastructures that are beyond the reach of most labs. We believe 3C has valuable scalability implications in other domains that require pixel-accurate tracking of multiple objects in image stacks or video.



page 1

page 2

page 4

page 5

page 7


MOTS: Multi-Object Tracking and Segmentation

This paper extends the popular task of multi-object tracking to multi-ob...

PointTrack++ for Effective Online Multi-Object Tracking and Segmentation

Multiple-object tracking and segmentation (MOTS) is a novel computer vis...

Associative Embedding: End-to-End Learning for Joint Detection and Grouping

We introduce associative embedding, a novel method for supervising convo...

Towards Annotation-free Instance Segmentation and Tracking with Adversarial Simulations

Quantitative analysis of microscope videos often requires instance segme...

Occlusion-Resistant Instance Segmentation of Piglets in Farrowing Pens Using Center Clustering Network

Computer vision enables the development of new approaches to monitor the...

Pixel personality for dense object tracking in a 2D honeybee hive

Tracking large numbers of densely-arranged, interacting objects is chall...

Bootstrapping Labelled Dataset Construction for Cow Tracking and Behavior Analysis

This paper introduces a new approach to the long-term tracking of an obj...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.