Image segmentation via Cellular Automata

08/11/2020
by   Mark Sandler, et al.
28

In this paper, we propose a new approach for building cellular automata to solve real-world segmentation problems. We design and train a cellular automaton that can successfully segment high-resolution images. We consider a colony that densely inhabits the pixel grid, and all cells are governed by a randomized update that uses the current state, the color, and the state of the 3× 3 neighborhood. The space of possible rules is defined by a small neural network. The update rule is applied repeatedly in parallel to a large random subset of cells and after convergence is used to produce segmentation masks that are then back-propagated to learn the optimal update rules using standard gradient descent methods. We demonstrate that such models can be learned efficiently with only limited trajectory length and that they show remarkable ability to organize the information to produce a globally consistent segmentation result, using only local information exchange. From a practical perspective, our approach allows us to build very efficient models – our smallest automaton uses less than 10,000 parameters to solve complex segmentation tasks.

READ FULL TEXT

page 8

page 10

page 21

page 25

research
09/22/2014

Neighborhood Selection and Rules Identification for Cellular Automata: A Rough Sets Approach

In this paper a method is proposed which uses data mining techniques bas...
research
02/07/2023

Med-NCA: Robust and Lightweight Segmentation with Neural Cellular Automata

Access to the proper infrastructure is critical when performing medical ...
research
01/23/2015

Unsupervised Segmentation of Multispectral Images with Cellular Automata

Multispectral images acquired by satellites are used to study phenomena ...
research
02/13/2011

Guaranteeing Convergence of Iterative Skewed Voting Algorithms for Image Segmentation

In this paper we provide rigorous proof for the convergence of an iterat...
research
05/03/2022

Growing Isotropic Neural Cellular Automata

Modeling the ability of multicellular organisms to build and maintain th...
research
03/06/2021

Learning to Generate 3D Shapes with Generative Cellular Automata

We present a probabilistic 3D generative model, named Generative Cellula...
research
11/26/2021

μNCA: Texture Generation with Ultra-Compact Neural Cellular Automata

We study the problem of example-based procedural texture synthesis using...

Please sign up or login with your details

Forgot password? Click here to reset