Affinity LCFCN: Learning to Segment Fish with Weak Supervision

11/06/2020
by   Issam Laradji, et al.
16

Aquaculture industries rely on the availability of accurate fish body measurements, e.g., length, width and mass. Manual methods that rely on physical tools like rulers are time and labour intensive. Leading automatic approaches rely on fully-supervised segmentation models to acquire these measurements but these require collecting per-pixel labels – also time consuming and laborious: i.e., it can take up to two minutes per fish to generate accurate segmentation labels, almost always requiring at least some manual intervention. We propose an automatic segmentation model efficiently trained on images labeled with only point-level supervision, where each fish is annotated with a single click. This labeling process requires significantly less manual intervention, averaging roughly one second per fish. Our approach uses a fully convolutional neural network with one branch that outputs per-pixel scores and another that outputs an affinity matrix. We aggregate these two outputs using a random walk to obtain the final, refined per-pixel segmentation output. We train the entire model end-to-end with an LCFCN loss, resulting in our A-LCFCN method. We validate our model on the DeepFish dataset, which contains many fish habitats from the north-eastern Australian region. Our experimental results confirm that A-LCFCN outperforms a fully-supervised segmentation model at fixed annotation budget. Moreover, we show that A-LCFCN achieves better segmentation results than LCFCN and a standard baseline. We have released the code at <https://github.com/IssamLaradji/affinity_lcfcn>.

READ FULL TEXT

page 1

page 3

page 5

page 7

10/14/2021

Multi-Layer Pseudo-Supervision for Histopathology Tissue Semantic Segmentation using Patch-level Classification Labels

Tissue-level semantic segmentation is a vital step in computational path...
03/28/2018

Learning Pixel-level Semantic Affinity with Image-level Supervision for Weakly Supervised Semantic Segmentation

The deficiency of segmentation labels is one of the main obstacles to se...
05/07/2022

Automatic segmentation of meniscus based on MAE self-supervision and point-line weak supervision paradigm

Medical image segmentation based on deep learning is often faced with th...
04/15/2020

Analysis of Scoliosis From Spinal X-Ray Images

Scoliosis is a congenital disease in which the spine is deformed from it...
06/06/2015

What's the Point: Semantic Segmentation with Point Supervision

The semantic image segmentation task presents a trade-off between test t...

Please sign up or login with your details

Forgot password? Click here to reset