Fluid Annotation: a human-machine collaboration interface for full image annotation

06/20/2018
by   Mykhaylo Andriluka, et al.
2

We introduce Fluid Annotation, an intuitive human-machine collaboration interface for annotating the class label and outline of every object and background region in an image. Fluid Annotation starts from the output of a strong neural network model, which the annotator can edit by correcting the labels of existing regions, adding new regions to cover missing objects, and removing incorrect regions. Fluid annotation has several attractive properties: (a) it is very efficient in terms of human annotation time; (b) it supports full images annotation in a single pass, as opposed to performing a series of small tasks in isolation, such as indicating the presence of objects, clicking on instances, or segmenting a single object known to be present. Fluid Annotation subsumes all these tasks in one unified interface. (c) it empowers the annotator to choose what to annotate and in which order. This enables to put human effort only on the errors the machine made, which helps using the annotation budget effectively. Through extensive experiments on the COCO+Stuff dataset, we demonstrate that Fluid Annotation leads to accurate annotations very efficiently, taking three times less annotation time than the popular LabelMe interface.

READ FULL TEXT

page 1

page 3

page 4

page 8

research
12/05/2018

Interactive Full Image Segmentation

We address the task of interactive full image annotation, where the goal...
research
10/05/2020

OLALA: Object-Level Active Learning Based Layout Annotation

In layout object detection problems, the ground-truth datasets are const...
research
10/02/2020

HUMAN: Hierarchical Universal Modular ANnotator

A lot of real-world phenomena are complex and cannot be captured by sing...
research
09/04/2015

Semantic Amodal Segmentation

Common visual recognition tasks such as classification, object detection...
research
09/08/2016

Ashwin: Plug-and-Play System for Machine-Human Image Annotation

We present an end-to-end machine-human image annotation system where eac...
research
03/30/2023

Neglected Free Lunch – Learning Image Classifiers Using Annotation Byproducts

Supervised learning of image classifiers distills human knowledge into a...
research
08/25/2018

MADARi: A Web Interface for Joint Arabic Morphological Annotation and Spelling Correction

In this paper, we introduce MADARi, a joint morphological annotation and...

Please sign up or login with your details

Forgot password? Click here to reset