Semantic annotation for computational pathology: Multidisciplinary experience and best practice recommendations

06/25/2021
by   Noorul Wahab, et al.
14

Recent advances in whole slide imaging (WSI) technology have led to the development of a myriad of computer vision and artificial intelligence (AI) based diagnostic, prognostic, and predictive algorithms. Computational Pathology (CPath) offers an integrated solution to utilize information embedded in pathology WSIs beyond what we obtain through visual assessment. For automated analysis of WSIs and validation of machine learning (ML) models, annotations at the slide, tissue and cellular levels are required. The annotation of important visual constructs in pathology images is an important component of CPath projects. Improper annotations can result in algorithms which are hard to interpret and can potentially produce inaccurate and inconsistent results. Despite the crucial role of annotations in CPath projects, there are no well-defined guidelines or best practices on how annotations should be carried out. In this paper, we address this shortcoming by presenting the experience and best practices acquired during the execution of a large-scale annotation exercise involving a multidisciplinary team of pathologists, ML experts and researchers as part of the Pathology image data Lake for Analytics, Knowledge and Education (PathLAKE) consortium. We present a real-world case study along with examples of different types of annotations, diagnostic algorithm, annotation data dictionary and annotation constructs. The analyses reported in this work highlight best practice recommendations that can be used as annotation guidelines over the lifecycle of a CPath project.

READ FULL TEXT

page 3

page 5

page 7

page 14

page 17

page 27

page 31

page 42

research
09/24/2020

Best Practices for Managing Data Annotation Projects

Annotation is the labeling of data by human effort. Annotation is critic...
research
07/16/2023

Analyzing Dataset Annotation Quality Management in the Wild

Data quality is crucial for training accurate, unbiased, and trustworthy...
research
07/13/2021

BRIMA: low-overhead BRowser-only IMage Annotation tool (Preprint)

Image annotation and large annotated datasets are crucial parts within t...
research
08/04/2022

Development and Validation of ML-DQA – a Machine Learning Data Quality Assurance Framework for Healthcare

The approaches by which the machine learning and clinical research commu...
research
03/31/2023

LabelVizier: Interactive Validation and Relabeling for Technical Text Annotations

With the rapid accumulation of text data produced by data-driven techniq...
research
03/21/2022

Whose AI Dream? In search of the aspiration in data annotation

This paper present the practice of data annotation from the perspective ...
research
04/21/2020

Observations on Annotations

The annotation of textual information is a fundamental activity in Lingu...

Please sign up or login with your details

Forgot password? Click here to reset