Scope2Screen: Focus+Context Techniques for Pathology Tumor Assessment in Multivariate Image Data

10/10/2021
by   Jared Jessup, et al.
9

Inspection of tissues using a light microscope is the primary method of diagnosing many diseases, notably cancer. Highly multiplexed tissue imaging builds on this foundation, enabling the collection of up to 60 channels of molecular information plus cell and tissue morphology using antibody staining. This provides unique insight into disease biology and promises to help with the design of patient-specific therapies. However, a substantial gap remains with respect to visualizing the resulting multivariate image data and effectively supporting pathology workflows in digital environments on screen. We, therefore, developed Scope2Screen, a scalable software system for focus+context exploration and annotation of whole-slide, high-plex, tissue images. Our approach scales to analyzing 100GB images of 10^9 or more pixels per channel, containing millions of cells. A multidisciplinary team of visualization experts, microscopists, and pathologists identified key image exploration and annotation tasks involving finding, magnifying, quantifying, and organizing ROIs in an intuitive and cohesive manner. Building on a scope2screen metaphor, we present interactive lensing techniques that operate at single-cell and tissue levels. Lenses are equipped with task-specific functionality and descriptive statistics, making it possible to analyze image features, cell types, and spatial arrangements (neighborhoods) across image channels and scales. A fast sliding-window search guides users to regions similar to those under the lens; these regions can be analyzed and considered either separately or as part of a larger image collection. A novel snapshot method enables linked lens configurations and image statistics to be saved, restored, and shared. We validate our designs with domain experts and apply Scope2Screen in two case studies involving lung and colorectal cancers to discover cancer-relevant image features.

READ FULL TEXT

page 1

page 3

page 4

page 5

page 6

page 7

page 8

page 9

research
02/22/2021

Hierarchical Cell-to-Tissue Graph Representations for Breast Cancer Subtyping in Digital Pathology

Cancer diagnosis and prognosis for a tissue specimen are heavily influen...
research
07/18/2020

Automated Phenotyping via Cell Auto Training (CAT) on the Cell DIVE Platform

We present a method for automatic cell classification in tissue samples ...
research
06/09/2020

Visual cohort comparison for spatial single-cell omics-data

Spatially-resolved omics-data enable researchers to precisely distinguis...
research
02/14/2022

A Pragmatic Machine Learning Approach to Quantify Tumor Infiltrating Lymphocytes in Whole Slide Images

Increased levels of tumor infiltrating lymphocytes (TILs) in cancer tiss...
research
05/04/2022

Self-supervised learning unveils morphological clusters behind lung cancer types and prognosis

Histopathological images of tumors contain abundant information about ho...
research
07/08/2014

Visualization and Correction of Automated Segmentation, Tracking and Lineaging from 5-D Stem Cell Image Sequences

Results: We present an application that enables the quantitative analysi...

Please sign up or login with your details

Forgot password? Click here to reset