Towards Highly Expressive Machine Learning Models of Non-Melanoma Skin Cancer

07/09/2022
by   Simon M. Thomas, et al.
0

Pathologists have a rich vocabulary with which they can describe all the nuances of cellular morphology. In their world, there is a natural pairing of images and words. Recent advances demonstrate that machine learning models can now be trained to learn high-quality image features and represent them as discrete units of information. This enables natural language, which is also discrete, to be jointly modelled alongside the imaging, resulting in a description of the contents of the imaging. Here we present experiments in applying discrete modelling techniques to the problem domain of non-melanoma skin cancer, specifically, histological images of Intraepidermal Carcinoma (IEC). Implementing a VQ-GAN model to reconstruct high-resolution (256x256) images of IEC images, we trained a sequence-to-sequence transformer to generate natural language descriptions using pathologist terminology. Combined with the idea of interactive concept vectors available by using continuous generative methods, we demonstrate an additional angle of interpretability. The result is a promising means of working towards highly expressive machine learning systems which are not only useful as predictive/classification tools, but also means to further our scientific understanding of disease.

READ FULL TEXT

page 11

page 13

page 15

page 20

page 21

page 22

page 28

page 29

research
10/29/2019

Estimating Skin Tone and Effects on Classification Performance in Dermatology Datasets

Recent advances in computer vision and deep learning have led to breakth...
research
10/23/2021

Benchmarking of Lightweight Deep Learning Architectures for Skin Cancer Classification using ISIC 2017 Dataset

Skin cancer is one of the deadly types of cancer and is common in the wo...
research
09/05/2022

Representation Learning for Non-Melanoma Skin Cancer using a Latent Autoencoder

Generative learning is a powerful tool for representation learning, and ...
research
08/07/2018

Capturing global spatial context for accurate cell classification in skin cancer histology

The spectacular response observed in clinical trials of immunotherapy in...
research
12/06/2019

Recent advances in deep learning applied to skin cancer detection

Skin cancer is a major public health problem around the world. Its early...
research
09/07/2022

Morphology-preserving Autoregressive 3D Generative Modelling of the Brain

Human anatomy, morphology, and associated diseases can be studied using ...
research
03/22/2021

Fixes That Fail: Self-Defeating Improvements in Machine-Learning Systems

Machine-learning systems such as self-driving cars or virtual assistants...

Please sign up or login with your details

Forgot password? Click here to reset