LesionAid: Vision Transformers-based Skin Lesion Generation and Classification

02/02/2023
by   Ghanta Sai Krishna, et al.
0

Skin cancer is one of the most prevalent forms of human cancer. It is recognized mainly visually, beginning with clinical screening and continuing with the dermoscopic examination, histological assessment, and specimen collection. Deep convolutional neural networks (CNNs) perform highly segregated and potentially universal tasks against a classified finegrained object. This research proposes a novel multi-class prediction framework that classifies skin lesions based on ViT and ViTGAN. Vision transformers-based GANs (Generative Adversarial Networks) are utilized to tackle the class imbalance. The framework consists of four main phases: ViTGANs, Image processing, and explainable AI. Phase 1 consists of generating synthetic images to balance all the classes in the dataset. Phase 2 consists of applying different data augmentation techniques and morphological operations to increase the size of the data. Phases 3 4 involve developing a ViT model for edge computing systems that can identify patterns and categorize skin lesions from the user's skin visible in the image. In phase 3, after classifying the lesions into the desired class with ViT, we will use explainable AI (XAI) that leads to more explainable results (using activation maps, etc.) while ensuring high predictive accuracy. Real-time images of skin diseases can capture by a doctor or a patient using the camera of a mobile application to perform an early examination and determine the cause of the skin lesion. The whole framework is compared with the existing frameworks for skin lesion detection.

READ FULL TEXT

page 3

page 5

page 8

page 10

page 12

research
02/08/2019

Skin Lesion Synthesis with Generative Adversarial Networks

Skin cancer is by far the most common type of cancer. Early detection is...
research
05/14/2022

Monitoring of Pigmented Skin Lesions Using 3D Whole Body Imaging

Modern data-driven machine learning research that enables revolutionary ...
research
05/21/2022

Visualizing CoAtNet Predictions for Aiding Melanoma Detection

Melanoma is considered to be the most aggressive form of skin cancer. Du...
research
07/27/2018

Region of Interest Detection in Dermoscopic Images for Natural Data-augmentation

With the rapid growth of medical imaging research, there is a great inte...
research
09/28/2020

AI Progress in Skin Lesion Analysis

We examine progress in the use of AI for detecting skin lesions, with pa...
research
02/02/2021

Single Model Deep Learning on Imbalanced Small Datasets for Skin Lesion Classification

Deep convolutional neural network (DCNN) models have been widely explore...
research
04/25/2020

CS-AF: A Cost-sensitive Multi-classifier Active Fusion Framework for Skin Lesion Classification

Convolutional neural networks (CNNs) have achieved the state-of-the-art ...

Please sign up or login with your details

Forgot password? Click here to reset