A Robust Framework of Chromosome Straightening with ViT-Patch GAN

03/06/2022
by   Sifan Song, et al.
0

Chromosomes exhibit non-rigid and non-articulated nature with varying degrees of curvature. Chromosome straightening is an essential step for subsequent karyotype construction, pathological diagnosis and cytogenetic map development. However, robust chromosome straightening remains challenging, due to the unavailability of training images, distorted chromosome details and shapes after straightening, as well as poor generalization capability. We propose a novel architecture, ViT-Patch GAN, consisting of a motion transformation generator and a Vision Transformer-based patch (ViT-Patch) discriminator. The generator learns the motion representation of chromosomes for straightening. With the help of the ViT-Patch discriminator, the straightened chromosomes retain more shape and banding pattern details. The proposed framework is trained on a small dataset and is able to straighten chromosome images with state-of-the-art performance for two large datasets.

READ FULL TEXT

page 2

page 4

page 5

research
03/26/2023

Sector Patch Embedding: An Embedding Module Conforming to The Distortion Pattern of Fisheye Image

Fisheye cameras suffer from image distortion while having a large field ...
research
04/28/2020

Robust Generative Adversarial Network

Generative adversarial networks (GANs) are powerful generative models, b...
research
05/14/2019

An Improved Self-supervised GAN via Adversarial Training

We propose to improve unconditional Generative Adversarial Networks (GAN...
research
08/16/2019

Tag2Pix: Line Art Colorization Using Text Tag With SECat and Changing Loss

Line art colorization is expensive and challenging to automate. A GAN ap...
research
05/27/2019

Object Discovery with a Copy-Pasting GAN

We tackle the problem of object discovery, where objects are segmented f...
research
10/03/2022

One-shot Detail Retouching with Patch Space Neural Field based Transformation Blending

Photo retouching is a difficult task for novice users as it requires exp...
research
12/22/2022

S-patch: Modification of the Hermite parametric patch

A new modification of the Hermite cubic rectangular patch is proposed: t...

Please sign up or login with your details

Forgot password? Click here to reset