Joint Visual Denoising and Classification using Deep Learning

12/04/2016
by   Gang Chen, et al.
0

Visual restoration and recognition are traditionally addressed in pipeline fashion, i.e. denoising followed by classification. Instead, observing correlations between the two tasks, for example clearer image will lead to better categorization and vice visa, we propose a joint framework for visual restoration and recognition for handwritten images, inspired by advances in deep autoencoder and multi-modality learning. Our model is a 3-pathway deep architecture with a hidden-layer representation which is shared by multi-inputs and outputs, and each branch can be composed of a multi-layer deep model. Thus, visual restoration and classification can be unified using shared representation via non-linear mapping, and model parameters can be learnt via backpropagation. Using MNIST and USPS data corrupted with structured noise, the proposed framework performs at least 20% better in classification than separate pipelines, as well as clearer recovered images. The noise model and the reproducible source code is available at <https://github.com/ganggit/jointmodel>.

READ FULL TEXT

page 4

page 5

research
06/02/2022

Compound Multi-branch Feature Fusion for Real Image Restoration

Image restoration is a challenging and ill-posed problem which also has ...
research
03/26/2015

Generalized K-fan Multimodal Deep Model with Shared Representations

Multimodal learning with deep Boltzmann machines (DBMs) is an generative...
research
09/14/2021

Dynamic Attentive Graph Learning for Image Restoration

Non-local self-similarity in natural images has been verified to be an e...
research
06/08/2020

Neural Sparse Representation for Image Restoration

Inspired by the robustness and efficiency of sparse representation in sp...
research
07/26/2023

Artifact Restoration in Histology Images with Diffusion Probabilistic Models

Histological whole slide images (WSIs) can be usually compromised by art...
research
07/29/2023

Ultrasound Image Reconstruction with Denoising Diffusion Restoration Models

Ultrasound image reconstruction can be approximately cast as a linear in...
research
12/04/2016

Word Recognition with Deep Conditional Random Fields

Recognition of handwritten words continues to be an important problem in...

Please sign up or login with your details

Forgot password? Click here to reset