DeepAI AI Chat
Log In Sign Up

Fully Convolutional Network with Multi-Step Reinforcement Learning for Image Processing

11/10/2018
by   Ryosuke Furuta, et al.
The University of Tokyo
18

This paper tackles a new problem setting: reinforcement learning with pixel-wise rewards (pixelRL) for image processing. After the introduction of the deep Q-network, deep RL has been achieving great success. However, the applications of deep RL for image processing are still limited. Therefore, we extend deep RL to pixelRL for various image processing applications. In pixelRL, each pixel has an agent, and the agent changes the pixel value by taking an action. We also propose an effective learning method for pixelRL that significantly improves the performance by considering not only the future states of the own pixel but also those of the neighbor pixels. The proposed method can be applied to some image processing tasks that require pixel-wise manipulations, where deep RL has never been applied. We apply the proposed method to three image processing tasks: image denoising, image restoration, and local color enhancement. Our experimental results demonstrate that the proposed method achieves comparable or better performance, compared with the state-of-the-art methods based on supervised learning.

READ FULL TEXT

page 5

page 6

page 7

page 10

12/16/2019

PixelRL: Fully Convolutional Network with Reinforcement Learning for Image Processing

This paper tackles a new problem setting: reinforcement learning with pi...
01/02/2020

A Machine Learning Imaging Core using Separable FIR-IIR Filters

We propose fixed-function neural network hardware that is designed to pe...
01/19/2018

Fully Point-wise Convolutional Neural Network for Modeling Statistical Regularities in Natural Images

Modeling statistical regularities is the problem of representing the pix...
03/23/2022

Pixel VQ-VAEs for Improved Pixel Art Representation

Machine learning has had a great deal of success in image processing. Ho...
04/10/2018

Crafting a Toolchain for Image Restoration by Deep Reinforcement Learning

We investigate a novel approach for image restoration by reinforcement l...
07/26/2017

Modelling the Scene Dependent Imaging in Cameras with a Deep Neural Network

We present a novel deep learning framework that models the scene depende...
06/17/2010

Image processing of a spectrogram produced by Spectrometer Airglow Temperature Imager

The Spectral Airglow Temperature Imager is an instrument, specially desi...

Code Repositories

Pytorch-pixelRL

Pytorch reproduction of pixelRL


view repo