DRL-ISP: Multi-Objective Camera ISP with Deep Reinforcement Learning

07/07/2022
by   Ukcheol Shin, et al.
2

In this paper, we propose a multi-objective camera ISP framework that utilizes Deep Reinforcement Learning (DRL) and camera ISP toolbox that consist of network-based and conventional ISP tools. The proposed DRL-based camera ISP framework iteratively selects a proper tool from the toolbox and applies it to the image to maximize a given vision task-specific reward function. For this purpose, we implement total 51 ISP tools that include exposure correction, color-and-tone correction, white balance, sharpening, denoising, and the others. We also propose an efficient DRL network architecture that can extract the various aspects of an image and make a rigid mapping relationship between images and a large number of actions. Our proposed DRL-based ISP framework effectively improves the image quality according to each vision task such as RAW-to-RGB image restoration, 2D object detection, and monocular depth estimation.

READ FULL TEXT

page 1

page 3

page 5

page 6

research
03/08/2018

A Multi-Objective Deep Reinforcement Learning Framework

This paper presents a new multi-objective deep reinforcement learning (M...
research
06/06/2019

Deep Reinforcement Learning for Multi-objective Optimization

This study proposes an end-to-end framework for solving multi-objective ...
research
07/17/2020

Hierarchical Deep Reinforcement Learning Approach for Multi-Objective Scheduling With Varying Queue Sizes

Multi-objective task scheduling (MOTS) is the task scheduling while opti...
research
08/08/2019

Learning to Grasp from 2.5D images: a Deep Reinforcement Learning Approach

In this paper, we propose a deep reinforcement learning (DRL) solution t...
research
09/06/2023

On Reducing Undesirable Behavior in Deep Reinforcement Learning Models

Deep reinforcement learning (DRL) has proven extremely useful in a large...
research
10/10/2021

Vectorization of Raster Manga by Deep Reinforcement Learning

Manga is a popular Japanese-style comic form that consists of black-and-...

Please sign up or login with your details

Forgot password? Click here to reset