Toward Designing Intelligent PDEs for Computer Vision: An Optimal Control Approach

09/06/2011
by   Risheng Liu, et al.
0

Many computer vision and image processing problems can be posed as solving partial differential equations (PDEs). However, designing PDE system usually requires high mathematical skills and good insight into the problems. In this paper, we consider designing PDEs for various problems arising in computer vision and image processing in a lazy manner: learning PDEs from real data via data-based optimal control. We first propose a general intelligent PDE system which holds the basic translational and rotational invariance rule for most vision problems. By introducing a PDE-constrained optimal control framework, it is possible to use the training data resulting from multiple ways (ground truth, results from other methods, and manual results from humans) to learn PDEs for different computer vision tasks. The proposed optimal control based training framework aims at learning a PDE-based regressor to approximate the unknown (and usually nonlinear) mapping of different vision tasks. The experimental results show that the learnt PDEs can solve different vision problems reasonably well. In particular, we can obtain PDEs not only for problems that traditional PDEs work well but also for problems that PDE-based methods have never been tried before, due to the difficulty in describing those problems in a mathematical way.

READ FULL TEXT

page 3

page 16

page 18

page 19

page 21

page 23

page 24

page 25

research
10/25/2021

Fast PDE-constrained optimization via self-supervised operator learning

Design and optimal control problems are among the fundamental, ubiquitou...
research
10/15/2021

Solving Image PDEs with a Shallow Network

Partial differential equations (PDEs) are typically used as models of ph...
research
08/08/2023

Online identification and control of PDEs via Reinforcement Learning methods

We focus on the control of unknown Partial Differential Equations (PDEs)...
research
09/19/2023

An overview of some mathematical techniques and problems linking 3D vision to 3D printing

Computer Vision and 3D printing have rapidly evolved in the last 10 year...
research
03/22/2023

Leveraging Multi-time Hamilton-Jacobi PDEs for Certain Scientific Machine Learning Problems

Hamilton-Jacobi partial differential equations (HJ PDEs) have deep conne...
research
07/01/2023

Accelerated primal-dual methods with enlarged step sizes and operator learning for nonsmooth optimal control problems

We consider a general class of nonsmooth optimal control problems with p...
research
07/26/2020

PDE Evolutions for M-Smoothers in One, Two, and Three Dimensions

Local M-smoothers are interesting and important signal and image process...

Please sign up or login with your details

Forgot password? Click here to reset