Semantic Segmentation using Neural Ordinary Differential Equations

09/18/2022
by   Seyedalireza Khoshsirat, et al.
0

The idea of neural Ordinary Differential Equations (ODE) is to approximate the derivative of a function (data model) instead of the function itself. In residual networks, instead of having a discrete sequence of hidden layers, the derivative of the continuous dynamics of hidden state can be parameterized by an ODE. It has been shown that this type of neural network is able to produce the same results as an equivalent residual network for image classification. In this paper, we design a novel neural ODE for the semantic segmentation task. We start by a baseline network that consists of residual modules, then we use the modules to build our neural ODE network. We show that our neural ODE is able to achieve the state-of-the-art results using 57 less memory for testing, and 68 model on the Cityscapes, CamVid, LIP, and PASCAL-Context datasets.

READ FULL TEXT
research
06/19/2018

Neural Ordinary Differential Equations

We introduce a new family of deep neural network models. Instead of spec...
research
09/26/2022

Optical Neural Ordinary Differential Equations

Increasing the layer number of on-chip photonic neural networks (PNNs) i...
research
11/21/2019

Discrete and Continuous Deep Residual Learning Over Graphs

In this paper we propose the use of continuous residual modules for grap...
research
10/23/2019

Neural Ordinary Differential Equations for Semantic Segmentation of Individual Colon Glands

Automated medical image segmentation plays a key role in quantitative re...
research
12/12/2020

Delay Differential Neural Networks

Neural ordinary differential equations (NODEs) treat computation of inte...
research
01/07/2022

Forecasting emissions through Kaya identity using Neural Ordinary Differential Equations

Starting from the Kaya identity, we used a Neural ODE model to predict t...
research
08/12/2021

m-RevNet: Deep Reversible Neural Networks with Momentum

In recent years, the connections between deep residual networks and firs...

Please sign up or login with your details

Forgot password? Click here to reset