PROPEL: Probabilistic Parametric Regression Loss for Convolutional Neural Networks

07/28/2018
by   Muhammad Asad, et al.
0

Recently, Convolutional Neural Networks (CNNs) have dominated the field of computer vision. Their widespread success has been attributed to their representation learning capabilities. For classification tasks, CNNs have widely employed probabilistic output and have shown the significance of providing additional confidence for predictions. However, such probabilistic methodologies are not widely applicable for addressing regression problems using CNNs, as regression involves learning unconstrained continuous and, in many cases, multi-variate target variables. We propose a PRObabilistic Parametric rEgression Loss (PROPEL) that enables probabilistic regression using CNNs. PROPEL is fully differentiable and, hence, can be easily incorporated for end-to-end training of existing regressive CNN architectures. The proposed method is flexible as it learns complex unconstrained probabilities while being generalizable to higher dimensional multi-variate regression problems. We utilize a PROPEL-based CNN to address the problem of learning hand and head orientation from uncalibrated color images. Comprehensive experimental validation and comparisons with existing CNN regression loss functions are provided. Our experimental results indicate that PROPEL significantly improves the performance of a CNN, while reducing model parameters by 10x as compared to the existing state-of-the-art.

READ FULL TEXT

page 3

page 5

page 8

research
08/24/2022

Radial Basis Function Networks for Convolutional Neural Networks to Learn Similarity Distance Metric and Improve Interpretability

Radial basis function neural networks (RBFs) are prime candidates for pa...
research
08/11/2018

Automatically Designing CNN Architectures Using Genetic Algorithm for Image Classification

Convolutional Neural Networks (CNNs) have gained a remarkable success on...
research
06/14/2017

Teaching Compositionality to CNNs

Convolutional neural networks (CNNs) have shown great success in compute...
research
10/24/2020

A regression framework to head-circumference delineation from US fetal images

Background and Objectives Measuring head-circumference (HC) length from ...
research
06/06/2021

Highlighting the Importance of Reducing Research Bias and Carbon Emissions in CNNs

Convolutional neural networks (CNNs) have become commonplace in addressi...
research
07/03/2018

Stochastic Channel Decorrelation Network and Its Application to Visual Tracking

Deep convolutional neural networks (CNNs) have dominated many computer v...
research
09/18/2019

Probabilistic Atlases to Enforce Topological Constraints

Probabilistic atlases (PAs) have long been used in standard segmentation...

Please sign up or login with your details

Forgot password? Click here to reset