PROPEL: Probabilistic Parametric Regression Loss for Convolutional Neural Networks

by   Muhammad Asad, et al.

Recently, Convolutional Neural Networks (CNNs) have dominated the field of computer vision. Their widespread success has been attributed to their representation learning capabilities. For classification tasks, CNNs have widely employed probabilistic output and have shown the significance of providing additional confidence for predictions. However, such probabilistic methodologies are not widely applicable for addressing regression problems using CNNs, as regression involves learning unconstrained continuous and, in many cases, multi-variate target variables. We propose a PRObabilistic Parametric rEgression Loss (PROPEL) that enables probabilistic regression using CNNs. PROPEL is fully differentiable and, hence, can be easily incorporated for end-to-end training of existing regressive CNN architectures. The proposed method is flexible as it learns complex unconstrained probabilities while being generalizable to higher dimensional multi-variate regression problems. We utilize a PROPEL-based CNN to address the problem of learning hand and head orientation from uncalibrated color images. Comprehensive experimental validation and comparisons with existing CNN regression loss functions are provided. Our experimental results indicate that PROPEL significantly improves the performance of a CNN, while reducing model parameters by 10x as compared to the existing state-of-the-art.


page 3

page 5

page 8


Automatically Designing CNN Architectures Using Genetic Algorithm for Image Classification

Convolutional Neural Networks (CNNs) have gained a remarkable success on...

Teaching Compositionality to CNNs

Convolutional neural networks (CNNs) have shown great success in compute...

Highlighting the Importance of Reducing Research Bias and Carbon Emissions in CNNs

Convolutional neural networks (CNNs) have become commonplace in addressi...

A regression framework to head-circumference delineation from US fetal images

Background and Objectives Measuring head-circumference (HC) length from ...

Curriculum By Texture

Convolutional Neural Networks (CNNs) have shown impressive performance i...

On Complex Valued Convolutional Neural Networks

Convolutional neural networks (CNNs) are the cutting edge model for supe...

Probabilistic Atlases to Enforce Topological Constraints

Probabilistic atlases (PAs) have long been used in standard segmentation...