Optimal Hyperparameters and Structure Setting of Multi-Objective Robust CNN Systems via Generalized Taguchi Method and Objective Vector Norm

02/09/2022
by   Sheng-Guo Wang, et al.
0

Recently, Machine Learning (ML), Artificial Intelligence (AI), and Convolutional Neural Network (CNN) have made huge progress with broad applications, where their systems have deep learning structures and a large number of hyperparameters that determine the quality and performance of the CNNs and AI systems. These systems may have multi-objective ML and AI performance needs. There is a key requirement to find the optimal hyperparameters and structures for multi-objective robust optimal CNN systems. This paper proposes a generalized Taguchi approach to effectively determine the optimal hyperparameters and structure for the multi-objective robust optimal CNN systems via their objective performance vector norm. The proposed approach and methods are applied to a CNN classification system with the original ResNet for CIFAR-10 dataset as a demonstration and validation, which shows the proposed methods are highly effective to achieve an optimal accuracy rate of the original ResNet on CIFAR-10.

READ FULL TEXT

page 6

page 7

page 8

research
09/09/2022

Multi-objective hyperparameter optimization with performance uncertainty

The performance of any Machine Learning (ML) algorithm is impacted by th...
research
06/15/2022

Multi-Objective Hyperparameter Optimization – An Overview

Hyperparameter optimization constitutes a large part of typical modern m...
research
01/16/2020

Optimization of Convolutional Neural Network Using the Linearly Decreasing Weight Particle Swarm Optimization

Convolutional neural network (CNN) is one of the most frequently used de...
research
10/14/2021

Multi-task problems are not multi-objective

Multi-objective optimization (MOO) aims at finding a set of optimal conf...
research
12/15/2021

COVID-19 Electrocardiograms Classification using CNN Models

With the periodic rise and fall of COVID-19 and numerous countries being...
research
03/04/2022

AutoMO-Mixer: An automated multi-objective Mixer model for balanced, safe and robust prediction in medicine

Accurately identifying patient's status through medical images plays an ...
research
06/10/2021

A multi-objective perspective on jointly tuning hardware and hyperparameters

In addition to the best model architecture and hyperparameters, a full A...

Please sign up or login with your details

Forgot password? Click here to reset