DeepAI AI Chat
Log In Sign Up

Dataloader Parameter Tuner: An Automated Dataloader Parameter Tuner for Deep Learning Models

10/11/2022
by   JooYoung Park, et al.
Korea University
0

Deep learning has recently become one of the most compute/data-intensive methods and is widely used in many research areas and businesses. One of the critical challenges of deep learning is that it has many parameters that can be adjusted, and the optimal value may need to be determined for faster operation and high accuracy. The focus of this paper is the adjustable parameters of the dataloader. The dataloader in a system mainly groups the data appropriately and loads it to the main memory for the deep learning model to use. We introduce an automated framework called Dataloader Parameter Tuner (DPT) that determines the optimal value for the parameters required for the dataloader. This framework discovers the optimal values for the number of dataloader's subprocesses (i.e., worker) and prefetch factor through grid search to accelerate the data transfer for machine learning systems.

READ FULL TEXT

page 1

page 2

page 3

page 4

11/28/2017

Parameters Optimization of Deep Learning Models using Particle Swarm Optimization

Deep learning has been successfully applied in several fields such as ma...
06/03/2013

Predicting Parameters in Deep Learning

We demonstrate that there is significant redundancy in the parameterizat...
03/14/2023

Optimizing Deep Learning Model Parameters with the Bees Algorithm for Improved Medical Text Classification

This paper introduces a novel mechanism to obtain the optimal parameters...
12/03/2021

A Survey: Deep Learning for Hyperspectral Image Classification with Few Labeled Samples

With the rapid development of deep learning technology and improvement i...
12/03/2019

Value-laden Disciplinary Shifts in Machine Learning

As machine learning models are increasingly used for high-stakes decisio...
08/11/2021

Deep Learning Classification of Lake Zooplankton

Plankton are effective indicators of environmental change and ecosystem ...