Memory visualization tool for training neural network

10/25/2021
by   Mahendran N, et al.
0

Software developed helps world a better place ranging from system software, open source, application software and so on. Software engineering does have neural network models applied to code suggestion, bug report summarizing and so on to demonstrate their effectiveness at a real SE task. Software and machine learning algorithms combine to make software give better solutions and understanding of environment. In software, there are both generalized applications which helps solve problems for entire world and also some specific applications which helps one particular community. To address the computational challenge in deep learning, many tools exploit hardware features such as multi-core CPUs and many-core GPUs to shorten the training time. Machine learning algorithms have a greater impact in the world but there is a considerable amount of memory utilization during the process. We propose a new tool for analysis of memory utilized for developing and training deep learning models. Our tool results in visual utilization of memory concurrently. Various parameters affecting the memory utilization are analysed while training. This tool helps in knowing better idea of processes or models which consumes more memory.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/13/2018

Deep Learning in Software Engineering

Recent years, deep learning is increasingly prevalent in the field of So...
research
11/09/2022

Profiling and Improving the PyTorch Dataloader for high-latency Storage: A Technical Report

A growing number of Machine Learning Frameworks recently made Deep Learn...
research
06/03/2019

NeuralVis: Visualizing and Interpreting Deep Learning Models

Deep Neural Network(DNN) techniques have been prevalent in software engi...
research
06/10/2019

Performance Analysis and Characterization of Training Deep Learning Models on NVIDIA TX2

Training deep learning models on mobile devices recently becomes possibl...
research
10/21/2019

Quantifying the Carbon Emissions of Machine Learning

From an environmental standpoint, there are a few crucial aspects of tra...
research
03/01/2023

Kamodo: Simplifying Model Data Access and Utilization

To address the lack of user-friendly software needed to simplify the uti...
research
09/23/2019

Machine Learning Pipelines with Modern Big DataTools for High Energy Physics

The effective utilization at scale of complex machine learning (ML) tech...

Please sign up or login with your details

Forgot password? Click here to reset