Deep Learning Meets Software Engineering: A Survey on Pre-Trained Models of Source Code

05/24/2022
by   Changan Niu, et al.
0

Recent years have seen the successful application of deep learning to software engineering (SE). In particular, the development and use of pre-trained models of source code has enabled state-of-the-art results to be achieved on a wide variety of SE tasks. This paper provides an overview of this rapidly advancing field of research and reflects on future research directions.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/08/2023

An Empirical Comparison of Pre-Trained Models of Source Code

While a large number of pre-trained models of source code have been succ...
research
06/29/2021

Making the most of small Software Engineering datasets with modern machine learning

This paper provides a starting point for Software Engineering (SE) resea...
research
12/01/2021

BERT_SE: A Pre-trained Language Representation Model for Software Engineering

The application of Natural Language Processing (NLP) has achieved a high...
research
03/13/2023

Generation-based Code Review Automation: How Far Are We?

Code review is an effective software quality assurance activity; however...
research
05/03/2022

A Survey of Deep Learning Models for Structural Code Understanding

In recent years, the rise of deep learning and automation requirements i...
research
11/23/2022

Explainable AI for Pre-Trained Code Models: What Do They Learn? When They Do Not Work?

In recent years, there has been a wide interest in designing deep neural...
research
12/20/2022

A Survey on Pretrained Language Models for Neural Code Intelligence

As the complexity of modern software continues to escalate, software eng...

Please sign up or login with your details

Forgot password? Click here to reset