Towards a question answering assistant for software development using a transformer-based language model

Question answering platforms, such as Stack Overflow, have impacted substantially how developers search for solutions for their programming problems. The crowd knowledge content available from such platforms has also been used to leverage software development tools. The recent advances on Natural Language Processing, specifically on more powerful language models, have demonstrated ability to enhance text understanding and generation. In this context, we aim at investigating the factors that can influence on the application of such models for understanding source code related data and produce more interactive and intelligent assistants for software development. In this preliminary study, we particularly investigate if a how-to question filter and the level of context in the question may impact the results of a question answering transformer-based model. We suggest that fine-tuning models with corpus based on how-to questions can impact positively in the model and more contextualized questions also induce more objective answers.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/15/2021

Transformer-based Language Models for Factoid Question Answering at BioASQ9b

In this work, we describe our experiments and participating systems in t...
research
03/02/2018

A Factoid Question Answering System for Vietnamese

In this paper, we describe the development of an end-to-end factoid ques...
research
03/21/2021

Characterization and Prediction of Questions without Accepted Answers on Stack Overflow

A fast and effective approach to obtain information regarding software d...
research
10/06/2020

DaNetQA: a yes/no Question Answering Dataset for the Russian Language

DaNetQA, a new question-answering corpus, follows (Clark et. al, 2019) d...
research
02/07/2023

ChatGPT and Software Testing Education: Promises Perils

Over the past decade, predictive language modeling for code has proven t...
research
01/17/2021

Profiling Software Developers with Process Mining and N-Gram Language Models

Context: Profiling developers is challenging since many factors, such as...
research
08/22/2023

Exploring the Effectiveness of GPT Models in Test-Taking: A Case Study of the Driver's License Knowledge Test

Large language models such as Open AI's Generative Pre-trained Transform...

Please sign up or login with your details

Forgot password? Click here to reset