Many bioinformatics programming tasks can be automated with ChatGPT

03/07/2023
by   Stephen R. Piccolo, et al.
0

Computer programming is a fundamental tool for life scientists, allowing them to carry out many essential research tasks. However, despite a variety of educational efforts, learning to write code can be a challenging endeavor for both researchers and students in life science disciplines. Recent advances in artificial intelligence have made it possible to translate human-language prompts to functional code, raising questions about whether these technologies can aid (or replace) life scientists' efforts to write code. Using 184 programming exercises from an introductory-bioinformatics course, we evaluated the extent to which one such model – OpenAI's ChatGPT – can successfully complete basic- to moderate-level programming tasks. On its first attempt, ChatGPT solved 139 (75.5 provided natural-language feedback to the model, prompting it to try different approaches. Within 7 or fewer attempts, ChatGPT solved 179 (97.3 exercises. These findings have important implications for life-sciences research and education. For many programming tasks, researchers no longer need to write code from scratch. Instead, machine-learning models may produce usable solutions. Instructors may need to adapt their pedagogical approaches and assessment techniques to account for these new capabilities that are available to the general public.

READ FULL TEXT
research
03/09/2023

Large Language Models (GPT) Struggle to Answer Multiple-Choice Questions about Code

We analyzed effectiveness of three generative pre-trained transformer (G...
research
11/27/2019

Automated Generation of Computer Graded Unit Testing-Based Programming Assessments for Education

Automatic assessment of code, in particular to support education, is an ...
research
12/02/2017

Will humans even write code in 2040 and what would that mean for extreme heterogeneity in computing?

Programming trends suggest that software development will undergo a radi...
research
01/26/2023

Analyzing the Quality of Submissions in Online Programming Courses

Programming education should aim to provide students with a broad range ...
research
02/15/2021

Finding Anomalies in Scratch Assignments

In programming education, teachers need to monitor and assess the progre...
research
11/15/2017

Maintaining The Humanity of Our Models

Artificial intelligence and machine learning have been major research in...
research
03/16/2023

Can Generative Pre-trained Transformers (GPT) Pass Assessments in Higher Education Programming Courses?

We evaluated the capability of generative pre-trained transformers (GPT)...

Please sign up or login with your details

Forgot password? Click here to reset