Software Testing of Generative AI Systems: Challenges and Opportunities

09/07/2023
by   Aldeida Aleti, et al.
0

Software Testing is a well-established area in software engineering, encompassing various techniques and methodologies to ensure the quality and reliability of software systems. However, with the advent of generative artificial intelligence (GenAI) systems, new challenges arise in the testing domain. These systems, capable of generating novel and creative outputs, introduce unique complexities that require novel testing approaches. In this paper, I aim to explore the challenges posed by generative AI systems and discuss potential opportunities for future research in the field of testing. I will touch on the specific characteristics of GenAI systems that make traditional testing techniques inadequate or insufficient. By addressing these challenges and pursuing further research, we can enhance our understanding of how to safeguard GenAI and pave the way for improved quality assurance in this rapidly evolving domain.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/13/2023

Generative AI

The term "generative AI" refers to computational techniques that are cap...
research
07/14/2020

Opening the Software Engineering Toolbox for the Assessment of Trustworthy AI

Trustworthiness is a central requirement for the acceptance and success ...
research
01/14/2022

Artificial Intelligence in Software Testing : Impact, Problems, Challenges and Prospect

Artificial Intelligence (AI) is making a significant impact in multiple ...
research
03/18/2021

Blockchain Testing: Challenges, Techniques, and Research Directions

Specific testing solutions targeting blockchain-based software are gaini...
research
03/22/2019

On Testing Data-Intensive Software Systems

Today's software systems like cyber-physical production systems or big d...
research
07/26/2018

Assurances in Software Testing: A Roadmap

As software engineering researchers, we already understand how to make t...
research
08/31/2021

Towards a Common Testing Terminology for Software Engineering and Data Science Experts

Analytical quality assurance, especially testing, is an integral part of...

Please sign up or login with your details

Forgot password? Click here to reset