A Multi-level Methodology for Behavioral Comparison of Software-Intensive Systems

05/17/2022
by   Dennis Hendriks, et al.
0

Software-intensive systems constantly evolve. To prevent software changes from unintentionally introducing costly system defects, it is important to understand their impact to reduce risk. However, it is in practice nearly impossible to foresee the full impact of software changes when dealing with huge industrial systems with many configurations and usage scenarios. To assist developers with change impact analysis we introduce a novel multi-level methodology for behavioral comparison of software-intensive systems. Our fully automated methodology is based on comparing state machine models of software behavior. We combine existing complementary comparison methods into a novel approach, guiding users step by step though relevant differences by gradually zooming into more and more detail. We empirically evaluate our work through a qualitative exploratory field study, showing its practical value using multiple case studies at ASML, a leading company in developing lithography systems. Our method shows great potential for preventing regressions in system behavior for software changes.

READ FULL TEXT

page 16

page 17

research
12/16/2021

Developing a Suitability Assessment Criteria for Software Developers: Behavioral Assessment Using Psychometric Test

Developing a Suitability Assessment Criteria for Software Developers: Be...
research
01/08/2020

Comparing Constraints Mined From Execution Logs to Understand Software Evolution

Complex software systems evolve frequently, e.g., when introducing new f...
research
04/12/2023

SmartChoices: Augmenting Software with Learned Implementations

We are living in a golden age of machine learning. Powerful models are b...
research
08/04/2017

BDCI: Behavioral Driven Conflict Identification

Source Code Management (SCM) systems support software evolution by provi...
research
04/01/2021

Assessing the Exposure of Software Changes: The DiPiDi Approach

Context: Changing a software application with many build-time configurat...
research
09/01/2020

Towards Evaluating Exploratory Model Building Process with AutoML Systems

The use of Automated Machine Learning (AutoML) systems are highly open-e...
research
02/23/2020

Behavior Cloning in OpenAI using Case Based Reasoning

Learning from Observation (LfO), also known as Behavioral Cloning, is an...

Please sign up or login with your details

Forgot password? Click here to reset