Creating a Virtuous Cycle in Performance Testing at MongoDB

01/25/2021
by   David Daly, et al.
0

It is important to detect changes in software performance during development in order to avoid performance decreasing release to release or dealing with costly delays at release time. Performance testing is part of the development process at MongoDB, and integrated into our continuous integration system. We describe a set of changes to that performance testing environment designed to improve testing effectiveness. These changes help improve coverage, provide faster and more accurate signaling for performance changes, and help us better understand the state of performance. In addition to each component performing better, we believe that we have created and exploited a virtuous cycle: performance test improvements drive impact, which drives more use, which drives further impact and investment in improvements. Overall, MongoDB is getting faster and we avoid shipping major performance regressions to our customers because of this infrastructure.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/26/2018

An Infrastructure for Software Release Analysis through Provenance Graphs

Nowadays, quickly evolving and delivering software through a continuous ...
research
05/30/2022

Effectiveness and Scalability of Fuzzing Techniques in CI/CD Pipelines

Fuzzing has proven to be a fundamental technique to automated software t...
research
04/17/2020

Automated System Performance Testing at MongoDB

Distributed Systems Infrastructure (DSI) is MongoDB's framework for runn...
research
12/19/2022

Using Microbenchmark Suites to Detect Application Performance Changes

Software performance changes are costly and often hard to detect pre-rel...
research
09/27/2015

Optimal Release Time Decision from Fuzzy Mathematical Programming Perspective

Demand for high software reliability requires rigorous testing followed ...
research
06/12/2019

Comparing Popularity of Testing Careers among Canadian, Chinese, Indian Students

Despite its importance, software testing is, arguably, the least underst...
research
06/01/2020

MLOS: An Infrastructure for AutomatedSoftware Performance Engineering

Developing modern systems software is a complex task that combines busin...

Please sign up or login with your details

Forgot password? Click here to reset