Page - 14 - in The Future of Software Quality Assurance

14 S. Amann and E. Jürgens 6 Conclusion Today, testershaveto testever largeramountsofsoftware ineversmallerperiodsof time. This makes it infeasible to simply execute even fully automated test suites in their entirety for every change. Also it has become impractical—if it ever was—to manually ensure that the tests cover all changes. Therefore,we need to rethink our testingstrategies tobecomebothmoreefficientandeffective. Inthischapter,weintroducedChange-DrivenTesting.InChange-DrivenTesting, we analyze existing data from the software development process to automatically answer questions that drive our testing. We use Test-Impact Analysis to automat- ically find the impacted tests for any given code change and sort them in a way that increases the chance of catching mistakes early on. This makes testing more efficient, catching over 90% of mistakes in only 2% testing time. We use Test-Gap Analysis toautomaticallyidentifytestgaps, i.e.,codechangesthat lacktesting.This enables us to make conscious decisions about where to direct our limited testing resource to improveour testingeffectiveness. References 1. Eder, S., Hauptmann, B., Junker, M., Juergens, E., Vaas, R., Prommer, K.H.: Did we test our changes? Assessing alignment between tests and development in practice. In: Proceedings of theEighth International Workshop on Automationof Software Test (AST’13) (2013) 2. Juergens, E.,Pagano, D.:Did We Test the Right Thing? Experiences withTest Gap Analysis in Practice. Whitepaper, CQSE GmbH(2016) 3. Juergens,E.,Pagano,D.,Goeb,A.:Test ImpactAnalysis:DetectingErrorsEarlyDespiteLarge, Long-Running Test Suites. Whitepaper, CQSE GmbH (2018) 4. Rott,J.:EmpirischeUntersuchungderEffektivitätvonTestpriorisierungsverfahren inderPraxis. Master’s thesis, Technische Universität München (2019) 5. Rott, J., Niedermayr, R., Juergens, E., Pagano, D.: Ticket coverage: putting test coverage into context. In: Proceedings of the 8th Workshop on Emerging Trends in Software Metrics (WETSoM’17) (2017) Open Access This chapter is licensed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits use, sharing, adaptation,distributionandreproduction inanymediumorformat, as longasyougiveappropriate credit to the original author(s) and thesource, provide a link to theCreative Commons licence and indicate if changes were made. The images or other third party material in this chapter are included in the chapter’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the chapter’s Creative Commons licence and your intended use is not permitted by statutory regulation orexceeds the permitteduse, you willneed toobtain permission directly from the copyright holder.