Abstract
EvoCrash is a recent search-based approach to generate a test case that reproduces reported crashes. The search is guided by a fitness function that uses a weighted sum scalarization to combine three different heuristics: (i) code coverage, (ii) crash coverage and (iii) stack trace similarity. In this study, we propose and investigate two alternatives to the weighted sum scalarization: (i) the simple sum scalarization and (ii) the multi-objectivization, which decomposes the fitness function into several optimization objectives as an attempt to increase test case diversity. We implemented the three alternative optimizations as an extension of EvoSuite, a popular search-based unit test generator, and applied them on 33 real-world crashes. Our results indicate that for complex crashes the weighted sum reduces the test case generation time, compared to the simple sum, while for simpler crashes the effect is the opposite. Similarly, for complex crashes, multi-objectivization reduces test generation time compared to optimizing with the weighted sum; we also observe one crash that can be replicated only by multi-objectivization. Through our manual analysis, we found out that when optimizing the original weighted function gets trapped in local optima, optimization for decomposed objectives improves the search for crash reproduction. Generally, while multi-objectivization is under-explored, our results are promising and encourage further investigations of the approach.
Original language | English |
---|---|
Title of host publication | Search-Based Software Engineering - 10th International Symposium, SSBSE 2018, Proceedings |
Publisher | Springer Verlag |
Pages | 325-340 |
Number of pages | 16 |
ISBN (Print) | 9783319992402 |
DOIs | |
Publication status | Published - 1 Jan 2018 |
Externally published | Yes |
Event | 10th International Symposium on Search-Based Software Engineering, SSBSE 2018 - Montpellier, France Duration: 8 Sept 2018 → 10 Sept 2018 |
Publication series
Name | Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) |
---|---|
Volume | 11036 LNCS |
ISSN (Print) | 0302-9743 |
ISSN (Electronic) | 1611-3349 |
Conference
Conference | 10th International Symposium on Search-Based Software Engineering, SSBSE 2018 |
---|---|
Country/Territory | France |
City | Montpellier |
Period | 8/09/18 → 10/09/18 |
Fingerprint
Dive into the research topics of 'Single-objective versus multi-objectivized optimization for evolutionary crash reproduction'. Together they form a unique fingerprint.Datasets
-
JCrashPack: A Java Crash Reproduction Benchmark
Derakhshanfar, P. (Creator), Devroey, X. (Creator) & Soltani, M. (Contributor), Zenodo, 26 Apr 2020
Dataset