Single-objective versus multi-objectivized optimization for evolutionary crash reproduction

Mozhan Soltani, Pouria Derakhshanfar, Annibale Panichella, Xavier Devroey, Andy Zaidman, Arie van Deursen

Research output: Contribution in Book/Catalog/Report/Conference proceedingConference contribution

Abstract

EvoCrash is a recent search-based approach to generate a test case that reproduces reported crashes. The search is guided by a fitness function that uses a weighted sum scalarization to combine three different heuristics: (i) code coverage, (ii) crash coverage and (iii) stack trace similarity. In this study, we propose and investigate two alternatives to the weighted sum scalarization: (i) the simple sum scalarization and (ii) the multi-objectivization, which decomposes the fitness function into several optimization objectives as an attempt to increase test case diversity. We implemented the three alternative optimizations as an extension of EvoSuite, a popular search-based unit test generator, and applied them on 33 real-world crashes. Our results indicate that for complex crashes the weighted sum reduces the test case generation time, compared to the simple sum, while for simpler crashes the effect is the opposite. Similarly, for complex crashes, multi-objectivization reduces test generation time compared to optimizing with the weighted sum; we also observe one crash that can be replicated only by multi-objectivization. Through our manual analysis, we found out that when optimizing the original weighted function gets trapped in local optima, optimization for decomposed objectives improves the search for crash reproduction. Generally, while multi-objectivization is under-explored, our results are promising and encourage further investigations of the approach.

Original languageEnglish
Title of host publicationSearch-Based Software Engineering - 10th International Symposium, SSBSE 2018, Proceedings
PublisherSpringer Verlag
Pages325-340
Number of pages16
ISBN (Print)9783319992402
DOIs
Publication statusPublished - 1 Jan 2018
Externally publishedYes
Event10th International Symposium on Search-Based Software Engineering, SSBSE 2018 - Montpellier, France
Duration: 8 Sep 201810 Sep 2018

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume11036 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference10th International Symposium on Search-Based Software Engineering, SSBSE 2018
Country/TerritoryFrance
CityMontpellier
Period8/09/1810/09/18

Fingerprint

Dive into the research topics of 'Single-objective versus multi-objectivized optimization for evolutionary crash reproduction'. Together they form a unique fingerprint.

Cite this