Abstract
This study presents the initial step towards a thorough analysis of the difficulty to reproduce a crash using searchbased crash reproduction. Traditionally, code size and complexity are considered representative indicators of the difficulty for search-based approaches, like search-based unit test generation, to generate tests. However, unlike unit test generation, crash reproduction does not seek to cover a set of behaviors but instead to generate one or more tests exercising a specific behavior reproducing a given crash. In this context, there is no guarantee that the indicators used for unit testing are still valid for crash reproduction. In this study, we seek to identify such indicators by considering various code metrics, code smells, and change metrics. We report our effort to collect those metrics for JCRASHPACK, a state-of-the-art crash reproduction benchmark, and an initial assessment by considering metrics individually. Our results show that although JCRASHPACK is larger than benchmarks used in previous studies, additional crashes should be added to improve its diversity and representativeness, and that no individual metric can be used to characterize the difficulty to reproduce a crash.
Original language | English |
---|---|
Title of host publication | Proceedings of the 19th Belgium-Netherlands Software Evolution Workshop (BENEVOL '20) |
Editors | Mike Papadakis, Maxime Cordy |
Place of Publication | Luxembourg, Luxembourg |
Number of pages | 5 |
Volume | 2912 |
Publication status | Published - 3 Dec 2020 |
Event | 19th Belgium-Netherlands Software Evolution Workshop, BENEVOL 2020 - Luxembourg, Luxembourg Duration: 3 Dec 2020 → 4 Dec 2020 |
Publication series
Name | CEUR Workshop Proceedings |
---|---|
Publisher | CEUR-WS |
ISSN (Print) | 1613-0073 |
Conference
Conference | 19th Belgium-Netherlands Software Evolution Workshop, BENEVOL 2020 |
---|---|
Country/Territory | Luxembourg |
City | Luxembourg |
Period | 3/12/20 → 4/12/20 |
Keywords
- Change metrics
- Code quality
- Search-based crash reproduction
- Software measurement
Fingerprint
Dive into the research topics of 'Crash reproduction difficulty, an initial assessment'. Together they form a unique fingerprint.Datasets
-
JCrashPack: A Java Crash Reproduction Benchmark
Derakhshanfar, P. (Creator), Devroey, X. (Creator) & Soltani, M. (Contributor), Zenodo, 26 Apr 2020
Dataset
Student theses
-
JCrashPack2.0: Search-based crash reproduction hardness analysis
Author: Cherry, B., 22 Jun 2020Supervisor: Vanderose, B. (Supervisor)
Student thesis: Master types › Master in Computer Science Professional focus in Software engineering
File