Crash reproduction difficulty, an initial assessment

Research output: Contribution in Book/Catalog/Report/Conference proceedingConference contribution

12 Downloads (Pure)

Abstract

This study presents the initial step towards a thorough analysis of the difficulty to reproduce a crash using searchbased crash reproduction. Traditionally, code size and complexity are considered representative indicators of the difficulty for search-based approaches, like search-based unit test generation, to generate tests. However, unlike unit test generation, crash reproduction does not seek to cover a set of behaviors but instead to generate one or more tests exercising a specific behavior reproducing a given crash. In this context, there is no guarantee that the indicators used for unit testing are still valid for crash reproduction. In this study, we seek to identify such indicators by considering various code metrics, code smells, and change metrics. We report our effort to collect those metrics for JCRASHPACK, a state-of-the-art crash reproduction benchmark, and an initial assessment by considering metrics individually. Our results show that although JCRASHPACK is larger than benchmarks used in previous studies, additional crashes should be added to improve its diversity and representativeness, and that no individual metric can be used to characterize the difficulty to reproduce a crash.

Original languageEnglish
Title of host publicationProceedings of the 19th Belgium-Netherlands Software Evolution Workshop (BENEVOL '20)
EditorsMike Papadakis, Maxime Cordy
Place of PublicationLuxembourg, Luxembourg
Number of pages5
Volume2912
Publication statusPublished - 3 Dec 2020
Event19th Belgium-Netherlands Software Evolution Workshop, BENEVOL 2020 - Luxembourg, Luxembourg
Duration: 3 Dec 20204 Dec 2020

Publication series

NameCEUR Workshop Proceedings
PublisherCEUR-WS
ISSN (Print)1613-0073

Conference

Conference19th Belgium-Netherlands Software Evolution Workshop, BENEVOL 2020
Country/TerritoryLuxembourg
CityLuxembourg
Period3/12/204/12/20

Keywords

  • Change metrics
  • Code quality
  • Search-based crash reproduction
  • Software measurement

Fingerprint

Dive into the research topics of 'Crash reproduction difficulty, an initial assessment'. Together they form a unique fingerprint.

Cite this