Projets par an
Résumé
Mutation analysis is a popular technique for assessing the strength of test suites. It relies on the mutation score, which indicates their fault-revealing potential. Yet, there are mutants whose behaviour is equivalent to the original system, wasting analysis resources and preventing the satisfaction of a 100\% mutation score. For finite behavioural models, the Equivalent Mutant Problem (EMP) can be transformed to the language equivalence problem of non-deterministic finite automata for which many solutions exist. However, these solutions are quite expensive, making computation unbearable when used for tackling the EMP. In this paper, we report on our assessment of a state-of-the-art exact language equivalence tool and two heuristics we proposed. We used 12 models, composed of (up to) 15,000 states, and 4,710 mutants. We introduce a random and a mutation-biased simulation heuristics, used as baselines for comparison. Our results show that the exact approach is often more than ten times faster in the weak mutation scenario. For strong mutation, our biased simulations can be up to 1,000 times faster for models larger than 300 states, while limiting the error of misclassifying non-equivalent mutants as equivalent to 8\% on average. We therefore conclude that the approaches can be combined for improved efficiency.
langue originale | Anglais |
---|---|
Pages (de - à) | 1-15 |
Nombre de pages | 15 |
journal | Journal of Systems and Software |
Volume | 141 |
Les DOIs | |
Etat de la publication | Publié - 1 juil. 2018 |
Financement
We would like to thank Damien Pous for his support on the HKC tool. This research was partially funded by the EU Horizon 2020 ICT-10-2016-RIA "STAMP" project (No.731529) and the Dutch 4TU project “Big Software on the Run” as well as by the European Regional Development Fund ( ERDF ) “Ideas for the future Internet” (IDEES) project (No. ETR121200001375).
Bailleurs de fonds | Numéro du bailleur de fonds |
---|---|
Horizon 2020 Framework Programme | 731529 |
Horizon 2020 | |
European Regional Development Fund |
Empreinte digitale
Examiner les sujets de recherche de « Model-based mutant equivalence detection using automata language equivalence and simulations ». Ensemble, ils forment une empreinte digitale unique.Projets
- 1 Terminé
-
FEDER-IDEES Co-Innovation: Co-Innovation
HEYMANS, P. (Responsable du Projet)
1/01/15 → 31/12/20
Projet: Recherche