Model-based mutant equivalence detection using automata language equivalence and simulations

Research output: Contribution to journalArticle

36 Downloads (Pure)

Abstract

Mutation analysis is a popular technique for assessing the strength of test suites. It relies on the mutation score, which indicates their fault-revealing potential. Yet, there are mutants whose behaviour is equivalent to the original system, wasting analysis resources and preventing the satisfaction of a 100\% mutation score. For finite behavioural models, the Equivalent Mutant Problem (EMP) can be transformed to the language equivalence problem of non-deterministic finite automata for which many solutions exist. However, these solutions are quite expensive, making computation unbearable when used for tackling the EMP. In this paper, we report on our assessment of a state-of-the-art exact language equivalence tool and two heuristics we proposed. We used 12 models, composed of (up to) 15,000 states, and 4,710 mutants. We introduce a random and a mutation-biased simulation heuristics, used as baselines for comparison. Our results show that the exact approach is often more than ten times faster in the weak mutation scenario. For strong mutation, our biased simulations can be up to 1,000 times faster for models larger than 300 states, while limiting the error of misclassifying non-equivalent mutants as equivalent to 8\% on average. We therefore conclude that the approaches can be combined for improved efficiency.
Original languageEnglish
Pages (from-to)1-15
Number of pages15
JournalJournal of Systems and Software
Volume141
DOIs
Publication statusPublished - 1 Jul 2018

Keywords

  • model-based mutation analysis
  • automata language equivalence
  • random simulations
  • Model-based mutation analysis
  • Random simulations
  • Automata language equivalence

Fingerprint Dive into the research topics of 'Model-based mutant equivalence detection using automata language equivalence and simulations'. Together they form a unique fingerprint.

  • Projects

    FEDER-IDEES Co-Innovation: Co-Innovation

    HEYMANS, P.

    1/01/1531/12/20

    Project: Research

    Cite this