A Variability Perspective of Mutation Analysis

Research output: Contribution in Book/Catalog/Report/Conference proceedingConference contribution

297 Downloads (Pure)

Abstract

Mutation testing is an effective technique for either improving or generating fault-finding test suites. It creates defective or incorrect program artifacts of the program under test and evaluates the ability of test suites to reveal them. Despite being effective, mutation is costly since it requires assessing the test cases with a large number of defective artifacts. Even worse, some of these artifacts are behaviourally "equivalent" to the original one and hence, they unnecessarily increase the testing effort. We adopt a variability perspective on mutation analysis. We model a defective artifact as a transition system with a specific feature selected and consider it as a member of a mutant family. The mutant family is encoded as a Featured Transition System, a compact formalism initially dedicated to model-checking of software product lines. We show how to evaluate a test suite against the set of all candidate defects by using mutant families. We can evaluate all the considered defects at the same time and isolate some equivalent mutants. We can also assist the test generation process and eciently consider higher-order mutants.
Original languageEnglish
Title of host publicationProceedings of the 22Nd ACM SIGSOFT International Symposium on Foundations of Software Engineering
Place of PublicationNew York, NY, USA
PublisherACM Press
Pages841-844
Number of pages4
DOIs
Publication statusPublished - 16 Nov 2014
Event22nd ACM SIGSOFT International Symposium on the Foundations of Software Engineering (FSE '14) - , Hong Kong
Duration: 16 Nov 201421 Nov 2014

Publication series

NameFSE 2014
PublisherACM

Conference

Conference22nd ACM SIGSOFT International Symposium on the Foundations of Software Engineering (FSE '14)
CountryHong Kong
Period16/11/1421/11/14

Fingerprint

Defects
Model checking
Testing

Keywords

  • Featured Transition Systems
  • Mutation Testing

Cite this

Devroey, X., Perrouin, G., Cordy, M., Papadakis, M., Legay, A., & Schobbens, P-Y. (2014). A Variability Perspective of Mutation Analysis. In Proceedings of the 22Nd ACM SIGSOFT International Symposium on Foundations of Software Engineering (pp. 841-844). (FSE 2014). New York, NY, USA: ACM Press. https://doi.org/10.1145/2635868.2666610
Devroey, Xavier ; Perrouin, Gilles ; Cordy, Maxime ; Papadakis, Mike ; Legay, Axel ; Schobbens, Pierre-Yves. / A Variability Perspective of Mutation Analysis. Proceedings of the 22Nd ACM SIGSOFT International Symposium on Foundations of Software Engineering. New York, NY, USA : ACM Press, 2014. pp. 841-844 (FSE 2014).
@inproceedings{a2ba919cc2804ac5bde4a5d8c49a1137,
title = "A Variability Perspective of Mutation Analysis",
abstract = "Mutation testing is an effective technique for either improving or generating fault-finding test suites. It creates defective or incorrect program artifacts of the program under test and evaluates the ability of test suites to reveal them. Despite being effective, mutation is costly since it requires assessing the test cases with a large number of defective artifacts. Even worse, some of these artifacts are behaviourally {"}equivalent{"} to the original one and hence, they unnecessarily increase the testing effort. We adopt a variability perspective on mutation analysis. We model a defective artifact as a transition system with a specific feature selected and consider it as a member of a mutant family. The mutant family is encoded as a Featured Transition System, a compact formalism initially dedicated to model-checking of software product lines. We show how to evaluate a test suite against the set of all candidate defects by using mutant families. We can evaluate all the considered defects at the same time and isolate some equivalent mutants. We can also assist the test generation process and eciently consider higher-order mutants.",
keywords = "Featured Transition Systems, Mutation Testing",
author = "Xavier Devroey and Gilles Perrouin and Maxime Cordy and Mike Papadakis and Axel Legay and Pierre-Yves Schobbens",
year = "2014",
month = "11",
day = "16",
doi = "10.1145/2635868.2666610",
language = "English",
series = "FSE 2014",
publisher = "ACM Press",
pages = "841--844",
booktitle = "Proceedings of the 22Nd ACM SIGSOFT International Symposium on Foundations of Software Engineering",
address = "United States",

}

Devroey, X, Perrouin, G, Cordy, M, Papadakis, M, Legay, A & Schobbens, P-Y 2014, A Variability Perspective of Mutation Analysis. in Proceedings of the 22Nd ACM SIGSOFT International Symposium on Foundations of Software Engineering. FSE 2014, ACM Press, New York, NY, USA, pp. 841-844, 22nd ACM SIGSOFT International Symposium on the Foundations of Software Engineering (FSE '14), Hong Kong, 16/11/14. https://doi.org/10.1145/2635868.2666610

A Variability Perspective of Mutation Analysis. / Devroey, Xavier; Perrouin, Gilles; Cordy, Maxime; Papadakis, Mike; Legay, Axel; Schobbens, Pierre-Yves.

Proceedings of the 22Nd ACM SIGSOFT International Symposium on Foundations of Software Engineering. New York, NY, USA : ACM Press, 2014. p. 841-844 (FSE 2014).

Research output: Contribution in Book/Catalog/Report/Conference proceedingConference contribution

TY - GEN

T1 - A Variability Perspective of Mutation Analysis

AU - Devroey, Xavier

AU - Perrouin, Gilles

AU - Cordy, Maxime

AU - Papadakis, Mike

AU - Legay, Axel

AU - Schobbens, Pierre-Yves

PY - 2014/11/16

Y1 - 2014/11/16

N2 - Mutation testing is an effective technique for either improving or generating fault-finding test suites. It creates defective or incorrect program artifacts of the program under test and evaluates the ability of test suites to reveal them. Despite being effective, mutation is costly since it requires assessing the test cases with a large number of defective artifacts. Even worse, some of these artifacts are behaviourally "equivalent" to the original one and hence, they unnecessarily increase the testing effort. We adopt a variability perspective on mutation analysis. We model a defective artifact as a transition system with a specific feature selected and consider it as a member of a mutant family. The mutant family is encoded as a Featured Transition System, a compact formalism initially dedicated to model-checking of software product lines. We show how to evaluate a test suite against the set of all candidate defects by using mutant families. We can evaluate all the considered defects at the same time and isolate some equivalent mutants. We can also assist the test generation process and eciently consider higher-order mutants.

AB - Mutation testing is an effective technique for either improving or generating fault-finding test suites. It creates defective or incorrect program artifacts of the program under test and evaluates the ability of test suites to reveal them. Despite being effective, mutation is costly since it requires assessing the test cases with a large number of defective artifacts. Even worse, some of these artifacts are behaviourally "equivalent" to the original one and hence, they unnecessarily increase the testing effort. We adopt a variability perspective on mutation analysis. We model a defective artifact as a transition system with a specific feature selected and consider it as a member of a mutant family. The mutant family is encoded as a Featured Transition System, a compact formalism initially dedicated to model-checking of software product lines. We show how to evaluate a test suite against the set of all candidate defects by using mutant families. We can evaluate all the considered defects at the same time and isolate some equivalent mutants. We can also assist the test generation process and eciently consider higher-order mutants.

KW - Featured Transition Systems

KW - Mutation Testing

U2 - 10.1145/2635868.2666610

DO - 10.1145/2635868.2666610

M3 - Conference contribution

T3 - FSE 2014

SP - 841

EP - 844

BT - Proceedings of the 22Nd ACM SIGSOFT International Symposium on Foundations of Software Engineering

PB - ACM Press

CY - New York, NY, USA

ER -

Devroey X, Perrouin G, Cordy M, Papadakis M, Legay A, Schobbens P-Y. A Variability Perspective of Mutation Analysis. In Proceedings of the 22Nd ACM SIGSOFT International Symposium on Foundations of Software Engineering. New York, NY, USA: ACM Press. 2014. p. 841-844. (FSE 2014). https://doi.org/10.1145/2635868.2666610