Towards Statistical Prioritization for Software Product Lines Testing

Research output: Contribution in Book/Catalog/Report/Conference proceedingConference contribution

204 Downloads (Pure)

Abstract

Software Product Lines (SPLs) are inherently difficult to test due to the combinatorial explosion of the number of products to consider. To reduce the number of products to test, sampling techniques such as combinatorial interac-tion testing have been proposed. They usually start from a feature model and apply a coverage criterion (e.g. pairwise feature interaction or dissimilarity) to generate tractable, fault-finding, lists of configurations to be tested. Prioritiza-tion can also be used to sort/generate such lists, optimizing coverage criteria or weights assigned to features. However, current sampling/prioritization techniques barely take prod-uct behaviour into account. We explore how ideas of statis-tical testing, based on a usage model (a Markov chain), can be used to extract configurations of interest according to the likelihood of their executions. These executions are gath-ered in featured transition systems, compact representation of SPL behaviour. We discuss possible scenarios and give a prioritization procedure validated on a web-based learning management software.
Original languageEnglish
Title of host publicationProceedings of the Eighth International Workshop on Variability Modelling of Software-Intensive Systems
EditorsAndrzej Wasowski, Thorsten Weyer
Place of PublicationSophia Antipolis, France
PublisherACM Press
Pages10:1-10:7
Number of pages8
VolumeVaMoS '14
ISBN (Print)978-1-4503-2556-1
DOIs
Publication statusPublished - Jan 2014
EventThe 8th International Workshop on Variability Modelling of Software-intensive Systems (VaMoS '14) - Nice, France
Duration: 22 Jan 201424 Jan 2014

Scientific committee

Scientific committeeThe 8th International Workshop on Variability Modelling of Software-intensive Systems (VaMoS '14)
CountryFrance
CityNice
Period22/01/1424/01/14

Fingerprint

Sampling
Testing
Markov processes
Explosions

Keywords

  • Software Product Line
  • Software Testing
  • Software Product Line Testing
  • Prioritization
  • Statistical Testing

Cite this

Devroey, X., Perrouin, G., Cordy, M., Schobbens, P-Y., Legay, A., & Heymans, P. (2014). Towards Statistical Prioritization for Software Product Lines Testing. In A. Wasowski, & T. Weyer (Eds.), Proceedings of the Eighth International Workshop on Variability Modelling of Software-Intensive Systems (Vol. VaMoS '14, pp. 10:1-10:7). [10] Sophia Antipolis, France: ACM Press. https://doi.org/10.1145/2556624.2556635
Devroey, Xavier ; Perrouin, Gilles ; Cordy, Maxime ; Schobbens, Pierre-Yves ; Legay, Axel ; Heymans, Patrick. / Towards Statistical Prioritization for Software Product Lines Testing. Proceedings of the Eighth International Workshop on Variability Modelling of Software-Intensive Systems. editor / Andrzej Wasowski ; Thorsten Weyer. Vol. VaMoS '14 Sophia Antipolis, France : ACM Press, 2014. pp. 10:1-10:7
@inproceedings{336491a97e084fa9aee2c8d9017e906d,
title = "Towards Statistical Prioritization for Software Product Lines Testing",
abstract = "Software Product Lines (SPLs) are inherently difficult to test due to the combinatorial explosion of the number of products to consider. To reduce the number of products to test, sampling techniques such as combinatorial interac-tion testing have been proposed. They usually start from a feature model and apply a coverage criterion (e.g. pairwise feature interaction or dissimilarity) to generate tractable, fault-finding, lists of configurations to be tested. Prioritiza-tion can also be used to sort/generate such lists, optimizing coverage criteria or weights assigned to features. However, current sampling/prioritization techniques barely take prod-uct behaviour into account. We explore how ideas of statis-tical testing, based on a usage model (a Markov chain), can be used to extract configurations of interest according to the likelihood of their executions. These executions are gath-ered in featured transition systems, compact representation of SPL behaviour. We discuss possible scenarios and give a prioritization procedure validated on a web-based learning management software.",
keywords = "Software Product Line, Software Testing, Software Product Line Testing, Prioritization, Statistical Testing",
author = "Xavier Devroey and Gilles Perrouin and Maxime Cordy and Pierre-Yves Schobbens and Axel Legay and Patrick Heymans",
year = "2014",
month = "1",
doi = "10.1145/2556624.2556635",
language = "English",
isbn = "978-1-4503-2556-1",
volume = "VaMoS '14",
pages = "10:1--10:7",
editor = "Andrzej Wasowski and Thorsten Weyer",
booktitle = "Proceedings of the Eighth International Workshop on Variability Modelling of Software-Intensive Systems",
publisher = "ACM Press",
address = "United States",

}

Devroey, X, Perrouin, G, Cordy, M, Schobbens, P-Y, Legay, A & Heymans, P 2014, Towards Statistical Prioritization for Software Product Lines Testing. in A Wasowski & T Weyer (eds), Proceedings of the Eighth International Workshop on Variability Modelling of Software-Intensive Systems. vol. VaMoS '14, 10, ACM Press, Sophia Antipolis, France, pp. 10:1-10:7, The 8th International Workshop on Variability Modelling of Software-intensive Systems (VaMoS '14), Nice, France, 22/01/14. https://doi.org/10.1145/2556624.2556635

Towards Statistical Prioritization for Software Product Lines Testing. / Devroey, Xavier; Perrouin, Gilles; Cordy, Maxime; Schobbens, Pierre-Yves; Legay, Axel; Heymans, Patrick.

Proceedings of the Eighth International Workshop on Variability Modelling of Software-Intensive Systems. ed. / Andrzej Wasowski; Thorsten Weyer. Vol. VaMoS '14 Sophia Antipolis, France : ACM Press, 2014. p. 10:1-10:7 10.

Research output: Contribution in Book/Catalog/Report/Conference proceedingConference contribution

TY - GEN

T1 - Towards Statistical Prioritization for Software Product Lines Testing

AU - Devroey, Xavier

AU - Perrouin, Gilles

AU - Cordy, Maxime

AU - Schobbens, Pierre-Yves

AU - Legay, Axel

AU - Heymans, Patrick

PY - 2014/1

Y1 - 2014/1

N2 - Software Product Lines (SPLs) are inherently difficult to test due to the combinatorial explosion of the number of products to consider. To reduce the number of products to test, sampling techniques such as combinatorial interac-tion testing have been proposed. They usually start from a feature model and apply a coverage criterion (e.g. pairwise feature interaction or dissimilarity) to generate tractable, fault-finding, lists of configurations to be tested. Prioritiza-tion can also be used to sort/generate such lists, optimizing coverage criteria or weights assigned to features. However, current sampling/prioritization techniques barely take prod-uct behaviour into account. We explore how ideas of statis-tical testing, based on a usage model (a Markov chain), can be used to extract configurations of interest according to the likelihood of their executions. These executions are gath-ered in featured transition systems, compact representation of SPL behaviour. We discuss possible scenarios and give a prioritization procedure validated on a web-based learning management software.

AB - Software Product Lines (SPLs) are inherently difficult to test due to the combinatorial explosion of the number of products to consider. To reduce the number of products to test, sampling techniques such as combinatorial interac-tion testing have been proposed. They usually start from a feature model and apply a coverage criterion (e.g. pairwise feature interaction or dissimilarity) to generate tractable, fault-finding, lists of configurations to be tested. Prioritiza-tion can also be used to sort/generate such lists, optimizing coverage criteria or weights assigned to features. However, current sampling/prioritization techniques barely take prod-uct behaviour into account. We explore how ideas of statis-tical testing, based on a usage model (a Markov chain), can be used to extract configurations of interest according to the likelihood of their executions. These executions are gath-ered in featured transition systems, compact representation of SPL behaviour. We discuss possible scenarios and give a prioritization procedure validated on a web-based learning management software.

KW - Software Product Line

KW - Software Testing

KW - Software Product Line Testing

KW - Prioritization

KW - Statistical Testing

U2 - 10.1145/2556624.2556635

DO - 10.1145/2556624.2556635

M3 - Conference contribution

SN - 978-1-4503-2556-1

VL - VaMoS '14

SP - 10:1-10:7

BT - Proceedings of the Eighth International Workshop on Variability Modelling of Software-Intensive Systems

A2 - Wasowski, Andrzej

A2 - Weyer, Thorsten

PB - ACM Press

CY - Sophia Antipolis, France

ER -

Devroey X, Perrouin G, Cordy M, Schobbens P-Y, Legay A, Heymans P. Towards Statistical Prioritization for Software Product Lines Testing. In Wasowski A, Weyer T, editors, Proceedings of the Eighth International Workshop on Variability Modelling of Software-Intensive Systems. Vol. VaMoS '14. Sophia Antipolis, France: ACM Press. 2014. p. 10:1-10:7. 10 https://doi.org/10.1145/2556624.2556635