Search-based Similarity-driven Behavioural SPL Testing

Research output: Contribution in Book/Catalog/Report/Conference proceedingConference contribution

36 Downloads (Pure)

Abstract

Dissimilar test cases have been proven to be effective to reveal faults in software systems. In the Software Product Line (SPL) context, this criterion has been applied successfully to mimic combinatorial interaction testing in an efficient and scalable manner by selecting and prioritising most dissimilar configurations of feature models using evolutionary algorithms. In this paper, we extend dissimilarity to behavioural SPL models (FTS) in a search-based approach, and evaluate its effectiveness in terms of product and fault coverage. We investigate different distances as well as as single-objective algorithms, (dissimilarity on actions, random, all-actions). Our results on four case studies show the relevance of dissimilarity-based test generation for behavioural SPL models, especially on the largest case-study where no other approach can match it.
Original languageEnglish
Title of host publicationProceedings of the Tenth International Workshop on Variability Modelling of Software-intensive Systems
Place of PublicationSalvador of Bahia, Brazil
PublisherACM Press
Pages89-96
Number of pages8
ISBN (Print)978-1-4503-4019-9
DOIs
Publication statusPublished - 27 Jan 2016

Publication series

NameVaMoS '16
PublisherACM

Fingerprint

Testing
Evolutionary algorithms

Keywords

  • Dissimilarity Testing
  • Featured Transition System
  • Software Product Line Testing

Cite this

Devroey, X., Perrouin, G., Legay, A., Schobbens, P-Y., & Heymans, P. (2016). Search-based Similarity-driven Behavioural SPL Testing. In Proceedings of the Tenth International Workshop on Variability Modelling of Software-intensive Systems (pp. 89-96). (VaMoS '16). Salvador of Bahia, Brazil: ACM Press. https://doi.org/10.1145/2866614.2866627
Devroey, Xavier ; Perrouin, Gilles ; Legay, Axel ; Schobbens, Pierre-Yves ; Heymans, Patrick. / Search-based Similarity-driven Behavioural SPL Testing. Proceedings of the Tenth International Workshop on Variability Modelling of Software-intensive Systems. Salvador of Bahia, Brazil : ACM Press, 2016. pp. 89-96 (VaMoS '16).
@inproceedings{34ca57afe5054103b1b3f3c601e006ff,
title = "Search-based Similarity-driven Behavioural SPL Testing",
abstract = "Dissimilar test cases have been proven to be effective to reveal faults in software systems. In the Software Product Line (SPL) context, this criterion has been applied successfully to mimic combinatorial interaction testing in an efficient and scalable manner by selecting and prioritising most dissimilar configurations of feature models using evolutionary algorithms. In this paper, we extend dissimilarity to behavioural SPL models (FTS) in a search-based approach, and evaluate its effectiveness in terms of product and fault coverage. We investigate different distances as well as as single-objective algorithms, (dissimilarity on actions, random, all-actions). Our results on four case studies show the relevance of dissimilarity-based test generation for behavioural SPL models, especially on the largest case-study where no other approach can match it.",
keywords = "Dissimilarity Testing, Featured Transition System, Software Product Line Testing",
author = "Xavier Devroey and Gilles Perrouin and Axel Legay and Pierre-Yves Schobbens and Patrick Heymans",
year = "2016",
month = "1",
day = "27",
doi = "10.1145/2866614.2866627",
language = "English",
isbn = "978-1-4503-4019-9",
series = "VaMoS '16",
publisher = "ACM Press",
pages = "89--96",
booktitle = "Proceedings of the Tenth International Workshop on Variability Modelling of Software-intensive Systems",
address = "United States",

}

Devroey, X, Perrouin, G, Legay, A, Schobbens, P-Y & Heymans, P 2016, Search-based Similarity-driven Behavioural SPL Testing. in Proceedings of the Tenth International Workshop on Variability Modelling of Software-intensive Systems. VaMoS '16, ACM Press, Salvador of Bahia, Brazil, pp. 89-96. https://doi.org/10.1145/2866614.2866627

Search-based Similarity-driven Behavioural SPL Testing. / Devroey, Xavier; Perrouin, Gilles; Legay, Axel; Schobbens, Pierre-Yves; Heymans, Patrick.

Proceedings of the Tenth International Workshop on Variability Modelling of Software-intensive Systems. Salvador of Bahia, Brazil : ACM Press, 2016. p. 89-96 (VaMoS '16).

Research output: Contribution in Book/Catalog/Report/Conference proceedingConference contribution

TY - GEN

T1 - Search-based Similarity-driven Behavioural SPL Testing

AU - Devroey, Xavier

AU - Perrouin, Gilles

AU - Legay, Axel

AU - Schobbens, Pierre-Yves

AU - Heymans, Patrick

PY - 2016/1/27

Y1 - 2016/1/27

N2 - Dissimilar test cases have been proven to be effective to reveal faults in software systems. In the Software Product Line (SPL) context, this criterion has been applied successfully to mimic combinatorial interaction testing in an efficient and scalable manner by selecting and prioritising most dissimilar configurations of feature models using evolutionary algorithms. In this paper, we extend dissimilarity to behavioural SPL models (FTS) in a search-based approach, and evaluate its effectiveness in terms of product and fault coverage. We investigate different distances as well as as single-objective algorithms, (dissimilarity on actions, random, all-actions). Our results on four case studies show the relevance of dissimilarity-based test generation for behavioural SPL models, especially on the largest case-study where no other approach can match it.

AB - Dissimilar test cases have been proven to be effective to reveal faults in software systems. In the Software Product Line (SPL) context, this criterion has been applied successfully to mimic combinatorial interaction testing in an efficient and scalable manner by selecting and prioritising most dissimilar configurations of feature models using evolutionary algorithms. In this paper, we extend dissimilarity to behavioural SPL models (FTS) in a search-based approach, and evaluate its effectiveness in terms of product and fault coverage. We investigate different distances as well as as single-objective algorithms, (dissimilarity on actions, random, all-actions). Our results on four case studies show the relevance of dissimilarity-based test generation for behavioural SPL models, especially on the largest case-study where no other approach can match it.

KW - Dissimilarity Testing

KW - Featured Transition System

KW - Software Product Line Testing

U2 - 10.1145/2866614.2866627

DO - 10.1145/2866614.2866627

M3 - Conference contribution

SN - 978-1-4503-4019-9

T3 - VaMoS '16

SP - 89

EP - 96

BT - Proceedings of the Tenth International Workshop on Variability Modelling of Software-intensive Systems

PB - ACM Press

CY - Salvador of Bahia, Brazil

ER -

Devroey X, Perrouin G, Legay A, Schobbens P-Y, Heymans P. Search-based Similarity-driven Behavioural SPL Testing. In Proceedings of the Tenth International Workshop on Variability Modelling of Software-intensive Systems. Salvador of Bahia, Brazil: ACM Press. 2016. p. 89-96. (VaMoS '16). https://doi.org/10.1145/2866614.2866627