Abstract
Software product lines (SPLs) are families of software systems sharing common assets and exhibiting variabilities specific to each product member of the family. Commonalities and variabilities are often represented as features organized in a feature model. Due to combinatorial explosion of the number of products induced by possible features combinations, exhaustive testing of SPLs is intractable. Therefore, sampling and prioritization techniques have been proposed to generate sorted lists of products based on coverage criteria or weights assigned to features. Solely based on the feature model, these techniques do not take into account behavioural usage of such products as a source of prioritization. In this paper, we assess the feasibility of integrating usage models into the testing process to derive statistical testing approaches for SPLs. Usage models are given as Markov chains, enabling prioritization of probable/rare behaviours. We used featured transition systems, compactly modelling variability and behaviour for SPLs, to determine which products are realizing prioritized behaviours. Statistical prioritization can achieve a significant reduction in the state space, and modelling efforts can be rewarded by better automation. In particular, we used MaTeLo, a statistical test cases generation suite developed at ALL4TEC. We assess feasibility criteria on two systems: Claroline, a configurable course management system, and Sferion™, an embedded system providing helicopter landing assistance.
| Original language | English |
|---|---|
| Pages (from-to) | 153-171 |
| Number of pages | 19 |
| Journal | Software and Systems Modeling |
| Volume | 16 |
| Issue number | 1 |
| DOIs | |
| Publication status | Published - 1 Feb 2017 |
Fingerprint
Keywords
- Prioritization
- Software product line testing
- Statistical testing
Cite this
}
Statistical prioritization for software product line testing: an experience report. / Devroey, Xavier; Perrouin, Gilles; Cordy, Maxime; Samih, Hamza; Legay, Axel; Schobbens, Pierre Yves; Heymans, Patrick.
In: Software and Systems Modeling, Vol. 16, No. 1, 01.02.2017, p. 153-171.Research output: Contribution to journal › Article
TY - JOUR
T1 - Statistical prioritization for software product line testing: an experience report
AU - Devroey, Xavier
AU - Perrouin, Gilles
AU - Cordy, Maxime
AU - Samih, Hamza
AU - Legay, Axel
AU - Schobbens, Pierre Yves
AU - Heymans, Patrick
PY - 2017/2/1
Y1 - 2017/2/1
N2 - Software product lines (SPLs) are families of software systems sharing common assets and exhibiting variabilities specific to each product member of the family. Commonalities and variabilities are often represented as features organized in a feature model. Due to combinatorial explosion of the number of products induced by possible features combinations, exhaustive testing of SPLs is intractable. Therefore, sampling and prioritization techniques have been proposed to generate sorted lists of products based on coverage criteria or weights assigned to features. Solely based on the feature model, these techniques do not take into account behavioural usage of such products as a source of prioritization. In this paper, we assess the feasibility of integrating usage models into the testing process to derive statistical testing approaches for SPLs. Usage models are given as Markov chains, enabling prioritization of probable/rare behaviours. We used featured transition systems, compactly modelling variability and behaviour for SPLs, to determine which products are realizing prioritized behaviours. Statistical prioritization can achieve a significant reduction in the state space, and modelling efforts can be rewarded by better automation. In particular, we used MaTeLo, a statistical test cases generation suite developed at ALL4TEC. We assess feasibility criteria on two systems: Claroline, a configurable course management system, and Sferion™, an embedded system providing helicopter landing assistance.
AB - Software product lines (SPLs) are families of software systems sharing common assets and exhibiting variabilities specific to each product member of the family. Commonalities and variabilities are often represented as features organized in a feature model. Due to combinatorial explosion of the number of products induced by possible features combinations, exhaustive testing of SPLs is intractable. Therefore, sampling and prioritization techniques have been proposed to generate sorted lists of products based on coverage criteria or weights assigned to features. Solely based on the feature model, these techniques do not take into account behavioural usage of such products as a source of prioritization. In this paper, we assess the feasibility of integrating usage models into the testing process to derive statistical testing approaches for SPLs. Usage models are given as Markov chains, enabling prioritization of probable/rare behaviours. We used featured transition systems, compactly modelling variability and behaviour for SPLs, to determine which products are realizing prioritized behaviours. Statistical prioritization can achieve a significant reduction in the state space, and modelling efforts can be rewarded by better automation. In particular, we used MaTeLo, a statistical test cases generation suite developed at ALL4TEC. We assess feasibility criteria on two systems: Claroline, a configurable course management system, and Sferion™, an embedded system providing helicopter landing assistance.
KW - Prioritization
KW - Software product line testing
KW - Statistical testing
UR - http://www.scopus.com/inward/record.url?scp=84937933560&partnerID=8YFLogxK
U2 - 10.1007/s10270-015-0479-8
DO - 10.1007/s10270-015-0479-8
M3 - Article
VL - 16
SP - 153
EP - 171
JO - Software and Systems Modeling
JF - Software and Systems Modeling
SN - 1619-1366
IS - 1
ER -