Java Unit Testing Tool Competition - Seventh Round

Fitsum Kifetew, Xavier Devroey, Urko Rueda

Résultats de recherche: Contribution dans un livre/un catalogue/un rapport/dans les actes d'une conférenceArticle dans les actes d'une conférence/un colloque

Résumé

We report on the results of the seventh edition of the JUnit tool competition. This year, four tools were executed on a benchmark with (i) new classes, selected from real-world software projects, and (ii) challenging classes from the previous edition. We use Randoop and manual test suites from the projects as baselines. Given the interesting findings of last year, we analyzed the effectiveness of the combined test suites generated by all competing tools and compared; results are confronted with the manual test suites of the projects, as well as those generated by the competing tools. This paper describes our methodology and the results, highlight challenges faced during the contest.

langue originaleAnglais
titreProceedings - 2019 IEEE/ACM 12th International Workshop on Search-Based Software Testing, SBST 2019
EditeurInstitute of Electrical and Electronics Engineers Inc.
Pages15-20
Nombre de pages6
ISBN (Electronique)9781728122335
Les DOIs
étatPublié - 1 mai 2019
Modification externeOui
Evénement12th IEEE/ACM International Workshop on Search-Based Software Testing, SBST 2019 - Montreal, Canada
Durée: 27 mai 2019 → …

Série de publications

NomProceedings - 2019 IEEE/ACM 12th International Workshop on Search-Based Software Testing, SBST 2019

Une conférence

Une conférence12th IEEE/ACM International Workshop on Search-Based Software Testing, SBST 2019
PaysCanada
La villeMontreal
période27/05/19 → …

Empreinte digitale

Testing

Citer ceci

Kifetew, F., Devroey, X., & Rueda, U. (2019). Java Unit Testing Tool Competition - Seventh Round. Dans Proceedings - 2019 IEEE/ACM 12th International Workshop on Search-Based Software Testing, SBST 2019 (p. 15-20). [8812209] (Proceedings - 2019 IEEE/ACM 12th International Workshop on Search-Based Software Testing, SBST 2019). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/SBST.2019.00014
Kifetew, Fitsum ; Devroey, Xavier ; Rueda, Urko. / Java Unit Testing Tool Competition - Seventh Round. Proceedings - 2019 IEEE/ACM 12th International Workshop on Search-Based Software Testing, SBST 2019. Institute of Electrical and Electronics Engineers Inc., 2019. p. 15-20 (Proceedings - 2019 IEEE/ACM 12th International Workshop on Search-Based Software Testing, SBST 2019).
@inproceedings{3322ba1f8fa247edbe10e8d4ef7d72b2,
title = "Java Unit Testing Tool Competition - Seventh Round",
abstract = "We report on the results of the seventh edition of the JUnit tool competition. This year, four tools were executed on a benchmark with (i) new classes, selected from real-world software projects, and (ii) challenging classes from the previous edition. We use Randoop and manual test suites from the projects as baselines. Given the interesting findings of last year, we analyzed the effectiveness of the combined test suites generated by all competing tools and compared; results are confronted with the manual test suites of the projects, as well as those generated by the competing tools. This paper describes our methodology and the results, highlight challenges faced during the contest.",
keywords = "automation, benchmark, combined performance, Java, mutation testing, statistical analysis, tool competition, unit testing",
author = "Fitsum Kifetew and Xavier Devroey and Urko Rueda",
year = "2019",
month = "5",
day = "1",
doi = "10.1109/SBST.2019.00014",
language = "English",
series = "Proceedings - 2019 IEEE/ACM 12th International Workshop on Search-Based Software Testing, SBST 2019",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
pages = "15--20",
booktitle = "Proceedings - 2019 IEEE/ACM 12th International Workshop on Search-Based Software Testing, SBST 2019",

}

Kifetew, F, Devroey, X & Rueda, U 2019, Java Unit Testing Tool Competition - Seventh Round. Dans Proceedings - 2019 IEEE/ACM 12th International Workshop on Search-Based Software Testing, SBST 2019., 8812209, Proceedings - 2019 IEEE/ACM 12th International Workshop on Search-Based Software Testing, SBST 2019, Institute of Electrical and Electronics Engineers Inc., p. 15-20, 12th IEEE/ACM International Workshop on Search-Based Software Testing, SBST 2019, Montreal, Canada, 27/05/19. https://doi.org/10.1109/SBST.2019.00014

Java Unit Testing Tool Competition - Seventh Round. / Kifetew, Fitsum; Devroey, Xavier; Rueda, Urko.

Proceedings - 2019 IEEE/ACM 12th International Workshop on Search-Based Software Testing, SBST 2019. Institute of Electrical and Electronics Engineers Inc., 2019. p. 15-20 8812209 (Proceedings - 2019 IEEE/ACM 12th International Workshop on Search-Based Software Testing, SBST 2019).

Résultats de recherche: Contribution dans un livre/un catalogue/un rapport/dans les actes d'une conférenceArticle dans les actes d'une conférence/un colloque

TY - GEN

T1 - Java Unit Testing Tool Competition - Seventh Round

AU - Kifetew, Fitsum

AU - Devroey, Xavier

AU - Rueda, Urko

PY - 2019/5/1

Y1 - 2019/5/1

N2 - We report on the results of the seventh edition of the JUnit tool competition. This year, four tools were executed on a benchmark with (i) new classes, selected from real-world software projects, and (ii) challenging classes from the previous edition. We use Randoop and manual test suites from the projects as baselines. Given the interesting findings of last year, we analyzed the effectiveness of the combined test suites generated by all competing tools and compared; results are confronted with the manual test suites of the projects, as well as those generated by the competing tools. This paper describes our methodology and the results, highlight challenges faced during the contest.

AB - We report on the results of the seventh edition of the JUnit tool competition. This year, four tools were executed on a benchmark with (i) new classes, selected from real-world software projects, and (ii) challenging classes from the previous edition. We use Randoop and manual test suites from the projects as baselines. Given the interesting findings of last year, we analyzed the effectiveness of the combined test suites generated by all competing tools and compared; results are confronted with the manual test suites of the projects, as well as those generated by the competing tools. This paper describes our methodology and the results, highlight challenges faced during the contest.

KW - automation

KW - benchmark

KW - combined performance

KW - Java

KW - mutation testing

KW - statistical analysis

KW - tool competition

KW - unit testing

UR - http://www.scopus.com/inward/record.url?scp=85072556942&partnerID=8YFLogxK

U2 - 10.1109/SBST.2019.00014

DO - 10.1109/SBST.2019.00014

M3 - Conference contribution

T3 - Proceedings - 2019 IEEE/ACM 12th International Workshop on Search-Based Software Testing, SBST 2019

SP - 15

EP - 20

BT - Proceedings - 2019 IEEE/ACM 12th International Workshop on Search-Based Software Testing, SBST 2019

PB - Institute of Electrical and Electronics Engineers Inc.

ER -

Kifetew F, Devroey X, Rueda U. Java Unit Testing Tool Competition - Seventh Round. Dans Proceedings - 2019 IEEE/ACM 12th International Workshop on Search-Based Software Testing, SBST 2019. Institute of Electrical and Electronics Engineers Inc. 2019. p. 15-20. 8812209. (Proceedings - 2019 IEEE/ACM 12th International Workshop on Search-Based Software Testing, SBST 2019). https://doi.org/10.1109/SBST.2019.00014