Noises in Interaction Traces Data and Their Impact on Previous Research Studies

Zéphyrin Soh, Thomas Drioul, Pierre Antoine Rappe, Foutse Khomh, Yann Gaël Guéhéneuc, Naji Habra

Résultats de recherche: Contribution dans un livre/un catalogue/un rapport/dans les actes d'une conférenceArticle dans les actes d'une conférence/un colloque

Résumé

Context: Developers' interaction traces (ITs) are commonly used in software engineering to understand how developers maintain and evolve software systems. Researchers make several assumptions when mining ITs, e.g., edit events are considered to be change activities and the time mined from ITs is considered to be the time spent by the developers performing the maintenance task. Goal: We investigate the extent to which these assumptions are correct. We examine noises in developers'''' ITs data and the impact of these noises on previous results derived from these traces. Approach: We perform an experiment with 15 participants, whom we asked to perform bug-fixing activities and collect Mylyn ITs and VLC video captures. We then investigate noises between the two data sets and propose an approach to correct noises in ITs. Results: We find that Mylyn ITs can miss on average about 6% of the time spent performing a task and contain on average about 28% of false edit-events. We report that these noises may have led researchers to mislabel some participants'''' editing styles in about 34% of the cases and that the numbers of edit-events performed by developers and the times that they spent on tasks are correlated, when they were considered not to be. Conclusion: We show that ITs must be carefully cleaned before being used in research studies.

langue originaleAnglais
titreInternational Symposium on Empirical Software Engineering and Measurement
EditeurIEEE Computer Society Press
Pages1-10
Nombre de pages10
Volume2015-November
ISBN (imprimé)9781467378994
Les DOIs
Etat de la publicationPublié - 5 nov. 2015
EvénementACM/IEEE International Symposium on Empirical Software Engineering and Measurement, ESEM 2015 - Beijing, Chine
Durée: 22 oct. 201523 oct. 2015

Une conférence

Une conférenceACM/IEEE International Symposium on Empirical Software Engineering and Measurement, ESEM 2015
Pays/TerritoireChine
La villeBeijing
période22/10/1523/10/15

Empreinte digitale

Examiner les sujets de recherche de « Noises in Interaction Traces Data and Their Impact on Previous Research Studies ». Ensemble, ils forment une empreinte digitale unique.

Contient cette citation