Integrating runtime data with development data to monitor external quality: challenges from practice
Aytaj Aghabayli, Dietmar Pfahl, Silverio Martínez-Fernández
Aug 26, 2019
Citations
2
Citations
Journal
Proceedings of the 2nd ACM SIGSOFT International Workshop on Software Qualities and Their Dependencies
Full text
Semantic Scholar
Key Takeaway Key Takeaway: Integrating runtime and development data in software projects can weakly correlate external quality with internal quality, but data cleaning and higher quality data are needed for more robust correlations.
Abstract
The use of software analytics in software development companies has grown in the last years. Still, there is little support for such companies to obtain integrated insightful and actionable information at the right time. This research aims at exploring the integration of runtime and development data to analyze to what extent external quality is related to internal quality based on real project data. Over the course of more than three months, we collected and analyzed data of a software product following the CRISP-DM process. We studied the integration possibilities between runtime and development data, and implemented two integrations. The number of bugs found in code has a weak positive correlation with code quality measures and a moderate negative correlation with the number of rule violations found. Other types of correlations require more data cleaning and higher quality data for their exploration. During our study, several challenges to exploit data gathered both at runtime and during development were encountered. Lessons learned from integrating external and internal data in software projects may be useful for practitioners and researchers alike.