Tampere University of Technology

TUTCRIS Research Portal

Guidelines for improving the testing process of open source software

Research output: Contribution to journalArticleScientificpeer-review


Original languageEnglish
Pages (from-to)1-22
Number of pages22
JournalInternational Journal of Open Source Software and Processes
Issue number2
Publication statusPublished - Apr 2011
Externally publishedYes
Publication typeA1 Journal article-refereed


Open Source Software (OSS) products do not usually follow traditional software engineering development paradigms. Specifically, testing activities in OSS development may be quite different from those carried out in Closed Source Software (CSS) development. As testing and verification require a good deal of resources in OSS, it is necessary to have ways to assess and improve OSS testing processes. This paper provides a set of testing guidelines and issues that OSS developers can use to decide which testing techniques make most sense for their OSS products. This paper 1) provides a checklist that helps OSS developers identify the most useful testing techniques according to the main characteristics of their products, and 2) outlines a proposal for a method that helps assess the maturity of OSS testing processes. The method is a proposal of a Maturity Model for testing processes (called OSS-TMM). To show its usefulness, the authors apply the method to seven real-life projects. Specifically, the authors apply the method to BusyBox, Apache Httpd, and Eclipse Test & Performance Tools Platform to show how the checklist supports and guides the testing process of these OSS products.

ASJC Scopus subject areas


  • Open Source Software (OSS) Quality, Survey, Testing Process, Testing Quality Assessment, Trustworthiness