Do faster releases improve software quality? An empirical case study of Mozilla Firefox

IEEE International Working Conference on Mining Software Repositories

Volumn , Issue , 2012, Pages 179-188

  Khomh, Foutse ^a   Dhaliwal, Tejinder ^a   Zou, Ying ^a   Adams, Bram ^b  

^a QUEEN S UNIVERSITY   (Canada)

^b ÉCOLE POLYTECHNIQUE DE MONTRÉAL   (Canada)

Author keywords

bugs; release cycle; software quality; Software release; testing

Indexed keywords

BUGS; CRASH RATE; CYCLE LENGTH; DEVELOPMENT PROCESS; EMPIRICAL CASE STUDIES; END USERS; FIREFOX; MARKETING OPPORTUNITIES; MOZILLA; RELEASE CYCLE; SOFTWARE COMPANY; SOFTWARE EXECUTION; SOFTWARE PRODUCTS; SOFTWARE QUALITY; WAITING-TIME;

COMPUTER SOFTWARE SELECTION AND EVALUATION; INDUSTRY; SOFTWARE TESTING; TESTING; WEB BROWSERS;

PROGRAM DEBUGGING;

EID: 84865113814     PISSN: 21601852     EISSN: 21601860     Source Type: Conference Proceeding    
DOI: 10.1109/MSR.2012.6224279     Document Type: Conference Paper

References (35)

1. "Shorten release cycles by bringing developers to application lifecycle management," HP Applications Handbook, Retrieved on Febuary 08, 2012. [Online]. Available: http://bit.ly/x5PdXl
2. "Mozilla puts out firefox 5.0 web browser which carries over 1,000 improvements in just about 3 months of development," InvestmentWatch on June 25th, 2011. Retrieved on January 12, 2012. [Online]. Available: http://bit.ly/aecRrL
3. K. Beck and C. Andres, Extreme Programming Explained: Embrace Change (2nd Edition). Addison-Wesley, 2004.
4. O. Baysal, I. Davis, and M. W. Godfrey, "A tale of two browsers," in Proc. of the 8th Working Conf. on Mining Software Repositories (MSR), 2011, pp. 238-241.
5. A. Porter, C. Yilmaz, A. M. Memon, A. S. Krishna, D. C. Schmidt, and A. Gokhale, "Techniques and processes for improving the quality and performance of open-source software," Software Process: Improvement and Practice, vol. 11, no. 2, pp. 163-176, 2006.
6. T. Downer, "Some clarification and musings," Accessed on January 06, 2012. [Online]. Available: http://bit.ly/q8RCuw
7. "Web browsers (global marketshare)," Roxr Software Ltd. Retrieved on January 12, 2012. [Online]. Available: http://bit.ly/81klgi
8. S. Shankland, "Google ethos speeds up chrome release cycle," http://cnet.co/wlS24U, July 2010.
9. -, "Rapid-release firefox meets corporate backlash," http://cnet.co/ktBsUU, June 2011.
10. "New channels for firefox rapid releases," The Mozilla Blog. 2011-04-13. Retrieved on January 12, 2012. [Online]. Available: http://bit.ly/hc1zmY
11. R. Paul, "Mozilla outlines 16-week firefox development cycle," 2011. [Online]. Available: http://bit.ly/fLHEfo
12. "Socorro: Mozilla's crash reporting system," Accessed on March 29, 2011. [Online]. Available: http://bit.ly/9A9zKP
13. I. Herraiz, E. Shihab, T. H. D. Nguyen, and A. E. Hassan, "Impact of installation counts on perceived quality: A case study on debian." in Proc. of the 18th Working Conf. on Reverse Engineering (WCRE), 2011, pp. 219-228.
14. M. Hollander and D. A. Wolfe, Nonparametric Statistical Methods, 2nd ed. John Wiley and Sons, inc., 1999.
15. F. Khomh, B. Chan, Y. Zou, and A. E. Hassan, "An entropy evaluation approach for triaging field crashes: A case study of mozilla firefox," in Proc. of the 18th Working Conf. on Reverse Engineering (WCRE), 2011.
16. M. Marschall, "Transforming a six month release cycle to continuous flow," in Proc. of the conf. on AGILE, 2007, pp. 395-400.
17. "Understanding the corporate impact," Retrieved on January 12, 2012. [Online]. Available: http://bit.ly/mBzP37
18. "Why do companies stay on old technology?" Retrieved on January 12, 2012. [Online]. Available: http://bit.ly/k3fruK
19. "Mozilla proposes not-so-rapid-release firefox," CNET, Retrieved on February 08, 2012. [Online]. Available: http://cnet.co/mQZ6Tf
20. R. K. Yin, Case Study Research: Design and Methods - Third Edition, 3rd ed. SAGE Publications, 2002.
21. "Sourcemonitor," Accessed on January 12, 2012. [Online]. Available: http://bit.ly/9AKzN8
22. T. Otte, R. Moreton, and H. D. Knoell, "Applied quality assurance methods under the open source development model," in Proc. of the 32nd Annual IEEE Intl. Computer Software and Applications Conf. (COMPSAC), 2008, pp. 1247-1252.
23. A. W. Brown, "A case study in agile-at-scale delivery," in Proc. of the 12th Intl. Conf. on Agile Processes in Software Engineering and Extreme Programming (XP), vol. 77, May 2011, pp. 266-281.
24. J. Jenkins, "Velocity culture (the unmet challenge in ops)," Presentation at O'Reilly Velocity Conference, June 2011.
25. E. Gamma, "Agile, open source, distributed, and on-time - inside the eclipse development process," Keynote at the 27th Intl. Conf. on Software Engineering (ICSE), May 2005.
26. T. van der Storm, "Continuous release and upgrade of component-based software," in Proc. of the 12th intl. wrksh. on Softw. configuration management (SCM), 2005, pp. 43-57.
27. E. Dolstra, M. de Jonge, and E. Visser, "Nix: A safe and policy-free system for software deployment," in Proc. of the 18th USENIX conf. on System admin., 2004, pp. 79-92.
28. P. Duvall, S. M. Matyas, and A. Glover, Continuous Integration: Improving Software Quality and Reducing Risk. Addison-Wesley Professional, 2007.
29. J. Humble and D. Farley, Continuous Delivery: Reliable Software Releases through Build, Test, and Deployment Automation, 1st ed. Addison-Wesley Professional, 2010.
30. S. Kong, J. E. Kendall, and K. E. Kendall, "The challenge of improving software quality: Developers' beliefs about the contribution of agile practices," in Proc. of the Americas Conf. on Information Systems (AMCIS), August 2009, p. 12p.
31. VersionOne, "4th annual state of agile survey," http://bit.ly/6BPw5, 2009.
32. P. Hodgetts and D. Phillips, eXtreme Adoption eXperiences of a B2B Start Up. Addison-Wesley Longman Publishing Co., Inc., 2002, ch. 30, extreme Programming Perspectives.
33. S. Kuppuswami, K. Vivekanandan, P. Ramaswamy, and P. Rodrigues, "The effects of individual xp practices on software development effort," SIGSOFT Softw. Eng. Notes, vol. 28, p. 6p., November 2003.
34. K. J. Stewart, D. P. Darcy, and S. L. Daniel, "Observations on patterns of development in open source software projects," SIGSOFT Softw. Eng. Notes, vol. 30, pp. 1-5, May 2005.
35. S. Jansen and S. Brinkkemper, "Ten misconceptions about product software release management explained using update cost/value functions," in Proc. of the Intl. Workshop on Software Product Management, 2006, pp. 44-50.