A survey of software testing practices in Canada

Journal of Systems and Software

Volumn 86, Issue 5, 2013, Pages 1354-1376

  Garousi, Vahid ^a,b   Zhi, Junji ^a  

^a UNIVERSITY OF CALGARY   (Canada)

^b MIDDLE EAST TECHNICAL UNIVERSITY   (Turkey)

Author keywords

Canada; Industry practices; Software testing; Survey

Indexed keywords

ACCEPTANCE TESTS; BUDGET CONTROL; COMPUTER PROGRAMMING; LIFE CYCLE; QUALITY ASSURANCE; SOFTWARE DESIGN; SURVEYING; SURVEYS;

CANADA; DEVELOPMENT APPROACH; INDUSTRY PRACTICES; ONLINE DISCUSSION FORUMS; SOFTWARE DEVELOPMENT LIFE CYCLE; SOFTWARE PRACTITIONERS; TEST DRIVEN DEVELOPMENT; WEB APPLICATION TESTING;

SOFTWARE TESTING;

EID: 84875265017     PISSN: 01641212     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jss.2012.12.051     Document Type: Article

References (55)

1. A. Abran, P. Bourque, R. Dupuis, and J.W. Moore Guide to the Software Engineering Body of Knowledge (SWEBOK) 2001 IEEE Press
2. S. Ali, T. Yue, L.C. Briand, and S. Walawege A product line modeling and configuration methodology to support model-based testing: an industrial case study MoDELS 2012 726 742
3. S. Ambler Test driven development (TDD): reality over rhetoric Dr. Dobb's Journal 2009, January http://www.ddj.com/architect/212902568?cid=Ambysoft (cited October 2009)
4. C. Andersson, and P. Runeson Verification and validation in industry-a qualitative survey on the state of practice Proceedings of the International Symposium on Empirical Software Engineering 2002 37 47
5. V.R. Basili Software Modeling and Measurement: The Goal/Question/Metric Paradigm, Technical Report 1992 University of Maryland at College Park
6. (Canadian) Consortium for Software Engineering. www.cser.ca (accessed April 2012).
7. A. Cater-Steel Addressing the challenges of replications of surveys in software engineering research International Symposium on Empirical Software Engineering 2005
8. A. Causevic, D. Sundmark, and S. Punnekkat An industrial survey on contemporary aspects of software testing International Conference on Software Testing Verification and Validation 2010 393 401
9. J.R. Cordy Comprehending reality-practical barriers to industrial adoption of software maintenance automation Proceedings of the IEEE International Workshop on Program Comprehension 2003 196 205
10. L. Crispin, and J. Gregory Agile Testing: A Practical Guide for Testers and Agile Teams 2008 Pearson Education
11. M.A. Cusumano, and D.B. Yoffie Software development in internet time IEEE Computer 32 10 1999 60 69
12. E. Engström, and P. Runeson A qualitative survey of regression testing practices International Conference on Product-Focused Software Process Improvement 2010 3 16
13. V. Garousi An open modern software testing laboratory courseware: an experience report Proceedings of the 23rd IEEE Conference on Software Engineering Education and Training 2010 177 184
14. V. Garousi Recent Trends in Software Testing: Opportunities for Industry-Academia Collaborations, Invited Speaker 2010, June 30 YouTube Corporation San Bruno, CA
15. V. Garousi Metrics and measurement in software testing Invited Talk and Workshop, Toronto TesTrek Symposium Organized by the Quality Assurance International (QAI) Global Institute, October 18-20 2010
16. V. Garousi Incorporating real-world industrial testing projects in software testing courses: opportunities, challenges, and lessons learned Proceedings of the IEEE Conference on Software Engineering Education and Training (CSEE&T) 2011 396 400
17. V. Garousi Better Software Testing Through University/Industry Collaborations, Invited Talk 2011, September 20 Calgary Software Quality Discussion Group (SQDG)
18. V. Garousi, and A. Mathur Current state of the software testing education in North American academia and some recommendations for the new educators Proceedings of the 23rd IEEE Conference on Software Engineering Education and Training 2010 89 96
19. V. Garousi, and T. Varma A replicated survey of software testing practices in the Canadian Province of Alberta: what has changed from 2004 to 2009? Journal of Systems and Software 83 11 2010 2251 2262
20. V. Garousi, and J. Zhi A Survey of Software Testing Practices in Canada (2010) 2012, October www.softqual.ucalgary.ca/projects/2010/Survey-Software- Testing-Practices-in-Canada (accessed October 2012)
21. D.A. Garvin Managing Quality: The Strategic and Competitive Edge 1988 Free Press
22. D. Gelperin, and B. Hetzel The growth of software testing Communications of the ACM 31 6 1988 687 695
23. A.M. Geras, M.R. Smith, and J. Miller A survey of software testing practices in Alberta Canadian Journal of Electrical and Computer Engineering 29 3 2004 183 191
24. M. Grindal, J. Offutt, and J. Mellin On the testing maturity of software producing organizations Testing: Academia & Industry Conference-Practice And Research Techniques 2006
25. M. Hayes Quality first Information Week 889 2002 38 54
26. K. Iberle, and S. Bartlett Estimating tester to developer ratios (or not) Pacific Northwest Software Quality Conference 2001 http://www.stickyminds.com/ s.asp?F=S6174-ART-2
27. IBM IBM CASCON (Centre for Advanced Studies Conference) 2012 www.ibm.com/ibm/cas/cascon (accessed April 2012)
28. Y. Jia, and M. Harman An analysis and survey of the development of mutation testing IEEE Transactions on Software Engineering 37 5 2011 649 678
29. S.A. Jolly, V. Garousi, and M.M. Eskandar Automated unit testing of a SCADA control software: an industrial case study based on action research IEEE International Conference on Software Testing, Verification and Validation (ICST) 2012 400 409
30. J. Kasurinen, P. Runeson, L. Riungu, and K. Smolander A self-assessment framework for finding improvement objectives with ISO/IEC 29119 test standard European Conference on Software Process Improvement 2011 25 36
31. J. Kasurinen, O. Taipale, and K. Smolander How test organizations adopt new testing practices and methods? International Conference on Software Testing, Verification and Validation 2011 553 558
32. L. Koskela Test Driven: TDD and Acceptance TDD for Java Developers 2007 Manning Publications
33. D. Martin, J. Rooksby, M. Rouncefield, and I. Sommerville 'Good' organisational reasons for 'bad' software testing: an ethnographic study of testing in a small software company International Conference on Software Engineering 2007 602 611
34. A.P. Mathur Foundations of Software Testing 2008 Pearson Education
35. S.P. Ng, T. Murnane, K. Reed, D. Grant, and T.Y. Chen A preliminary survey on software testing practices in Australia Proceedings of Australian Software Engineering Conference 2004 116 125
36. C. Pinheiro, V. Garousi, F. Maurer, and J. Sillito Introducing automated environment configuration testing in an industrial setting Proceedings of the International Conference on Software Engineering and Knowledge Engineering, Workshop on Software Test Automation, Practice, and Standardization 2010 186 191
37. Quality Assurance Institute Status of Software Testing 2002, March www.geocities.com/mtarrani/StatusOfSoftwareTesting.doc (cited October 2009)
38. H. Rubin, E. Yourdon, and H. Battaglia Industry Canada: Worldwide Benchmark Project 1995 Rubin Systems Inc.
39. P. Runeson A survey of unit testing practices IEEE Software 23 4 2006 22 29
40. P. Runeson, and M. Höst Guidelines for conducting and reporting case study research in software engineering Empirical Software Engineering 14 2 2009 131 164
41. P. Runeson, C. Andersson, and M. Host Test processes in software product evolution-a qualitative survey on the state of practice Journal of Software Maintenance and Evolution: Research and Practice 15 2003 41 59
42. R.L. Scheaffer, W. Mendenhall, R.L. Ott, and K. Gerow Elementary Survey Sampling 2011 Cengage Learning
43. K. Schwaber, M. Beedle, and R.C. Martin Agile Software Development with Scrum 2001 Prentice Hall
44. Software Engineering Research Group (SERG) Workshop on Enhancing Software Engineering Practices among Alberta's Industry, Government, and Universities in Alberta (SEAB) 2007 http://www.serg.ucalgary.ca/SEAB/2007 (accessed April 2012)
45. Statistics Canada Software Development and Computer Services Service Bulletin (Data for Year 2007) 2007 http://dsp-psd.pwgsc.gc.ca/collection-2009/ statcan/63-255-X/63-255-x2009001-eng.pdf (accessed February 2010)
46. O. Taipale, K. Smolander, and H. Kälviäinen Finding and ranking research directions for software testing European Conference on Software Process Improvement 2005 39 48
47. G. Tassey, 2002. The Economic Impacts of Inadequate Infrastructure for Software Testing, Planning Report 02-3. Prepared by RTI for the National Institute of Standards and Technology (NIST). http://www.nist.gov/director/prog- ofc/report02-3.pdf.
48. The Standish Group Extreme CHAOS 2001 http://www.standishgroup.com/ sample-research/showfile.php?File=extreme-chaos.pdf (cited October 2009)
49. The Standish Group CHAOS Manifesto 2009, October https://secure. standishgroup.com/newsroom/chaos-manifesto.php (cited October 2009)
50. TMMi Foundation TMMi Reference Model v2.0 2010 http://www.tmmifoundation. org/downloads/tmmi/TMMi%20Framework.pdf (accessed February 2010)
51. R. Torkar, and S. Mankefors A survey on testing and reuse Proceedings of IEEE International Conference on Software: Science, Technology and Engineering 2003 164 173
52. US Government Accounting Office Greater Emphasis on Testing needed to Make Computer Software more Reliable and Less Costly 1983 Report # GAO/IMTEC-64.2
53. J. Whittaker Google vs. Microsoft, and the Dev:Test Ratio Debate 2008, December http://blogs.msdn.com/james-whittaker/archive/2008/12/09/google-v- microsoft-and-the-dev-test-ratio-debate.aspx (cited October 2009)
54. C. Wohlin, P. Runeson, M. Höst, M.C. Ohlsson, and B. Regnell Experimentation in Software Engineering: An Introduction 2000 Kluwer International Series in Software Engineering
55. M.A. Wojcicki, and P. Strooper A state-of-practice questionnaire on verification and validation for concurrent programs Proc. of workshop on Parallel and Distributed Systems: Testing and Debugging 2006 1 10