The 'magic number 5': Is it enough for web testing?

Information Design Journal

Volumn 11, Issue 2-3, 2002, Pages 160-170

  Barnum, Carol ^a  

^a SOUTHERN POLYTECHNIC STATE UNIVERSITY   (United States)

Author keywords

Number of users; Reliability; Usability testing; Web usability

Indexed keywords

EID: 33749573258     PISSN: 01425471     EISSN: 1569979X     Source Type: Journal    
DOI: 10.1075/idj.11.2.08bar     Document Type: Article

References (20)

1. Bailey, B. (2001) How reliable is usability performance testing? UI Design Update Newsletter, Sept. 2001. http://www.humanfactors.com/downloads/ sep01.asp
2. Barnum, C. (2002) Usability Testing and Research. New York: Longman. http://www.ablongman.com/barnum
3. Cockton, G. and Woolrych, A. (2002) Sale must end: Should discount methods be cleared off HCI shelves? Interactions. Sept./Oct 2002.
4. Dumas, J. (1999) Usability testing methods: When does a usability test become a research experiment? Common Ground 9 1 pp. 3-5.
5. Hudson, W. (2001) How many users does it take to change a web site? SIGCHI Bulletin, May/June 2001.
6. Kessner, M., Wood, J, Dillon, R.F., and West, R.L. (2001) On the reliability of usability testing. CHI 2001. Poster.
7. Lewis, J.R. (1994) Sample sizes for usability studies: Additional considerations. Human Factors 36, pp. 368-378.
8. Molich, R. (1998) CUE Comparative Usability Evaluation. http://www.dialogdesign.dk/cue.html
9. Molich, R., Damgaard Thomsen, A., Karyukina, B., Schmidt, L., Ede, M., Oel, W. van, Arcuri, M. (1999). Comparative evaluation of usability tests. CHI 99 Extended Abstracts, pp. 83-84.
10. Nielsen, J. (1989) Usability engineering at a discount. Designing and Using Human-Computer Interfaces and Knowledge Based Systems. pp. 394-401. In G. Salvendy and M.J. Smiths (Eds.) Amsterdam: Elsevier.
11. Nielsen, J. (1990) Evaluating the thinking-aloud technique for use by computer scientists. In H. Hartson and D. Hix (Eds.) Advances in Human Computer Interaction, 2. pp. 69-82. Norwood, NJ: Ablex.
12. Nielsen, J. (1994) Guerilla HCI: Using discount usability engineering to penetrate the intimidation barrier. pp. 242-272 in: R.G. Bias and D.J. Mayhew (Eds.) Cost-Justifying Usability. Boston: Academic Press.
13. Nielsen, J. (2000) Why you only need to test with 5 users. Alertbox, Mar 2000. http://www.useit.com/alertbox/20000319.html
14. Nielsen, J. (2001) Success rate: The simplest usability metric, Alertbox, 18 February 2001 http://www.useit.com/alertbox/20010218.html
15. Schroeder, W. Learning from the work of others. http://www.uie.com/ Articles/molich.htm
16. Spool, J. (2000) Latest findings from usability research, UPA Annual Conference, 2000.
17. Spool, J. (2001) Eight is not enough. UIEtips, 5 June 2001.
18. Spool, J. and Schroeder, W. (2001) Testing websites: Five users is nowhere near enough, CHI 2001 Extended Abstracts pp. 285-286.
19. Virzi, R. (1990) Streamlining the design process: Running fewer subjects. Proceedings of the Human Factors Society 34th Annual Meeting, pp 291-294.
20. Virzi, R. (1992) Refining the test phase of usability evaluation: How many subjects is enough? Human Factors, 34, pp. 457-468.