Tracking the effectiveness of usability evaluation methods

Behaviour and Information Technology

Volumn 16, Issue 4-5, 1997, Pages 188-202

  John, Bonnie E ^a   Marks, Steven J ^b  

^a Carnegie Mellon University ^*  (United States)

^b CGvL Engineers   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COGNITIVE SYSTEMS; COMPUTER SCIENCE; DESIGN; EVALUATION; HUMAN COMPUTER INTERACTION;

USABILITY;

INFORMATION TECHNOLOGY;

EID: 0031186483     PISSN: 0144929X     EISSN: 13623001     Source Type: Journal    
DOI: 10.1080/014492997119789     Document Type: Article

References (31)

1. Butler, K. A., Jacob, R. J. K. and John, B. E. 1994, Introduction and overview of human-computer interaction, Companion Proceedings of ACM CHI’94 Conference on Human Factors in Computing Systems, (ACM, New York), Vol 2, 351-352.
2. Carroll, J. M. and Rosson, M.-B. 1987, The paradox of the active user, in J. M. Carroll (ed.), Interfacing thought (MIT Press, Cambridge, MA), 80-111.
3. Carroll, J. M. and Rosson, M. B. 1991, Deliberated evolution: stalking the view matcher in design space, Human-Computer Interaction, 6, 281-318.
4. Cook, T. D. and Campbell, D. T. 1979, Quasi-experimentation: Design and analysis issues for field settings (Houghton Mifflin Comany, Geneva, IL).
5. Dillon, A., Sweeney, M. and Maguire, M. 1993, A survey of usability engineering within the European IT industry- current practice and needs, Proceedings of the HCI’93 Conference on People and Computers VIII, Cambridge University Press, Cambridge UK, 81-94.
6. Gallagher, S. and Meter, S. 1993, Volume View Interface Design, School of Computer Science, Carnegie Mellon University.
7. Gray, W. D., John, B. E. and Atwood, M. E. 1993, Project Ernestine: validating a GOMS analysis for predicting and explaining real-world task performance, Human-Computer Interaction, 8, 237-309.
8. Gray, W. D. and Salzman, M. C. 1996, Damaged merchandise? A review of experiments that compare usability evaluation methods. Manuscript submitted for publication.
9. Hartson, H. R., Siochi, A. C. and Hix, D. 1990, The UAN: A user-oriented representation for direct manipulation interface designs. ACM Transactions on Information Systems, 8, 181-203.
10. Jeffries, R., Miller, J. R., Wharton, C. and Uyeda, K. M. 1991, User interface evaluation in the real world: A comparison of four techniques, Proceedings of CHI, 1991 (New Orleans, Louisiana, April 28-May 2, 1991), (ACM, New York) 119-124.
11. John, B. E. and Kieras, D. E. 1996, Using GOMS for user interface design and evaluation: Which technique? ACM Transactions on Computer-Human Interaction, 3, 287-319.
12. John, B. E. and Marks, S. J. 1996, Tracking the effectiveness of usability evaluation methods (Human-Computer Interaction Institute Technical Report CMU-HCII-96-102), Carnegie Mellon University.
13. John, B. E. and Mashyna, M. M. 1997, Evaluating a multimedia authoring tool with cognitive walkthrough and think-aloud user studies. Journal of the American Society of Information Science, 48 (9).
14. John, B. E. and Packer, H. 1995, Learning and using the Cognitive Walkthrough Method: A case study approach, Proceedings of CHI, 1995 (Denver, Colorado, May 7-11, 1995), (ACM, New York), 429-436.
15. Kellogg, W. A. 1989, Qualitative Artifact Analysis, (Research Report RC 15768), IBM T. J. Watson Research Center.
16. Kieras, D. E. 1994, A guide to GOMS task analysis (Spring 1994), University of Michigan.
17. Lewis, C. 1982, Using the ‘thinking-aloud’ method in cognitive interface design, (Research Report RC9265), IBM T. J. Watson Research Center.
18. Lewis, J. R. 1994, Sample sizesfor usability studies: Additional considerations. Human Factors, 36, 368-378.
19. Marks, S. J. 1996, Exploratory evaluation of usability inspection techniques. Unpublished Undergraduate Senior Thesis, Carnegie Mellon University.
20. Miller, P. L., Pane, J. F., Meter, G. and Vorthmann, S. 1994, Evolution of novice programming environments: the structure editors of Carnegie Mellon University, Interactive Learning Environments, 4, 140-158.
21. Molich, R. and Nielsen, J. 1990, Improving a human-computer dialog, Communications of the ACM, 33, 338-348.
22. Nielsen, J. 1993, Usability Engineering, (Academic Press, Boston, MA).
23. Nielsen, J. and Landauer, T. K. 1993, A mathematical model of the finding of usability problems, Proceedings of INTERCHI, 1993 (Amsterdam, April 24-April 29, 1993). (ACM, New York), 206-213.
24. Nielsen, J. and Mack, R. L. (eds), 1994, Usability Inspection Methods, (John Wiley, New York).
25. Pane, J. F., Corbett, A. T. and John, B. E. 1996, Assessing dynamics in computer-based instruction, Proceedings of CHI, 1996 (Vancouver, BC, April 14-18, 1996), (ACM, New York), 197-204.
26. Rieman, J. 1993, The diary study: A workplace-oriented research tool to guide laboratory efforts, Proceedings of INTERCHI, 1993 (Amsterdam, The Netherlands, 24-29 April, 1993), (ACM, New York), 321-326.
27. Sanderson, P. M., Scott, J. P., Johnston, T., Mainzer, j., Wanatabe, L. M. and James, J. M. 1994, MacShapa and the enterprise of Exploratory Sequential Data Analysis (ESDA). International Journal of Human-Computer Studies, 41, 633-681.
28. Siochi, A. and Hartson, H. R. 1989, Task oriented representation of asynchronous user interfaces, Proceedings of CHI, 1989 (Austin, Texas, April 30-May 4, 1989), (ACM, New York), 183-188.
29. Virzi, R. A. 1990, Streamlining the design process: Running fewer subjects, Proceedings of the Human Factors Society 34th Annual Meeting, (Human Factors Society, Santa Monica, CA), 291-294.
30. Virzi, R. A. 1992, Refining the test phase of usability evaluation: How many subjects is enough? Human Factors, 34, 457-468.
31. Wharton, C., Rieman, j., Lewis, C. and Polson, P. 1994, The Cognitive Walkthrough Method: A practitioner’s guide, in J. Nielsen and R. L. Mack (eds), Usability Inspection Methods, (John Wiley & Sons, Inc, New York), 105-140.