Prioritizing usability problems: Data-driven and judgement-driven severity estimates

Behaviour and Information Technology

Volumn 19, Issue 1, 2000, Pages 29-42

  Hassenzahl, Marc ^a  

^a SIEMENS AG   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER SOFTWARE; COSTS; HEURISTIC METHODS; PROBLEM SOLVING; USABILITY ENGINEERING;

SOFTWARE-ERGONOMIC SYSTEMS;

ERGONOMICS;

EID: 0033993172     PISSN: 0144929X     EISSN: 13623001     Source Type: Journal    
DOI: 10.1080/014492900118777     Document Type: Article

References (31)

1. Bortz, J. 1989, Statistik Fur Sozialwissenschaftler. [Statistics for social scientists] Berlin, Heidelberg, New York: Springer
2. Bortz, J. And Doring, N. 1995, Forschungsmethoden und Evaluation für Sozialwissenschaftler, 2. Auflage [Research methods and evaluation for social sciences, 2nd ed] (Berlin: Springer).
3. Brodbeck, F. C. 1991, Fehlerbewaltigungszeiten und die Nutzung von UnterstUtzungsmoglichkeiten [Error handling time and the usage of support facilities]. In M. Frese and D. Zapf (eds) Fehler bei der Arbeit mit dem Computer-Ergebnisse von Beobachtungen und Befragungen im Burobereich (Bern, Huber): 80-94.
4. Carroll, J. M. And Mack, R. L. 1984, Learning to use a word processor: By doing, by thinking, and by knowing. In J. C. Thomas and M. L. Schneider (eds), Human Factors in Computer Systems (Norwood, NJ: Ablex).
5. Covey, S. R., Merrill, A. R and Merrill, R. R. 1994, First Things First (New York: Simon & Schuster).
6. Eilers, K., Nachreiner, F. And HAnecke, K. 1986, Entwicklung und Überprüfung einer Skala zur Erfassung subjektiv erlebter Antrengung [Development and evaluation of a scale for measuring subjective mental effort]. Zeitschrift fur Arbeitswissenschaft, 40, 215-224.
7. Fleiss, J. L., 1971, Measuring nominal scale agreement among many raters. Psychological Bulletin, 76, 378-382.
8. Greenbaum, J. And Kyng, M. 1991, Design at work: cooperative design of computer systems (Hillsdale, NJ: Lawrence Erlbaum Associates).
9. Hassenzahl, M., PrUmper, J. And Sailer, U. 1997, Die Priorisierung von Problemhinweisen in der software-ergonomischen Qualitätssicherung [The prioritization of usability problems]. In R. Liskowsky, B. M. Velichkovsky, and W. Wunschmann (eds), Software-Ergonomie’97. Usability Engineering: Integration von Mensch-Computer-Interaktion und Software-Entwicklung (Stuttgart: B. G. Teubner), 191-201.
10. ISO 1996, ISO 9241: Ergonomic requirements for office work with visual display terminals. Part 11: Guidance on usability, International Organization for Standardization.
11. Jeffries, R., Miller, J. R., Wharton, C. And Uyeda, K. M. 1991, User interface evaluation in the real world: A comparison of four techniques. In CHI’91 Conference Proceedings, 119-124.
12. Jorgenson, A. H. 1989, Using the thinking-aloud method in system development. In G. Salvendy and M. J. Smith (eds), Designing and Using Human-Computer Interfaces and Knowledge Based Systems. (Amsterdam: Elsevier), 743-750.
13. Karat, C.-M., Campbell, R. And Fliegel, T. 1992, Comparison of empirical testing and walkthrough methods in userinterface evaluation. In CHI’92 Conference Proceedings, 397-404.
14. Kensik, A., PrUmper, J. And Frese, M. 1995, Ergonomische Gestaltung von Software auf Grundlage handlungsorientierter Fehleranalysen. In H. D. Bocker (ed), SoftwareErgonomie’95-Anwendungsbereiche lernen voneinander (Stuttgart: B. G. Teubner), 217-232.
15. Neale, J. M. And Liebert, R. M. 1973, Science and behavior. (Englewood Cliffs, NJ: Prentice-Hall).
16. Nielsen, J. 1992, Reliability of Severity Estimates for Usability Problems Found by Heuristic Evaluation. In CHI’92 Conference Proceedings-Posters and Short Talks. 129-130.
17. Nielsen, J. 1993a, Heuristic Evaluation. In J. Nielsen and R. L. Mack (eds), Usability Inspection Methods (New York: Wiley), 25-62.
18. Nielsen, J. 1993b, Usability Engineering (Boston, San Diego: Academic Press).
19. Nielsen, J. 1994, Estimating the number of subjects needed for a thinking aloud test. International Journal of HumanComputer Studies, 41, 385-397.
20. Oppermann, R. And Reiterer, R. 1997, Software evaluation using the 9241 evaluator. Behavior & Information Technology, 16, 232-245.
21. Pomberger, G. And Blaschek, G. 1996, Software Engineering. Prototypen und objekt-orientierte Software-Entwicklung, 2. Auflage [Software engineering. Prototypes and object-oriented software development, 2nd ed] (Mtinchen, Wien: Hanser).
22. PrUmper, J., Sailer, U. And Hassenzahl, M. 1997, Pegasus: Partizipative Evaluation und Gestaltung aufgabenorientierter Software unter Berücksichtigung europäischer Standards [Participative evaluation and design of software with regard to European standards]. In R. Liskowsky, B. M. Velichkovsky and W. Wunschmann (eds), Software-Ergonomie’97. Usability Engineering: Integration von Mensch-Compu-ter-Interaktion und Software-Entwicklung. (Stuttgart: B. G. Teubner), 367.
23. Smilowitz, E. D., Darnell, M. And Benson, A. E. 1993, Are we overlooking some usability testing methods? A comparison of lab, beta, and forum tests. Behaviour & Information Technology, 13, 183-190.
24. Staples, S. 1996, Human Response to Environmental Noise: Psychological Research and Public Policy. American Psychologist, 51, 143 -150.
25. Udris, I. And Ulich, E. 1987, Organisations-und Technikgestaltung: Prozeß-und partizipationsorientierle Arbeitsanalysen [Design of organisations and technology: process-and participation-oriented task-analysis]. In K. Sonntag (ed) Arbeitsanalyse und Technikentwicklung (Köln: Bachem), 49-64.
26. Virzi, R. E. 1992, Refining the test phase of usability evaluation: How many subjects is enough? Human Factors, 4, 457-468.
27. Wright, P. C. And Monk, A. F. 1991, A cost-effective evaluation method for use by designers, International Journal of Man-Machine Studies, 35, 891-912.
28. Yourdon, E. 1997, Death March (Upper Saddle River, NJ: Prentice-Hall).
29. Zapf, D., Brodbeck, F. C., Frese, M., Peters, H. And PrUmper, J. 1992, Errors in working with office computers: A first validation of a taxonomy for observed errors in a field setting. International Journal of Human-Computer Interaction, 4, 311-339.
30. Zapf, D., Brodbeck, F. C. And Prümper, J. 1989, Handlungsorientierte Fehlertaxonomie in der Mensch-Computer Interaktion [An action-oriented error taxonomy in humancomputer interaction], Zeitschrift für Arbeits-und Organisationspsychologie, 33, 178-187.
31. Zijlstra, F. R. H. 1993, Efficiency in work behaviour. A design approach for modern tools, (Delft: Delft University Press).