The influence of laboratory set-up in usability tests: Effects on user performance, subjective ratings and physiological measures

Ergonomics

Volumn 52, Issue 11, 2009, Pages 1350-1361

  Sonderegger, Andreas ^a   Sauer, Juergen ^a  

^a UNIVERSITY OF FRIBOURG   (Switzerland)

Author keywords

Heart rate variability; Laboratory set up; Social facilitation; Usability laboratory; Usability test

Indexed keywords

HEART RATE VARIABILITY; LABORATORY SET-UP; SOCIAL FACILITATION; USABILITY LABORATORY; USABILITY TEST;

HEART VALVE PROSTHESES; LABORATORIES; PHYSIOLOGICAL MODELS; TELECOMMUNICATION EQUIPMENT;

TESTING;

ADULT; ARTICLE; COMPUTER SIMULATION; CONTROLLED STUDY; EMOTIONALITY; ERGONOMICS; FEMALE; HEART RATE VARIABILITY; HUMAN; HUMAN EXPERIMENT; MALE; METHODOLOGY; MOBILE PHONE; NORMAL HUMAN; PHYSIOLOGICAL STRESS; RATING SCALE; SOCIAL INTERACTION; TASK PERFORMANCE;

ADOLESCENT; ADULT; FEMALE; HEART RATE; HUMANS; MALE; MONITORING, PHYSIOLOGIC; RESEARCH DESIGN; RESEARCHER-SUBJECT RELATIONS; SWITZERLAND; TASK PERFORMANCE AND ANALYSIS; USER-COMPUTER INTERFACE; YOUNG ADULT;

EID: 70350735904     PISSN: 00140139     EISSN: 13665847     Source Type: Journal    
DOI: 10.1080/00140130903067797     Document Type: Article

References (41)

1. Berntson, G.G. and Cacioppo, J.T., 2004. Heart rate variability: Stress and psychiatric conditions. In: M. Malik and A.J. Camm, eds. Dynamic electrocardiography. New York: Blackwell, 57-64.
2. Berntson, G.G. and Stowell, J.R., 1998. ECG artifacts and heart period variability: Don't miss a beat! Psychophysiology, 35 (1), 127-132.
3. Boucsein, W. and Backs, R.W., 2000. Engineering psychophysiology as a discipline: Historical and theoretical aspects. In: R.W. Backs and W. Boucsein, eds. Engineering psychophysiology issues and applications. Mahwah, NJ: Lawrence Erlbaum, 3-30.
4. Brooke, J., 1996. SUS: A quick and dirty usability scale. In: P. Jordan, B. Thomas, B. Weerdmeester, and I. McClelland, eds. Usability evaluation in industry. London: Taylor & Francis, 189-194.
5. Chin, J.P., Diehl, V.A., and Norman,K.L., 1988. Development of an instrument measuring user satisfaction of the human computer interface. In: Proceedings of the SIGCHI conference on Human factors in computing systems, Washington, DC. New York: ACM Press, 213-218.
6. Dörner, D. and Stäudel, T., 1990. Emotion und Kognition [emotion and cognition]. In: K.H. Scherer, ed. Psychologie der Emotion Göttingen: Hogrefe, 293-344.
7. Dray, S. and Siegel, D., 2004. Remote possibilities? International usability testing at a distance. Interactions, 11 (2), 10-17.
8. Forgas, J.P. and George, J.M., 2001. Affective influences on judgments and behavior in organizations: An information processing perspective. Organizational Behavior and Human Decision Processes, 86 (1), 3-34.
9. Geen, R.G., 1991. Social motivation. Annual Review of Psychology, 42, 377-399.
10. Guerin, B., 1986. Mere presence effects in humans: A review. Journal of Experimental Social Psychology, 22, 38-77.
11. Hancock, P.A., Weaver, J.L., and Parasuraman, R., 2002. Sans subjectivity - ergonomics is engineering. Ergonomics, 45 (14), 991-994.
12. Hembree, R., 1988. Correlates, causes, effects, and treatment of test anxiety. Review of Educational Research, 58 (1), 47-77.
13. Jordan, P.W., 1998. An introduction to usability. London: Taylor & Francis.
14. Jorna, P.G.A.M., 1992. Spectral analysis of heart rate and psychological state: A review of its validity as a workload index. Biological Psychology, 34 (2-3), 237-257.
15. Kettunen, J. and Keltikangas-Järvinen, L., 2001. Intraindividual analysis of instantaneous heart rate variability. Psychophysiology 38 (4), 659-668.
16. Khalid, H.M., 2006. Embracing diversity in user needs for affective design. Applied Ergonomics, 37 (4), 409-418.
17. Kirakowski, J., 1996. The software usability measurement inventory (SUMI): Background and usage. In: P. Jordan, B. Thomas, B. Weerdmeester, and I. McClelland, eds. Usability evaluation in industry. London: Taylor & Francis, 169-177.
18. Kirschbaum, C., Pirke, K.M., and Hellhammer, D.H., 1993. The 'Trier Social Stress Test' - a tool for investigating psychobiological stress responses in a laboratory setting. Neuropsychobiology, 28 (1-2), 76-81.
19. Krohne, H.W., et al., 1996. Untersuchungen mit einer deutschen Version der 'Positive and Negative Affect Schedule' (PANAS) [Studies with a German version of the positive and negative affect schedule]. Diagnostica, 42 (2), 139-156.
20. Lazarus, R.S., 1993. From psychological stress to the emotions: A history of changing outlooks. Annual Review of Psychology, 44, 1-21.
21. Lewis, J.R., 1995. IBM computer usability satisfaction questionnaire: Psychometric evaluation and instructions for use. International Journal of Human-Computer Interaction, 7 (1), 57-78.
22. Lewis, J.R., 2006. Usability Testing. In: G. Salvendy, ed. Handbook of human factors and ergonomics, 3rd ed. Hoboken, NJ: Wiley, 1275-1316.
23. Marcus, A., 2003. The emotion commotion. Interactions, 10 (6), 28-34.
24. Nickel, P. and Nachreiner, F., 2003. Sensitivity and diagnosticity of the 0.1 Hz component of heart rate variability as an indicator of mental workload. Human Factors, 45 (4), 575-590.
25. Nielsen, J. and Levy, J., 1994. Measuring usability: Preference vs. performance. Communication of the ACM, 37 (4), 66-75.
26. Niskanen, J.-P., et al., 2004. Software for advanced HRV analysis. Computer Methods and Programs in Biomedicine, 76 (1), 73-81.
27. Patel, M. and Loring, B., 2001. Handling awkward usability testing situations. In: Proceedings of the Human Factors and Ergonomics Society annual meeting, 2. Santa Monica, CA: HFES, 1772-1776.
28. Pruyn, A., Aasman, J., and Wyers, B., 1985. Social influences on mental processes and cardiovascular activity. In: J.F. Orlebeke, G. Mulder, and L.J.P. Van Doornen, eds. The psychophysiology of cardiovascular control (models, methods, and data). New York: Plenum Press, 865-877.
29. Rubin, J., 1994. Handbook of usability testing: How to plan, design, and conduct effective tests. New York: J. Wiley.
30. Salzman, M.C. and Rivers, S.D., 1994. Smoke and mirrors: Setting the stage for a successful usability test. Behavior & Information Technology, 13 (1), 9-16.
31. Sauer, J. and Sonderegger, A., 2009. The influence of prototype fidelity and aesthetics of design in usability tests: Effects on user behaviour, subjective evaluation and emotion. Applied Ergonomics, 40 (4), 670-677.
32. Schrier, J.R., 1992. Reducing stress associated with participating in a usability test. In: Proceedings of the Human Factors Society 36th annual meeting. Santa Monica, CA: HFES, 1210-1214.
33. Seva, R.R., Duh, H.B.-L., and Helander, M.G., 2007. The marketing implications of affective product design. Applied Ergonomics, 38 (6), 723-731.
34. Shiv, B. and Fedorikhin, A., 1999. Heart and mind in conflict: The interplay of affect and cognition in consumer decision making. Journal of Consumer Research, 26 (3), 278-292.
35. Stroud, L., Salovey, P., and Epel, E., 2002. Sex differences in stress responses: Social rejection versus achievement stress. Biological Psychiatry, 52 (4), 318-327.
36. Task Force of the European Society of Cardiology and the North American Society of Pacing and Electrophysiology, 1996. Heart rate variability. Standards of measurement, physiological interpretation, and clinical use. Circulation, 93, 1043-1065.
37. Tractinsky, N., Katz, A.S., and Ikar, D., 2000. What is beautiful is usable. Interacting with Computers, 13, 127-145.
38. Wastell, D. and Newman, M., 1996. Information system design, stress and organisational change in the ambulance services: A tale of two cities. Accounting, Management and Information Technologies, 6, 283-300.
39. Watson, D., Clark, L.A., and Tellegen, A., 1988. Development of brief measures of positive and negative affect. Journal of Personality and Social Psychology, 54 (6), 1063-1070.
40. Wickens, C.D. and Hollands, J.G., 2000. Engineering psychology and human performance. Upper Saddle River, NJ: Prentice-Hall.
41. Wilson, G.M. and Sasse, A.M., 2000. Investigating the impact of audio degradations on users: Subjective vs. objective assessment methods. In: Proceedings of OZCHI, 4. Sydney, Australia, 135-142.