Cultural cognition in usability evaluation

Interacting with Computers

Volumn 21, Issue 3, 2009, Pages 212-220

  Clemmensen, Torkil ^a   Hertzum, Morten ^b   Hornbæk, Kasper ^c   Shi, Qingxin ^a   Yammiyavar, Pradeep ^d  

^a Copenhagen Business School ^*  (Denmark)

^b ROSKILDE UNIVERSITY   (Denmark)

^c UNIVERSITY OF COPENHAGEN   (Denmark)

^d INDIAN INSTITUTE OF TECHNOLOGY GUWAHATI   (India)

Author keywords

Cultural differences; International systems development; Thinking aloud; Usability

Indexed keywords

HUMAN COMPUTER INTERACTION; SOFTWARE ENGINEERING;

CULTURAL BACKGROUNDS; CULTURAL DIFFERENCE; INTERNATIONAL SYSTEM; NON-VERBAL BEHAVIOURS; THINKING ALOUD; USABILITY; USABILITY EVALUATION; USABILITY PROBLEMS;

USABILITY ENGINEERING;

EID: 67649085836     PISSN: 09535438     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.intcom.2009.05.003     Document Type: Article

References (68)

1. Bond M.H. The Psychology of the Chinese People (1986), Oxford University Press, USA
2. Boren M.T., and Ramey J. Thinking aloud: reconciling theory and practice. IEEE Transactions on Professional Communication 43 3 (2000) 261-278
3. Briley D.A., Morris M.W., and Simonson I. Reasons as carriers of culture: dynamic versus dispositional models of cultural influence on decision making. Journal of Consumer Research 27 2 (2000) 157-178
4. Brown D.E. Human Universals (1991), McGraw-Hill, New York
5. Callahan E. Interface design and culture. Annual Review of Information Science and Technology 39 (2005) 257-310
6. Chavan A.L. Another culture, another method. Proceedings of the 11th International Conference on Human-Computer Interaction (2005), Erlbaum, Mahwah, NJ
7. Choi I., and Nisbett R.E. Situational salience and cultural differences in the correspondence bias and actor-observer bias. Personality and Social Psychology Bulletin 24 9 (1998) 949-960
8. Choi I., and Nisbett R.E. Cultural psychology of surprise: holistic theories and recognition of contradiction. Journal of Personality and Social Psychology 79 6 (2000) 890-905
9. Choong, Y.-Y., 1996. Design of Computer Interfaces for the Chinese Population. PhD thesis, Purdue University.
10. Chua H.F., Leu J., and Nisbett R.E. Culture and diverging views of social events. Personality and Social Psychology Bulletin 31 7 (2005) 925-934
11. Clemmensen T. Community knowledge in an emerging online professional community: the case of sigchi.dk. Knowledge and Process Management 11 2 (2005) 1-10
12. Cordes R.E. Task-selection bias: a case for user-defined tasks. International Journal of Human-Computer Interaction 13 4 (2001) 411-419
13. In: del Galdo E., and Nielsen J. (Eds). International User Interfaces (1996), Wiley, New York
14. Dumas J.S. User-based evaluations. In: Jacko J.A., and Sears A. (Eds). The Human-Computer Interaction Handbook: Fundamentals, Evolving Technologies, and Emerging Applications (2003), Erlbaum, Mahwah, NJ 1093-1117
15. Dumas J.S., and Redish J.C. A Practical Guide to Usability Testing. revised ed. (1999), Intellect, Exeter, UK
16. Ericsson K.A., and Simon H.A. Verbal reports as data. Psychological Review 87 3 (1980) 215-251
17. Ericsson K.A., and Simon H.A. Protocol Analysis. Verbal Reports as Data. revised ed. (1993), MIT Press, Cambridge, MA
18. Evers V. Cross-cultural applicability of user evaluation methods: a case study amongst Japanese, North-American, English and Dutch users. CHI '02 Extended Abstracts on Human Factors in Computing Systems (2002), ACM Press, New York 740-741
19. Gulliksen J., Boivie I., Persson J., Hektor A., and Herulf L. Making a difference - a survey of the usability profession in Sweden. Proceedings of the Third Nordic Conference on Human-Computer Interaction (2004), ACM Press, New York 207-215
20. Hall M., de Jong M., and Steedhouder M. Cultural differences and usability evaluation: individualistic and collectivistic participants compared. Technical Communication 51 4 (2004) 489-503
21. Haritos C., and Nelson K. Bilingual memory: the interaction of language and thought. Bilingual Research Journal 25 4 (2001) 417-438
22. Hertzum M. Problem prioritization in usability evaluation: from severity assessments toward impact on design. International Journal of Human-Computer Interaction 21 2 (2006) 125-146
23. Hertzum M., and Jacobsen N.E. The evaluator effect: a chilling fact about usability evaluation methods. International Journal of Human-Computer Interaction 15 1 (2003) 183-204
24. Hofstede G. Culture's Consequences: Comparing Values, Behaviors, Institutions, and Organizations Across Nations (2001), Sage Publications, Thousand Oaks, CA
25. Hong Y.-y., and Mallorie L.M. A dynamic constructivist approach to culture: lessons learned from personality psychology. Journal of Research in Personality 38 1 (2004) 59-67
26. ISO 9241. Ergonomic Requirements for Office Work with Visual Display Terminals (VDTs) - Part 11: Guidance on Usability (1998), International Organization for Standardization, Genève, CH
27. Jacobsen N.E., Hertzum M., and John B.E. The evaluator effect in usability studies: problem detection and severity judgments. Proceedings of the Human Factors and Ergonomics Society 42nd Annual Meeting (1998), HFES, Santa Monica, CA 1336-1340
28. Ji L.-J., Peng K., and Nisbett R.E. Culture, control, and perception of relationships in the environment. Journal of Personality and Social Psychology 78 5 (2000) 943-955
29. Ji L.-J., Zhang Z., and Nisbett R.E. Is it culture or is it language? Examination of language effects in cross-cultural research on categorization. Journal of Personality and Social Psychology 87 1 (2004) 57-65
30. Kim H.S. We talk, therefore we think? A cultural analysis of the effect of talking on thinking. Journal of Personality and Social Psychology 83 4 (2002) 828-842
31. Kühnen U., Hannover B., Röder U., Shah A.A., Schubert B., Upmeyer A., and Zakaria S. Cross-cultural variations in identifying embedded figures: comparisons from the United States, Germany, Russia and Malaysia. Journal of Cross-Cultural Psychology 32 3 (2001) 366-372
32. Kühnen U., Hannover B., and Schubert B. The semantic-procedural interface model of the self: the role of self-knowledge for context-dependent versus context-independent modes of thinking. Journal of Personality and Social Psychology 80 3 (2001) 397-409
33. Lavery D., Cockton G., and Atkinson M.P. Comparison of evaluation methods using structured usability problem reports. Behaviour & Information Technology 16 4 (1997) 246-266
34. Law E.L.-C., and Hvannberg E.T. Analysis of combinatorial user effect in international usability tests. Proceedings of the CHI 2004 Conference on Human Factors in Computing Systems (2004), ACM Press, New York 9-16
35. Lewis, C., 1982. Using the 'Thinking-Aloud' Method in Cognitive Interface Design, Report No. RC 9265 #40713. IBM Thomas J Watson Research Center, Yorktown Heights, NY.
36. Lewis J.R. Sample sizes for usability studies: additional considerations. Human Factors 36 2 (1994) 368-378
37. Lewis J.R. Usability testing. In: Salvendy G. (Ed). Handbook of Human Factors and Ergonomics (2006), Wiley, New York 1275-1316
38. Ling, C., 2005. Advances in Heuristic Evaluation, Purdue University Dissertation. .
39. Masuda T., and Nisbett R.E. Attending holistically versus analytically: comparing the context sensitivity of Japanese and Americans. Journal of Personality and Social Psychology 81 5 (2001) 922-934
40. Miller J.G. Culture and the development of everyday social explanation. Journal of Personality and Social Psychology 46 5 (1984) 961-978
41. Miyamoto Y., Nisbett R.E., and Masuda T. Culture and the physical environment - holistic versus analytic perceptual affordances. Psychological Science 17 2 (2006) 113-119
42. Monk A., Wright P., Haber J., and Davenport L. Improving Your Human-Computer Interface: A Practical Technique (1993), Prentice Hall, New York
43. Murphy J. Modelling designer-tester-subject relationships in international usability testing. In: Day D., and Dunckley L. (Eds). Designing for Global Markets. International Workshop on Internationalization of Products and System vol. 3 (2001), IWIPS, Milton Keynes, UK 33-44
44. Nielsen J. Usability Engineering (1993), Academic Press, London
45. Nielsen J., Clemmensen T., and Yssing C. Getting access to what goes on in people's heads? Reflections on the think-aloud technique. Proceedings of the Second Nordic Conference on Human-Computer Interaction (2002), ACM Press, New York 101-110
46. Nisbett R.E. The Geography of Thought: How Asians and Westerners Think Differently - and Why (2003), Brealey, London
47. Nisbett R.E., Peng K.P., Choi I., and Norenzayan A. Culture and systems of thought: holistic versus analytic cognition. Psychological Review 108 2 (2001) 291-310
48. Nørgaard M., and Hornbæk K. What do usability evaluators do in practice? An explorative study of think-aloud testing. Proceedings of the DIS 2006 Conference on Designing Interactive Systems (2006), ACM Press, New York 209-218
49. Page C., and Rahimi R. Concurrent and retrospective verbal protocols in usability testing: is there value added in collecting both?. Proceedings of the Human Factors and Ergonomics Society 39th Annual Meeting (1995), HFES, Santa Monica, CA 223-227
50. Peng K.P., and Nisbett R.E. Culture, dialectics, and reasoning about contradiction. American Psychologist 54 9 (1999) 741-754
51. Pinker S. The blank slate. The General Psychologist 41 1 (2006) 1-8
52. Preece J., Rogers Y., and Sharp H. Interaction Design: Beyond Human-Computer Interaction. second ed. (2007), Wiley, New York
53. Rubin J. Handbook of Usability Testing: How to Plan, Design and Conduct Effective Tests (1994), Wiley, New York
54. Sahay S., Nicholson B., and Krishna S. Global IT Outsourcing: Software Development Across Borders (2003), Cambridge University Press, Cambridge, UK
55. Sanchez-Burks J., Nisbett R.E., and Ybarra O. Cultural styles, relational schemas, and prejudice against out-groups. Journal of Personality and Social Psychology 79 2 (2000) 174-189
56. Sanchez-Burks J., Lee F., Choi I., Nisbett R., Zhao S., and Koo J. Conversing across cultures: east-west communication styles in work and nonwork contexts. Journal of Personality and Social Psychology 85 2 (2003) 363-372
57. Smagorinsky P. Thinking and speech and protocol analysis. Mind, Culture, and Activity 5 3 (1998) 157-177
58. Smith, A., Yetim, F. (Eds.), 2004. Global Human-Computer Systems: Cultural Determinants of Usability. Interacting with Computers 16 (1) (special issue).
59. Smith A., Dunkley L., French T., Minnocha S., and Chang Y. A process model for developing usable cross-cultural websites. Interacting with Computers 16 1 (2004) 63-91
60. van Baaren R.B., Horgan T.G., Chartrand T.L., and Dijkmans M. The forest, the trees, and the chameleon: context dependence and mimicry. Journal of Personality and Social Psychology 86 3 (2004) 453-460
61. van den Haak M.J., de Jong M.D.T., and Schellens P.J. Employing think-aloud protocols and constructive interaction to test the usability of online library catalogues: a methodological comparison. Interacting with Computers 16 6 (2004) 1153-1170
62. Vatrapu R., and Pérez-Quiñones M. Culture and usability evaluation: the effects of culture in structured interviews. Journal of Usability Studies 1 4 (2006) 156-170
63. Vermeeren A.P.O.S., van Kesteren I.E.H., and Bekker M.M. Managing the evaluator effect in user testing. Proceedings of the INTERACT '03 Conference on Human-Computer Interaction (2003), IOS Press, Amsterdam 647-654
64. Wang L. Switching to first language among writers with differing second-language proficiency. Journal of Second Language Writing 12 4 (2003) 347-375
65. Wang W., and Wen Q. L1 use in the L2 composing process: an exploratory study of 16 Chinese EFL writers. Journal of Second Language Writing 11 3 (2002) 225-246
66. Witkin H.A., and Berry J.W. Psychological differentiation in cross-cultural perspective. Journal of Cross-Cultural Psychology 6 1 (1975) 4-87
67. Witkin H.A., Moore C.A., Goodenough D.R., and Cox P.W. Field-dependent and field-independent cognitive styles and their educational implications. Review of Educational Research 47 1 (1977) 1-64
68. Yeo A.W. Global-software development lifecycle: an exploratory study. Proceedings of the CHI 2001 Conference on Human Factors in Computing Systems (2001), ACM Press, New York 104-111