Cultural cognition in the thinking-Aloud method for usability evaluation;Cognition culturelle pour l'évaluation de l'usabilité par la méthode de pensée à haute voix

ICIS 2008 Proceedings - Twenty Ninth International Conference on Information Systems

Volumn , Issue , 2008, Pages

  Clemmensen, Torkil ^a   Hertzum, Morten ^b   Hornbæk, Kasper ^c   Shi, Qingxin ^a   Yammiyavar, Pradeep ^d  

^a Department of International Economics and Management   (Denmark)

^b ROSKILDE UNIVERSITY   (Denmark)

^c UNIVERSITY OF COPENHAGEN   (Denmark)

^d INDIAN INSTITUTE OF TECHNOLOGY GUWAHATI   (India)

Author keywords

Cultural differences; International systems development; Thinking aloud; Usability

Indexed keywords

CULTURAL BACKGROUNDS; CULTURAL DIFFERENCE; DIFFERENT EFFECTS; INTERNATIONAL SYSTEM; TASK PERFORMANCE; THINKING ALOUD; USABILITY; USABILITY EVALUATION; USABILITY PROBLEMS; WESTERN EUROPE;

INFORMATION SYSTEMS;

USABILITY ENGINEERING;

EID: 84870969212     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (64)

1. Boren, M. T., and Ramey, J. "Thinking aloud: Reconciling theory and practice, " IEEE Transactions on Professional Communication (43:3), 2000, pp. 261-278.
2. Briley, D. A., Morris, M. W., and Simonson, I. "Reasons as carriers of culture: Dynamic versus dispositional models of cultural influence on decision making, " Journal of Consumer Research (27:2), 2000, pp. 157-178.
3. Brown, D. E. Human Universals, McGraw-Hill, New York, 1991.
4. Callahan, E. "Interface design and culture, " Annual Review of Information Science and Technology (39), 2005, pp. 257-310.
5. Chavan, A. L. "Another culture, another method, " in Proceedings of the 11th International Conference on Human-Computer Interaction. Erlbaum, Mahwah, NJ, 2005.
6. Choi, I., and Nisbett, R. E. "Situational salience and cultural differences in the correspondence bias and actorobserver bias, " Personality and Social Psychology Bulletin (24:9), 1998, pp. 949-960.
7. Choi, I., and Nisbett, R. E. "Cultural psychology of surprise: Holistic theories and recognition of contradiction, " Journal of Personality and Social Psychology (79:6), 2000, pp. 890-905.
8. Chua, H.F., Leu, J., and Nisbett, R.E. "Culture and diverging views of social events, " Personality and Social Psychology Bulletin (31:7), 2005, pp. 925-934.
9. Clemmensen, T. "Community knowledge in an emerging online professional community: The case of sigchi. dk, " Knowledge and Process Management (11:2), 2005, pp. 1-10.
10. Cordes, R. E. "Task-selection bias: A case for user-defined tasks, " International Journal of Human-Computer Interaction (13:4), 2001, pp. 411-419.
11. del Galdo, E., and Nielsen, J. (Eds.). International User Interfaces, Wiley, New York, 1996.
12. Dumas, J. S. "User-based evaluations, " in The Human-Computer Interaction Handbook: Fundamentals, Evolving Technologies, and Emerging Applications, Jacko, J. A., and Sears, A. (Eds.), Erlbaum, Mahwah, NJ, 2003, pp. 1093-1117.
13. Dumas, J. S., and Redish, J. C. A Practical Guide to Usability Testing. Revised Edition, Intellect, Exeter, UK, 1999.
14. Ericsson, K. A., and Simon, H. A. "Verbal reports as data, " Psychological Review (87:3), 1980, pp. 215-251.
15. Ericsson, K. A., and Simon, H. A. Protocol Analysis. Verbal Reports as Data. Revised Edition, MIT Press, Cambridge, MA, 1993.
16. Evers, V. "Cross-cultural applicability of user evaluation methods: A case study amongst Japanese, North-American, English and Dutch users, " in CHI '02 Extended Abstracts on Human Factors in Computing Systems, ACM Press, New York, 2002, pp. 740-741.
17. Gulliksen, J., Boivie, I., Persson, J., Hektor, A., and Herulf, L. "Making a difference-a survey of the usability profession in Sweden, " in Proceedings of the Third Nordic Conference on Human-Computer Interaction, ACM Press, New York, 2004, pp. 207-215.
18. Hall, M., de Jong, M., and Steedhouder, M. "Cultural differences and usability evaluation: Individualistic and collectivistic participants compared, " Technical Communication (51:4), 2004, pp. 489-503.
19. Haritos, C., and Nelson, K. "Bilingual memory: The interaction of language and thought, " Bilingual Research Journal (25:4), 2001, pp. 417-438.
20. Hertzum, M., and Jacobsen, N. E. "The evaluator effect: A chilling fact about usability evaluation methods, " International Journal of Human-Computer Interaction (15:1), 2003, pp. 183-204.
21. Hofstede, G. Culture's Consequences: Comparing Values, Behaviors, Institutions, and Organizations across Nations, Sage Publications, Thousand Oaks, CA, 2001.
22. Hong, Y.-y., and Mallorie, L. M. "A dynamic constructivist approach to culture: Lessons learned from personality psychology, " Journal of Research in Personality (38:1), 2004, pp. 59-67.
23. ISO 9241. Ergonomic Requirements for Office Work With Visual Display Terminals (VDTs)-Part 11: Guidance on Usability, International Organization for Standardization, Genève, CH, 1998.
24. Jacobsen, N. E., Hertzum, M., and John, B. E. "The evaluator effect in usability studies: Problem detection and severity judgments, " in Proceedings of the Human Factors and Ergonomics Society 42nd Annual Meeting, HFES, Santa Monica, CA, 1998, pp. 1336-1340.
25. Ji, L.-J., Peng, K., and Nisbett, R.E. "Culture, control, and perception of relationships in the environment, " Journal of Personality and Social Psychology (78:5), 2000, pp. 943-955.
26. Ji, L.-J., Zhang, Z., and Nisbett, R. E. "Is it culture or is it language? Examination of language effects in crosscultural research on categorization, " Journal of Personality and Social Psychology (87:1), 2004, pp. 57-65.
27. Kim, H. S. "We talk, therefore we think? A cultural analysis of the effect of talking on thinking, " Journal of Personality and Social Psychology (83:4), 2002, pp. 828-842.
28. Kühnen, U., Hannover, B., Röder, U., Shah, A.A., Schubert, B., Upmeyer, A., and Zakaria. S. "Cross-cultural variations in identifying embedded figures: Comparisons from the United States, Germany, Russia and Malaysia, " Journal of Cross-Cultural Psychology (32:3), 2001a, pp. 366-372.
29. Kühnen, U., Hannover, B., and Schubert, B. "The semantic-procedural interface model of the self: The role of selfknowledge for context-dependent versus context-independent modes of thinking, " Journal of Personality and Social Psychology (80:3), 2001b, pp. 397-409.
30. Lavery, D., Cockton, G., and Atkinson, M. P. "Comparison of evaluation methods using structured usability problem reports, " Behaviour & Information Technology (16:4), 1997, pp. 246-266.
31. Law, E. L.-C., and Hvannberg, E. T. "Analysis of combinatorial user effect in international usability tests, " in Proceedings of the CHI 2004 Conference on Human Factors in Computing Systems, ACM Press, New York, 2004, pp. 9-16.
32. Lewis, C. Using the 'Thinking-Aloud' Method in Cognitive Interface Design, Report no. RC 9265 #40713, IBM Thomas J Watson Research Center, Yorktown Heights, NY, 1982.
33. Lewis, J. R. "Sample sizes for usability studies: Additional considerations, " Human Factors (36:2), 1994, pp. 368-378.
34. Lewis, J. R. "Usability testing, " in Handbook of Human Factors and Ergonomics, Salvendy, G. (Ed.), Wiley, New York, 2006, pp. 1275-1316.
35. Ling, C. Advances in Heuristic Evaluation, Purdue University Dissertation, 2005, http://docs.lib.purdue.edu/dissertations/AAI3210740/.
36. Masuda, T., and Nisbett, R. E. "Attending holistically versus analytically: Comparing the context sensitivity of Japanese and Americans, " Journal of Personality and Social Psychology (81:5), 2001, pp. 922-934.
37. Miller, J. G. "Culture and the development of everyday social explanation, " Journal of Personality and Social Psychology (46:5), 1984, pp. 961-978.
38. Miyamoto, Y., Nisbett, R. E., and Masuda, T. "Culture and the physical environment-holistic versus analytic perceptual affordances, " Psychological Science (17:2), 2006, pp. 113-119.
39. Monk, A., Wright, P., Haber, J., and Davenport, L. Improving Your Human-Computer Interface: A Practical Technique, Prentice Hall, New York, 1993.
40. Murphy, J. "Modelling designer-tester-subject relationships in international usability testing, " in Designing for Global Markets. International Workshop on Internationalization of Products and System (Vol. 3), Day, D., and Dunckley, L. (Eds.), IWIPS, Milton Keynes, UK, 2001, pp. 33-44.
41. Nielsen, J. Usability Engineering, Academic Press, London, 1993.
42. Nielsen, J., Clemmensen, T., and Yssing, C. "Getting access to what goes on in people's heads?-Reflections on the think-aloud technique, " in Proceedings of the Second Nordic Conference on Human-Computer Interaction, ACM Press, New York, 2002, pp. 101-110.
43. Nisbett, R. E. The Geography of Thought: How Asians and Westerners Think Differently-and Why, Brealey, London, 2003.
44. Nisbett, R. E., Peng, K. P., Choi, I., and Norenzayan, A. "Culture and systems of thought: Holistic versus analytic cognition, " Psychological Review (108:2), 2001, pp. 291-310.
45. Nørgaard, M., and Hornbæk, K. "What do usability evaluators do in practice? An explorative study of think-aloud testing, " in Proceedings of the DIS 2006 Conference on Designing Interactive Systems, ACM Press, New York, 2006, pp. 209-218.
46. Page, C., and Rahimi, R. "Concurrent and retrospective verbal protocols in usability testing: Is there value added in collecting both?" in Proceedings of the Human Factors and Ergonomics Society 39th Annual Meeting, HFES, Santa Monica, CA, 1995, pp. 223-227.
47. Peng, K. P., and Nisbett, R. E. "Culture, dialectics, and reasoning about contradiction, " American Psychologist (54:9), 1999, pp. 741-754.
48. Pinker, S. "The blank slate, " The General Psychologist (41:1), 2006, pp. 1-8.
49. Preece, J., Rogers, Y., and Sharp, H. Interaction Design: Beyond Human-Computer Interaction. Second Edition, Wiley, New York, 2007.
50. Rubin, J. (1994). Handbook of usability testing: How to plan, design and conduct effective tests. New York: Wiley.
51. Sahay, S., Nicholson, B., and Krishna, S. Global IT Outsourcing: Software Development across Borders, Cambridge University Press, Cambridge, UK, 2003.
52. Sanchez-Burks, J., Lee, F., Choi, I., Nisbett, R., Zhao, S., and Koo, J. "Conversing across cultures: East-West communication styles in work and nonwork contexts, " Journal of Personality and Social Psychology (85:2), 2003, pp. 363-372.
53. Sanchez-Burks, J., Nisbett, R. E., and Ybarra, O. "Cultural styles, relational schemas, and prejudice against outgroups, " Journal of Personality and Social Psychology (79:2), 2000, pp. 174-189.
54. Smagorinsky, P. "Thinking and speech and protocol analysis, " Mind, Culture, and Activity (5:3), 1998, pp. 157-177.
55. Smith, A., Dunkley, L., French, T., Minnocha, S., and Chang, Y. "A process model for developing usable crosscultural websites, " Interacting with Computers (16:1), 2004, pp. 63-91.
56. Smith, A., and Yetim, F. (Eds.). "Global human-computer systems: Cultural determinants of usability" (special issue), Interacting with Computers (16:1), 2004.
57. van Baaren, R. B., Horgan, T. G., Chartrand, T. L., and Dijkmans, M. "The forest, the trees, and the chameleon: Context dependence and mimicry, " Journal of Personality and Social Psychology (86:3), 2004, pp. 453-460.
58. van den Haak, M. J., de Jong, M. D. T., and Schellens, P. J. "Employing think-aloud protocols and constructive interaction to test the usability of online library catalogues: A methodological comparison, " Interacting with Computers (16:6), 2004, pp. 1153-1170.
59. Vatrapu, R., and Pérez-Quiñones, M. "Culture and usability evaluation: The effects of culture in structured interviews, " Journal of Usability Studies (1:4), 2006, pp. 156-170.
60. Vermeeren, A. P. O. S., van Kesteren, I. E. H., and Bekker, M. M. "Managing the evaluator effect in user testing, " in Proceedings of the INTERACT '03 Conference on Human-Computer Interaction, IOS Press, Amsterdam, 2003, pp. 647-654.
61. Wang, L. "Switching to first language among writers with differing second-language proficiency, " Journal of Second Language Writing (12:4), 2003, pp. 347-375.
62. Wang, W., and Wen, Q. "L1 use in the l2 composing process: An exploratory study of 16 Chinese EFL writers, " Journal of Second Language Writing (11:3), 2002, pp. 225-246.
63. Witkin, H. A., Moore, C. A., Goodenough, D. R., and Cox, P. W. "Field-dependent and field-independent cognitive styles and their educational implications, " Review of Educational Research (47:1), 1977, pp. 1-64.
64. Yeo, A. W. "Global-software development lifecycle: An exploratory study, " in Proceedings of the CHI 2001 Conference on Human Factors in Computing Systems, ACM Press, New York, 2001, pp. 104-111.