Usability problem identification in culturally diverse settings

Information Systems Journal

Volumn 22, Issue 2, 2012, Pages 151-175

  Clemmensen, Torkil ^a  

^a Copenhagen Business School ^*  (Denmark)

Author keywords

Cross cultural research; IS cultural models; Usability problems; Usability professionals; Usability testing

Indexed keywords

CROSS-CULTURAL RESEARCH; CULTURAL MODELS; USABILITY PROBLEMS; USABILITY PROFESSIONALS; USABILITY TESTING;

RESEARCH;

USABILITY ENGINEERING;

EID: 84857429217     PISSN: 13501917     EISSN: 13652575     Source Type: Journal    
DOI: 10.1111/j.1365-2575.2011.00381.x     Document Type: Article

References (69)

1. 9241-11, I.I.S. (1998) Ergonomic requirements for office work with visual display terminals (VDTs) - part 11: guidance on usability. (No. ISO 9, 1998(E)).
2. Al-Gahtani, S.S., Hubona, G.S. & Wang, J. (2007) Information technology (IT) in Saudi Arabia: culture and the acceptance and use of IT. Information and Management, 44, 681-691.
3. Bandyopadhyay, K. & Fraccastoro, K.A. (2007) The effect of culture on user acceptance of information technology. Communications of the Association for Information Systems, 2007, 522-543.
4. Barber, W. & Badre, A. (1998) Culturability: the merging of culture and usability. In: Cantor, J. (ed.) 4th conference on Human Factors and the web, New Jersey, USA, June 5 1998
5. Bond, M.H. (1986) The Psychology of the Chinese People. Oxford University Press, New York, USA.
6. Bourges-Waldegg, P., & Scrivener, S. A. R. (1998). Meaning, the central issue in cross-cultural HCI design. Interacting with Computers, 9, 287.
7. Caulton, D.A. (2001) Relaxing the homogeneity assumption in usability testing. Behaviour and Information Technology, 20, 1-7.
8. Chavan, A.L., Gorney, D., Prabhu, B., Arora, S. (2009): The washing machine that ate my sari - Mistakes in cross-cultural design. Interactions 16, 26-31.
9. Clemmensen, T. (2009) Towards a theory of cultural usability: a comparison of ADA and CM-U theory. Lecture Notes in Computer Science, 5619, 416-425.
10. Clemmensen, T. (2011) Templates for cross-cultural and culturally specific usability testing: results from field studies and ethnographic interviewing in three countries. International Journal of Human-Computer Interaction, 27, 634-669.
11. Clemmensen, T., Hertzum, M., Hornbaek, K., Shi, Q. & Yammiyavar, P. (2008) Cultural cognition in the thinking-aloud method for usability evaluation. ICIS 2008 Proceedings. Paper 189. [WWW document]. URL
12. Cockton, G. & Woolrych, A. (2002) Sale must end: should discount methods be cleared off HCI's shelves? Interactions, 9, 13-18.
13. Dahler-Larsen, P. (2002) At Fremstille Kvalitative Data. Syddansk Universitetsforlag, Odense, Denmark.
14. Dray, S. & Siegel, D. (2005) Sunday in Shanghai, Monday in Madrid?!: key issues and decisions in planning international user studies. In: Usability and Internationalization of Information Technology, Aykin, N. (ed.), pp. 189-212. Lawrence Erlbaum, Mahwah, NJ, USA.
15. Ericsson, K. A., & Simon, H. A. (1993). Protocol Analysis. Verbal reports as data: Cambridge Massachusetts.
16. Ford, G. & Gelderblom, H. (2003) The effects of culture on performance achieved through the use of human computer interaction. In: Eloff, J., Engelbrecht, A., Kotzé, P., Eloff, M. (eds.) SAICSIT '03 Proceedings of the 2003 annual research conference of the South African institute of computer scientists and information technologists on Enablement through technology, pp. 218-230. South African Institute for Computer Scientists and Information Technologists, Republic of South Africa, Cape Town.
17. Ford, D.P., Connelly, C.E. & Meister, D.B. (2003) Information systems research and Hofstede's culture's consequences: an uneasy and incomplete partnership. IEEE Transactions on Engineering Management, 50, 8-25.
18. Frandsen-Thorlacius, O., Hornbæk, K.A.S., Hertzum, M. & Clemmensen, T. (2009) Non-universal usability?. Paper presented at CHI 2009, - Designing for Other Cultures, April 4-9, Boston, USA, pp. 41-50. ACM, New York.
19. Hanisch, J. & Corbitt, B. (2007) Impediments to requirements engineering during global software development. European Journal of Information Systems, 16, 793-805.
20. Herman, L. (1996) Towards effective usability evaluation in Asia: cross-cultural differences. In Proceedings of the 6th Australian Conference on Computer-Human Interaction (OZCHI'96), November 24-27, Hamilton, New Zealand, p. 135.
21. Hertzum, M. (2006) Problem prioritization in usability evaluation: from severity assessments toward impact on design. International Journal of Human-Computer Interaction, 21, 125-146.
22. Hertzum, M. & Jacobsen, N.E. (2001) The evaluator effect: a chilling fact about usability evaluation methods. International Journal of Human-Computer Interaction, 13, 421-443.
23. Hertzum, M., Clemmensen, T., Hornbæk, K., Kumar, J., Shi, Q. & Yammiyavar, P.G. (2011) Personal usability constructs: how people construe usability across nationalities and stakeholder groups. International Journal of Human-Computer Interaction, 27, 729-761.
24. Hofstede, G. (1980) Culture's Consequence: Comparing Values, Behaviours Institutions and Organizations Across Nations. Sage Publications, Thousand Oaks, CA, USA.
25. Hong, Y.-Y. & Mallorie, L.M. (2004) A dynamic constructivist approach to culture: lessons learned from personality psychology. Journal of Research in Personality, 38, 59-67.
26. Irani, L. (2010) HCI on the move: methods, culture, values. Paper presented at the CHI2010, 10-15 April, Atlanta, Georgia, USA. ACM, New York, pp. 2939-2942.
27. ISO 9241-210, F. (2009) 9241-210: 2009. Ergonomics of Human System Interaction - Part 210: Human-Centred Design for Interactive Systems (Formerly Known as 13407). International Organization for Standardization (ISO), Geneva, Switzerland.
28. Ji, L.J., Zhang, Z.Y. & Nisbett, R.E. (2004) Is it culture or is it language? Examination of language effects in cross-cultural research on categorization. Journal of Personality and Social Psychology, 87, 57-65.
29. Kappos, A. & Rivard, S. (2008) A three-perspective model of culture, information systems, and their development and use. MIS Quarterly, 32, 601-634.
30. Kashima, Y. (2004). Culture, Communication and Entitativity - A Social Psychological Investigation of Social Reality. In V. Yzerbyt, C. M. Judd & O. Corneille (Eds.), The psychology of group perception - perceived variability, entitativity and essentialism (pp. 257-274). NY: Psychology Press.
31. Keil, M., Im, G.P. & Mahhring, M. (2007) Reporting bad news on software projects: the effects of culturally constituted views of face-saving. Information Systems Journal, 17, 59-87.
32. Kurosu, M. (2008) Usability and culture as two of the value criteria for evaluation the artifact. Paper presented at the Cultural Usability and Human Work Interaction Design - Techniques that Connects: Proceedings from NordiCHI 2008 Workshop, 19 October 2008, Lund, Sweden.
33. Kurosu, M., Kobayashi, T., Yoshitake, R., Takahashi, H., Urokohara, H. & Sato, D. (2004) Trend in usability research and activities in Japan. International Journal of Human-Computer Interaction, 17, 103-124.
34. Law, E.L.-C. (2006) Evaluating the downstream utility of user tests and examining the developer effect: a case study. International Journal of Human-Computer Interaction, 21, 147-172.
35. Law, E.L.-C. & Hvannberg, E.T. (2004) Analysis of combinatorial user effects in international usability tests. Paper presented at the CHI 2004, Vienna, Austria.
36. Lee, J.-J. & Lee, K.-P. (2007) Cultural differences and design methods for user experience research: Dutch and Korean participants compared. Paper presented at the Proceedings of the 2007 Conference on Designing Pleasurable Products and Interfaces, Helsinki, Finland.
37. Leidner, D.E. & Kayworth, T. (2006) Review: a review of culture in information systems research: toward a theory of information technology culture conflict. MIS Quarterly, 30, 357-399.
38. Lewis, C. (1982) Using the 'thinking-aloud' method in cognitive interface design. IBM Research Report RC 9265, IBM T.J. Watson Research Center, Yorktown Heights, NY, USA.
39. Marcus, A. (2002). Fast forward: Culture class vs. culture clash. Interactions, 9, 25-28.
40. McCoy, S., Galletta, D.F. & King, W.R. (2007) Applying TAM across cultures: the need for caution. European Journal of Information Systems, 16, 81-90.
41. Molich, R., Dray, S. & Siegel, D. (2004) Tips and tricks for a better international usability test. Paper presented at the CHI 2004 Special Interest Group, Vienna, Austria.
42. Nardi, B.A., Vatrapu, R. & Clemmensen, T. (2011) Comparative informatics. Interactions, 18, 28-33.
43. Nawaz, A., Plocher, T., Clemmensen, T., Qu, W. & Sun, X. (2007) Cultural differences in the structure of categories in Denmark and China. Working Paper no. 03-2007, Department of Informatics, CBS.
44. Nielsen, J. (1990) Designing for international use. Elsevier Science, Essex, UK.
45. Nisbett, R.E. (2003) The Geography of Thought. Nicholas Brealey Publishing, London, UK.
46. Nisbett, R.E. & Masuda, T. (2003) Culture and point of view. Proceedings of the National Academy of Sciences of the United States of America, 100, 11163-11170.
47. Nisbett, R.E. & Miyamoto, Y. (2005) The influence of culture: holistic versus analytic perception. Trends in Cognitive Sciences, 9, 467-473.
48. Noiwan, J. & Norcio, A.F. (2006) Cultural differences on attention and perceived usability: investigating color combinations of animated graphics. International Journal of Human-Computer Studies, 64, 103-122.
49. Nørgaard, M. & Høgh, R.T. (2008) Evaluating usability: using models of argumentation to improve persuasiveness of usability feedback. Paper presented at the DIS2008, 25-27 February, Cape Town, South Africa. ACM, New York.
50. Oyugi, C., Dunckley, L. & Smith, A. (2008) Evaluation methods and cultural differences: studies across three continents. Paper presented at NordiCHI 2008, 18-22 October, Lund, Sweden. ACM, New York, pp. 318-325.
51. Paterson, B., Winschiers-Theophilus, H., Dunne, T.T., Schinzel, B. & Underhill, L.G. (2011) Interpretation of a cross-cultural usability evaluation: a case study based on a hypermedia system for rare species management in Namibia. Interacting with Computers, 23, 239-246.
52. Pauleen, D.J., Evaristo, R., Davison, R.M., Soon, A., Alanis, M. & Klein, S. (2006) Cultural bias in information systems research and practice: are you coming from the same place I am? Communications of the Association for Information Systems, 2006, 2-36.
53. Qu, W., Sun, X., Nawaz, A., Plocher, T. & Clemmensen, T. (2007) Cultural differences between Chinese and Danes in card sorting. Paper presented at the Eighth Pan-Pacific Conference on Occupational Ergonomics (PPCOE 2007), October 17-19, 2007, Bangkok, Thailand.
54. Rauterberg, M. (2006) From personal to cultural computing: how to assess a cultural experience. Proceedings of the 4th Usability Day, 9 June 2006, Applied University Vorarlberg, Dornbirn, Austria, Pabst Science Publisher.
55. Sanchez-Burks, J. & Lee, F.J. (2005) Cultural psychology of workways. In: Handbook of Cultural Psychology, Vol. 1. Kitayama, S. & Cohen, D. (eds), pp. 346-369. New York, Guilford.
56. Shi, Q. (2008) A field study of the relationship and communication between Chinese evaluators and users in thinking aloud usability tests. Paper presented at the NordiChi 2008, 18-22 October, Lund, Sweden. ACM, New York, pp. 344-352.
57. Shi, Q. & Clemmensen, T. (2008) Communication patterns and usability problem finding in cross-cultural thinking aloud usability testing. Paper presented at CHI 2008 Florence, Italy - April 05-10, 2008, pp. 2811-2816. ACM, New York.
58. Smith, A. (2011) Issues in adapting usability testing for global usability. In: Global Usability, Douglas, I. & Liu, Z. (eds), pp. 23-38. Springer, London.
59. Strauss, A. & Corbin, J. (1998) Basics of Qualitative Research - Techniques and Procedures for Developing Grounded Theory. SAGE Publications, London, UK.
60. Sun, H. (2003) Exploring cultural usability: a localization study of mobile text messaging use. Paper presented at the CHI2003 Doctorial Consortium, April 5-10, 2003, Ft. Lauderdale, Florida, USA. ACM, New York, pp. 670-671.
61. Vatrapu, R. & Pérez-Quiñones, M. (2006) Culture and usability evaluation: the effects of culture in structured interviews. Journal of Usability Studies, 1, 156-170.
62. Vatrapu, R. & Suthers, D. (2007) Culture and computers: a review of the concept of culture and implications for intercultural collaborative online learning. In: Ishida, T., Fussell, S., Vossen, P. (eds.) Intercultural Collaboration, vol. 4568. Lecture Notes in Computer Science, pp. 260-275. Springer Berlin / Heidelberg, Germany.
63. Vöhringer-Kuhnt, T. (2002) The influence of culture on usability. Master thesis, Berlin, Germany.
64. Winschiers, H. & Fendler, J. (2007) Assumptions considered harmful. In: Usability and Internationalization. HCI and Culture, Vol. 4559, Aykin, N. (ed.), pp. 452-461. Springer Berlin, Heidelberg, Germany.
65. Winschiers-Theophilus, H., Chivuno-Kuria, S., Kapuire, G.K., Bidwell, N.J. & Blake, E. (2010) Being participated: a community approach. Paper presented at the Proceedings of the 11th Biennial Participatory Design Conference, November 29-December 3, Sydney, Australia, pp. 1-10. ACM, New York.
66. Witkin, H.A. & Berry, J.W. (1975) Psychological differentiation in cross-cultural perspective. Journal of Cross-Cultural Psychology, 6, 4-87.
67. Yeo, A.W. (1998) Cultural effects in usability assessment. Paper presented at the CHI 98, Doctoral Consortium, April 18-23, Los Angeles, CA, USA, pp. 74-75. ACM, New York.
68. Yeo, A.W. (2001) Global-software development lifecycle: an exploratory study. Paper presented at the CHI 2001, 31 March-5 April, Seattle, Washington, USA, pp.104-111. ACM, New York.
69. Zakaria, N., Stanton, J.M. & Sarkar-Barney, S.T.M. (2003) Designing and implementing culturally-sensitive IT applications: The interaction of culture values and privacy issues in the Middle East, Information Technology & People, 16, 49-75.