Templates for cross-cultural and culturally specific usability testing: Results from field studies and ethnographic interviewing in three countries

International Journal of Human-Computer Interaction

Volumn 27, Issue 7, 2011, Pages 634-669

  Clemmensen, Torkil ^a  

^a Copenhagen Business School ^*  (Denmark)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 79956290921     PISSN: 10447318     EISSN: 15327590     Source Type: Journal    
DOI: 10.1080/10447318.2011.555303     Document Type: Article

References (65)

1. Arcury, T. A, & Quandt, S. A. (1999). Participant recruitment for qualitative research: A sitebased approach to community research in complex societies. Human Organization, 58, 128-133.
2. Arvid, K. (2002). Personality preferences in graphical interface design. In NordiChi 2002 (pp. 217-218). Aarhus, Denmark: ACM.
3. th Conference on Human Factors and theWeb. Retrieved from http://research.microsoft.com/en-us/um/people/marycz/hfweb98/barber/
4. Barkhuus, L., & Rode, J. (2007). From mice to men-24 years of evaluation in CHI. In CHI 2007 (Alt-CHI). Retrieved from http://www.itu.dk/~barkhuus/barkhuus-altchi.pdf
5. Barnum, C. M. (2001). Usability testing and research. Needham Heights, MA: Allyn & Bacon.
6. Beu, A., Honold, P., & Yuan, X. (2000). How to build up an infrastructure for intercultural usability engineering. International Journal of Human-Computer Interaction, 12, 347-358.
7. Boren, M. T., & Ramey, J. (2000). Thinking aloud: Reconciling theory and practice. IEEE Transactions on Professional Communication, 43, 261-278.
8. Brooke, J. (1996). SUS-A quick and dirty usability scale. In P. W. Jordan, B. Thomas, B. A. Weerdmeester & A. L. McClelland (Eds.), Usability Evaluation in Industry. London: Taylor and Francis.
9. Brouwer-Janse, M. D. (1995). From our past to our future: User interfaces over the lifespan (panel session). In CHI 1995 (pp. 187-188). Denver, CO: ACM.
10. Capra, M. G. (2007). Comparing usability problem identification and description by practitioners and students. In Human Factors and Ergonomics Society AnnualMeeting 51 (Vol. 51, pp. 474-478). Baltimore, MD: Human Factors and Ergonomics Society.
11. Choi, B., Lee, I., & Kim, J. (2006). Culturability in mobile data services: A qualitative study of the relationship between cultural characteristics and user-experience attributes. International Journal of Human-Computer Interaction, 20, 171-203.
12. Clemmensen, T. (2004). Four approaches to user modelling-A qualitative research interview study of HCI professionals' practice. Interacting with Computers, 16, 799-829.
13. Clemmensen, T. (2005). Community knowledge in an emerging online professional community: The case of Sigchi.dk. Knowledge and Process Management, 11(2), 1-10.
14. Clemmensen, T., Hertzum, M., Hornbaek, K., Shi, Q., & Yammiyavar, P. (2009). Cultural cognition in usability evaluation. Interacting with Computers, 21, 212-220.
15. Clemmensen, T., & Plocher, T. (2007). The Cultural Usability (CULTUSAB) Project: Studies of cultural models in psychological usability evaluation methods. In N. Aykin (Ed.), Usability and internationalization. HCI and culture (Vol. 4559, pp. 274-280). Beijing, China: Springer Berlin/Heidelberg.
16. Constantine, L. (2003). CHI 2003 Feature: Testing. 1 2 3 4 5. Testing. In CHI 2003. Retrieved from http://usabilitynews.com/news/article1058.asp
17. De Angeli, A., Sutcliffe, A., & Hartmann, J. (2006). Interaction, usability and aesthetics: What influences users' preferences? DIS 2006 (pp. 271-280). University Park, PA: ACM
18. Dray, S., & Mrazek, D. (1996). A day in the life. Studying context across cultures. In E. del Galdo, & J. Nielsen (Eds.), International user interfaces (pp. 242-256). New York, NY: Wiley.
19. Ericsson, K. A. (1998). How to study thinking in everyday life: Contrasting think-aloud protocols with descriptions and explanations of thinking. Mind, Culture, & Activity, 5, 178-186.
20. Ericsson, K. A., & Simon, H. A. (1993). Protocol analysis. Verbal reports as data. Cambridge MA: MIT Press.
21. Fiotakis, G., Raptis, D., & Avouris, N. (2009). Considering cost in usability evaluation of mobile applications: Who, where and when. In Interact 2009 (pp. 231-234). New York, NY: Springer.
22. Ford, G., & Kotze, P. (2005). Researching culture and usability-A conceptual model of usability. People and Computers, 19, 317-333.
23. Frandsen-Thorlacius, O., Hornbæk, K., Hertzum, M., & Clemmensen, T. (2009). Nonuniversal usability? A survey of how usability is understood by Chinese and Danish Users. In U. Boston (Ed.), CHI 2009 (pp. 41-50). New York, NY: ACM.
24. German, T. P., & Barrett, H. C. (2006). Functional fixedness in a technologically sparse culture. Psychological Science, 16(1), 1-5.
25. Glaser, B. G., & Holton, J. (2004). Remodeling grounded theory. Forum Qualitative Sozialforschung/Forum: Qualitative Social reseach [Online Journal], 5(2), 4. Retrieved from http://www.qualitative-research.net/fqs-texte/2-0472-04glaser-e.htm
26. Gray, W. D., & Salzman, M. C. (1998). Damaged merchandise? A review of experiments that compare usability evaluation methods. Human-Computer Interaction, 13, 203-261.
27. Gulliksen, J., Boivie, I., Persson, J., Hektor, A., & Herulf, L. (2004). Making a difference - A survey of the usability profession in Sweden. In NordiChi 2004 (pp. 207-215). Tampere, Finland: ACM.
28. Hall, M., De Jong, M., & Steehouder, M. (2004). Cultural differences and usability evaluation: Individualistic and collectivistic participants compared. Technical Communication, 51, 489.
29. Hartson, H. R., Andre, T. S., & Williges, R. C. (2003). Criteria For evaluating usability evaluation methods. International Journal of Human-Computer Interaction, 15(1), 145-181.
30. Herman, L. (1996). Towards effective usability evaluation in Asia: Cross-cultural differences. In Proceedings of the 6th Australian Conference on Computer-Human Interaction (OZCHI'96) (pp. 135-136). Sydney, Australia.Washington D.C.: IEEE Computer Society.
31. Hertzum, M. (2010). Images of usability. International Journal of Human-Computer Interaction, 26, 567-600.
32. Hertzum, M., Clemmensen, T., Hornbæk, K., Kumar, J., Shi, Q., & Yammiyavar, P. (in press). Personal usability constructs: How people construe usability across nationalities and stakeholder groups. International Journal of Human-Computer Interaction.
33. Hofstede, G. (1980). Culture's consequence: Comparing values, behaviours, institutions and organizations across nations. London, UK: Sage.
34. Hong, Y.-Y., & Mallorie, L.M. (2004). A dynamic constructivist approach to culture: Lessons learned from personality psychology. Journal of Research in Personality, 38, 59-67.
35. Jagne, J., & Smith-Atakan, A. S. G. (2006). Cross-cultural interface design strategy. Universal Access in the Information Society, 5, 299-305.
36. Katre, D., Orngreen, R., Yammiyavar, P., & Clemmensen, T. (Eds.). (2010). Human work interaction design: Usability in social, cultural and organizational contexts. New York: Springer-Verlag.
37. Kirakowski, J., & Murphy, R. (2009). A comparison of current approaches to usability measurement. In UPA 2009 Workshop: Comparative Usability Task Measurement (CUE-8), Portland, OR.
38. Kjeldskov, J., Skov, M. B., Als, B. S., & Hoegh, R. T. (2004). Is it worth the hassle? Exploring the added value of evaluating the usability of context-aware mobile systems in the field. In Mobile Human-Computer Interaction-Mobilehci 2004, Proceedings (Vol. 3160, pp. 61-73). Berlin, Germany: Springer.
39. Law, E. L.-C., & Hvannberg, E. T. (2004). Analysis of combinatorial user effects in international usability tests. In CHI 2004 (pp. 9-16). Vienna, Austria: ACM.
40. Lindgaard, G., & Chattratichart, J. (2007). Usability testing:What have we overlooked? CHI 2007 (pp. 1415-1424). San Jose, CA: ACM.
41. Ling, C., & Salvendy, G. (2009). Effect of evaluators' cognitive style on heuristic evaluation: Field dependent and field independent evaluators. International Journal of Human-Computer Studies, 67, 382-393.
42. Marcus, A. (2006). Culture: Wanted? Alive or dead. Journal of Usability Studies, 1(2), 62-63.
43. Marcus, A., & Gould, E.W. (2000). Crosscurrents: Cultural dimensions and globalweb userinterface design. Interactions, 7(4), 32-46.
44. Mayhew, D. J., & Bias, R. G. (2005). Cost-justifying usability engineering for cross-cultural user interface design. In N. Aykin (Ed.), Usability and internationalization of information technology (pp. 213-252). Mahwah, NJ: Erlbaum.
45. Molich, R., Ede, M. R., Kaasgaard, k., & Karyukin, B. (2004). Comparative usability evaluation. Behavior and Information Technology, 23(1), 65-74.
46. Nisbett, R. E., Peng, K. P., Choi, I., & Norenzayan, A. (2001). Culture and systems of thought: Holistic versus analytic cognition. Psychological Review, 108, 291-310.
47. Norman, D. A. (1988). The design of everyday things. New York: Basic Books.
48. Nørgaard, M., & Høegh, R. T. (2008). Evaluating usability: using models of argumentation to improve persuasiveness of usability feedback. In DIS 2008 (pp. 212-221). Cape Town, South Africa: ACM.
49. Preece, J., Rogers, Y., & Sharp, H. (2007). Interaction design: Beyond human-computer interaction (2nd ed.). New York, NY:Wiley.
50. Rau, P.-L. P., Choong, Y.-Y., & Salvendy, G. (2004). A cross cultural study on knowledge representation and structure in human computer interfaces. International Journal of Industrial Ergonomics, 34, 117.
51. Rauterberg, M. (2006). From personal to cultural computing: How to assess a cultural experience. In Proceedings of the 4th Usability Day (9. Juni 2006). Applied University Vorarlberg, Dornbirn, Austria: Pabst Science.
52. Rousseau, G. K., & Rogers, W. A. (1998). Computer usage patterns of university faculty members across the life span. Computers in Human Behavior, 14, 417-428.
53. Shi, Q. (2008). A field study of the relationship and communication between Chinese evaluators and users in thinking aloud usability tests NordiChi 2008 (pp. 344-352). Lund, Sweden: ACM.
54. Smith, A., Dunckley, L., French, T., Minocha, S., & Chang, Y. (2004). A process model for developing usable cross-cultural websites. Interacting with Computers, 16(1), 63.
55. Smith, A., & Yetim, F. (2004). Global human-computer systems: Cultural determinants of usability. Editorial. Interacting with Computers, 16(1), 1-5
56. Spradley, J. P. (1979). The ethnographic interview. FortWorth, TX: Harcourt Brace Jovanovich.
57. Sun, H. (2004). Expanding the scope of localization: A cultural usability perspective on mobile text messaging use in American and Chinese contexts. Unpublished doctoral dissertation, Rensselaer Polytechnic Institute, New York.
58. Sun, X., & Shi, Q. (2007). Language issues in cross cultural usability testing: a pilot study in China. In N. Aykin (Ed.), Usability and internationalization. Global and local user interfaces (Vol. 4560, pp. 274-284). Beijing, China: Springer Berlin/Heidelberg.
59. Trost, J. E. (1986). Statistically nonrepresentative stratified sampling: A sampling technique for qualitative studies. Qualitative Sociology, 9(1), 54-57.
60. Vatrapu, R., & Pérez-Quiñones, M. A. (2006). Culture and usability evaluation: The effects of culture in structured interviews. Journal of Usability Studies, 1, 156-170.
61. Vermeeren, A. P. O. S., Attema, J., Akar, E., de Ridder, H., von Doorn, A. J., Erbug, C., Maguire, M. C. (2008). Usability problem reports for comparative studies: Consistency and inspectability. Human-Computer Interaction, 23, 329-380.
62. Winschiers-Theophilus, H. (2009). The art of cross-cultural design for usability. LectureNotes in Computer Science, 5614, 665-671.
63. Yammiyavar, P., Clemmensen, T., & Kumar, J. (2008). Influence of cultural background on non-verbal communication in a usability testing situation. International Journal of Design, 2(2), 31-40.
64. Yeo, A. W. (1998). Cultural effects in usability assessment. In CHI 1998 (pp. 74-75). Los Angeles, CA: ACM.
65. Zakaria, N., Stanton, J. M., & Sarkar-Barney, S. T. M. (2003). Designing and implementing culturally-sensitive IT applications. Information Technology & People, 16(1), 49-75.