A field study of the relationship and communication between Chinese evaluators and users in thinking aloud usability tests

ACM International Conference Proceeding Series

Volumn 358, Issue , 2008, Pages 344-352

  Shi, Qingxin ^a  

^a Department of Innovation and Organizational Economics   (Denmark)

Author keywords

Culture; Field study; Formative evaluation; Thinking aloud usability testing

Indexed keywords

CULTURAL THEORY; CULTURE; EFFECTIVE COMMUNICATION; FIELD OBSERVATIONS; FIELD STUDIES; FIELD STUDY; FORMATIVE EVALUATION; THINK ALOUD; THINKING ALOUD; THINKING ALOUD USABILITY TEST; THINKING ALOUD USABILITY TESTING; USABILITY EVALUATION METHODS; USABILITY PROBLEMS; USABILITY TESTING;

COMMUNICATION; KNOWLEDGE MANAGEMENT;

HUMAN COMPUTER INTERACTION;

EID: 70049115205     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1463160.1463198     Document Type: Conference Paper

References (32)

1. Law, E.L.-C. and E.T. Hvanneberg. Analysis of Combinatorial User Effects in International Usability Tests. in CHI 2004. Vienna, Austria
2. Tamler, H., High-tech versus high-touch: The limits of automation in diagnostic usability testing. http://www.htamler.com/papers/techtouch/, 2001.
3. Capra, M.G., Usability Problem Description and the Evaluator Effect in Usability Testing. 2006, Virginia Polytechnic Institute and State University: Blacksburg, Virginia. p. 292.
4. Nielsen, J., Usability Engineering[M]. 1993: New Jersey: AP Professional.
5. Shi, Q. and T. Clemmensen. Communication Patterns and Usability Problem Finding in Cross-Cultural Thinking Aloud Usability Testing. in CHI 2008. Florence, P: 2811-2816.
6. Ericsson, K.A. and H.A. Simon, Protocol Analysis. Verbal reports as data. A Bradford Book. 1993: Cambridge Massachusetts.
7. Boren, M.T. and J. Ramey, Thinking aloud: Reconciling theory and practice. IEEE Transactions on Professional Communication, 2000. 43(3): p. 261-278.
8. Kim, H.S., We talk, therefore we think? A cultural analysis of the effect of talking on thinking. journal of Personality and Social Psychology, 2002. 83(4): p. 828-842.
9. Sanchez-Burks, J., R.E. Nisbett, and O. Ybarra, Cultural Styles, Relational Schemas and Prejudice Against Outgroups. 2000, University of Michigan.
10. Clemmensen, T. and T. Plocher, The Cultural Usability (CULTUSAB) Project: Studies of Cultural Models in Psychological Usability Evaluation Methods, in Usability and Internationalization - Second International Conference on Usability and Internationalization, HCI International 2007, Beijing, China, Proceedings, Part I, N. Aykin, Editor. Springer: Heidelberg. p. 274-280.
11. Yeo, A.W. Cultural Effects in Usability Assessment. in CHI 98, Doctoral Consortium. 1998.
12. Faiola, A. and S.A. Matei, Cultural cognitive style and web design: Beyond a behavioral inquiry into computermediated communication. Journal of Computer-Mediated Communication, 2005. 11(1).
13. Hertzum, M. and N.E. Jacobsen, The evaluator effect: A chilling fact about usability evaluation methods. International Journal of Human-Computer Interaction, 2001. 13(4): p. 421-443.
14. Nisbett, R.E., The Geography of Thought. 2003, London: Nicholas Brealey Publishing.
15. Nisbett, R.E. and T. Masuda, Cultural and point of view. PNAS 2003. 100(19): p. 11163-11170.
16. Ramey, J., et al. Does Think Aloud Work? How Do We Know? in CHI 2006, April 22-27.
17. Yeo, A.W. Global-software Development Lifecycle: An Exploratory Study. in CHI 2001.
18. Hong, Y.-y. and L.M. Mallorie, A dynamic constructivist approach to culture: Lessons learned from personality psychology. Journal of Research in Personality, 2004. 38: p. 59-67.
19. Shi, Q. and T. Clemmensen. Relationship Model in Cultural Usability Testing. in HCI International, 2007, Beijing.
20. Festinger, L., & Katz, D., Research methods in the behavioral sciences. 1966, New York: Holt, Rinehart and Winston.
21. Ross, N., Culture and cognition: implication for theory and method. 2004, Vanderbilt University: International Educational and Professional Publisher.
22. Jordan, B. and A. Henderson, Interaction Analysis: Foundations and Practice. The Journal of the Learning Sciences, 1995. 4(1): p. 39-103.
23. Punch, K.F., Introduction to social research-quantitative and qualitative approaches. 2005, London: SAGE Publications.
24. Clemmensen, T. and Q. Shi. What is Part of a Usability Test? in CHI 2008. Florence, P: 3603-3608.
25. Clemmensen, T., et al. Cultural Usability Tests - How Usability Tests Are Not the Same All over the World. in HCI International 2007. Beijing, China, P: 281-290 (Lecture Notes on Computer Science; 4559).
26. Nørgaard, M. and K. Hornbæk. What do usability evaluators do in practice?: an explorative study of thinkaloud testing in Proceedings of the 6th ACM conference on Designing Interactive systems, 209 - 218, 2006. USA.
27. Guan, Z., et al. The Validity of the Stimulated Retrospective Think-Aloud Method as Measured by Eye Tracking. in CHI. 2006.
28. Haak, M.J.v.d., M.D.T.d. Jong, and P.J. Schellens, Employing think-aloud protocols and constructive interaction to test the usability of online library catalogues: a methodological comparison. Interacting with Computers 2004. 16: p. 1153-1170.
29. Haak, M.J.v.d., M.D.T.d. Jong, and P.J. Schellens, Retrospective vs. concurrent think-aloud protocols: testing the usability of an online library catalogue. BEHAVIOUR & INFORMATION TECHNOLOGY, 2003. 22(5): p. 339-351.
30. Barnum, C.M., Usability testing and research. 2002: Longman.
31. Leventhal, L.M. and J.A. Barnes, Usability Engineering: process, products, and examples. 2007, Upper Saddle River, New Jersey: Pearson Education, Inc.
32. Yammiyavar, P., T. Clemmensen, and J. Kumar. Analyzing non-verbal cues in Usabiliy Evaluation Tests. in HCI International, 2007, Beijing.