Getting access to what goes on in people's heads? - Reflections on the think-aloud technique

ACM International Conference Proceeding Series

Volumn 31, Issue , 2002, Pages 101-110

  Nielsen, Janni ^a   Clemmensen, Torkil ^a   Yssing, Carsten ^a  

^a Department of International Economics and Management   (Denmark)

Author keywords

think aloud; usability; verbal report

Indexed keywords

COGNITIVE PROCESS; ERICSSON; EXPERIMENTAL RESEARCH; HIGHER ORDER; HUMAN THINKING; SHORT TERM MEMORY; TEST PROCEDURES; THINK ALOUD; THINKING ALOUD; USABILITY TESTING;

KNOWLEDGE MANAGEMENT; RESEARCH; TESTING;

HUMAN COMPUTER INTERACTION;

EID: 77953910132     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/572020.572033     Document Type: Conference Paper

References (39)

1. Bannon, L. (1991), From Human Factors to Human Actors: The Role of Psychology and Human-Computer Interaction Studies in Systems Design, in Design at work: Cooperative Design of Computer Systems., eds. Greenbaum, J. & Kyng, M., Hillsdale: Lawrence Erlbaum Associates, pp. 25-44.
2. Bedny, G. & Meister, D. (1997), The Russian Theory of Activity: Current Applications to Design and Learning, Lawrence Erlbaum, Mahwah, New Yersey.
3. Boren, M. T. & Ramey, J. (2000), Thinking aloud: Reconciling theory and practice, IEEE Transactions on Professional Communication, vol. 43, no. 3, pp. 261-278.
4. Branch, J. L. (2000), Investigating the information-seeking processes of adolescents: The value of using think alouds and think afters, Library & Information Science Research, vol. 22, no. 4, pp. 371-392.
5. Bringham, B., John, R. & Lewis, C. (1991), Usability Testing of a Graphical Programming System: Things We Missed in a Programming Walkthrough, in Human factors in computing systems conference proceedings on Reaching through technology, New Orleans, Louisiana, United States, pp. 7-12.
6. Buur, J. & Bagger, K. (1999), Replacing usability testing with user dialogue - How a Danish manufacturing company enhanced its product design process by supporting user participation, Communications of the ACM, vol. 42, no. 5, pp. 63-66.
7. Bødker, S. (1996), Applying AT to Video Analysis: How to make sense of Video Data in HCI, in Context and Consciousness, ed. Nardi, B. A., MIT Press, pp. 147-174.
8. Clemmensen, T. (2002), Interest in theory and method in a Danish community of usability specialists (in Danish). Working paper, Copenhagen Business School, Department of Informatics, HCI research group., pp. 1-30.
9. Dix, A., Finlay, J., Abowd, G. & Beale, R. (1997), Human-Computer Interaction, Prentice Hall.
10. Duncker, Karl(1945) On problem-solving, in Dashiell, John F.: Psychological Monographs, The American Psychologoical Association, Inc., Washington DC, vol. 58, pp. 1-114. (reprint, Westport, Conn. Greenwood, 1976).
11. Ericsson, K. A. & Simon, H. A. (1984), Protocol Analysis. Verbal reports as data, Cambridge Massachusets.
12. Ericsson, K. A. & Simon, H. A. (1998), How to study thinking in everyday life: Contrasting think-aloud protocols with descriptions and explanations of thinking., Mind, Culture, & Activity, vol. 5, no. 3, pp. 178-186.
13. Flading, Janne(2002) Usability expert at B&O - personal communication
14. Hackos, J. T. & Redish, J. C. (1998), User and Task Analysis for interface Design, Wiley, USA.
15. Kaptelinin, V. & Nardi, B. A. (1997), Activity Theory: Basic Concepts and Applications, Available: [http://www.acm.org/sigchi/chi97/proceedings/ tutorial/bn.htm].
16. Kari, K. & Arvonen, T. (1992), Identifying Potential CSCW Applications by Means of Activity Theory Concepts: A Case Example, in CSCW 92.
17. Karsenty, L. (2001), Adapting verbal protocol methods to investigate speech systems use, Applied Ergonomics, vol. 32, no. 1, pp. 15-22.
18. Katalin, E. (2000), "Please, keep talking": The 'think-aloud' method in second language reading research, Novelty, vol. 7, no. 3.
19. Kensing, F. (1998), Prompted Reflections: A Technique for Understanding complex Work, Interactions, vol. January-February 1998, pp. 7-15.
20. Kirkeby, O. F.(1988) Kroppens Tanke (The thought of the body), Samfundslitteratur, Copenhagen
21. Koenemann-Belliveau, J., Carroll, J. M., Rosson, M. B. & Singley, M. K. (1994), Comparative usability evaluation: critical incidents and critical threads, in Human factors in computing systems : "Celebrating interdependence", ACM Press, New York, NY, USA, Boston, Massachusetts, United States, pp. 245-251.
22. Kuutti, K. (1996), AT as a Potential Framework for Human-Computer Interaction Research., in Context and Consciousness., eds. Bødker, S. & Nardi, B. A., MIT Press, pp. 17-44.
23. Mehlenbacher, B. (1993), Software usability: choosing appropriate methods for evaluating online systems and documentation, in Proceedings of the 11th annual international conference on Systems documentation, Waterloo, Ontario, Canada, pp. 209-222.
24. Molich, R. (1994), User friendly systems (in Danish), Teknisk forlag, København.
25. Nielsen, Janni (1992), Designers' Decision Making: Design of a User Interface for a Picture Search
26. Nielsen, Janni & Christiansen, N. (2000), Mindtape: A Tool for Reflection in Participatory Design, in Participatory Design, New York, pp. 303-313.Database, Esprit 3066, AMODEUS RP7/WP14.
27. Nielsen, J. (1994), Estimating the Number of Subjects Needed for a Thinking Aloud Test, International Journal of Human-Computer Studies, vol. 41, no. 3, pp. 385-397.
28. Nielsen, J. (1992). Evaluating the thinking aloud technique for use by computer scientists. In Hartson, H. R. and Hix, D. (Eds.): Advances in Human
29. Nisbett, R. E. & Wilson, T. D. (1977), Telling More Than We Can Know: Verbal Reports on Mental Processes, Psychological Review, vol. 84, no. 3, pp. 231-259.
30. Preece, J. (1994), Human-Computer Interaction, Addison-Wesley, England.
31. Preece, J., Rogers, Y. & Sharp, H. (2002), Interaction Design: Beyond Human-Computer Interaction, John Wiley & Sons.
32. Ritter, F. E. & Young, R. M. (2001), Embodied models as simulated users: introduction to this special issue on using cognitive models to improve interface design, International Journal of Human-Computer Studies, vol. 55, no. 1, pp. 1-14.
33. Rowley, D. E. (1994), Usability testing in the field: bringing the laboratory to the user., in Human factors in computing systems : "Celebrating interdependence". ACM Press, New York, NY, USA, Boston, Massachusetts, United States, pp. 252-257.
34. Simpson, M. (1990), How usability testing can aid the development of online documentation, ACM SIGDOC Journal of Computer Documentation, vol. 14, no. 4.
35. Turner, P., Turner, S. & Horton, J. (1999), From description to requirements: an activity theoretic perspective, in Proceedings of the international ACM SIGGROUP conference on Supporting group work, ACM Press, New York, NY, USA, Phoenix, Arizona, United States, pp. 286-295.
36. Vermersch, P. (1999), Introspection as practice, in The View from Within - First person approaches to the study of consciousness, eds. Varela, F. & Shear, J., Imprint Academic, Exeter, UK, p. 320 pages. The chapter is also available from http://cognet.mit.edu/MITECS/Entry/voneche.html.
37. Waes, L. v. (1998), Evaluating on-line and off-line searching behavior using thinking-aloud protocols to detect navigation barriers, in Proceedings of the sixteenth annual international conference on Computer documentation, ACM Press, New York, NY, USA, Quebec, Canada, pp. 180-183.
38. Wright, P. C. & Monk, A. F. (1990), The use of think-aloud evaluation methods in design, ACM SIGCHI Bulletin December 1990, vol. 23, no. 1.
39. Yeo, A. (1998), Cultural Effects in Usability Assessment, in CHI 98, Doctoral Consortium, pp. 74-76.