Thinking about thinking aloud: A comparison of two verbal protocols for usability testing

IEEE Transactions on Professional Communication

Volumn 47, Issue 2, 2004, Pages 105-117

  Krahmer, Emiel ^a   Ummelen, Nicole ^a  

^a TILBURG UNIVERSITY   (Netherlands)

Author keywords

Lostness; Thinking aloud; Usability research; Usability testing

Indexed keywords

BEHAVIORAL RESEARCH; COGNITIVE SYSTEMS; HUMAN ENGINEERING; STANDARDS; USABILITY ENGINEERING;

LOSTNESS; THINKING ALOUD; USABILITY TESTING;

WEBSITES;

EID: 3042688560     PISSN: 03611434     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPC.2004.828205     Document Type: Article

References (26)

1. A. Newell and H. Simon, Human Problem Solving. Englewood Cliffs, NJ: Prentice Hall, 1972.
2. L. Flower and J. Hayes, "A cognitive process theory of writing," College Compos. Commun., vol. 32, pp. 365-387, 1981.
3. J. Carroll, P. Smith-Kerker, J. Ford, and S. Mazur-Rimetz, "The minimal manual," Human Comput. Interaction, vol. 3, pp. 123-153, 1987.
4. K. A. Schriver, "Revising computer documentation for comprehension: Ten exercises in method-aided revision," Carnegie Mellon Univ., Pittsburgh, PA, Tech. Rep. No. 14, 1984.
5. ____, Dynamics in Documentation Design: Creating Text for Readers. New York: Wiley, 1997.
6. J. Nielsen, Usability Engineering. Cambridge, MA: Academic, 1993.
7. K. Ericsson and H. Simon, "Verbal reports as data," Psychol. Rev., vol. 87, pp. 215-251, 1980.
8. J. E. Russo, E. J. Jonson, and D. L. Stephens, "The validity of verbal methods," Memory Cogn., vol. 17, no. 6, pp. 759-769, 1989.
9. P. Smagorinsky, "The reliability and validity of method analysis," Written Commun., vol. 6, pp. 463-479, 1989.
10. M. Veenman, J. Elshout, and M. Groen, "Thinking aloud: Does it affect regulatory processes in learning?," Tijdschrift voor Onderwijsresearch, vol. 18, no. 6, pp. 322-330, 1993.
11. N. Ummelen and R. Neutelings, "Measuring reading behavior in policy documents: A comparison of two instruments," IEEE Trans. Profess. Commun., vol. 43, no. 3, pp. 292-302, 2000.
12. M. Boren and J. Ramey, "Thinking aloud: Reconciling theory and practice," IEEE Trans. Profess. Commun., vol. 43, no. 3, pp. 261-278, 2000.
13. R. E. Nisbett and T. D. Wilson, "Telling more than we can know: Verbal reports on mental processes," Psychol. Rev., vol. 84, pp. 231-259, 1977.
14. K. Ericsson and H. Simon, Protocol Analysis: Verbal Reports as Data. Cambridge, MA: MIT Press, 1993.
15. J. Dumas and J. Redish, A Practical Guide to Usability Testing. Norwood, NJ: Ablex, 1994.
16. H. Clark and E. Schaefer, "Contributing to discourse," Cogn. Sci., vol. 13, pp. 259-294, 1989.
17. N. Ward and W. Tsukahara, "Prosodic features which cue back-channel responses in English and Japanese," J. Pragmat., vol. 23, pp. 1177-1207, 2000.
18. H. den Hartog Jager, Dolen door des schrijvers geest, (in Dutch), in NRC Handelsblad, 2000.
19. H. A. Simon, "The functional equivalence of problem solving skills," Cogn. Psychol., vol. 7, pp. 268-288, 1975.
20. K. Drummond and R. Hopper, "Some uses of yeah," Lang. Soc. Interaction, vol. 26, no. 2, pp. 203-212, 1993.
21. P. A. Smith, "Toward a practical measure of hypertext usability," Interacting Comput., pp. 365-381, 1996.
22. M. Otter and H. Johnson, "Lost in hyperspace: Metrics and mental models," Interacting Comput., vol. 13, pp. 1-40, 2000.
23. N. A. Stanton and M. S. Young, "What price ergonomics?," Nature, vol. 399, pp. 197-198, 1999.
24. W. D. Gray and M. C. S. Salzman, "Damaged merchandise? A review of experiments that compare usability evaluation methods," Human Comput. Interaction, vol. 13, pp. 203-261, 1998.
25. M. de Jong and P. J. Schellens, "Toward a document evaluation methodology: What does research tell us about the validity and reliability of evaluation methods?," IEEE Trans. Profess. Commun., vol. 43. no. 3, pp. 242-260, 2000.
26. J. Nielsen, "Estimating the number of subjects needed for a thinking aloud test," Int. J. Human-Comput. Studies, vol. 41, pp. 385-397, 1994.