Employing think-aloud protocols and constructive interaction to test the usability of online library catalogues: A methodological comparison

Interacting with Computers

Volumn 16, Issue 6, 2004, Pages 1153-1170

  Van Den Haak, M J ^a   De Jong, M D T ^a   Schellens, P J ^a  

^a UNIVERSITY OF TWENTE   (Netherlands)

Author keywords

Co discovery; Concurrent think aloud protocols; Constructive interaction; Retrospective think aloud protocols; Usability testing; Validity

Indexed keywords

COGNITIVE SYSTEMS; HUMAN COMPUTER INTERACTION; ONLINE SYSTEMS; PROBLEM SOLVING; RELIABILITY; STATISTICAL TESTS; USABILITY ENGINEERING;

CO-DISCOVERY; CONCURRENT THINK-ALOUD PROTOCOLS; CONSTRUCTIVE INTERACTIONS; RETROSCOPIC THINK-ALOUD PROTOCOLS; USABILITY TESTING; VALIDITY;

DIGITAL LIBRARIES;

EID: 9944233034     PISSN: 09535438     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.intcom.2004.07.007     Document Type: Article

References (23)

1. Allwood, C.M., Kalén, T., 1997. Evaluating and improving the usability of a user manual. Behaviour and Information Technology 16, 43-57.
2. Battleson, B., Booth, A., Weintrop, J., 2001. Usability testing of an academic library web site: a case study. Journal of Academic Librarianship 237, 188-198.
3. Bowers, V.A., Snyder, H.L., 1990. Concurrent versus retrospective verbal protocols for comparing window usability, Proceedings of the Human Factors Society 34th Meeting, HFES, Santa Monica, CA, pp. 1270-1274.
4. Campbell, N. (Ed.), 2001. Usability Assessment of Library-Related Web Sites: methods and Case Studies, Chicago, LITA.
5. De Jong, M., Schellens, P.J., 2000. Toward a document evaluation methodology: what does research tell us about the validity and reliability of methods?. IEEE Transactions on Professional Communication 43 (3), 242-260.
6. Dumas, J.S., Redish, J.C., 1999. A practical guide to usability testing (revised edition). Intellect, Exeter.
7. Ericsson, K.A., Simon, H.A., 1993. Protocol Analysis: Verbal Reports as Data (revised edition). MIT Press, Cambridge, MA.
8. Gray, W.D., Salzman, M.C., 1998. Damaged merchandise? A review of experiments that compare usability evaluation methods. Human-Computer Interaction 13, 203-261.
9. Hackman, G.S., Biers, D.W., 1992. Team usability testing: are two heads better than one? Proceedings of the Human Factors Society 36th Annual Meeting, HFES, Santa Monica, CA, pp. 1205-1209.
10. Henderson, R.D., Smith, M.C., Podd, J., Varela-Alvarez, H., 1995. A comparison of the four prominent user-based methods for evaluating the usability of computer software. Ergonomics 38, 2030-2044.
11. Höysniemi, J., Hämäläinen, P., Turkki, L., 2003. Using peer tutoring in evaluating the usability of a physically interactive computer game with children. Interacting with Computers 15, 203-225.
12. Kahler, H., 2000. Constructive interaction and collaborative work: introducing a method for testing collaborative systems. ACM Interactions 7 (3), 27-34.
13. Lewis, J.R., 1994. Sample sizes for usability studies: additional considerations. Human Factors 36, 369-378.
14. Miyake, N., 1982. Constructive Interaction. Center for Human Information Processing. University of California, San Diego, CA.
15. Molich, R., Ede, M.R., Kaasgaard, K., Karyukin, B., 2004. Comparative usability evaluation. Behaviour and Information Technology 35 (1), 65-74.
16. Nielsen, J., 1993. Usability Engineering. Academic Press, Boston, MA.
17. Nielsen, J., 1994. Estimating the number of subjects needed for a thinking aloud test. International Journal of Human-Computer Studies 41, 385-397.
18. Norlin, E., Winters, C.M., 2002. Usability Testing for Library Websites: A Hands-on Guide. American Library Association, Chicago.
19. Sienot, M., 1997. Pretesting web sites; a comparison between the plus-minus method and the think-aloud methods for the world wide web. Journal of Business and Technical Communication 11, 469-482.
20. Smilowitz, E.D., Darnell, M.J., Benson, A.E., 1994. Are we overlooking some usability testing methods? A comparison of lab, beta, and forum tests. Behaviour and Information Technology 13, 183-190.
21. Van den Haak, M.J., De Jong, M.D.T., Schellens, P.J. 2003. Retrospective versus concurrent think-aloud protocols: Testing the usability of an online library catalogue. Behaviour & Information Technology, 22, 339-351.
22. Van Oostendorp, H., De Mul, S., 1999. Learning by exploration: thinking aloud while exploring an information system. Instructional Science 27, 269-284.
23. Virzi, R.A., 1992. Refining the test phase of usability evaluation: how many subjects is enough? Human Factors 34, 457-468.