Using the repertory grid and laddering technique to determine the user's evaluative model of search engines

Journal of Documentation

Volumn 63, Issue 2, 2007, Pages 259-280

  Johnson, Frances C ^a   Crudge, Sarah E ^a  

^a MANCHESTER METROPOLITAN UNIVERSITY   (United Kingdom)

Author keywords

Information retrieval; Research work; Search engines

Indexed keywords

EID: 33847664753     PISSN: 00220418     EISSN: None     Source Type: Journal    
DOI: 10.1108/00220410710737213     Document Type: Article

References (51)

1. Brandt, D.S. and Uden, L. (2003), "Insight into mental models of novice Internet searchers", Communications of the ACM, Vol. 46 No. 7, pp. 133-6.
2. Burke, M. (2001), "The use of repertory grids to develop a user-driven classification of a collection of digitized photographs", Proceedings of the 64th ASIST Annual Meeting, Washington, Information Today Inc., Medford, NJ, pp. 76-92.
3. Corbridge, C., Rugg, G., Major, N.P., Shadbolt, N.R. and Burton, A.M. (1994), "Laddering: technique and tool use in knowledge acquisition", Knowledge Acquisition, Vol. 6, pp. 315-41.
4. Crudge, S.E. and Johnson, F.C. (2004), "Using the information seeker to elicit construct models for search engine evaluation", Journal of the American Society for Information Science and Technology, Vol. 55 No. 9, pp. 794-806.
5. DeKleer, J. and Brown, J.S. (1983), "Assumptions and ambiguities in mechanistics mental models", in Gentner, D. and Stevens, A.L. (Eds), Mental Models, Lawrence Erlbaum Associates, Hillsdale, NJ, pp. 15-34.
6. Dillon, A. (2004), Designing Usable Electronic Text: Ergonomic Aspects of Human Information Usage, 2nd ed., CRC Press, London.
7. Dillon, A. and McKnight, C. (1990), "Towards a classification of text types: a repertory grid approach", International Journal of Man-Machine Studies, Vol. 33 No. 6, pp. 623-36.
8. Draper, S.W. and Dunlop, M.D. (1997), "New IR - new evaluation: the impact of interactive multimedia on information retrieval and its evaluation", The New Review of Hypermedia and Multimedia, Vol. 3, pp. 107-22.
9. Dunn, W.N. (1986), "The policy grid: a cognitive methodology for assessing policy dynamics", in Dunn, W.N. (Ed.), Policy Analysis: Perspectives, Concepts and Methods, JAI Press, Greenwich, CT, pp. 355-75.
10. Fetzer, J.H. (1993), "The argument for mental models is unsound", Behavioral and Brain Sciences, Vol. 16 No. 2, pp. 347-8.
11. Fransella, F., Bell, R. and Bannister, D. (2003), A Manual For Repertory Grid Technique, John Wiley & Sons.
12. Hassenzahl, M. and Trautmann, T. (2001), "Analysis of web sites with the repertory grid technique", available at: www.tu-darmstadt.de/fb/fb3/ psy/soz/veroeffentlichungenmh/ Chi01hassrgt.pdf (accessed August 2003).
13. Hinkle, D. (1965), "The change of personal constructs from the view point of a theory of construct implications", unpublished PhD thesis, Ohio State University, OH.
14. Hunter, M.G. (1997), "The use of RepGrids to gather interview data about information systems analysts", Information Systems Journal, Vol. 7, pp. 67-81.
15. Johnson, F.C., Griffiths, J.R. and Hartley, R.J. (2001), DEVISE: A Framework for the Evaluation of Internet Search Engines, Library and Information Commission Research Report 100.
16. Johnson, F.C., Griffiths, J.R. and Hartley, R.J. (2003), "Task dimensions of user evaluations of information retrieval systems", Information Research, Vol. 8 No. 4, available at: http://informationr.net/ir/8- 4/paper157.html (accessed July 9, 2005).
17. Johnson-Laird, P.N. and Byrne, R.M. (1991), Deduction, Lawrence Erlbaum, Hillsdale, NJ.
18. Kelly, G.A. (1991), The Psychology of Personal Constructs, Routledge, London (original work published 1955).
19. Landfield, A.W. (1971), Personal Construct Systems in Psychotherapy, Rand McNally, Chicago, IL.
20. McKnight, C. (2000), "The personal construction of information space", Journal of the American Society for Information Science, Vol. 51 No. 8, pp. 730-3.
21. Moukdad, H. and Large, A. (2001), "Users' perceptions of the Web as revealed by transaction log analysis", Online Information Review, Vol. 25 No. 6, pp. 349-58.
22. Moynihan, T. (1996), "An inventory of personal constructs for information systems project risk researchers", Journal of Information Technology, Vol. 11, pp. 359-71.
23. Muhr, T. (1997), Atlas/ti: Short User's Manual, Scientific Software Development, Berlin.
24. Muramatsu, J. and Pratt, W. (2001), "Transparent queries: investigation users' mental models of search engines", ACM SIGIR, New Orleans, LA, September 9-12, 2001.
25. Norman, D.A. (1983), "Some observations on mental models", in Gentner, D. and Stevens, A.L. (Eds), Mental Models, Lawrence Erlbaum Associates, Hillsdale, NJ, pp. 15-34.
26. Ratzan, L. (2000), "Making sense of the Web: a metaphorical approach", Information Research, Vol. 6 No. 1, available at: http://informationr.net/ir/6-1/paper85.html, (accessed July 9, 2005).
27. Reynolds, T.J. and Gutman, J. (1988), "Laddering theory, method, analysis and interpretation", Journal of Advertising Research, Vol. 28, pp. 11-31.
28. Rugg, B., Eva, M., Mahmood, A., Rehman, N., Andrews, S. and Davies, S. (1999), "Eliciting information about organisational culture via laddering", Proceedings of the Enterprise Management and Resource Planning Studies, San Salvador, Venice, November 25-26, available at: http://leks.iasi.rm.cnr.it/emrps'99/papers/ruggetal.pdf (accessed August 2003).
29. Saracevic, T. (1996), "Modelling interaction in information retrieval: a review and proposal", Proceedings of the 59th Annual ASIS Meeting, Baltimore, October 21-24, Information Today Inc., Medford, NJ, pp. 3-9.
30. Seadle, M. (2003), "Editorial: mental models for personal digital assistants (PDAs)", Library High Tech, Vol. 21 No. 4, pp. 390-2.
31. Silverstein, C., Henzinger, M., Marais, H. and Moricz, M. (1999), "Analysis of a very large Web search engine query log", SIGIR Forum, Vol. 33 No. 1, pp. 6-12.
32. Slone, D.J. (2002), "The influence of mental models and goals on search patterns during Web interaction", Journal of the American Society for Information Science and Technology, Vol. 53 No. 13, pp. 1152-69.
33. Spink, A., Jansen, B.J. and Ozmultu, H.C. (2000), "Use of query reformulation and relevance feedback by Excite users", Internet Research, Vol. 10 No. 4, pp. 317-28.
34. Spink, A., Wolfram, D., Jansen, B.J. and Saracevic, T. (2001), "Searching the web: the public and their queries", Journal of the American Society for Information Science and Technology, Vol. 52 No. 3, pp. 226-34.
35. Staggers, N. and Norcio, A.F. (1993), "Mental models: concepts for human-computer interaction research", International Journal of Man-Machine Studies, Vol. 38, pp. 587-605.
36. Stewart, V. and Stewart, A. (1981), Business Applications of Repertory Grid, McGraw-Hill, London.
37. Su, L.T. (2003), "A comprehensive and systematic model of user evaluation of Web search engines: I. Theory and background", Journal of the American Society for Information Science and Technology, Vol. 54 No. 13, pp. 1175-92.
38. Van der Veer, G.C. (1989), "Individual differences and the user interface", Ergonomics, Vol. 32 No. 11, pp. 1431-49.
39. Whyte, G. and Bytheway, A. (1996), "Factors affecting information systems' success", International Journal of Service Industry Management, Vol. 7 No. 1, pp. 74-93.
40. Xie, H. (2003), "Supporting ease-of-use and user control: desired features and structure of Web-based online IR systems", Information Processing & Management, Vol. 39 No. 6, pp. 899-922.
41. Zhang, X. and Chignell, M. (2001), "Assessment of the effects of user characteristics on mental models of information retrieval systems", Journal of the American Society for Information Science and Technology, Vol. 52 No. 6, pp. 445-59.
42. Holscher, C. and Strube, G. (2000), "Web search behaviour of Internet experts and newbies", Computer Networks, Vol. 33, pp. 337-46.
43. Jansen, B.J., Spink, A. and Saracevic, T. (2000), "Real life, real users, and real queries: a study and analysis of user queries on the Web", Information Processing and Management, Vol. 36 No. 2, pp. 207-27.
44. Otter, M. and Johnson, H. (2000), "Lost in hyperspace: metrics and mental models", Interacting With Computers, Vol. 13, pp. 1-40.
45. Saracevic, T. (1997), "Extension and application of the stratified model of information retrieval interaction", Proceedings of the Annual Meeting of the American Society for Information Science, 34, pp. 3-9.
46. Spink, A. (2002), "A user-centred approach to evaluating human interaction with web search engines: an exploratory study", Information Processing and Management, Vol. 38 No. 3, pp. 401-26.
47. Spink, A., Bateman, J. and Jansen, B.J. (1999), "Searching the Web: a survey of Excite users", Internet Research, Vol. 9 No. 2, pp. 117-28.
48. Strauss, A. and Corbin, J. (1998), Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory, 2nd ed., Sage, London.
49. Sullivan, D. (2003), Nielsen NetRatings Search Engine Ratings, available at: www.searchenginewatch.com/reports/article.php/2156451 (accessed July 9, 2004).
50. Tan, F.B. and Hunter, M.G. (2002), "The repertory grid technique: a method for the study of cognition in information systems", MIS Quarterly, Vol. 26 No. 1, pp. 39-57.
51. Thatcher, A. and Greyling, M. (1998), "Mental models of the Internet", International Journal of Industrial Ergonomics, Vol. 22, pp. 299-305.