Modelling what users see when they look at images: A cognitive viewpoint

Journal of Documentation

Volumn 58, Issue 1, 2002, Pages 6-29

  Greisdorf, Howard ^a   O’Connor, Brian ^a  

^a UNIVERSITY OF NORTH TEXAS   (United States)

Author keywords

Document image processing; Information retrieval

Indexed keywords

EID: 0036332553     PISSN: 00220418     EISSN: None     Source Type: Journal    
DOI: 10.1108/00220410210425386     Document Type: Article

References (74)

1. Androutsas, D. et al. (1998), “Content-based representation and retrieval of visual media: a state-of-the-art review”, Multimedia Tools and Applications, Vol. 3 No. 3, pp. 179-202.
2. Arnheim, R. (1969), Visual Thinking, University of California Press, Berkeley, CA.
3. Armitage, L. and Enser, P. (1997), “Analysis of user need in image archives”, Journal of Information Science, Vol. 23 No. 4, pp. 287-99.
4. Biederman, I. (1987), “Recognition-by-components: a theory of human image understanding”, Psychological Review, Vol. 94 No. 2, pp. 115-47.
5. Berger, J. (1980), About Looking, Vintage International, New York, NY.
6. Besser, H. (1997), “The changing role of photographic collections with the advent of digitization”, The Wired Museum, American Association of Museums, Washington. Available at: http://www.gseis.ucla.edu/∼howard/Papers/garmil-eastman.html (visited 31 January 2001).
7. Bjarnestam, A. (1998), Description of an Image Retrieval System, Presentation at The Challenge of Image Retrieval Research Workshop, Newcastle upon Tyne, 5 February.
8. Brooks, R.A. (1981), “Symbolic reasoning among 3-D models and 2-D images”, Artificial Intelligence, Vol. 17, pp. 285-348.
9. Brown, S.J. (1965), The World of Imagery, Haskell House, New York, NY.
10. Carson, C.S., Belongie, S., Greenspan, H. and Malik, J. (1997), “Region-based image querying”, Proceedings of IEEE Workshop on Content-Based Access of Image and Video Libraries, San Juan, Puerto Rico, IEEE Computer Society, Los Alamitos, CA, pp. 42-9.
11. Cha, G. and Chung, C. (1999), “An indexing and retrieval mechanism for complex similarity queries in image databases”, Journal of Visual Communication and Image Representation, Vol. 10, pp. 268-90.
12. Chan, Y. and Kung, S.Y. (1997), “A hierarchical algorithm for image retrieval by sketch”, 1st IEEE Workshop on Multimedia Signal Processing, pp. 564-9.
13. Chen, H. (2001), “An analysis of image queries in the field of art history”, Journal of the American Society for Information Science, Vol. 52 No. 3, pp. 260-73.
14. Chuang, G.C. and Kuo, C.J. (1996), “Wavelet descriptor of planar curves: theory and applications”, IEEE Trans. Image Proc., Vol. 5 No. 1, pp. 56-70.
15. Churchland, P.M. (1995), The Engine of Reason, the Seat of the Soul, The MIT Press, Cambridge, MA.
16. Connell, J.H. and Brady, J.M. (1987), “Generating and generalizing models of visual objects”, Artificial Intelligence, Vol. 31 No. 2, pp. 159-83.
17. Craven, T. (1934), Modern Art: the Men, the Movements, the Meaning, Simon and Schuster, New York, NY.
18. Damasio, A. (1999), The Feeling of What Happens: Body and Emotion in the Making of Consciousness, Harcourt Brace & Company, New York, NY, pp. 320-1.
19. del Bimbo, A., Pala, P. and Santini, S. (1996), “Image retrieval by elastic matching of shapes and image patterns”, Proceedings of Multimedia ’96, pp. 215-18.
20. Dervin, B. (1983), “An overview of sense-making research: concepts, methods, and results to date”, International Communication Association Annual Meeting, Dallas. Available at: http://communication.sbs.ohio-state.edu/sense-making/art/artdervin83.html (visited 16 July 2001).
21. Eakins, J. and Graham, M. (1999), “Content-based image retrieval”, JISC Technology Applications Programme, JTAP Reports, University of Northumbria at Newcastle, pp. 1-67. Available at: http://www.jtap.ac.uk/reports/htm/jtap-039.html (visited 23 January 2001).
22. Enser, P. (1993), “Query analysis in a visual information retrieval context”, Journal of Documentation and Text Management, Vol. 1 No. 1, pp. 25-52.
23. Enser, P. (1995), “Pictorial information retrieval”, Journal of Documentation, Vol. 51 No. 2 pp. 126-70.
24. Enser, P. (2000), “Visual image retrieval: seeking the alliance of concept-based and content-based paradigms”, Journal of Information Science, Vol. 26 No. 4, pp. 199-210.
25. Enser, P. and McGregor, C. (1992), “Analysis of visual information retrieval queries’’, Report on Project G16412 to the British Library Research and Development Department, British Library, London.
26. Fidel, R. (1997), “The image retrieval task: implications for the design and evaluation of image databases”, The New Review of Hypermedia and Multimedia, Vol. 3, pp. 181-99.
27. Forsyth, D.A., Malik, J., Fleck, M., Greenspan, H., Leung, T., Belongie, S., Carson, C. and Begler, C. (1996), “Finding pictures of objects in large collections of images”, Proceedings, International Workshop on Object Recognition, Cambridge, April, in Ponce, J., Zisserman, A. and Hebert, M. (Eds), Object Representation in Computer Vision: Lecture Notes in Computer Science, Vol. 1144, Springer-Verlag, New York, NY, pp. 355-61.
28. Fried, L.S. and Holyoak, K.J. (1984), “Induction of category distributions: a framework for classification learning”, Journal of Experimental Psychology: Learning, Memory, and Cognition, Vol. 10, pp. 234-57.
29. Frisby, J.P. (1980, Seeing: Illusion, Brain and Mind, Oxford University Press, New York, NY.
30. Gombrich, E.H. (1960), Art and Illusion: A Study in the Psychology of Pictorial Representation. The A.W. Mellon Lectures in the Fine Arts, 1956, Bollingen Series XXXV.5, Princeton University Press, Princeton, NJ.
31. Gotlieb, C.C. and Kreyszig, H.E. (1990), “Texture descriptors based on co-occurrence matrices”, Computer Vision, Graphics, and Image Processing, Vol. 51, pp. 70-86.
32. Greisdorf, H. (2000), “Relevance thresholds: a conjunctive/disjunctive model of end-user cognition as an evaluative process”, unpublished doctoral dissertation, University of North Texas, Denton, TX.
33. Hastings, S.K. (1995), “Query categories in a study of intellectual access to digitized art images”, Proceedings of the 58th Annual Meeting of the Society for Information Science, ASIS ’95, Vol. 32, Information Today, Medford, NJ, pp. 3-8.
34. Henderson, J.M. and Hollingsworth, A. (2000), “Eye movements, visual memory, and scene representation”, Michigan State University Eye Movement Laboratory Technical Report 5, pp. 1-17.
35. Hidderly, R. and Rafferty, P. (1997), “Democratic indexing: an approach to the retrieval of film”, Proceedings of Library and Information Studies: Research and Professional Practice, Queen Margaret College, Edinburgh, Taylor Graham, London, pp. 90-102.
36. Hinkle, D.E., Wiersma, W. and Jurs, S.G. (1994), Applied Statistics for the Behavioral Sciences, Houghton Mifflin Company, Boston, MA.
37. Hirata, K. and Kato, T. (1992), “Query by vision example: content-based image retrieval”, Third International Conference on Extending Database Technology, EDBT ’92, Springer-Verlag, New York, NY, pp. 56-71.
38. Holland, J.H., Holyoak, K., Nisbett, R. and Thagard, P. (1989), Induction: Processes of Inference, Learning, and Discovery, The MIT Press, Cambridge, MA.
39. Ioka, M. (1989), “A method of defining the similarity of images on the basis of color information”, Technical Report RT-0300, IBM Research, Tokyo Research Laboratory, November.
40. Jaffe, H.L.C. (1969), The World of the Impressionists, Hammond Incorporated, Maplewood, NJ.
41. Jain, A.K. and Vailaya, A. (1996), “Image retrieval using color and shape”, Pattern Recognition, Vol. 29 No. 8, pp. 1233-44.
42. Jorgensen, C. (1998), “Attributes of images in describing tasks”, Information Processing & Management, Vol. 34 No. 2/3, pp. 161-74.
43. Kato, T. (1992), “Database architecture for content-based image retrieval”, in Jambardino, A. and Niblack, W. (Eds), Image Storage and Retrieval Systems, SPIE, Bellingham, WA, pp. 112-23.
44. Keister, L. (1994), “User types and queries: impact on image access systems”, in Fidel, R. (Ed.), Challenges in Indexing Electronic Text and Images, American Society for Information Science, pp. 7-19.
45. Kimia, B.B., Chan, J., Bertrand, D., Coe, S., Roadhouse, Z. and Tek, H. (1997), “A shock-based approach for indexing of image databases using shape”, in Kuo, J. et al. (Eds), Multimedia Storage and Archiving Systems II, SPIE, Bellingham, WA, pp. 288-302.
46. Liu, F. and Picard, R.W. (1996), “Periodicity, directionality and randomness: world features for image modeling and retrieval”, IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 18 No. 7, pp. 722-33.
47. McCorry, H. and Morrison, I.O. (1995), Report on the Catechism Project, National Museums of Scotland.
48. Ma, W.Y. and Manjunath, B.S. (1998), “A texture thesaurus for browsing large aerial photo-graphs”, Journal of the American Society for Information Science, Vol. 49 No. 7, pp. 633-48.
49. Manjunath, B.S. and Ma, W.Y. (1996), “Texture features for browsing and retrieval of large image data”, IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 18, pp. 837-42.
50. Marchionini, G. (1995), Information Seeking in Electronic Environments, Cambridge University Press, Cambridge, UK.
51. Markkula, M. and Sormumen, E. (1998), “Searching for photos: journalists’ practices in pictorial IR”, The Challenge of Image Retrieval Research Workshop, Newcastle upon Tyne, 5 February.
52. Mehrotra, R. and Gary, J.E. (1995), “Similar-shape retrieval in shape data management”, IEEE Computer, Vol. 28 No. 9, pp. 57-62.
53. Niblack, W., Barber, R., Equitz, W., Flickner, M., Glasma, E., Petkovic, D., Yanker, P., Faloutsos, C. and Taubin, G. (1993), “The QBIC project: querying images by color, texture and shape”, IBM Research Report RJ-9203, IBM Research Division, San Jose, CA.
54. O’Connor, B. (1993), “Browsing: a framework for seeking functional information”, Knowledge: Creation, Diffusion, Utilization, Vol. 15 No. 2, pp. 211-32.
55. O’Connor, B., O’Connor, M. and Abbas, J. (1999), “User reactions as access mechanism: an exploration based on captions for images”, Journal of the American Society for Information Science, Vol. 50 No. 8, pp. 681-97.
56. Oliva, A. et al. (1997), “Real-world scene categorization by a self-organizing neural network”, Perception, Supp. 26, No. 19.
57. Ornager, S. (1997), ‘‘Image retrieval: theoretical analysis and empirical user studies on accessing information in images”, in Schwartz, C. and Rorvig, M. (Eds), Proceedings of the 60th Annual Meeting of the American Society for Information Science, Vol. 34, Information Today, Medford, NJ, pp. 202-11.
58. Panofsky, E. (1955), Meaning in the Visual Arts, Anchor, New York, NY.
59. Pentland, A., Picard, R. and Sclaroff, S. (1996), “Photobook: tools for content-based manipulation of image databases”, International Journal of Computer Vision, Vol. 18 No. 3, pp. 233-54.
60. Pylyshyn, Z. (1998), Is Vision Continuous with Cognition? The Case for Cognitive Impenetrability of Visual Perception, Rutgers Center for Cognitive Science, Rutgers University, New Brunswick, NJ. Available at: http://ruccs.rutgers.edu/faculty/bbs98.html (visited 1 February 2001).
61. Rabbitti, F. and Stanchev, P. (1989), “GRIM_DBMS: a graphical image database management system”, in Kunii, T. (Ed.), Visual Database Systems, Elsevier, Amsterdam, pp. 415-30.
62. Rosch, E. (1973), “On the internal structure of perceptual and semantic categories”, in Moore, T.E. (Ed.), Cognitive Development and the Acquisition of Language, Academic Press, New York, NY, pp. 111-44.
63. Rui, Y., Huang, T.S. and Chang, S. (1999), “Image retrieval: current techniques, promising directions, and open issues”, Journal of Visual Communication and Image Representation, Vol. 10, pp. 39-62.
64. Shatford, S. (1986), “Analyzing the subject of a picture: a theoretical approach”, Cataloging and Classification Quarterly, Vol. 6 No. 3, pp. 39-62.
65. Shatford-Layne, S. (1994), “Some issues in the indexing of images”, Journal of the American Society for Information Science, Vol. 45 No. 8, pp. 583-8.
66. Smith, E.E. and Medin, D.L. (1981), Categories and Concepts, Harvard University Press, Cambridge, MA.
67. Strat, T.M. and Fischler, M.A. (1991), “Context-based vision: recognizing objects using information from both 2-D and 3-D imagery”, IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 13 No. 10, pp. 1050-65.
68. Stricker, M. and Dimai, A. (1996), “Color indexing with weak spatial constraints”, in Sethi, I. and Jain, R. (Eds), Storage and Retrieval for Image and Video Databases IV, pp. 29-40.
69. Stricker, M. and Orengo, M. (1995), “Similarity of color images”, in Niblack, W. and Jain, R. (Eds), Storage and Retrieval for Image and Video Databases III, pp. 381-92.
70. Svenonius, E. (1994), “Access to nonbook materials: the limits of subject indexing for visual and aural languages”, Journal of the American Society for Information Science, Vol. 45, pp. 600-6.
71. Swain, M. and Ballard, D. (1991), “Color indexing”, International Journal of Computer Vision, Vol. 7 No. 1, pp. 11-32.
72. Tamura, H., Mori, S. and Yamawaki, T. (1978), “Textural features corresponding to visual perception”, IEEE Transactions on Systems, Man and Cybernetics, Vol. 8 No. 6, pp. 460-72.
73. Tirthapura, S., Sharvit, D., Klein, P. and Kimia, B. (1998), “Indexing based on edit-distance matching of shape graphics”, in Kuo, C., Chang, S. and Panchanathan, S. (Eds), Multimedia Storage and Archiving Systems III, pp. 25-36.
74. Venters, C.C. and Cooper, M. (2000), “A review of content-based image retrieval systems”, JISC Technology Applications Programme, JTAP Reports, University of Manchester, pp. 1-63. Available at: http://www.jtap.ac.uk/reports/htm/jtap-054.html (visited 23 January 2001).