Modeling eye movements in visual agnosia with a saliency map approach: Bottom-up guidance or top-down strategy?

Neural Networks

Volumn 24, Issue 6, 2011, Pages 665-677

  Foulsham, Tom ^a   Barton, Jason J S ^a   Kingstone, Alan ^a   Dewhurst, Richard ^b   Underwood, Geoffrey ^c  

^a UNIVERSITY OF BRITISH COLUMBIA   (Canada)

^b LUND UNIVERSITY   (Sweden)

^c UNIVERSITY OF NOTTINGHAM   (United Kingdom)

Author keywords

Eye movements; Neuropsychology; Object recognition; Visual attention; Visual saliency

Indexed keywords

EYE MOVEMENT CONTROL; HUMAN VISUAL; NEUROPSYCHOLOGICAL; NEUROPSYCHOLOGY; OBJECT RECOGNITION PROBLEM; SALIENCY MAP; SALIENCY MAP MODEL; TOP-DOWN PROCESS; TOPDOWN; VISUAL ATTENTION; VISUAL SALIENCY;

FEATURE EXTRACTION; OBJECT RECOGNITION; VISUALIZATION;

EYE MOVEMENTS;

AGNOSIA; ARTICLE; AUDITORY MEMORY; BENTON LINE ORIENTATION TEST; BOSTON NAMING TEST; BRAIN PERFUSION; BRAIN SCINTISCANNING; CASE REPORT; COLOR VISION; COMPUTATIONAL SALIENCY MAP MODEL; COMPUTER MODEL; CONTROLLED STUDY; DYSLEXIA; EYE FIXATION; EYE MOVEMENT; EYE TRACKING; FEMALE; HUMAN; LATERAL BRAIN VENTRICLE; LEARNING TEST; NEUROPSYCHOLOGICAL TEST; PRIORITY JOURNAL; RECOGNITION; SACCADIC EYE MOVEMENT; TASK PERFORMANCE; VERBAL MEMORY; VISUAL AGNOSIA; VISUAL FIELD; VISUAL STIMULATION;

ADULT; AGNOSIA; ATTENTION; EYE MOVEMENTS; FEMALE; HUMANS; MALE; MIDDLE AGED; MODELS, BIOLOGICAL; PATTERN RECOGNITION, VISUAL; PHOTIC STIMULATION; REACTION TIME; VISUAL FIELDS; YOUNG ADULT;

EID: 79957598636     PISSN: 08936080     EISSN: 18792782     Source Type: Journal    
DOI: 10.1016/j.neunet.2011.01.004     Document Type: Article

References (52)

1. Ballard D.H., Hayhoe M.M. Modelling the role of task in the control of gaze. Visual Cognition 2009, 17(6-7):1185-1204.
2. Bar M., Kassam K.S., Ghuman A.S., Boshyan J., Schmidt A.M., Dale A.M., et al. Top-down facilitation of visual recognition. Proceedings of the National Academy of Sciences of the United States of America 2006, 103(2):449-454.
3. Barton J.J.S. What is meant by impaired configural processing in acquired prosopagnosia?. Perception 2009, 38(2):242-260.
4. Barton J.J.S., Cherkasova M.V., Press D.Z., Intriligator J.M., O'Connor M. Perceptual functions in prosopagnosia. Perception 2004, 33(8):939-956.
5. Behrmann M. Neuropsychological approaches to perceptual organization. Perception of faces, objects and scenes: analytic and holistic processes 2003, 295-334. Oxford University Press, Oxford. M.A. Peterson, G. Rhodes (Eds.).
6. Benson D.F., Davis R.J., Snyder B.D. Posterior cortical atrophy. Archives of Neurology 1988, 45(7):789-793.
7. Birmingham E., Bischof W.F., Kingstone A. Saliency does not account for fixations to eyes within social scenes. Vision Research 2009, 49(24):2992-3000.
8. Bruce N.D.B., Tsotsos J.K. Saliency, attention, and visual search: an information theoretic approach. Journal of Vision 2009, 9(3):1-24.
9. Burt P.J., Adelson E.H. The Laplacian pyramid as a compact image code. IEEE Transactions on Communications 1983, 31(4):532-540.
10. Chen X., Zelinsky G.J. Real-world visual search is dominated by top-down guidance. Vision Research 2006, 46(24):4118-4133.
11. Cutsuridis V. A cognitive model of saliency, attention, and picture scanning. Cognitive Computation 2009, 1:292-299.
12. Einhauser W., Rutishauser U., Koch C. Task-demands can immediately reverse the effects of sensory-driven saliency in complex visual stimuli. Journal of Vision 2008, 8(2):1-19.
13. Farah M.J. Visual agnosia: disorders of object recognition and what they tell us about normal vision 1990, MIT Press, Cambridge, MA.
14. Findlay J.M., Walker R. A model of saccade generation based on parallel processing and competitive inhibition. Behavioral and Brain Sciences 1999, 22(4):661-721.
15. Foulsham T., Barton J.J.S., Kingstone A., Dewhurst R., Underwood G. Fixation and saliency during search of natural scenes: the case of visual agnosia. Neuropsychologia 2009, 47(8-9):1994-2003.
16. Foulsham T., Kingstone A. Asymmetries in the direction of saccades during perception of scenes and fractals: effects of image type and image features. Vision Research 2010, 50(8):779-795.
17. Foulsham T., Underwood G. How does the purpose of inspection influence the potency of visual saliency in scene perception?. Perception 2007, 36:1123-1138.
18. Foulsham T., Underwood G. What can saliency models predict about eye movements? Spatial and sequential aspects of fixations during encoding and recognition. Journal of Vision 2008, 8(6):1-17.
19. Henderson J.M. Human gaze control during real-world scene perception. Trends in Cognitive Sciences 2003, 7(11):498-504.
20. Henderson J.M., Brockmole J.R., Castelhano M.S., Mack M.L. Visual saliency does not account for eye movements during visual search in real-world scenes. Eye movements: a window on mind and brain 2007, 537-562. Elsevier, Amsterdam. R. van Gompel, M. Fischer, W. Murray, R.W. Hill (Eds.).
21. Henderson J.M., Malcolm G.L., Schandl C. Searching in the dark: cognitive relevance drives attention in real-world scenes. Psychonomic Bulletin & Review 2009, 16(5):850-856.
22. Henderson J.M., Weeks P.A., Hollingworth A. The effects of semantic consistency on eye movements during complex scene viewing. Journal of Experimental Psychology-Human Perception and Performance 1999, 25(1):210-228.
23. Humphreys G.W., Riddoch M.J. To see but not to see: a case study of visual agnosia 1987, Erlbaum, Hillsdale, NJ.
24. Itti L. Quantifying the contribution of low-level saliency to human eye movements in dynamic scenes. Visual Cognition 2005, 12(6):1093-1123.
25. Itti L., Koch C. A saliency-based search mechanism for overt and covert shifts of visual attention. Vision Research 2000, 40(10-12):1489-1506.
26. Itti L., Koch C. Computational modelling of visual attention. Nature Reviews Neuroscience 2001, 2(3):194-203.
27. James W. The principles of psychology 1890, Holt, New York.
28. Koch C., Ullman S. Shifts in selective visual attention: towards the underlying neural circuitry. Human Neurobiology 1985, 4:219-227.
29. Le Meur O., Le Callet P., Barba D. Predicting visual fixations on video based on low-level visual features. Vision Research 2007, 47(19):2483-2498.
30. Mannan S., Kennard C., Husain M. The role of visual salience in directing eye movements in visual object agnosia. Current Biology 2009, 19(6):R247-R248.
31. Mannan S., Ruddock K., Wooding D. Automatic control of saccadic eye movements made in visual inspection of briefly presented 2-D images. Spatial Vision 1995, 9(3):363-386.
32. Navalpakkam V., Itti L. Modeling the influence of task on attention. Vision Research 2005, 45(2):205-231.
33. Olson A.C., Humphreys G.W. Connectionist models of neuropsychological disorders. Trends in Cognitive Sciences 1997, 1(6):222-228.
34. Parkhurst D., Law K., Niebur E. Modeling the role of salience in the allocation of overt visual attention. Vision Research 2002, 42(1):107-123.
35. Peters R.J., Iyer A., Itti L., Koch C. Components of bottom-up gaze allocation in natural images. Vision Research 2005, 45(18):2397-2416.
36. Reinagel P., Zador A.M. Natural scene statistics at the centre of gaze. Network: Computation in Neural Systems 1999, 10(4):341-350.
37. Riddoch M.J., Humphreys G.W. A case of integrative visual agnosia. Brain 1987, 110:1431-1462.
38. Riddoch M.J., Humphreys G.W. Visual agnosia. Neurologic Clinics 2003, 21(2):501-520.
39. Rubens A.B., Benson D.F. Associative visual agnosia. Archives of Neurology 1971, 24(4):305-316.
40. Steeves J.K.E., Humphrey G.K., Culham J.C., Menon R.S., Milner A.D., Goodale M.A. Behavioral and neuroimaging evidence for a contribution of color and texture information to scene classification in a patient with visual form agnosia. Journal of Cognitive Neuroscience 2004, 16(6):955-965.
41. Tatler B.W., Baddeley R.J., Gilchrist I.D. Visual correlates of fixation selection: effects of scale and time. Vision Research 2005, 45(5):643-659.
42. Torralba A., Oliva A., Castelhano M.S., Henderson J.M. Contextual guidance of eye movements and attention in real-world scenes: the role of global features in object search. Psychological Review 2006, 113(4):766-786.
43. Treisman A., Gelade G. A feature-integration theory of attention. Cognitive Psychology 1980, 12:97-136.
44. Treue S. Visual attention: the where, what, how and why of saliency. Current Opinion in Neurobiology 2003, 13(4):428-432.
45. Underwood G., Foulsham T. Visual saliency and semantic incongruency influence eye movements when inspecting pictures. Quarterly Journal of Experimental Psychology 2006, 59(11):1931-1949.
46. Underwood G., Foulsham T., Humphrey K. Saliency and scan patterns in the inspection of real-world scenes: eye movements during encoding and recognition. Visual Cognition 2009, 17(6-7):812-834.
47. Underwood G., Foulsham T., van Loon E., Humphreys L., Bloyce J. Eye movements during scene inspection: a test of the saliency map hypothesis. European Journal of Cognitive Psychology 2006, 18(3):321-342.
48. Walther D., Koch C. Modeling attention to salient proto-objects. Neural Networks 2006, 19(9):1395-1407.
49. Wolfe J.M. Guidance of visual search by preattentive information. Neurobiology of attention 2005, 101-104. Academic Press/Elsevier, San Diego, CA. L. Itti, G. Rees, J.K. Tsotsos (Eds.).
50. Yarbus A.L. Eye movements and vision 1967, Plenum, New York.
51. Zelinsky G.J. A theory of eye movements during target acquisition. Psychological Review 2008, 115(4):787-835.
52. Zetzsche C. Natural scene statistics and salient visual features. Neurobiology of attention 2005, Elsevier, London. L. Itti, G. Rees, J.K. Tsotsos (Eds.).