Intrinsic and extrinsic effects on image memorability

Vision Research

Volumn 116, Issue , 2015, Pages 165-178

  Bylinskii, Zoya ^a,b   Isola, Phillip ^b,c   Bainbridge, Constance ^b   Torralba, Antonio ^a,b   Oliva, Aude ^b  

^a USA   (United States)

^b MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^c MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Context; Eye movements; Fine grained categories; Image memorability; Scene dataset; Visual distinctiveness

Indexed keywords

ARTICLE; CONTROLLED STUDY; EYE MOVEMENT; EYE TRACKING; HUMAN; HUMAN EXPERIMENT; IMAGE MEMORABILITY; MEMORY CONSOLIDATION; NORMAL HUMAN; PREDICTION; PRIORITY JOURNAL; RECALL; THEORETICAL MODEL; VISUAL MEMORY; ATTENTION; FEMALE; LONG TERM MEMORY; MALE; PATTERN RECOGNITION; PHYSIOLOGY; TASK PERFORMANCE; YOUNG ADULT;

ATTENTION; EYE MOVEMENTS; FEMALE; HUMANS; MALE; MEMORY, LONG-TERM; PATTERN RECOGNITION, VISUAL; TASK PERFORMANCE AND ANALYSIS; YOUNG ADULT;

EID: 84946605063     PISSN: 00426989     EISSN: 18785646     Source Type: Journal    
DOI: 10.1016/j.visres.2015.03.005     Document Type: Article

References (53)

1. Attneave F. Applications of information theory to psychology: A summary of basic concepts, methods, and results 1959, Rinehart & Winston. 1st ed.
2. Bainbridge W.A., Isola P., Oliva A. The intrinsic memorability of face images. Journal of Experimental Psychology: General 2013, 142(4):1323-1334.
3. Bartlett J.C., Hurry S., Thorley W. Typicality and familiarity of faces. Memory & Cognition 1984, 12(3):219-228.
4. Borji A., Itti L. Defending Yarbus: Eye movements reveal observers' task. Journal of Vision 2014, 14(3):1-22.
5. Borkin, M., Vo, A., Bylinskii, Z., Isola, P., Sunkavalli, S., Oliva, A. et al. (2013). What Makes a Visualization Memorable? In: IEEE Transactions on Visualization and Computer Graphics (Infovis).
6. Brady T.F., Konkle T., Alvarez G.A. A review of visual memory capacity: Beyond individual items and toward structured representations. Journal of Vision 2011, 11(5):1-34.
7. K. Brodersen, C. Ong, K. Stephan, J. Buhmann, The balanced accuracy and its posterior distribution, in: International Conference on Pattern Recognition (ICPR), 2010.
8. Bruce V., Burton A., Dench N. What's distinctive about a distinctive face?. The Quarterly Journal of Experimental Psychology 1994, 47(1):119-141.
9. Bulling, A., & Roggen, D. (2011). Recognition of visual memory recall processes using eye movement analysis. In International joint conference on pervasive and ubiquitous computing (UbiComp).
10. Busey T. Formal models of familiarity and memorability in face recognition. Computation, geometric and process perspectives on facial cognition: Contexts and challenges 2001, Lawrence Erlbaum Associates Inc. M.W.J. Townsend (Ed.).
11. Chun M.C., Turk-Browne N.B. Interactions between attention and memory. Current Opinion in Neurobiology 2007, 17:177-184.
12. Curby K.M., Glazek K., Gauthier I. A visual short-term memory advantage for objects of expertise. Journal of Experimental Psychology: Human Perception and Performance 2009, 35(1):94-107.
13. Eysenck M.W. Depth, elaboration, and distinctiveness. Levels of processing in human memory 1979, Lawrence Erlbaum Associates, Hillsdale, NJ.
14. Foulsham T., Underwood G. What can saliency models predict about eye movements? Fixations during encoding and recognition. Journal of Vision 2008, 8(2):1-17.
15. Glanzer M., Adams J. The mirror effect in recognition memory: Data and theory. Journal of Experimental Psychology: Learning, Memory, and Cognition 2010, 16:5-16.
16. Greene M., Liu T., Wolfe J. Reconsidering Yarbus: A failure to predict observers' task from eye movement patterns. Vision Research 2012, 62:1-8.
17. Herzmann G., Curran T. Experts memory: An ERP study of perceptual expertise effects on encoding and recognition. Memory & Cognition 2011, 39(3):412-432.
18. Hunt R.R., Worthen J.B. Distinctiveness and memory 2006, Oxford University Press, New York.
19. Ihler, A., & Mandel, M. (2014). Kernel density estimation toolbox for MATLAB (R13).(accessed: 2014-07-21). http://www.ics.uci.edu/ihler/code/kde.html.
20. Isola, P., Xiao, J., Torralba, A., & Oliva, A. (2011). What makes an image memorable? In IEEE Conference on Computer Vision and Pattern Recognition (CVPR).
21. Isola, P., Parikh, D., Torralba, A., & Oliva, A. (2011). Understanding the Intrinsic Memorability of Images. In Conference on Neural Information Processing Systems (NIPS).
22. Isola P., Xiao J., Parikh D., Torralba A., Oliva A. What makes a photograph memorable?. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI) 2014, 36(7):1469-1482.
23. Jacoby L.L. A process dissociation framework: Separating automatic from intentional uses of memory. Journal of Memory and Language 1991, 30(5):513-541.
24. Khosla, A., Xiao, J., Isola, P., Torralba, A., & Oliva, A. (2012). Image memorability and visual inception. In SIGGRAPH Asia Technical Briefs.
25. Khosla, A., Xiao, J., Torralba, A., & Oliva, A. (2012) Memorability of image regions. In Conference on Neural Information Processing Systems (NIPS).
26. A. Khosla, A., Bainbridge, W. A., Torralba, A. & Oliva, A. (2013). Modifying the memorability of face photographs. In International Conference on Computer Vision (ICCV).
27. Konkle T., Brady T.F., Alvarez G.A., Oliva A. Conceptual distinctiveness supports detailed visual long-term memory for real-world objects. Journal of Experimental Psychology: General 2010, 139:558-578.
28. Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2012). ImageNet classification with deep convolutional neural networks. In Conference on neural information processing systems (NIPS).
29. Mancas, M., & Le Meur, O. (2013). Memorability of natural scene: The role of attention. In IEEE international conference on image processing (ICIP).
30. Mandler G. Familiarity breeds attempts: A critical review of dual-process theories of recognition. Perspectives on Psychological Science 2008, 3(5):390-399.
31. McGaugh J.L. Time-dependent processes in memory storage. Science 1966, 153(3742):1351-1358.
32. Nairne J.S. Modeling distinctiveness: Implications for general memory theory. Distinctiveness and memory 2006, Oxford University Press. R.R. Hunt, J.B. Worthen (Eds.).
33. Noton D., Stark L. Scanpaths in saccadic eye movements while viewing and recognizing patterns. Vision Research 1971, 11(9):929-942.
34. Oliva A., Torralba A. Modeling the shape of the scene: A holistic representation of the spatial envelope. International Journal of Computer Vision (IJCV) 2001, 42(3):145-175.
35. Rawsona K.A., Overscheldeb J.P.V. How does knowledge promote memory? Skilled memory. Journal of Memory and Language 2008, 58(3):646-668.
36. Razavian, A. S., Azizpour, H., Sullivan, J. & Carlsson, S. (2014). CNN features off-the-shelf: An astounding baseline for recognition. In IEEE conference on computer vision and pattern recognition (CVPR) workshops.
37. Ross, J., Irani, L., Silberman, M. S., Zaldivar, A., & Tomlinson, B. (2010). Who are the crowdworkers?: Shifting demographics in mechanical turk. CHI EA '10. ACM, pp. 2863-2872.
38. Schmidt S. Encoding and retrieval processes in the memory for conceptually distinctive events. Journal of Experimental Psychology: Learning, Memory, Cognition 1985, 11(3):565-578.
39. Seiffert C., Khoshgoftaar T.M., Hulse J.V., Napolitano A. RUSBoost: A hybrid approach to alleviating class imbalance. IEEE Transactions on Systems, Man, and Cybernetics 2010, 40(1):185-197.
40. Standing L. Learning 10,000 pictures. The Quarterly Journal of Experimental Psychology 1973, 25(2):207-222.
41. Tatler B.W., Wade N.J., Kwan H., Findlay J.M., Velichkovsky B.M. Yarbus, eye movements, and vision. i-Perception 2010, 1(1):7-27.
42. Tuckey M.R., Brewer N. The influence of schemas, stimulus ambiguity, and interview schedule on eyewitness memory over time. Journal of Experimental Psychology: Applied 2003, 9(2):101-118.
43. Valentine T. A unified account of the effects of distinctiveness, inversion, and race in face recognition. The Quarterly Journal of Experimental Psychology 1991, 43(2):161-204.
44. Vicente K.J., Wang J.H. An ecological theory of expertise effects in memory recall. Psychological Review 1998, 105(1):33-57.
45. Vogt S., Magnussen S. Long-term memory for 400 pictures on a common theme. Experimental Psychology 2007, 54(4):298-303.
46. Vokey J., Read J. Familiarity, memorability, and the effect of typicality on the recognition of faces. Memory Cognition 1992, 20(3):291-302.
47. von Restorff H. Bereichsbildungen im Spurenfeld. Psychologische Forschung 1933, 18:299-342.
48. Walker W.R., Vogl R.J., Thompson C.P. Autobiographical memory: Unpleasantness fades faster than pleasantness over time. Applied Cognitive Psychology 1997, 11(5):399-413.
49. Wiseman S., Neisser U. Perceptual organization as a determinant of visual recognition memory. The American Journal of Psychology 1974, 87(4):675-681.
50. Xiao, J., Hayes, J., Ehinger, K., Oliva, A., & Torralba, A. (2010). SUN database: Large-scale scene recognition from Abbey to Zoo. In IEEE conference on computer vision and pattern recognition (CVPR).
51. Yarbus A. Eye movements and vision 1967, Plenum Press, New York.
52. Zhou, B., Lapedriza, A. Xiao, J., Torralba, A.& Oliva, A. (2014). Learning deep features for scene recognition using places database. In Conference on Neural Information Processing Systems (NIPS).
53. Zhou, B., Khosla, A., Lapedriza, A., Oliva, A., & Torralba, A. (2015). Object detectors emerge in deep scene CNNs. arXiv:. arxiv:1412.6856.