Humans have idiosyncratic and task-specific scanpaths for judging faces

Vision Research

Volumn 108, Issue , 2015, Pages 67-76

  Kanan, Christopher ^a   Bseiso, Dina N F ^b   Ray, Nicholas A ^b   Hsiao, Janet H ^c   Cottrell, Garrison W ^b  

^a CALIFORNIA INSTITUTE OF TECHNOLOGY   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

Eye movements; Face perception; Machine learning; Scanpath routines

Indexed keywords

ACCURACY; ADULT; AGE; ANGER; ARTICLE; DECISION MAKING; EYE FIXATION; EYE MOVEMENT; FACIAL EXPRESSION; FATIGUE; FEMALE; HAPPINESS; HIDDEN MARKOV MODEL; HUMAN; HUMAN EXPERIMENT; MALE; NORMAL HUMAN; PHYSICAL ATTRACTIVENESS; SUPPORT VECTOR MACHINE; TASK PERFORMANCE; TRAINING; TRUST; VISUAL DISCRIMINATION; ADOLESCENT; ALGORITHM; ATTENTION; FACE; FACIAL RECOGNITION; PATTERN RECOGNITION; PHOTOSTIMULATION; PHYSIOLOGY; PROCEDURES; REACTION TIME; RECOGNITION; YOUNG ADULT;

ADOLESCENT; ADULT; ALGORITHMS; ATTENTION; EYE MOVEMENTS; FACE; FACIAL EXPRESSION; FACIAL RECOGNITION; FEMALE; FIXATION, OCULAR; HUMANS; JUDGMENT; MALE; PATTERN RECOGNITION, VISUAL; PHOTIC STIMULATION; REACTION TIME; RECOGNITION (PSYCHOLOGY); YOUNG ADULT;

EID: 84922440390     PISSN: 00426989     EISSN: 18785646     Source Type: Journal    
DOI: 10.1016/j.visres.2015.01.013     Document Type: Article

References (49)

1. Althoff R., Cohen N. Eye movement-based memory. Journal of Experimental Psychology: Learning, Memory, & Cognition 1999, 25:997-1010.
2. Benson P., Beedie S., Shephard E., Giegling I., Rujescu D., St.Clair D. Simple viewing tests can detect eye movement abnormalities that distinguish schizophrenia cases from controls with exceptional accuracy. Biological Psychiatry 2012, 71:716-724.
3. Borji A., Itti L. Defending yarbus: Eye movements reveal observers' task. Journal of Vision 2014, 14(3):29.
4. Botev Z. A novel nonparametric density estimator 2006, The University of Queensland, Tech. rep.
5. Brainard D.H. The psychophysics toolbox. Spatial Vision 1997, 10:433-436.
6. Budesheim T., DePaola S. Beauty or the beast? the effects of appearance, personality, and issue information on evaluations of political candidates. Personality and Social Psychology Bulletin 1994, 20:339-348.
7. Chang C., Lin C. A library for support vector machines. ACM Transactions on Intelligent Systems and Technology 2011, 2(3):1-27.
8. Cornelissen F., Peters E., Palmer J. The eyelink toolbox: Eye tracking with MATLAB and the psychophysics toolbox. Behavior Research Methods, Instruments & Computers 2002, 34:613-617.
9. Desrochers T., Jin D., Goodman N., Graybiel A. Optimal habits can develop spontaneously through sensitivity to local cost. Proceedings of the National Academy of Sciences 2010, 107:20512-20517.
10. Ebner N., Riediger M., Lindenberger U. Faces - A database of facial expressions in young, middle-aged, and older women and men: Development and validation. Behavior Research Methods 2010, 42:351-362.
11. Ekman P. Darwin and facial expression: A century of research in review 1973, Academic Press.
12. Everingham, M., Sivic, J., & Zisserman, A. (2006). "Hello! My name is. Buffy" - Automatic naming of characters in TV video. In: Proc. of the british machine vision conference.
13. Foulsham T., Dewhurst R., Nystrom M., Jarodzka H., Johansson R., Underwood G., et al. Comparing scanpaths during scene encoding and recognition: A multi-dimensional approach. Journal of Eye Movement Research 2012, 5:1-14.
14. Gosselin F., Schyns P. Bubbles: A technique to reveal the use of information in recognition tasks. Vision Research 2001, 41(17):2261-2271.
15. Greene M.R., Liu T., Wolfe J.M. Reconsidering Yarbus: A failure to predict observer's task from eye movement patterns. Vision Research 2012, 62:1-8.
16. Hayhoe M., Ballard D. Eye movements in natural behavior. Trends in Cognitive Sciences 2005, 9:188-194.
17. Henderson J. Human gaze control during real-world scene perception. Trends in Cognitive Science 2003, 7:498-504.
18. Hikosaka O., Takikawa Y., Kawagoe R. Role of the basal ganglia in the control of purposive saccadic eye movements. Physiological Reviews 2000, 80:953-978.
19. Hsiao J., Cottrell G. Two fixations suffice in face recognition. Psychological Science 2008, 19(10):998-1006.
20. Izard C.E. The face of emotion 1971, Appleton-Century-Crofts.
21. Jaakkola T., Diekhans M., Haussler D. A discriminative framework for detecting remote protein homologies. Journal of Computational Biolology 2000, 7:95-114.
22. Jaakkola, T., & Haussler, D. (1998). Exploiting generative models in discriminative classifiers. In: Advances in neural information processing systems (NIPS-1998) (pp. 487-493).
23. Joyce, C. (2000). Saving faces: Using eye movement, ERP, and SCR measures of face processing and recognition to investigate eyewitness identification (Ph.D. thesis). University of California San Diego.
24. Kanan, C., Ray, N., Bseiso, D., Hsiao, J., & Cottrell, G. (2014). Predicting an observer's task using multi-fixation pattern analysis. In: 2014 symposium on eye tracking research and applications (ETRA-2014).
25. Kleisner K., Priplatova L., Frost P., Flegr J. Trustworthy-looking face meets brown eyes. PLoS One 2013, 8:e53285.
26. Langner O., Dotsch R., Bijlstra G., Wigboldus D., Hawk S., van Knippenberg A. Presentation and validation of the Radboud faces database. Cognition & Emotion 2010, 24:1377-1388.
27. Mehoudar E., Arizpe J., Baker C., Yovel G. Faces in the eye of the beholder: Unique and stable eye scanning patterns of individual observers. Journal of Vision 2014, 14(7):6.
28. Nelson J., Cottrell G. A probabilistic model of eye movements in concept formation. Neurocomputing 2007, 70:2256-2272.
29. Nguyen H., Isaacowitz D., Rubin P. Age- and fatigue-related markers of human faces: An eye tracking study. Opthamology 2009, 115:355-360.
30. Noton D., Stark L. Scanpaths in saccadic eye movements while viewing and recognizing patterns. Vision Research 1971, 11:929-942.
31. Oldfield R. The assessment and analysis of handedness: The Edinburgh inventory. Neuropsychologia 1971, 9:97-113.
32. Perronnin, F., Sanchez, J., & Mensink, T. (2010). Improving the Fisher kernel for large-scale image classification. In: European conference on computer vision (ECCV-2010).
33. Peterson M., Eckstein M. Looking just below the eyes is optimal across face recognition tasks. Proceedings of the National Academy of Sciences 2012, 109(48):E3314-E3323.
34. Peterson M., Eckstein M. Individual differences in eye movements during face identification reflect observer-specific optimal points of fixation. Psychological Science 2013, 24:1216-1225.
35. Rehder B., Hoffman A. Eyetracking and selective attention in category learning. Cognitive Psychology 2005, 51:1-41.
36. Schyns P., Bonnar L., Gosselin F. Show me the features! understanding recognition from the use of visual information. Psychological Science 2002, 13:402-409.
37. Shepard R., Hovland C., Jenkins H. Learning and memorization of classifications. Psychological Monographs 1961, 75:1-42.
38. Simoyan, K., Parkhi, O., Vedaldi, A., & Zisserman, A. (2013). Fisher vector faces in the wild. In: British machine vision conference (BMVC-2013).
39. Spitz H., Stark L., Noton D. Scanpaths and pattern recognition. Science 1971, 173:753.
40. Sun, C., & Nevatia, R. (2013). Active: Activity concept transitions in video event classification. In: IEEE international conference on computer vision (ICCV-2013) (pp. 913-920).
41. Sundelin T., Lekander M., Kecklund G., Van Someren E., Olsson A., Axelsson J. Cues of fatigue: Effects of sleep deprivation on facial appearance. Sleep 2013, 36(9):1355-1360.
42. Tatler B., Wade N., Kwan H., Findlay J., Velichkovsky B. Yarbus, eye movements, and vision. i-Perception 2010, 1:7-27.
43. Tseng P., Cameron I., Pari G., Reynolds J., Munoz D., Itti L. High-throughput classification of clinical populations from natural viewing eye movements. Journal of Neurology 2013, 260:275-284.
44. van der Maaten, L. (2011). Learning discriminative Fisher kernels. In: Proc. 28th international conference on machine learning (ICML-2011).
45. Vedaldi, A., & Fulkerson, B. (2008). VLFeat: An open and portable library,. http://www.vlfeat.org/.
46. Vinette C., Gosselin F., Schyns P. Spatio-temporal dynamics of face recognition in a flash: Its in the eyes. Cognitive Science 2004, 28:289-301.
47. Wan, V., & Renals, S. (2002). Evaluation of kernel methods for speaker verification and identification. In: Proc. IEEE ICASSP 2002 (pp. 669-672).
48. Willis J., Todorov A. First impressions: Making up your mind after a 100-ms exposure to a face. Psychological Science 2006, 17:592-598.
49. Zaidel D., Bava S., Reis V. Relationship between facial asymmetry and judging trustworthiness in faces. Laterality 2003, 8:225-232.