Using gaze patterns to predict task intent in collaboration

Frontiers in Psychology

Volumn 6, Issue , 2015, Pages

  Huang, Chien Ming ^a   Andrist, Sean ^a   Sauppé, Allison ^a   Mutlu, Bilge ^a  

^a University of Wisconsin   (United States)

Author keywords

eye gaze; gaze patterns; intention; intention prediction; support vector machine

Indexed keywords

EID: 84964875536     PISSN: None     EISSN: 16641078     Source Type: Journal    
DOI: 10.3389/fpsyg.2015.01049     Document Type: Article

References (52)

1. Adams R. B. Kleck R. E. (2005). Effects of direct and averted gaze on the perception of facially communicated emotion. Emotion 5:3. 10.1037/1528-3542.5.1.315755215
2. Andrist S. Collier W. Gleicher M. Mutlu B. Shaffer D. (2015). Look together: analyzing gaze coordination with epistemic network analysis. Front. Psychol. 6:1016. 10.3389/fpsyg.2015.01016
3. Astington J. W. (1993). The Child's Discovery of the Mind, Vol. 31. Cambridge, MA: Harvard University Press.
4. Bangerter A. (2004). Using pointing and describing to achieve joint focus of attention in dialogue. Psychol. Sci. 15, 415–419. 10.1111/j.0956-7976.2004.00694.x15147496
5. Baron-Cohen S. Wheelwright S. Hill J. Raste Y. Plumb I. (2001). The reading the mind in the eyes test revised version: a study with normal adults, and adults with Asperger syndrome or high-functioning autism. J. Child Psychol. Psychiatry 42, 241–251. 10.1111/1469-7610.0071511280420
6. Blakemore S.-J. Decety J. (2001). From the perception of action to the understanding of intention. Nat. Rev. Neurosci. 2, 561–567. 10.1038/3508602311483999
7. Bratman M. (1987). Intention, Plans, and Practical Reason. Cambridge, MA: Harvard University Press.
8. Brennan S. E. Chen X. Dickinson C. A. Neider M. B. Zelinsky G. J. (2008). Coordinating cognition: the costs and benefits of shared gaze during collaborative search. Cognition 106, 1465–1477. 10.1016/j.cognition.2007.05.01217617394
9. Buccino G. Binkofski F. Fink G. R. Fadiga L. Fogassi L. Gallese V. et al. (2001). Action observation activates premotor and parietal areas in a somatotopic manner: an fMRI study. Eur. J. Neurosci. 13, 400–404. 10.1046/j.1460-9568.2001.01385.x11168545
10. Butler S. C. Caron A. J. Brooks R. (2000). Infant understanding of the referential nature of looking. J. Cogn. Dev. 1, 359–377. 10.1207/S15327647JCD0104_01
11. Butterworth G. (1991). The Ontogeny and Phylogeny of Joint Visual Attention. Oxford, UK: Basil Blackwell.
12. Chang C.-C. Lin C.-J. (2011). LIBSVM: a library for support vector machines. ACM Trans. Intell. Syst. Technol. 2, 27:1–27:27. 10.1145/1961189.196119917217518
13. Chen Y.-W. Lin C.-J. (2006). Combining SVMs with various feature selection strategies, in Feature Extraction, eds Guyon I. Gunn S. Nikravesh M. Zadeh L. A. (Berlin; Heidelberg: Springer), 315–324.
14. Clark H. H. (1996). Using Language, Vol. 1996. Cambridge: Cambridge University Press.
15. Clark H. H. Brennan S. E. (1991). Grounding in communication. Perspect. Soc. Shared Cogn. 13, 127–149.
16. Cortes C. Vapnik V. (1995). Support-vector networks. Mach. Learn. 20, 273–297. 10.1007/BF0099401817306960
17. d'Andrade R. (1987). A Folk Model of the Mind. Cambridge, UK: Cambridge University Press.
18. Doshi A. Trivedi M. M. (2009). On the roles of eye gaze and head dynamics in predicting driver's intent to change lanes. IEEE Trans. Intell. Transport. Syst. 10, 453–462. 10.1109/TITS.2009.2026675
19. Feinfield K. A. Lee P. P. Flavell E. R. Green F. L. Flavell J. H. (1999). Young children's understanding of intention. Cogn. Dev. 14, 463–486.
20. Frischen A. Bayliss A. P. Tipper S. P. (2007). Gaze cueing of attention: visual attention, social cognition, and individual differences. Psychol. Bull. 133:694. 10.1037/0033-2909.133.4.69417592962
21. Griffin Z. M. (2001). Gaze durations during speech reflect word selection and phonological encoding. Cognition 82, B1–B14. 10.1016/S0010-0277(01)00138-X11672707
22. Haji-Abolhassani A. Clark J. J. (2014). An inverse Yarbus process: predicting observers task from eye movement patterns. Vis. Res. 103, 127–142. 10.1016/j.visres.2014.08.01425175112
23. Hayhoe M. Ballard D. (2014). Modeling task control of eye movements. Curr. Biol. 24, R622–R628. 10.1016/j.cub.2014.05.02025004371
24. Heal J. (2005). Joint attention and understanding the mind, in Joint Attention: Communication and Other Minds, eds Bourget D. Chalmers D. (Oxford, UK: Oxford University Press), 34–44.
25. Hoffman G. Breazeal C. (2007). Effects of anticipatory action on human-robot teamwork efficiency, fluency, and perception of team, in Proceedings of the ACM/IEEE International Conference on Human-Robot Interaction (Arlington, VA: ACM), 1–8.
26. Huber M. Kupferberg A. Lenz C. Knoll A. Brandt T. Glasauer S. (2013). Spatiotemporal movement planning and rapid adaptation for manual interaction. PLoS ONE 8:e64982. 10.1371/journal.pone.006498223724112
27. Johansson R. S. Westling G. Bäckström A. Flanagan J. R. (2001). Eye–hand coordination in object manipulation. J. Neurosci. 21, 6917–6932. 11517279
28. Kuhl P. K. Andruski J. E. Chistovich I. A. Chistovich L. A. Kozhevnikova E. V. Ryskina V. L. et al. (1997). Cross-language analysis of phonetic units in language addressed to infants. Science 277, 684–686. 9235890
29. Land M. Mennie N. Rusted J. (1999). The roles of vision and eye movements in the control of activities of daily living. Perception 28, 1311–1328. 10755142
30. Leslie A. M. (1987). Pretense and representation: the origins of “theory of mind.” Psychol. Rev. 94, 412.
31. Malle B. F. Knobe J. (1997). The folk concept of intentionality. J. Exp. Soc. Psychol. 33, 101–121.
32. Masur E. F. (1983). Gestural development, dual-directional signaling, and the transition to words. J. Psycholinguist. Res. 12, 93–109.
33. McCall J. C. Wipf D. P. Trivedi M. M. Rao B. D. (2007). Lane change intent analysis using robust operators and sparse bayesian learning. IEEE Trans. Intell. Transport. Syst. 8, 431–440. 10.1109/TITS.2007.902640
34. Meltzoff A. N. (1995). Understanding the intentions of others: re-enactment of intended acts by 18-month-old children. Dev. Psychol. 31, 838. 25147406
35. Meltzoff A. N. Brooks R. (2001). “Like Me” as a building block for understanding other minds: bodily acts, attention, and intention, in Intentions and Intentionality: Foundations of Social Cognition, eds Malle B. F. Moses L. J. Baldwin D. A. (Cambridge, MA: MIT Press), 171–191.
36. Meyer A. S. Sleiderink A. M. Levelt W. J. (1998). Viewing and naming objects: eye movements during noun phrase production. Cognition 66, B25–B33. 9677766
37. Morales M. Mundy P. Rojas J. (1998). Following the direction of gaze and language development in 6-month-olds. Infant Behav. Dev. 21, 373–377.
38. Morency L.-P. de Kok I. Gratch J. (2010). A probabilistic multimodal approach for predicting listener backchannels. Auton. Agent. Multi. Agent. Syst. 20, 70–84. 10.1007/s10458-009-9092-y
39. Morris D. Desebrock G. (1977). Manwatching: A Field Guide to Human Behaviour. New York, NY: HN Abrams.
40. Mundy P. Newell L. (2007). Attention, joint attention, and social cognition. Curr. Dir. Psychol. Sci. 16, 269–274. 10.1111/j.1467-8721.2007.00518.x19343102
41. Ognibene D. Chinellato E. Sarabia M. Demiris Y. (2013). Contextual action recognition and target localization with an active allocation of attention on a humanoid robot. Bioinspirat. Biomimet. 8:035002. 10.1088/1748-3182/8/3/03500223981534
42. Ognibene D. Demiris Y. (2013). Towards active event recognition, in Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence (Beijing: AAAI Press), 2495–2501.
43. Pezzulo G. Donnarumma F. Dindo H. (2013). Human sensorimotor communication: a theory of signaling in online social interactions. PLoS ONE 8:e79876. 10.1371/journal.pone.007987624278201
44. Rizzolatti G. Craighero L. (2004). The mirror-neuron system. Annu. Rev. Neurosci. 27, 169–192. 10.1146/annurev.neuro.27.070203.14423015217330
45. Sakita K. Ogawara K. Murakami S. Kawamura K. Ikeuchi K. (2004). Flexible cooperation between human and robot by interpreting human intention from gaze information, in Proceedings 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems, 2004 (IROS 2004), Vol. 1 (Sendai: IEEE), 846–851.
46. Sebanz N. Bekkering H. Knoblich G. (2006). Joint action: bodies and minds moving together. Trends Cogn. Sci. 10, 70–76. 10.1016/j.tics.2005.12.00916406326
47. Sebanz N. Knoblich G. (2009). Prediction in joint action: what, when, and where. Top. Cogn. Sci. 1, 353–367. 10.1111/j.1756-8765.2009.01024.x25164938
48. Shibata S. Tanaka K. Shimizu A. (1995). Experimental analysis of handing over, in Proceedings 4th IEEE International Workshop on Robot and Human Communication, 1995, RO-MAN'95 TOKYO (Tokyo: IEEE), 53–58.
49. Tomasello M. (1995). Joint attention as social cognition, in Joint Attention: Its Origins and Role in Development, eds Moore C. Dunham P. J. (New York, NY: Psychology Press), 103–130.
50. White S. (1989). Backchannels across cultures: a study of Americans and Japanese. Lang. Soc. 18, 59–76.
51. Wu T.-F. Lin C.-J. Weng R. C. (2004). Probability estimates for multi-class classification by pairwise coupling. J. Mach. Learn. Res. 5, 975–1005.
52. Yi W. Ballard D. (2009). Recognizing behavior in hand-eye coordination patterns. Int. J. Humanoid Robot. 6, 337–359. 10.1142/S021984360900186320862267