Look together: analyzing gaze coordination with epistemic network analysis

Frontiers in Psychology

Volumn 6, Issue , 2015, Pages

  Andrist, Sean ^a   Collier, Wesley ^a   Gleicher, Michael ^a   Mutlu, Bilge ^a   Shaffer, David ^a  

^a UNIVERSITY OF WISCONSIN MADISON   (United States)

Author keywords

conversational repair; epistemic network analysis; gaze tracking; referential gaze; social signals

Indexed keywords

EID: 85042327771     PISSN: None     EISSN: 16641078     Source Type: Journal    
DOI: 10.3389/fpsyg.2015.01016     Document Type: Article

References (46)

1. Allopenna P. D. Magnuson J. S. Tanenhaus M. K. (1998). Tracking the time course of spoken word recognition using eye movements: evidence for continuous mapping models. J. Mem. Lang. 38, 419–439. 10.1006/jmla.1997.2558
2. Altmann G. T. Kamide Y. (2004). Now you see it, now you don't: mediating the mapping between language and the visual world, in The Interface of Language, Vision, and Action: Eye Movements and the Visual World, eds Henderson J. M. Ferreira F. (New York, NY: Psychology Press), 347–386.
3. Argyle M. Cook M. (1976). Gaze and Mutual Gaze. Cambridge, UK: Cambridge University Press.
4. Baldwin D. A. (1995). Understanding the link between joint attention and language, in Joint Attention: Its Origins and Role in Development, eds Moore C. Dunham P. J. (Hillsdale, NJ: Erlbaum), 131–158. 1756664
5. Bard E. G. Hill R. Arai M. (2009). Referring and gaze alignment: accessibility is alive and well in situated dialogue, in Proceedings of CogSci 2009 (Amsterdam: Cognitive Science Society), 1246–1251.
6. Bavelas J. B. Coates L. Johnson T. (2002). Listener responses as a collaborative process: the role of gaze. J. Commun. 52, 566–580. 10.1111/j.1460-2466.2002.tb02562.x
7. Brandes U. Erlebach T. (eds.) (2005). Network analysis: methodological foundations, in Theoretical Computer Science and General Issues (Springer-Verlag Berlin Heidelberg: Springer Science & Business Media), 472. 10.1007/b106453
8. Branigan H. P. Pickering M. J. Cleland A. A. (2000). Syntactic co-ordination in dialogue. Cognition 75, B13–B25. 10.1016/S0010-0277(99)00081-510771277
9. Brown-Schmidt S. Campana E. Tanenhaus M. K. (2005). Real-time reference resolution by naïve participants during a task-based unscripted conversation, in Approaches to Studying World-Situated Language Use: Bridging the Language-as-Product and Language-as-Action Traditions, eds Trueswell J. C. Tanenhaus M. K. (Cambridge, MA: MIT Press), 153–171.
10. Campana E. Baldridge J. Dowding J. Hockey B. A. Remington R. W. Stone L. S. (2001). Using eye movements to determine referents in a spoken dialogue system, in Proceedings of the 2001 Workshop on Perceptive User Interfaces (New York, NY: ACM), 1–5.
11. Clark A. T. Gergle D. (2011). Mobile dual eye-tracking methods: challenges and opportunities, in Proceedings of the International Workshop on Dual Eye Tracking (DUET 2011) (Aarhus).
12. Clark A. T. Gergle D. (2012). Know what I'm talking about? Dual eye-tracking in multimodal reference resolution, in Proceedings of CSCW 2012 Workshop on Dual Eye Tracking (Seattle, WA), 1–8.
13. Clark H. H. (1996). Using Language. Cambridge, UK: Cambridge University Press.
14. Clark H. H. (2003). Pointing and placing, in Pointing: Where Language, Culture, and Cognition Meet, ed Kita S. (Hillsdale, NJ: Erlbaum), 243–268.
15. Clark H. H. Brennan S. E. (1991). Grounding in communication. Perspect. Soc. Shared Cogn. 13, 127–149. 10.1037/10096-006
16. Clark H. H. Krych M. A. (2004). Speaking while monitoring addressees for understanding. J. Mem. Lang. 50, 62–81. 10.1016/j.jml.2003.08.004
17. Condon W. S. Osgton W. D. (1971). Speech and body motion synchrony of the speaker-hearer, in The Perception of Language, eds Horton D. H. Jenkins J. J. (Academic Press), 150–184.
18. Duncan S. Kanki B. G. Mokros H. Fiske D. W. (1984). Pseudounilaterality, simple-rate variables, and other ills to which interaction research is heir. J. Pers. Soc. Psychol. 46, 1335–1348. 10.1037/0022-3514.46.6.1335
19. Fischer B. (1998). Attention in saccades, in Visual Attention, ed Wright R. D. (New York, NY: Oxford University Press), 289–305.
20. Garrod S. Pickering M. J. (2004). Why is conversation so easy? Trends Cogn. Sci. 8, 8–11. 10.1016/j.tics.2003.10.01614697397
21. Gergle D. Clark A. T. (2011). See what I'm saying?: using dyadic mobile eye tracking to study collaborative reference, in Proceedings of the ACM 2011 Conference on Computer Supported Cooperative Work (New York, NY: ACM), 435–444.
22. Giles H. Coupland N. Coupland J. (eds.). (1991). Accommodation theory: communication, context, and consequence, in Contexts of Accommodation (Cambridge: Cambridge University Press), 1–68. 10.1017/CBO9780511663673.001
23. Griffin Z. M. (2004). The eyes are right when the mouth is wrong. Psychol. Sci. 15, 814–821. 10.1111/j.0956-7976.2004.00761.x15563326
24. Griffin Z. M. Bock K. (2000). What the eyes say about speaking. Psychol. Sci. 11, 274–279. 10.1111/1467-9280.0025511273384
25. Hanna J. E. Brennan S. E. (2007). Speakers' eye gaze disambiguates referring expressions early during face-to-face conversation. J. Mem. Lang. 57, 596–615. 10.1016/j.jml.2007.01.008
26. Hirst G. McRoy S. Heeman P. Edmonds P. Horton D. (1994). Repairing conversational misunderstandings and non-understandings. Speech Commun. 15, 213–229. 10.1016/0167-6393(94)90073-6
27. Huang C.-M. Andrist S. Sauppé A. Mutlu B. (2015). Using gaze patterns to predict task intent in collaboration. Front. Psychol. 6:1049. 10.3389/fpsyg.2015.01049
28. Meyer A. van der Meulen F. Brooks A. (2004). Eye movements during speech planning: talking about present and remembered objects. Vis. Cogn. 11, 553–576. 10.1080/13506280344000248
29. Meyer A. S. Sleiderink A. M. Levelt W. J. (1998). Viewing and naming objects: eye movements during noun phrase production. Cognition 66, B25–B33. 10.1016/S0010-0277(98)00009-29677766
30. Nakano Y. I. Reinstein G. Stocky T. Cassell J. (2003). Towards a model of face-to-face grounding, in Proceedings of the 41st Annual Meeting on Association for Computational Linguistics (Stroudsburg, PA: Association for Computational Linguistics), 553–561.
31. Novick D. G. Hansen B. Ward K. (1996). Coordinating turn-taking with gaze, in Proceedings of the Fourth International Conference on Spoken Language (ICSLP 96) (Philadelphia, PA: IEEE), 1888–1891. 24976789
32. Orrill C. H. Shaffer D. W. (2012). Exploring connectedness: applying ENA to teacher knowledge, in International Conference of the Learning Sciences (ICLS) (Sydney, NSW).
33. Richardson D. C. Dale R. (2005). Looking to understand: the coupling between speakers' and listeners' eye movements and its relationship to discourse comprehension. Cogn. Sci. 29, 1045–1060. 10.1207/s15516709cog0000/2921702802
34. Richardson D. C. Dale R. Kirkham N. Z. (2007). The art of conversation is coordination: common ground and the coupling of eye movements during dialogue. Psychol. Sci. 18, 407–413. 10.1111/j.1467-9280.2007.01914.x17576280
35. Richardson D. C. Dale R. Tomlinson J. M. (2009). Conversation, gaze coordination, and beliefs about visual context. Cogn. Sci. 33, 1468–1482. 10.1111/j.1551-6709.2009.01057.x21585512
36. Rupp A. A. Choi Y. Gushta M. Mislevy R. Bagley E. Nash P. et al. (2009). Modeling learning progressions in epistemic games with epistemic network analysis: principles for data analysis and generation, in Proceedings from the Learning Progressions in Science Conference (Iowa City, IA), 24–26.
37. Rupp A. A. Gushta M. Mislevy R. J. Shaffer D. W. (2010). Evidence-centered design of epistemic games: measurement principles for complex learning environments. J. Technol. Learn. Assess. 8, 1–48. Available online at: http://ejournals.bc.edu/ojs/index.php/jtla/article/view/1623
38. Sacks H. Schegloff E. A. Jefferson G. (1974). A simplest systematics for the organization of turn-taking for conversation. Language 50, 696–735. 10.1353/lan.1974.0010
39. Salvucci D. D. Goldberg J. H. (2000). Identifying fixations and saccades in eye-tracking protocols, in Proceedings of the 2000 Symposium on Eye Tracking Research & Applications (New York, NY: ACM), 71–78.
40. Schober M. F. (1993). Spatial perspective-taking in conversation. Cognition 47, 1–24. 10.1353/lan.1974.00108482069
41. Shaffer D. W. Hatfield D. Svarovsky G. N. Nash P. Nulty A. Bagley E. et al. (2009). Epistemic network analysis: a prototype for 21st-century assessment of learning. Int. J. Learn. Media 1, 33–53. 10.1162/ijlm.2009.0013
42. Shockley K. Santana M.-V. Fowler C. A. (2003). Mutual interpersonal postural constraints are involved in cooperative conversation. J. Exp. Psychol. Hum. Percept. Perform. 29, 326–332. 10.1037/0096-1523.29.2.32612760618
43. Tanenhaus M. K. Spivey-Knowlton M. J. Eberhard K. M. Sedivy J. C. (1995). Integration of visual and linguistic information in spoken language comprehension. Science 268, 1632–1634. 10.1126/science.77778637777863
44. Wasserman S. (1994). Social Network Analysis: Methods and Applications, Vol. 8. Cambridge, UK: Cambridge University Press.
45. Zahn C. J. (1984). A reexamination of conversational repair. Commun. Monogr. 51, 56–66. 10.1080/03637758409390183
46. Zbilut J. P. Giuliani A. Webber C. L. (1998). Detecting deterministic signals in exceptionally noisy environments using cross-recurrence quantification. Phys. Lett. 246, 122–128. 10.1016/S0375-9601(98)00457-5