See what i'm saying?: Using Dyadic Mobile Eye tracking to study collaborative reference

Proceedings of the ACM Conference on Computer Supported Cooperative Work, CSCW

Volumn , Issue , 2011, Pages 435-444

  Gergle, Darren ^a,b   Clark, Alan T ^b  

^a NORTHWESTERN UNIVERSITY   (United States)

^b Northwestern University   (United States)

Author keywords

Dual eye tracking; Dyadic interaction; Gaze; Language; Reference; Shared visual space

Indexed keywords

USER INTERFACES; VISUAL LANGUAGES;

DUAL EYE TRACKING; DYADIC INTERACTION; GAZE; LANGUAGE; REFERENCE; SHARED VISUAL SPACE;

EYE TRACKING;

EID: 79955158932     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1958824.1958892     Document Type: Conference Paper

References (35)

1. Argyle, M., & Cook, M. (1976). Gaze and mutual gaze. Cambridge: Cambridge University Press.
2. Ariel, M. (1988). Referring and accessibility. Journal of Linguistics, 24, 65-87.
3. Bangerter, A. (2004). Using pointing and describing to achieve joint focus of attention in dialogue. Psychological Science, 15(6), 415-419. (Pubitemid 38782982)
4. Bard, E. G., Hill, R., & Arai, M. (2009). Referring and gaze alignment: Accessibility is alive and well in situated dialogue. Proc. of the 31st Annual Conference of the Cognitive Science Society.
5. Barr, D. J. (2008). Analyzing'visual world' eyetracking data using multilevel logistic regression. Journal of Memory & Language, 59, 457-474.
6. Boker, S. M., Xu, M., Rotondo, J. L., & King, K. (2002). Windowed cross-correlation and peak picking for the analysis of variability in the association between behavioral time series. Psych. Methods, 7(3), 338-355.
7. Bulling, A., Roggen, D., & Troster, G. (2008). It's in your eyes: Towards context-awareness and mobile HCI using wearable EOG goggles. Proc. of UbiComp'08, 84-93.
8. Byron, D. K., Mampilly, T., Sharma, V., & Xu, T. (2005). Utilizing visual attention for cross-modal coreference interpretation. Proc of CONTEXT-05.
9. Carlson, G. (2004). Reference. In L. R. Horn & G. Ward (Eds.), The Handbook of Pragmatics (pp. 74-96): Blackwell Publishing Ltd.
10. Carroll, J. M., Rosson, M. B., Convertino, G., & Ganoe, C. H. (2006). Awareness and teamwork in computersupported collaborations. Interacting with Computers, 18, 21-46.
11. Cassell, J. (2004). Towards a model of technology and literacy development: Story listening systems. Journal of Applied Developmental Psychology, 25(1), 75-105. (Pubitemid 38145872)
12. Chai, J. Y., Prasov, Z., Blaim, J., & Jin, R. (2005). Linguistic theories in efficient multimodal reference resolution: An empirical investigation. Proc. of IUI'05, 43-50.
13. Cherubini, M., & Dillenbourg, P. (2007). The effects of explicit reference in distance problem solving over shared maps. Proc. of GROUP 2007, 331-340.
14. Clark, H. H., & Wilkes-Gibbs, D. (1986). Referring as a collaborative process. Cognition, 22(1), 1-39.
15. Cooper, R. M. (1974). The control of eye fixation by the meaning of spoken language: A new methodology for the real-time investigation of speech perception, memory, and language processing. Cognitive Psychology, 6, 84-107.
16. Devault, D., Kariaeva, N., Kothari, A., Oved, I., & Stone, M. (2005). An information-state approach to collaborative reference. Proc. of ACL 2005.
17. Fussell, S. R., Setlock, L. D., & Parker, E. M. (2003). Where do helpers look? Gaze targets during collaborative physical tasks. Proc. of CHI'2003 (Extended Abstracts), 768-769.
18. Gergle, D., Kraut, R. E., & Fussell, S. R. (2004). Action as language in a shared visual space. Proc. of CSCW 2004, 487-496. NY: ACM Press. (Pubitemid 40928552)
19. Gergle, D., Rosé, C. P., & Kraut, R. E. (2007). Modeling the impact of shared visual information on collaborative reference. Proc. of CHI 2007, 1543-1552. (Pubitemid 47581747)
20. Gundel, J. K., Hedberg, N., & Zacharski, R. (1993). Cognitive status and the form of referring expressions in discourse. Language, 69(2), 274-307.
21. Hindmarsh, J., & Heath, C. (2000). Embodied reference: A study of deixis in workplace interaction. Journal of Pragmatics, 32, 1855-1878.
22. Kehler, A., Martin, J., Cheyer, A., Julia, L., Hobbs, J. R., & Bear, J. (1998). On representing salience and reference in multimodal human-computer interaction. Proc. of AAAI'98, 33-39.
23. Land, M., Mennie, N., & Rusted, J. (1999). The Roles of Vision and Eye Movements in the Control of Activities of Daily Living. Perception, 28(11), 1307-1432.
24. Mutlu, B., Forlizzi, J., & Hodgins, J. (2006). A storytelling robot: Modeling and evaluation of humanlike gaze behavior. Proc. of Humanoids'06.
25. Nakano, Y. I., Reinstein, G., Stocky, T., & Cassell, J. (2003). Towards a model of face-to-face grounding. Proc. of ACL 2003, 553-561.
26. Ou, J., Oh, K., Yang, J., & Fussell, S. R. (2005). Effects of task properties, partner actions, and message content on eye gaze patterns in a collaborative task. Proc. of CHI 2005, 231-240. ACM Press. (Pubitemid 41809060)
27. Pelz, J. B., Canosa, R., & Babcock, J. (2000). Extended tasks elicit complex eye movement patterns. Proc. of ETRA 2000, 37-43.
28. Prasov, Z., & Chai, J. Y. (2008). What's in a gaze? The role of eye-gaze in reference resolution in multimodal conversational interfaces. Proc. of IUI'08, 20-29.
29. Ranjan, A., Birnholtz, J. P., & Balakrishnan, R. (2007). Dynamic shared visual spaces: Experimenting with automatic camera control in a remote repair task. Proc. of CHI 2007, 1177-1186. NY: ACM Press. (Pubitemid 47581707)
30. Richardson, D. C., & Dale, R. (2005). Looking to understand: The coupling between speakers' and listeners' eye movements and its relationship to discourse comprehension. Cog. Sci. 29(6), 1045-1060. (Pubitemid 43432316)
31. Sidner, C., Lee, C., Kidd, C., & Lesh, N. (2004). Explorations in engagement for humans and robots. Proc. of the Int'l Conference on Humanoid Robots.
32. Tanenhaus, M. K., Spivey-Knowlton, M. J., Eberhard, K. E., & Sedivy, J. C. (1995). Integration of visual and linguistic information in spoken language comprehension. Science, 268, 1632-1634.
33. Torrey, C., Powers, A., Fussell, S. R., & Kiesler, S. (2007). Exploring adaptive dialogue based on a robot's awareness of human gaze and task progress. Proc. of Human Robot Interaction, 247-254. (Pubitemid 47333791)
34. Traum, D. R. (1999). Computational models of grounding in collaborative systems. Proc. of AAAI Fall Symposium on Psych. Models of Comm., 124-131.
35. Ward, G., & Kehler, A. (2005). Syntactic form and discourse accessibility. In A. Branco, T. McEnery, R. Mitkov & J. Benjamins (Eds.), Anapohora processing: Linguistic, cognitive and computational modeling.