Pay attention! Designing adaptive agents that monitor and improve user engagement

Conference on Human Factors in Computing Systems - Proceedings

Volumn , Issue , 2012, Pages 11-20

  Szafir, Dan ^a   Mutlu, Bilge ^a  

^a University of Wisconsin Madison   (United States)

Author keywords

Adaptive agents; Educational agents; Electroencephalography (EEG); Human robot interaction; Immediacy; Passive brain computer interfaces (BCI)

Indexed keywords

ADAPTIVE AGENTS; ATTENTION LEVEL; BRAIN-COMPUTER INTERFACES (BCI); COLLABORATIVE WORK; EDUCATIONAL AGENTS; EDUCATIONAL PSYCHOLOGY; EDUCATIONAL SETTINGS; EMBODIED AGENT; EXPERIMENTAL EVALUATION; IMMEDIACY; MENTAL STATE; REAL TIME; ROBOTIC AGENTS; STUDENT ENGAGEMENT; TEAM MEMBERS; USER ENGAGEMENT;

ELECTROENCEPHALOGRAPHY; ELECTROPHYSIOLOGY; HUMAN COMPUTER INTERACTION; HUMAN ENGINEERING; STUDENTS;

BRAIN COMPUTER INTERFACE;

EID: 84862103113     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2207676.2207679     Document Type: Conference Paper

References (48)

1. Aleven, V., and Koedinger, K. R. An effective metacognitive strategy: learning by doing and explaining with a computer-based cognitive tutor. Cognitive Science 26, 2 (2002), 147-179.
2. Alibali, M. W., Heath, D. C., and Myers, H. J. Effects of visibility between speaker and listener on gesture production: Some gestures are meant to be seen. Journal of Memory and Language 44, 2 (2001), 169-188.
3. Anderson, J. R., Corbett, A. T., Koedinger, K. R., and Pelletier, R. Cognitive tutors: Lessons learned. The Journal of the Learning Sciences 4, 2 (1995), 167-207.
4. Ayaz, H., Shewokis, P., Bunce, S., Schultheis, M., and Onaral, B. Assessment of cognitive neural correlates for a functional near infrared-based brain computer interface system. In Augmented Cognition, HCII 2009, D. Schmorrow, I. Estabrooke, and M. Grootjen, Eds., vol. 5638 of Lecture Notes in Computer Science. Springer Berlin / Heidelberg, 2009, 699-708.
5. Barenger, D. K., and McCroskey, J. Immediacy in the classroom: Student immediacy. Communication Education 49 (2000), 178-186.
6. Berka, C., Levendowski, D. J., Lumicao, M. N., Yau, A., Davis, G., Zivkovic, V. T., Olmstead, R. E., Tremoulet, P. D., and Craven, P. L. EEG correlates of task engagement and mental workload in vigilance, learning, and memory tasks. Aviation, Space, and Environmental Medicine 78, Supplement 1 (May), B231-B244.
7. Buller, D. B., and Aune, R. K. The effects of vocalics and nonverbal sensitivity on compliance a speech accommodation theory explanation. Human Communication Research, 14 (1988), 301-332.
8. Burgoon, J. K., and Dillman, L. Gender, immediacy, and nonverbal communication. In Gender, power, and communication in human relationships, P. J. Kalbfleisch and M. J. Cody, Eds. Psychology Press, 1995.
9. Cassell, J., Steedman, M., Badler, N., Pelachaud, C., Stone, M., Douville, B., Prevost, S., and Achorn, B. Modeling the interaction between speech and gesture. In Proc CogSci '94 (1994), 153-158.
10. Chesebro, J. L., and McCroskey, J. C. The relationship of teacher clarity and immediacy with student state receiver apprehension, affect, and cognitive learning. Communication Education 50, 1 (January 2001), 59-68.
11. Christophel, D. M. The relationships among teacher immediacy behaviors, student motivation, and learning. Communication Education 39, 4 (1990), 323-340.
12. Cutrell, E. Tan, D. BCI for passive input in HCI. In Proc CHI '07 (2007).
13. Ferrez, P. W., and Millan. You are wrong! automatic detection of interaction errors from brain waves. In Proc IJCAI '05 (2005).
14. Gentili, R. J., Hadavi, C., Ayaz, H., Shewokis, P. A., and Contreras-Vidal, J. L. Hemodynamic correlates of visuomotor motor adaptation by functional near infrared spectroscopy. In Proc IEEE '10 (2010).
15. George, L., and Lecuyer, A. An overview of research on 'passive' brain-computer interfaces for implicit human-computer interaction. In Proc ICABB '10 Workshop: "Brain-Computer Interfacing and Virtual Reality" (2010).
16. Gevins, A., and Smith, M. E. Neurophysiological measures of cognitive workload during human-computer interaction. Theoretical Issues in Ergonomics Science 4, 1 (2003), 113-131.
17. Gevins, A., Smith, M. E., Leong, H., McEvoy, L., Whitfield, S., Du, R., and Rush, G. Monitoring working memory load during computer-based tasks with EEG pattern recognition methods. Human Factors 40 (1998), 79-91.
18. Girouard, A., Solovey, E. T., and Jacob, R. J. K. Designing a passive brain computer interface using real time classification of functional near-infrared spectroscopy. International Journal of Autonomous and Adaptive Communications Systems (2010).
19. Gorham, J. The relationship between verbal teacher immediacy behaviors and student learning. Communication Education 37 (1988), 40-53.
20. Gorham, J., and Christophel, D. M. The relationship of teachers' use of humor in the classroom to immediacy and student learning. Communication Education 39 (1990), 46-62.
21. Gorham, J., and Christophel, D. M. Students' perceptions of teacher behaviors as motivating and demotivating factors in college classes. Communication Quarterly 40, 3 (1992), 239-252.
22. Gulz, A. Benefits of virtual characters in computer based learning environments: Claims and evidence. Int. J. Artif. Intell. Ed. 14 (December 2004), 313-334.
23. Harris, M., and Rosenthal, R. No more teachers' dirty looks: Effects of teacher nonverbal behavior on student outcomes. applications of nonverbal communication. In Applications of nonverbal communication, R. E. Riggio and R. S. Feldman, Eds. Lawrence Erlbaum, 2005, 157-192.
24. Kanda, T., Ishiguro, H., Ono, T., Imai, M., and Nakatsu, R. Development and evaluation of an interactive humanoid robot "robovie". In Proc ICRA '02, vol. 2 (2002), 1848-1855.
25. Kulik, C.-L. C., and Kulik, J. A. Effectiveness of computer-based instruction: An updated analysis. Computers in Human Behavior 7, 1-2 (1991), 75-94.
26. Lee, J. C., and Tan, D. S. Using a low-cost electroencephalograph for task classification in HCI research. In Proc UIST '06 (2006), 81-90.
27. Lowe, J. Computer-based education: Is it a panacea? Journal of Research on Technology in Education 34, 2 (2002), 163-71.
28. McCroskey, J. C., Richmond, V. P., Sallinen, A., Fayer, J. M., and Barraclough, R. Nonverbal immediacy and cognitive learning: A cross-cultural investigation. Communication Education 45, 3 (July 1996), 200-211.
29. McCroskey, J. C., Richmond, V. P., Sallinen, A., Fayer, J. M., and Barraclough, R. A. A cross-cultural and multi-behavioral analysis of the relationship between nonverbal immediacy and teacher evaluation. Communication Education 44, 4 (October 1995), 281-291.
30. Mehrabian, A. Immediacy: An indicator of attitudes in linguistic communication. Journal of Personality 34, 1 (1966), 26-34.
31. Menzel, K. E., and Carrell, L. J. The impact of gender and immediacy on willingness to talk and perceived learning. Communication Education 48, 1 (1999), 31-40.
32. Molina, G., Tsoneva, T., and Nijholt, A. Emotional brain-computer interfaces. In Proc ACII '09, IEEE (2009), 1-9.
33. Mumm, J., and Mutlu, B. Human-robot proxemics: physical and psychological distancing in human-robot interaction. In Proc HRI '11 (2011), 331-338.
34. Nijholt, A., Bos, D. P.-O., and Reuderink, B. Turning shortcomings into challenges: Brain-computer interfaces for games. Entertainment Computing 1, 2 (2009), 85-94.
35. Nijholt, A., and Tan, D. Brain-computer interfacing for intelligent systems. IEEE Intelligent Systems 23, 3 (May-June 2008), 72-79.
36. Pfurtscheller, G., Neuper, C., Guger, C., Harkam, W., Ramoser, H., Schlogl, A., Obermaier, B., and Pregenzer, M. Current trends in Graz Brain-Computer Interface (BCI) research. IEEE Transactions on Rehabilitation Engineering 8, 2 (2000), 216-219.
37. Pope, A. T., Bogart, E. H., and Bartolome, D. S. Biocybernetic system evaluates indices of operator engagement in automated task. Biological Psychology 40, 1-2 (1995), 187-195.
38. Richmond, V. P. Teacher nonverbal immediacy use and outcomes. In Communication for Teachers, J. Chesebro and J. McCroskey, Eds. Allyn & Bacon., 2001, 65-82.
39. Richmond, V. P., Gorham, J. S., and McCroskey, J. C. The relationship between selected immediacy behaviors and cognitive learning. Communication Yearbook, 10 (1987), 574-590.
40. Richmond, V. P., and McCroskey, J. C. Influencing teacher influence through immediacy. In Power in the classroom: communication, control, and concern, V. P. Richmond and J. C. McCroskey, Eds. Psychology Press, 1992, 101-119.
41. Richmond, V. P., McCroskey, J. C., and Johnson, A. D. Development of nonverbal immediacy scale (nis): Measures of self-and other-perceived nonverbal immediacy. Communication Quarterly 51, 4 (2003), 504-517.
42. Rosip, J. C., and Hall, J. A. Knowledge of nonverbal cues, gender, and nonverbal decoding accuracy. Journal of Nonverbal Behavior 28 (2004), 267-286.
43. Scherer, K., Ladd, D., and Silverman, K. Vocal cues to speaker affect: Testing two models. Journal of the Acoustical Society of America 76, 5 (1984), 1346-1356.
44. Schofield, J. W. Computers and Classroom Culture. Cambridge University Press, 1995.
45. Tan, D. Brain-computer interfaces: applying our minds to human-computer interaction. In Proc CHI Workshop: "What is the Next Generation of Human-Computer Interaction?" (2006).
46. Woolfolk, A. E., and Brooks, D. The influence of teachers' nonverbal behaviors on students' perceptions and performance. The Elementary School Journal 85 (1985), 513-528.
47. Zander, T., and Kothe, C. Towards passive brain-computer interfaces: applying brain-computer interface technology to human-machine systems in general. Journal of Neural Engineering 8, 2 (2011), 025005.
48. Zander, T. O., Kothe, C., Jatzev, S., and Gaertner, M. Enhancing human-computer interaction with input from active and passive brain-computer interfaces. In Brain-Computer Interfaces, D. S. Tan and A. Nijholt, Eds., Human-Computer Interaction Series. Springer London, 2010, 181-199.