Gazing and Frowning as a New Human-Computer Interaction Technique

ACM Transactions on Applied Perception

Volumn 1, Issue 1, 2004, Pages 40-56

  Surakka, Veikko ^a   Illi, Marko ^a   Isokoski, Poika ^a  

^a TAMPERE UNIVERSITY OF TECHNOLOGY   (Finland)

Author keywords

Electromyography; Experimentation; Facial muscle activity; Gaze direction; Human Factors; Performance

Indexed keywords

EID: 29144523055     PISSN: 15443558     EISSN: 15443965     Source Type: Journal    
DOI: 10.1145/1008722.1008726     Document Type: Article

References (44)

1. Allanson, J., Rodden, T., and Mariani, J. 1999. A toolkit for exploring electro-physiological human-computer interaction. In Proceedings of Human-Computer Interaction—INTERACT '99. IOS Press, Amsterdam, 231-237.
2. Accot, J. and Zhai, S. 2003. Refining Fitts' law models for bivariate pointing. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI 2003). ACM Press, New York, 193-200.
3. Barreto, A. B., Scargle, S. D., and Adjouadi, M. 2000. A practical EMG-based human-computer interface for users with motor disabilities. J. Rehabil. Res. Dev. 37, 53-63.
4. Card, S. K., English, W. K., and Burr, B. J. 1978. Evaluation of mouse, rate-controlled isometric joystick, step keys, and text keys for text selection on a CRT. Ergonomics 21, 601-613.
5. Dimberg, U. 1990. Facial electromyography and emotional reactions. Psychophysiology 27, 481-494.
6. Doherty, E., Bloor, C., and Cockton, G. 1999. The “cyberlink” brain-body interface as an assistive technology for persons with traumatic brain injury: Longitudinal results from a group of case studies. CyberPsychology Behav 2, 249-259.
7. Douglas, S. A. and Mithal, A. K. 1994. The effect of reducing homing time on the speed of a finger-controlled isometric pointing device. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI 94). ACM Press, New York, 411-416.
8. Douglas, S. A., Kirkpatrick, A. E., and MacKenzie, I. S. 1999. Testing pointing device performance and user assessment with the ISO 9241, Part 9 standard. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI '99). ACM Press, New York, 215-222.
9. Ekman, P. and Friesen, W. V. 1978. Facial Action Coding System (FACS): A Technique for the Measurement of Facial Action. Consulting Psychologists Press, Palo Alto, CA.
10. Fitts, P. M. 1954. The information capacity of the human motor system in controlling the amplitude of movement. J. Exp. Psychol. 47, 381-391.
11. Fitts, P. M. and Peterson J. R. 1964. Information capacity of discrete motor responses. J. Exp. Psychol. 67, 103-112.
12. Fridlund, A. J. 1991. Evolution and facial action in reflex, social motive, and paralanguage. Biol. Psychol. 32, 3-100.
13. Fridlund, A. J. and Cacioppo, J. T. 1986. Guidelines for human electromyographic research. Psychophysiology 23, 567-589.
14. Gillan, D. J., Holden, K., Adam, S., Rudisill, M., and Magee, L. 1990. How does Fitt's law fit pointing and dragging? In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI '90). ACM Press, New York, 227-234.
15. Hietanen, J. K., Surakka, V., and Linnankoski, I. 1998. Facial electromyographic responses to vocal affect expressions. Psychophysiology 35, 530-536.
16. Jacob, R. J. K. 1991. The use of eye movements in human computer interaction techniques: What you look at is what you get. ACM Trans. Inf. Syst. 9, 152-169.
17. Jacob, R. J. K. and Karn, K. S. 2003. Eye tracking in human-computer interaction and usability research: Ready to deliver the promises. In The Mind's Eyes: Cognitive and Applied Aspects of Oculomotor Research, J. Hyo na, R. Radach, and H. Deubel, eds. Elsevier Science, Oxford, 573-605.
18. KUbler, A., Kotchoubey, B., Hinterberger, T., Ghanayim, N., Perelmouter, J., Schauer, M., Fritsch, C., Taub, E., and Birbaumer, N. 1999. The thought translation device: A neurophysiological approach to communication in total motor paralysis. Exp. Brain Res. 124, 223-232.
19. Laakso, J., Juhola, M., and Surakka, V. 2002. Neural network recognition of electromyographic signals of two facial muscle sites. In Proceedings of Medical Informatics Europe 2002. 83-87.
20. Laakso, J. Juhola, M. Surakka, V., Aula, A., and Partala, T. 2001. Neural network and wavelet recognition of facial electromyographic signals. In Proceedings of 10th World Congress on Health and Medical Informatics, V. Patel, R. Rogers, and R. Haux, Eds. IOS Press, Amsterdam, 489-492.
21. Lauer, R. T., Peckham, H., Kilgore, K. L., and Heetderks, W. J. 2000. Applications of cortical signals to neuroprosthetic control: A critical review. IEEE Trans. Rehabil. Engng 8, 205-208.
22. Lusted, H. S. and Knapp, B. 1996. Controlling computers with neural signals. Sci. Am. 275, 82-87.
23. Mackenzie, I. S. 1992. Movement time prediction in human-computer interfaces. In Proceedings of Graphics Interface '92, Canadian Information Processing Society. 140-150.
24. Mackenzie, I. S. 1995. Movement time prediction in human-computer interfaces. In Readings in Human-Computer Interaction (2nd ed.), R. M. Baecker, W. A. S. Buxton, J. Grudin, and S. Greenberg, Eds. Kauffman, Los Altos, CA, 483-493.
25. Mackenzie, I. S., Kauppinen, T., and Silfverberg, M. 2001. Accuracy measures for evaluating computer pointing techniques. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI2001). ACM Press, New York, 9-16.
26. Miniotas, D. 2000. Application of Fitts' law to eye gaze interaction. In Extended Abstracts of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI2000). ACM Press, New York, 339-340.
27. Moore, M. and Kennedy, R. K. 2000. Human factors issues in the neural signals direct brain-computer interface. In Proceedings of the Fourth International ACM Conference on Assistive Technologies. ACM Press, New York, 114-120.
28. Partala, T., Aula, A., and Surakka, V. 2001. Combined voluntary gaze direction and facial muscle activity as a new pointing technique. In Proceedings of INTERACT 2001. IOS Press, Amsterdam, 100-107.
29. Partala, T. and Surakka, V. 2003. Pupil size variation as an indication of affective processing. Int. J. Human Comput. Stud. 59, 1-2, 185-198.
30. Rayner, K. 1998. Eye movements in reading and information processing: 20 years of research. Psychol. Bull. 124, 372-422.
31. Salvucci, D. D. 1999. Inferring intent in eye-based interfaces: Tracing eye movements with process models. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI 99). ACM Press, New York, 254-261.
32. Salvucci, D. D. and Anderson, J. R. 2000. Intelligent gaze-added interfaces. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI2000). ACM Press, New York, 273-280.
33. Sibert, L. E. and Jacob, R. J. K. 2000. Evaluation of eye gaze interaction. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI2000). ACM Press, New York, 281-288.
34. Stampe, D. M. and Reingold, E. M. 1995. Selection by looking: A novel computer interface and its application to psychological research. In Eye Movement Research: Mechanisms, Processes and Applications, J. M. Findlay, R. Walker, and R. W Kentridge, Eds. Elsevier Science, Amsterdam, 467-478.
35. Surakka, V. and Hietanen, J. K. 1998. Facial and emotional reactions to Duchenne and non-Duchenne smiles. Int. J. Psychophysiol. 29, 23-33.
36. Surakka, V., Illi, M., and Isokoski, P. 2003. Voluntary eye movements in human-computer interaction. In The Mind's Eyes: Cognitive and Applied Aspects of Oculomotor Research, J. Hyona, R. Radach, and H. Deubel, Eds. Elsevier Science, Oxford, 473-491.
37. Tanriverdi, V. and Jacob, R. J. K. 2000. Interacting with eye movements in virtual environments. In Proceedings of CHI'2000 Human Factors in Computing Systems. ACM Press, 265-272.
38. Tecce, J. T., Gips, J., Olivieri, C. P., Pok, L. J., and Consiglio, M. R. 1998. Eye movement control of computer functions. Int. J. Psychophysiol. 29, 319-325.
39. Vidal, J. J. 1973. Toward direct brain-computer communication. Ann. Rev. Biophys. Engng 2, 157-180.
40. van Boxtel, A. and Jessurum, M. 1993. Amplitude and bilateral coherency of facial and jaw-elevator EMG activity as an index of effort during a two-choice serial reaction task. Psychophysiology 30, 1065-1079.
41. Ware, C., and Mikaelian, H. H. 1987. An evaluation of an eyetracker as a device for computer input. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI '87). ACM Press, New York, 183-188.
42. Wolpaw, R. J., Birbaumer, N., Mcfarland, D. J., Pfurtscheller, G., and Vaughan, T. M. 2002. Brain-computer interfaces for communication and control. Clin. Neurophysiol. 113, 767-791.
43. Zhai, S. 2003. What's in the eyes for attentive input. Commun. ACM 46, 34-39.
44. Zhai, S., Morimoto, C., and Ihde, S. 1999. Manual and gaze input cascaded (MAGIC) pointing. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (CHI 99). ACM Press, New York, 246-253.