A research agenda for physiological computing

Interacting with Computers

Volumn 16, Issue 5, 2004, Pages 857-878

  Allanson, Jennifer ^a   Fairclough, Stephen H ^a  

^a LIVERPOOL JOHN MOORES UNIVERSITY   (United Kingdom)

Author keywords

Affective computing; Biofeedback; Brain computer interaction (BCI); Physiological computing

Indexed keywords

BIOELECTRIC PHENOMENA; ELECTROMAGNETISM; INTERFACES (COMPUTER); NEUROLOGY; PARAMETER ESTIMATION; SENSORS;

AUTONOMIC NERVOUS SYSTEMS (ANS); CENTRAL NERVOUS SYSTEMS (CNS); SOMATIC NERVOUS SYSTEMS (SNS);

HUMAN COMPUTER INTERACTION;

EID: 9544239374     PISSN: 09535438     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.intcom.2004.08.001     Document Type: Article

References (97)

1. Aasman, J., Mulder, G., Mulder, L.J.M., 1987. Operator effort and the measurement of heart rate variability. Human Factors 29 (2), 161-170.
2. Allanson, J., 2000. Developing support of electrophysiologically- interactive computer systems. PhD Thesis, Lancaster University, UK.
3. Andreassi, J.L., 1995. Psychophysiology: Human Behaviour and Physiological Response. Erlbaum, Hillsdale, NJ.
4. Backs, R.W., Selijos, K.A., 1994. Metabolic and cardiorespiratory measures of mental effort: the effects of level of difficulty in a working memory task. International Journal of Psychophysiology 16, 57-68.
5. Baehr, E., Rosenfeld, J.P., Baehr, R., 1997. The clinical use of an alpha asymmetry protocol in the neurofeedback treatment of depression: two case studies. Journal of Neurotherapy 2 (3), 10-23.
6. Basmajian, J.V., 1977. In: Schwartz, G.E., Beatty, J. (Eds.), Learned Control of Single Motor Units. Biofeedback Theory and Research. Academic Press, New York.
7. Beatty, J., 1982. Task-evoked pupillary responses, processing load and the structure of processing resources. Psychological Bulletin 91 (2), 276-292.
8. Bell, J.S., 1979. The use of EEG theta biofeedback in the treatment of a patient with sleep-onset insomnia. Biofeedback and Self-Regulation 4 (3), 229-236.
9. Berntson, G.G., Bigger, J.T., Eckberg, D.L., Grossman, P., Kaufman, P.G., Malik, M., et al., 1997. Heart rate variability: origins, methods, and interpretive caveats. Psychophysiology 34, 623-648.
10. Blascovich, J., Berry-Mendes, W., Hunter, S.B., Salomon, K., 1999. Social 'facilitation' as challenge and threat. Journal of Personality and Social Psychology 77 (1).
11. Boiten, F., 1998. The effects of emotional behaviour on components of respiratory cycle. Biological Psychology 49, 29-51.
12. Boutcher, S.H., Nugent, F.W., McLaren, P.F., Weltman, A.L., 1998. Heart period variability of trained and untrained men at rest and during mental challenge. Psychophysiology 35, 16-22.
13. Bowman, T., 1997. VR meets physical therapy. Communications of the ACM 40 (8), 59-60.
14. Byrne, E., Parasuraman, R., 1996. Psychophysiology and adaptive automation. Biological Psychology (42), 1996, 249-268.
15. Cacioppo, J.T., Bush, L.K., Tassinary, L.G., 1990. Microexpressive facial actions as a function of affective stimuli: replication and extension. Personality and Social Psychology Bulletin 18, 515-526.
16. Cacioppo, J.T., Tassinary, L.G., Berntson, G.G., 2000. Handbook of Psychophysiology. Cambridge University Press, Cambridge.
17. Calvert, S.L., Tan, S., 1994. Impact of virtual reality on young adult's physiological arousal and aggressive thoughts: interaction versus observation. Journal of Applied Developmental Psychology 15, 125-139.
18. Carroll, D., Turner, J.R., Hellawell, J.C., 1986a. Heart rate and oxygen consumption during active psychological challenge: the effects of levels of difficulty. Psychophysiology 23, 174-181.
19. Carroll, D., Turner, J.R., Prasad, R., 1986b. The effects of level of difficulty of mental arithmetic challenge on heart rate and oxygen consumption. International Journal of Psychophysiology 4, 167-173.
20. Christie, I.C., Friedman, B.H., 2004. Autonomic specificity of discrete emotion and dimensions of affective space: a multivariate approach. International Journal of Psychophysiology 51, 143-153.
21. Croft, R.J., Barry, R.J., 2000. Removal of ocular artifact from the EEC: a review. Neurophysiology Clinical 30, 5-19.
22. Davies, C., Harrison, J., 1996. Osmose: towards broadening the aesthetics of virtual reality. Computer Graphics 1996.
23. Davies, D.R., Shackleton, V.J., Parasuraman, R., 1983. Monotony and boredom. In: Hockey, G.R.J. (Ed.), Stress and Fatigue in Human Performance. Wiley, Chichester, pp. 1-25.
24. Denney, M.R., Baugh, J.L., Hardt, H.D., 1991. Sobriety outcome after alcoholism treatment with biofeedback participation: a pilot inpatient study. International Journal of Addiction 26 (3), 335-341.
25. Fahrenberg, Myrtek, 1996. Ambulatory Assessment: Computer-assisted Psychological and Psychophysiological Methods in Monitoring and Field Studies. Hogrefe and Huber, Gottingen, pp. 3-19.
26. Fahrion, S.L., Walters, E.D., Coyne, L., Allen, T., 1992. Alterations in EEG amplitude, personality factors, and brain electrical mapping after alpha-theta brainwave training: a controlled case study of an alcoholic in recovery. Alcoholism, Clinical and Experimental Research 16 (3), 547-552.
27. Farewell, L.A., Donchin, E., 1988. Talking off the top off your head: toward a mental prosthesis utilizing event-related brain potentials. Electroencephalography and Clinical Neurophysiology 70, 520-523.
28. Fernandez, R., 1997. Stochastic modelling of physiological signals with hidden Markov models: a step toward frustration detection in human-computer interfaces. Masters Thesis, Media Laboratory, MIT.
29. Freeman, F.G., Mikulka, P.J., Prinzel, L.J., Scerbo, M.W., 1999. Evaluation of an adaptive automation system using three EEG indices with a visual tracking task. Biological Psychology 50, 61-76.
30. Freeman, F.G., Mikulka, P.J., Scerbo, M.W., Prinzel, L.J., Clouatre, K., 2000. Evaluation of a psychophysiologically controlled adaptive automation system, using performance on a tracking system. Applied Psychophysiology and Biofeedback 25 (2), 103-115.
31. Gerasimov, V., 2003. Every sign of life. PhD Thesis, MIT.
32. Gevins, A., Smith, M.E., 2003. Neurophysiological measures of cognitive workload during human-computer interaction. Theoretical Issues in Ergonomic Science 4 (1/2), 113-121.
33. Gevins, A., Smith, M.E., Leong, H., McEvoy, L., Whitfield, S., Du, R., et al., 1998. Monitoring working memory load during computer-based tasks with EEG pattern recognition models. Human Factors 40 (1), 79-91.
34. Gilleade, K., Allanson, J., 2003. A Toolkit for exploring affective interface adaptation in videogames, Proceedings of the Human-Computer Interaction International (HCII03), Crete, Greece, 2003.
35. Hare, J.F., Timmons, B.H., Roberts, J.R., Burman, A.S., 1982. EEG alpha-biofeedback training: an experimental technique for the management of anxiety. Journal of Medical Engineering and Technology 6 (1), 19-24.
36. Junker, A., Berg, C., Schnider, P., 1995. Evaluation of the cyberlink interface as an alternative human operator controller. Technical Report No. AC/CF-TR-1995-0011, Wright-Patterson Air Force Base, OH.
37. Kelly, M.F., Parker, P.A., Scott, R.N., 1990. The application of neural networks to myoelectric signal analysis: a preliminary study. IEEE Engineering in Medicine and Biology 37, 221-229.
38. Knapp, R.B., Lusted, H.S., 1990. Bioelectric controller for computer music applications. Computer Music Journal 14 (1), 42-47.
39. Kramer, A.F., 1987. Event-related brain potentials. In: Gale, A., Christie, B. (Eds.), Psychophysiology and the Electronic Workplace. Wiley, London, pp. 197-222.
40. Laine, T.I., Bauer, K.W., Lanning, J.W., Russell, C.A., Wilson, G.F., 2002. Selection of input features across subjects for classifying crewmember workload using artificial neural networks. IEEE Transactions on Systems, Man, and Cybernetics, Part A: Systems and Humans 32 (6), 691-704.
41. Lake, C., 1997. Effects of prosthetic training on upper-extremity prosthesis use. Journal of Prosthetics and Othotics 9 (1), 3-9.
42. Light, K., 1981. Cardiovascular responses to effortful active coping: implications for the role of stress in hypertension development. Psychophysiology 18 (3), 216-225.
43. Lubar, J.F., 1995. In: Schwartz, M.S. (Ed.), Neurofeedback for the Management of Attention Deficit/Hyperactivity DisordersBiofeedback: A Practitioner's Guide. Guilford Press, New York, pp. 493-525.
44. Lubar, J.F., 1997. Neocortical dynamics: implications for understanding the role of neurofeedback and related techniques for the enhancement of attention. Applied Psychophysiology and Biofeedback 22 (2), 111-126.
45. Lusted, H.S., Knapp, R.B., Benjamin, R., 1996. Controlling Computers with Neural Signals. Scientific American, pp. 58-63.
46. Malmo, R.B., Malmo, H.P., 2000. On electromyographic (EMG) gradients and movement-related brain activity: significance for motor control, cognitive functions, and certain psychopathologies. International Journal of Psychophysiology 38, 143-207.
47. Martin, I., Venables, P.H., 1980. Techniques in Psychophysiology. Wiley, New York.
48. Mathias, C.W., Stanford, M.S., 2003. Impulsiveness and arousal: heart rate under conditions of rest and challenge in healthy males. Personality and Individual Differences 35, 355-371.
49. McFarland, D.J., Sarnacki, W.A., Vaughan, T.M., Wolpaw, J.R., 2000. EEG-based interface communication effect of target number and trial length on information transfer rate. Society of Neuroscience Abstracts 26, 1228.
50. McMillan, G.R., Eggleston, R.G., Anderson, T.R., 1995. Nonconventional controls. In: Salvendy, G. (Ed.), Handbook of Human Factors and Ergonomics. Wiley, New York, pp. 729-771.
51. Mekeig, S., Inlow, M., 1993. Lapses in alertness: coherence of fluctuations in performance and EEG spectrum. Electroencephalography and Clinical Neurophysiology 86, 23-25.
52. Mueller, J.H., 1992. Anxiety and performance. In: Smith, A.P., Jones, D.M. (Eds.), Handbook of Human Performance, vol. 3. Academic Press, London, pp. 127-160.
53. Mulder, G., 1986. The concept and measurement of mental effort. In: Hockey, G.R.J., Gaillard, A.W.K., Coles, M.G.H. (Eds.), Energetical Issues in Research on Human Information Processing. Martinus Nijhoff, Dordrecht, pp. 175-198.
54. Nelson, T.W., Hettinger, L.J., Cunningham, J.A., Roe, M.M., Lu, L.G., Haas, M.W., Dennis, L.B., Pick, H.L., Junker, A., 1996. Brain-body actuated control: assessment of an alternative control technology for virtual environments, 1996 Image Conference, Scottsdale, AZ 1996, pp. 225-232.
55. O'Donnell, R.D., Eggemeier, F.T., 1986. Workload assessment methodology, In: Boff, K., Kaufman, L., Thomas, J. (Eds.), Handbook of Human Perception and Performance, vol. 2. Wiley, New York, pp. 42.41-42.49.
56. Olson, P.R., 1995. Definitions of Biofeedback and Applied Psychophysiology Biofeedback: A Practitioner's Guide. In: Schwartz, M.S. (Ed.),. The Guilford Press, New York, pp. 27-31.
57. Paradiso, J., Morris, S., Benbasat, A., Asmussen, E., 2004. Interactive therapy with instrumented footwear. Electronic Proceedings CHI 2004, pp. 1341 (CD2).
58. Parasuraman, R., Riley, V., 1997. Humans and automation: use, misuse, disuse, abuse. Human Factors 39, 230-253.
59. Partala, T., Surakka, V., 2003. Pupil size variation as an indication of affective processing. International Journal of Human-Computer Studies 59, 185-198.
60. Peniston, E.G., Kulkosky, P.J., 1989. Alpha-theta brainwave training and beta-endorphin levels in alcoholics. Alcoholism, Clinical and Experimental Research 13 (2), 271-279.
61. Peniston, E.G., Kulkosky, P.J., 1991. Alpha-theta brainwave neuro-feedback therapy for Vietnam veterans with combat-related post-traumatic stress disorder. Medical Psychotherapy 4, 47-60.
62. Pfurtscheller, G., Neuper, C., Edlinger, A.G., 1997. Foot and hand area mu rhythms. International Journal of Psychophysiology 26, 121-135.
63. Pfurtscheller, G., Guger, C., Muller, G., Krausz, G., Neurper, C., 2000. Brain oscillations control hand orthosis in a tetraplegic. Neuroscience Letters 292, 211-214.
64. Pfurtscheller, G., Muller, G., Pfurtscheller, J., Gerner, H.J., Rupp, R., 2003. 'Thought'-control of functional electrical stimulation to restore hand grasp in a patient with tetraplegia. Neuroscience Letters 351, 33-36.
65. Picard, R.W., 1997. Affective Computing. The MIT Press.
66. Picard, W., Klein, J., 2002. Computers that recognise and respond to user emotion: theoretical and practical implications. Interacting with Computers 14, 141-169.
67. Pope, A.T., Bogart, E.H., Bartolome, D.S., 1995. Biocybernetic system evaluates indices of operator engagement in automated task. Biological Psychology 40, 187-195.
68. Porges, S.W., Byrne, E.A., 1992. Research methods for measurement of heart rate and respiration. Biological Psychology 34, 93-130.
69. Prinzel, L.J., 2002. Research in hazardous states of awareness and physiological factors in aerospace operations (No. NASA/TM-2002-211444): NASA.
70. Prinzel, L.J., Scerbo, M.W., Freeman, F.G., Mikulka, P.J., 1995. A bio-cybernetic system for adaptive automation, Human Factors and Ergonomics Society 39th Annual Meeting 1995.
71. Prinzel, L.J., Freeman, F.G., Scerbo, M.W., Mikulka, P.J., Pope, A.T., 2000. A closed-loop system for examining psychophysiological measures for adaptive task allocation. International Journal of Aviation Psychology 10 (4), 393-410.
72. Prinzel, L.J., Parasuraman, R., Freeman, F.G., Scerbo, M.W., Mikulka, P.J., Pope, A.T., 2003. Three experiments examining the use of electroencephalogram, event-related potentials, and heart-rate variability for real-time human-centred adaptive automation design (No. NASA/TP-2003-212442): NASA.
73. Quigley, K.S., Barrett, L.F., Weinstein, S., 2002. Cardiovascular patterns associated with threat and challenge appraisals: a within-subjects analysis. Psychophysiology 39, 292-302.
74. Rosenberg, R., 1998. Computing without mice and keyboards: text and graphic input devices for mobile computing. PhD Thesis, UCL, London.
75. Saridis, G.N., Gootie, T.P., 1982. EMG pattern analysis and classification for a prosthetic arm. IEEE Engineering in Medicine and Biology 29, 403-411.
76. Saxby, E., Penniston, E.G., 1995. Alpha-theta brainwave neurofeedback training: an effective treatment for male and female alcoholics with depressive symptoms. Journal of Clinical Psychology 51 (5), 685-693.
77. Scerbo, M.W., Freeman, F.G., Mikulka, P.J., 2003. A brain-based system for adaptive automation. Theoretical Issues in Ergonomic Science 4 (1/2), 200-219.
78. Siddle, D.A.T., Turpin, G., 1980. Measurement, quantification and analysis of cardiac activity. In: Martin, I., Venables, P.H. (Eds.), Techniques in Psychophysiology. Wiley, New York, pp. 139-246.
79. Stern, J.A., Boyer, D., Schroeder, D., 1994. Blink rate: a possible measure of fatigue. Human Factors 36 (2), 285-297.
80. Tansey, M.A., 1993. Ten-year stability of EEG biofeedback results for a hyperactive boy who failed fourth grade perceptually impaired class. Biofeedback and Self-regulation 18 (1), 33-44.
81. Tattersall, A.J., Hockey, G.R.J., 1995. Level of operator control and changes in heart rate variability during simulated flight maintenance. Human Factors 37 (4), 682-698.
82. Veltman, J.A., Gaillard, A.W.K., 1998. Physiological workload reactions to increasing levels of task difficulty. Ergonomics 41 (5), 656-669.
83. Vertegaal, R., 2003. Attentive user interfaces. Communications of the ACM 2003.
84. Verwey, W.B., Veltman, H.A., 1996. Detecting short periods of elevated workload: a comparison of nine workload assessment techniques. Journal of Experimental Psychology: Applied 2 (3), 270-285.
85. Wiederhold, B.K., Jang, D.P., Kaneda, M., Cabral, I., Lurie, Y., May, T., Wiederhold, M.D., Kim, S.I., 2003. An investigation into physiological responses in virtual environments: an objective measurement of presence. In: Riva, G., Galimberti, C. (Eds.), Towards Cyberpsychology: Minds, Cognitions and Society in the Internet Age. IOS Press, Amsterdam.
86. Wiener, N., 1961. Cybernetics: or Control and Communication in the Animal and the Machine. MIT Press, Cambridge, MA.
87. Wientjes, C.J.E., 1992. Respiration in psychophysiology: methods and applications. Biological Psychology 34, 179-204.
88. Wilhelm, F.H., 2002. Continuous electronic data capture of cardiopulmonary physiology, motor behavior and subjective experience with the LifeShirt: towards a comprehensive monitoring of affective states in real life. Workshop on Physiological Computing at CHI2002 2002.
89. Wilson, G.F., 2002. An analysis of mental workload in pilots during flight using multiple psychophysiological measures. International Journal of Aviation Psychology 12 (1), 3-18.
90. Wilson, G.F., Fisher, F., 1991. The use of cardiac and eye blink measures to determine flight segment in F4 crews. Aviation, Space and Environmental Medicine 62, 959-961.
91. Wilson, G.F., Fisher, F., 1996. Cognitive task classification based upon topographic EEG data. Biological Psychology 40, 239-250.
92. Wilson, G.F., Russell, C.A., 2003. Operator functional state classification using multiple psychophysiological features in an air traffic control task. Human Factors 45 (3), 381-389.
93. Wilson, G.F., Swain, C.R., Ullsperger, P., 1999. EEG power changes during a multiple level memory retention task. International Journal of Psychophysiology 32, 107-118.
94. Wolpaw, J.R., McFarland, D.J., Vaughan, T.M., 2000. Brain-computer interface research at the Wadsworth Center. IEEE Transactions on Rehabilitation Engineering 8, 222-225.
95. Wolpaw, J.R., Birbaumer, N., McFarland, D.J., Pfurtscheller, G., Vaughan, T.M., 2002. Brain-computer interfaces for communication and control. Clinical Neurophysiology 113, 767-791.
96. Woods, D.D., 1996. Decomposing automation: apparent simplicity, real complexity. In: Parasuraman, R., Mouloua, M. (Eds.), Automation and Human Performance: Theory and Application. Erlbaum, Hillsdale, NJ, pp. 3-17.
97. Yamada, F., 1998. Frontal midline theta rhythm and eyeblinking activity during a VDT task and a video game: useful tools for psychophysiology in ergonomics. Ergonomics 41 (5), 678-688.