Characterization of affective states by pupillary dynamics and autonomic correlates

Frontiers in Neuroengineering

Volumn , Issue NOV, 2013, Pages

  Onorati, Francesco ^a,b,c,d   Barbieri, Riccardo ^b,c   Mauri, Maurizio ^d   Russo, Vincenzo ^d   Mainardi, Luca ^a  

^a POLITECNICO DI MILANO   (Italy)

^b MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^c MASSACHUSETTS GENERAL HOSPITAL   (United States)

^d IULM UNIVERSITY   (Italy)

Author keywords

Autonomic nervous system (ANS); Coherence analysis; Emotions; Heart rate variability (HRV); Pupil dilation (PD); Reconstruction; Spectral analysis; Very high frequencies

Indexed keywords

AFFECT; ANGER; ARTICLE; AUTONOMIC NERVOUS SYSTEM; BREATHING RATE; CALCULATION; DISCRIMINANT ANALYSIS; ELECTROCARDIOGRAM; EMOTION; EMOTIONALITY; EYELID REFLEX; FREQUENCY ANALYSIS; HAPPINESS; HEART RATE VARIABILITY; HIGH FREQUENCY OSCILLATION; HUMAN; HUMAN EXPERIMENT; MATHEMATICAL MODEL; NORMAL HUMAN; PUPIL REFLEX; RECALL; SADNESS; SPECTROSCOPY;

EID: 84888117634     PISSN: 16626443     EISSN: None     Source Type: Journal    
DOI: 10.3389/fneng.2013.00009     Document Type: Article

References (58)

1. Akaike, H. (1974). A new look at the statistical model identification. IEEE Trans. Autom. Control 19, 716-723. doi: 10.1109/TAC.1974.1100705
2. Andreassi, J. L. (2000). "Pupillary Response and Behavior", in Psychophysiology: human behavior & physiological response, 4th edn, (Mahwah, NJ: Lawrence Erlbaum Association), 218-233.
3. Arnold, M. B. (1960). Emotion and Personality. New York, NY: Columbia University Press.
4. Barbieri, R., Parati, G., and Saul, J. P. (2001). Closed-versus open-loop assessment of heart rate baroreflex. Eng. Med. Biol. Mag. IEEE 20, 33-42. doi: 10.1109/51.917722
5. Beatty, J., and Lucero-Wagoner, B. (2000). "The pupillary system," in Handbook of Psychophysiology. 2nd Edn., eds J. T. Cacioppo, L. J. Tassinary, and G. G. Berntson (Cambridge: Cambridge University Press), 142-162.
6. Berntson, G. G., Bigger, J. T., Eckberg, D. L., Grossman, P., Kaufmann, P. G., Malik, M., et al. (1997). Heart rate variability: origins, methods, and interpretive caveats. Psychophysiology 34, 623-648. doi: 10.1111/j.14698986.1997.tb02140.x
7. Bond, C. V. A. (1998). Personal relevance is an important dimension for visceral reactivity in emotional imagery. Cogn. Emotion 12, 231-242. doi: 10.1080/026999398379736
8. Borgdorff, P. (1975). Respiratory fluctuations in pupil size. Am. J. Physiol. Legacy Content 228, 1094-1102.
9. Bradley, M., Miccoli, L., Escrig, M., and Lang, P. (2008). The pupil as a measure of emotional arousal and autonomic activation. Psychophysiology 45, 602-607. doi: 10.1111/j.1469-8986.2008.00654.x
10. Broomhead, D., and King, G. (1986). Extracting qualitative dynamics from experimental data. Physica D 20, 217-236. doi: 10.1016/0167-2789(86)90031-X
11. Cacioppo, J. T., Berntson, G. G., Larsen, J. T., Poehlmann, K. M., and Ito, T. A. (2000). "The psychophysiology of emotion," in Handbook of Psychophysiology. 2nd Edn., eds R. Lewis and J. M. Haviland-Jones (New York, NY: Guilford Press), 173-191.
12. Cacioppo, J. T., Tassinary, L. G., and Berntson, G. G. (2007). Handbook of Psychophysiology. Cambridge: Cambridge University Press. doi: 10.1017/CBO9780511546396
13. Calcagnini, G., Censi, F., Lino, S., and Cerutti, S. (2000). Spontaneous fluctuations of human pupil reflect central autonomic rhythms. Methods Inf. Med. 39, 142-145. Available online at: http://www.schattauer.de/t3page/1214.html?manuscript=31
14. Caldirola, D., Bellodi, L., Caumo, A., Migliarese, G., and Perna, G. (2004). Approximate entropy of respiratory patterns in panic disorder. Am. J. Psychiatr. 161, 79-87. doi: 10.1176/appi.ajp. 161.1.79
15. Camm, A., Malik, M., Bigger, J., Breithardt, G., Cerutti, S., Cohen, R., et al. (1996). Heart rate variability: standards of measurement, physiological interpretation and clinical use. task force of the european society of cardiology and the north american society of pacing and electrophysiology. Circulation 93, 1043-1065. doi: 10.1161/01.CIR. 93.5.1043
16. Cannon, W. B. (1927). The jameslange theory of emotions: a critical examination and an alternative theory. Am. J. Psychol. 39, 106-124. doi: 10.2307/1415404
17. Charman, W. N., and Heron, G. (2007). Fluctuations in accommodation: a review. Ophthal. Physiol. Opt. 8, 153-164. doi: 10.1111/j.1475-1313.1988.tb01031.x
18. Christie, I. C., and Friedman, B. H. (2004). Autonomic specificity of discrete emotion and dimensions of affective space: a multivariate approach. Int. J. Psychophysiol. 51, 143-153. doi: 10.1016/j.ijpsycho. 2003.08.002
19. Citi, L., Brown, E. N., and Barbieri, R. (2012). A real-time automated point-process method for the detection and correction of erroneous and ectopic heartbeats. IEEE Trans. Biomed. Eng. 59, 2828-2837. doi: 10.1109/TBME. 2012.2211356
20. Collet, C., Vernet-Maury, E., Delhomme, G., and Dittmar, A. (1997). Autonomic nervous system response patterns specificity to basic emotions. J. Auton. Nerv. Syst. 62, 45-57. doi: 10.1016/S0165-1838(96)00108-7
21. Damasio, A. (1994). Descartes' Error: Emotion, Reason and the Human Mind. New York, NY: Grossett/Putnam.
22. Einhäuser, W., Stout, J., Koch, C., and Carter, O. (2008). Pupil dilation reflects perceptual selection and predicts subsequent stability in perceptual rivalry. Proc. Natl. Acad. Sci. U.S.A. 105, 1704. doi: 10.1073/ pnas.0707727105
23. Ekman, P., Levenson, R. W., and Friesen, W. V. (1983). Autonomic nervous system activity distinguishes among emotions. Science 221, 1208-1210. doi: 10.1126/science.6612338
24. Ellis, C. J. (1981). The papillary light reflex in normal subjects. Br. J. Ophthalmol. 65, 754-759. doi: 10.1136/bjo.65.11.754
25. Faes, L., Pinna, G. D., Porta, A., Maestri, R., and Nollo, G. (2004). Surrogate data analysis for assessing the significance of the coherence function. IEEE Trans. Biomed. Eng. 51, 1156-1166. doi: 10.1109/TBME.2004.827271
26. Faes, L., Porta, A., and Nollo, G. (2009). "Surrogate data approaches to assess the significance of directed coherence: application to EEG activity propagation," in Engineering in Medicine and Biology Society, 2009. EMBC 2009. Annual International Conference of the IEEE (Minneapolis, MN: IEEE), 6280-6283. doi: 10.1109/IEMBS.2009.5332477
27. Friedman, M. (1937). The use of ranks to avoid the assumption of normality implicit in the analysis of variance. J. Am. Stat. Assoc. 32, 675-701. doi: 10.1080/01621459.1937.10503522
28. Grubbs, F. (1969). Procedures for detecting outlying observations in samples. Technometrics 11, 1-21. doi: 10.1080/00401706.1969. 10490657
29. James, W. (1894). The physical basis of emotion. Psychol. Rev. 1, 516.
30. Jänig, W. (1989). "Autonomic nervous system," in Human Physiology, eds R. F. Schmidt and G. Thews (Berlin: Springer), 333-370.
31. Katona, P. G., and Jih, F. (1975). Respiratory sinus arrhythmia: noninvasive measure of parasympathetic cardiac control. J. Appl. Physiol. 39, 801-805.
32. Lanata, A., Armato, A., Valenza, G., and Scilingo, E. P. (2011).Eye tracking and pupil size variation as response to affective stimuli: a preliminary study," in 2011 5th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth) (Dublin: IEEE), 78-84.
33. Lang, P. J. (1995). The emotion probe. Am. Psychol. 50, 372-385. doi: 10.1037/0003-066X.50.5.372
34. Levenson, R. W. (2003). "Autonomic specificity and emotion," in Handbook of Affective Sciences, eds R. J. Davidson, K. R. Scherer, and H. Goldsmith (Oxford: Oxford University Press), 212-224.
35. Levenson, R. W., Ekman, P., and Friesen, W. V. (1990). Voluntary facial action generates emotionspecific autonomic nervous system activity. Psychophysiology 27, 363-384. doi: 10.1111/j.1469-8986.1990.tb02330.x
36. Lilliefors, H. (1967). On the kolmogorov-smirnov test for normality with mean and variance unknown. J. Am. Stat. Assoc. 62, 399-402. doi: 10.1080/01621459.1967.10482916
37. Lowe, R., and Ziemke, T. (2011) The feeling of action tendencies: on the emotional regulation of goal-directed behavior. Front. Psychol. 2:346. doi: 10.3389/fpsyg.2011.00346
38. Mauri, M., Magagnin, V., Cipresso, P., Mainardi, L. T., Brown, E. N., Cerutti, S., et al. (2010). "Psychophysiological signals associated with affective states," in Engineering in Medicine and Biology Society (EMBC), 2010 Annual International Conference of the IEEE (Buenos Aires: IEEE), 3563-3566. doi: 10.1109/IEMBS. 2010.5627465
39. Mauri, M., Onorati, F., Russo, V., Mainardi, L., and Barbieri, R. (2012). Psychophysiological assessment of emotions. Int. J. Bioelectromagn. 14, 133-140. Available online at: http://www.ijbem.org/volume14/number3/ijbem_vol14_no3_pp133-140.pdf
40. Nakayama, M., and Shimizu, Y. (2004). "Frequency analysis of task evoked pupillary response and eye-movement," in Proceedings of the 2004 Symposium on Eye Tracking Research & Applications (New York, NY: ACM), 71-76.
41. Nowak, W., Hachol, A., and Kasprzak, H. (2008). Time-frequency analysis of spontaneous fluctuation of the pupil size of the human eye. Opt. Appl. 38, 469-480. Available online at: http://www.if.pwr.wroc.pl/optappl/pdf/2008/no2/optappl_3802p469.pdf
42. th International Workshop on Biosignal Interpretation, (Como), 117-120.
43. Partala, T., and Surakka, V. (2003). Pupil size variation as an indication of affective processing. Int. J. Hum. Comput. Stud. 59, 185-198. doi: 10.1016/S1071-5819(03)00017-X
44. Rainville, P., Bechara, A., Naqvi, N., and Damasio, A. (2006). Basic emotions are associated with distinct patterns of cardiorespiratory activity. Int. J. Psychophysiol. 61, 5-18. doi: 10.1016/j.ijpsycho. 2005.10.024
45. Russell, J. A. (1980). A circumplex model of affect. J. Pers. Soc. Psychol. 39, 1161. doi: 10.1037/h0077714
46. Sassi, R., Corino, V., and Mainardi, L. (2009). Analysis of surface atrial signals: time series with missing data? Ann. Biomed. Eng. 37, 2082-2092. doi: 10.1007/s10439-009-9757-3
47. Schachter, S., and Singer, J. (1962). Cognitive, social, and physiological determinants of emotional state. Psychol. Rev. 69, 379. doi:10.1037/ h0046234
48. Schoellhamer, D. (2001). Singular spectrum analysis for time series with missing data. Geophys. Res. Lett. 28, 3187-3190. doi: 10.1029/2000GL012698
49. Schreiber, T., and Schmitz, A. (2000). Surrogate time series. Physica D 142, 346-382. doi: 10.1016/S0167-2789(00)00043-9
50. Steinhauer, S., Siegle, G., Condray, R., and Pless, M. (2004). Sympathetic and parasympathetic innervation of pupillary dilation during sustained processing. Int. J. Psychophysiol. 52, 77-86. doi: 10.1016/j.ijpsycho.2003.12.005
51. Stephens, C. L., Christie, I. C., and Friedman, B. H. (2010). Autonomic specificity of basic emotions: evidence from pattern classification and cluster analysis. Biol. Psychol. 84, 463-473. doi: 10.1016/j.biopsycho.2010.03.014
52. Theiler, J., Eubank, S., Longtin, A., Galdrikian, B., and Farmer, J. D. (1992). Testing for nonlinearity in time series: the method of surrogate data. Physica D 58, 77-94. doi: 10.1016/0167-2789(92)90102-S
53. Valenza, G., Lanata, A., and Scilingo, E. P. (2012). The role of nonlinear dynamics in affective valence and arousal recognition. IEEE Trans. Affect. Comput. 3, 237-249. doi: 10.1109/T-AFFC.2011.30
54. Vautard, R., Yiou, P., and Ghil, M. (1992). Singular-spectrum analysis: a toolkit for short, noisy chaotic signals. Physica D 58, 95-126. doi: 10.1016/0167-2789(92)90103-T
55. Wiggins, R. A., and Robinson, E. A. (1965). Recursive solution to the multichannel filtering problem. J. Geophys. Res. 70, 1885-1891. doi: 10.1029/JZ070i008p01885
56. Wilcoxon, F. (1945). Individual comparisons by ranking methods. Biometrics Bull. 1, 80-83. doi: 10.2307/3001968
57. Yoshida, H., Yana, K., Okuyama, F., and Tokoro, T. (1994). Time-varying properties of respiratory fluctuations in pupil diameter of human eyes. Methods Inf. Med. 33, 46-46.
58. Zetterberg, L. (1969). Estimation of parameters for a linear difference equation with application to eeg analysis. Math. Biosci. 5, 227-275. doi: 10.1016/0025-5564(69)90044-3