Automatic Stress Classification With Pupil Diameter Analysis

International Journal of Human-Computer Interaction

Volumn 30, Issue 3, 2014, Pages 220-236

  Pedrotti, Marco ^a,b   Mirzaei, Mohammad Ali ^c   Tedesco, Adrien ^d   Chardonnet, Jean Rémy ^c   Mérienne, Frédéric ^c   Benedetto, Simone ^b,e   Baccino, Thierry ^b,e  

^a SORBONNE UNIVERSITÉ   (France)

^b CHArt LUTIN EA 4004 Cité des Sciences et de l'Industrie de la Villette   (France)

^c ARTS ET MÉTIERS PARISTECH   (France)

^d Scientific Brain Training   (France)

^e UNIVERSITÉ PARIS 8   (France)

Author keywords

[No Author keywords available]

Indexed keywords

DISCRIMINATING POWER; ELECTRODERMAL ACTIVITY; EXPERIMENTAL TRIALS; PARALLEL NEURAL NETWORKS; PSYCHOLOGICAL STRESS; SIMULATED DRIVING; STRESS CLASSIFICATIONS; STRESS DETECTION;

NEURAL NETWORKS;

BEHAVIORAL RESEARCH;

EID: 84893650346     PISSN: 10447318     EISSN: 15327590     Source Type: Journal    
DOI: 10.1080/10447318.2013.848320     Document Type: Article

References (74)

1. Bach, D. R., Friston, K. J. and Dolan, R. J. 2010. Analytic measures for quantification of arousal from spontaneous skin conductance fluctuations. International Journal of Psychophysiology, 76: 52 - 55. doi: 10.1016/ijpsycho.2010.01.011
2. Barman, D. and Chowdhury, N. 2012. A method for movie business prediction using back-propagation neural network. International Journal of Information Technology and Computer Science, 11: 67 - 73. doi: 10.5815/ijitcs.2012.11.09
3. Beatty, J. 1982. Task-evoked pupillary responses, processing load, and the structure of processing resources. Psychological Bulletin, 91: 276 - 292. doi: 10.1037/0033-2909.91.2.276
4. Beatty, J. 1986. " The pupillary system ". In Psychophysiology: Systems, processes, and applications, Edited by: Coles, M. G. H., Donchin, E. and Porges, S. W. 43 - 50. New York, NY:" Guilford.
5. Beatty, J. and Lucero-Wagoner, B. 2000. " The pupillary system ". In Handbook of psychophysiology, 2nd, Edited by: Cacioppo, J. T., Tassinary, L. G. and Berntson, G. G. 142 - 162. Cambridge, UK:" Cambridge University Press.
6. Benedek, M. and Kaernbach, C. 2010. A continuous measure of phasic electrodermal activity. Journal of Neuroscience Methods, 190: 80 - 91. doi: 10.1016/j.jneumeth.2010.04.028
7. Benedetto, S., Pedrotti, M. and Bridgeman, B. 2011. Microsaccades and exploratory saccades in a naturalistic environment. Journal of Eye Movement Research, 4 (2): 1 - 10.
8. Bergamin, O. and Kardon, R.H. 2003. Latency of the pupil light reflex: sample rate, stimulus intensity, and variation in normal subjects. Investigative Ophthalmology & Visual Science, 44: 1546 - 1554. doi: 10.1167/iovs.02-0468
9. Bernick, N. and Oberlander, M. 1968. Effect of verbalization and two different modes of experiencing pupil size. Perception & Psychophysics, 3: 327 - 330. doi: 10.3758/BF03212478
10. Boucsein, W. 2012. Electrodermal activity, 2nd ed., New York, NY:" Springer.
11. Boucsein, W., Fowles, D. C., Grimnes, S., Ben-Shakhar, G., Roth, W. T., Dawson, M. E. and Filion, D. L. 2012. Publication recommendations for electrodermal measurements. Psychophysiology, 49: 1017 - 1034. doi: 10.1111/j.1469-8986.2012.01384.x
12. Bradley, M. M., Miccoli, L., Escrig, M. A. and Lang, P. J. 2008. The pupil as a measure of emotional arousal and autonomic activation. Psychophysiology, 45: 602 - 607. doi: 10.1111/j.1469-8986.2008.00654.x
13. Brainard, D. H. 1997. The psychophysics toolbox. Spatial Vision, 10: 433 - 436. doi: 10.1163/156856897X00357
14. Cacioppo, J. and Tassinary, L. G. 1990. Inferring psychological significance from physiological signals. American Psychologist, 45: 16 - 28. doi: 10.1037/0003-066X.45.1.16
15. Czaja, S. J. and Sharit, J. 1993. Stress reactions to computer-interactive tasks as a function of task structure and individual differences. International Journal of Human-Computer Interaction, 5: 1 - 22. doi: 10.1080/10447319309526053
16. Dawson, M. E., Schell, A. M. and Filion, D. L. 2000. " The electrodermal system ". In Handbook of psychophysiology, 2nd, Edited by: Cacioppo, J. T., Tassinary, L. G. and Berntson, G. G. 200 - 223. Cambridge, UK:" Cambridge University Press.
17. Dennerlein, J., Becker, T., Johnson, P., Reynolds, C. and Picard, R. 2003. " Frustrating computer users increases exposure to physical factors ". In Proceedings of the International Ergonomics Association 24 - 29.
18. Di Stasi, L., Catena, A., Cañas, J., Macknik, S. L. and Martinez-Conde, S. 2013. Saccadic velocity as an arousal index in naturalistic tasks. Neuroscience and Biobehavioral Reviews, 37: 968 - 975. doi: 10.1016/j.neubiorev.2013.03.011
19. Ellis, C. J. 1981. The pupillary light reflex in normal subjects. British Journal of Ophthalmology, 65: 754 - 759. doi: 10.1136/bjo.65.11.754
20. Fawcett, T. 2006. An introduction to ROC analysis. Pattern Recognition Letters, 27: 861 - 874. doi: 10.1016/j.patrec.2005.10.010
21. Fujigaki, Y. and Mori, Kazuko. 1997. Longitudinal study of work stress among information system professionals. International Journal of Human-Computer Interaction, 9: 369 - 381. doi: 10.1207/s15327590ijhc0904_3
22. Gitelman, D. R. 2002. ILAB: A program for postexperimental eye movement analysis. Behavior Research Methods, Instruments, & Computers, 34: 605 - 612. doi: 10.3758/BF03195488
23. Goldwater, B.C. 1972. Psychological significance of pupillary movements. Psychological Bulletin, 77: 340 - 355. doi: 10.1037/h0032456
24. Granholm, E. and Steinhauer, S. R. 2004. Pupillometric measures of cognitive and emotional processes. International Journal of Psychophysiology, 52: 1 - 6. doi: 10.1016/j.ijpsycho.2003.12.001
25. Granholm, E. and Verney, S. P. 2004. Pupillary responses and attentional allocation problems on the backward masking task in schizophrenia. International Journal of Psychophysiology, 52: 37 - 51. doi: 10.1016/j.ijpsycho.2003.12.004
26. Hamid, N. A., Nawi, N. M. and Ghazali, R. 2011. The effect of adaptive gain and adaptive momentum in improving training time of gradient descent back propagation algorithm on classification problems. International Journal on Advanced Science, Engineering and Information Technology, 1: 178 - 184.
27. Holmqvist, K., Nyström, M., Andersson, R., Dewhurst, R., Jarodzka, H. and van de Weijer, J. 2010. Eye tracking: A comprehensive guide to methods and measures, New York, NY:" Oxford University Press.
28. ISO 26022. 2010. Road vehicles-Ergonomic aspects of transport information and control systems - Simulated lane change test to assess in-vehicle secondary task demand. ISO/TC 22/SC 13
29. Jainta, S. and Baccino, T. 2010. Analyzing the pupil response due to increased cognitive demand: An independent component analysis study. International Journal of Psychophysiology, 77: 1 - 7. doi: 10.1016/j.ijpsycho.2010.03.008
30. Janisse, M. P. 1977. Pupillometry: The psychology of the pupillary response, Washington DC:" Hemisphere.
31. Kleiner, M., Brainard, D. H. and Pelli, D. G. 2007. What's new in Psychtoolbox-3? Perception 36 ECPV Abstract Supplement
32. Klingner, J. 2010. " Fixation-aligned pupillary response averaging ". In Proceedings of the 2010 Symposium on Eye-Tracking Research & Applications, 275 - 282. New York, NY:" ACM Press.
33. Klingner, J., Kumar, R. and Hanrahan, P. 2008. " Measuring the task-evoked pupillary response with a remote eye tracker ". In Proceedings of the 2008 Symposium on Eye-Tracking Research & Applications, 69 - 72. New York, NY:" ACM Press.
34. Kuchinke, L., Vo, M. L. H., Hofmann, M. and Jacobs, A. M. 2007. Pupillary responses during lexical decisions vary with word frequency but not emotional valence. International Journal of Psychophysiology, 65: 132 - 140.
35. Kuhlmann, J. and Böttcher, M. 1999. Pupillography: Principles, methods and applications, München, Germany:" W. Zuckschwerdt Verlag.
36. Lanting, P., Bos, J. E., Aartsen, J., Schuman, L., Reichert-Thoen, J. and Heimans, J. J. 1990. Assessment of pupillary light reflex latency and darkness adapted pupil size in control subjects and in diabetic patients with and without cardiovascular autonomic neuropathy. Journal of Neurology, Neurosurgery, and Psychiatry, 53: 912 - 914. doi: 10.1136/jnnp.53.10.912
37. Lew, R., Dyre, B. P., Werner, S., Wotring, B. and Tran, T. 2008. " Exploring the potential of Short-Time Fourier Transforms for analyzing skin conductance and pupillometry in real-time applications ". In Proceedings of the Human Factors and Ergonomics Society 52nd Annual Meeting, 1536 - 1540. Santa Monica, CA:" Human Factors and Ergonomics Society.
38. Loewenfeld, I. and Lowenstein, O. 1993. The pupil: Anatomy, physiology, and clinical applications, Vol. I, Ames:" Iowa State University.
39. Lüdtke, H., Wilhelm, B., Adler, M., Schaeffel, F. and Wilhelm, H. 1998. Mathematical procedures in data recording and processing of pupillary fatigue waves. Vision Research, 38: 2889 - 2896.
40. Mallat, S. G. 1989. A theory for multiresolution signal decomposition: The wavelet respresentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 11: 674 - 693.
41. Mauss, I. B. and Robinson, M. D. 2009. Measures of emotion: A review. Cognition and Emotion, 23: 209 - 237. doi: 10.1080/02699930802204677
42. Marshall, S. P. 2000. " Method and apparatus for eye tracking and monitoring pupil dilation to evaluate cognitive activity ". In US Patent No 6,090,051
43. th Conference on Human Factors and Power Plants 7.5 - 7.9.
44. Minin, L., Benedetto, S., Pedrotti, M., Re, A. and Montanari, R. 2011. Measuring the effects of visual demand on lateral deviation: A comparison among driver's performance indicators. Applied Ergonomics, 43: 486 - 492.
45. Minu, K. K., Lineesh, M. C. and Jessy John, C. 2010. Wavelet neural networks for nonlinear time series analysis. Applied Mathematical Sciences, 4: 2485 - 2495.
46. Mitsopoulos-Rubens, E., Trotter, M. J. and Lenné, M. G. 2011. Effects on driving performance of interacting with an in-vehicle music player: A comparison of three interface layout concepts for information presentation. Applied Ergonomics, 42: 583 - 591.
47. Moré, J. J. 1978. The Levenberg-Marquardt algorithm: Implementation and theory. Numerical Analysis, 630: 105 - 116.
48. Nakayama, M. 2006. Influence of blink on pupillary indices. Biomedical Circuits and Systems Conference,:" 29 - 32. 2006 IEEE Conference Publications
49. Nakayama, M. and Shimizu, Y. 2002. " An estimation model of pupil size for 'Blink artifact' and its applications ". In 10th European Symposium on Artificial Neural Networks, Edited by: Verleysen, M. 251 - 256. Bruges, Belgium:" D-side publications. M.
50. Nakayama, M. and Shimizu, Y. 2004. " Frequency analysis of task evoked pupillary responses and eye-movement ". In Eye-Tracking Research & Applications Symposium 2004, Edited by: Duchowsky, A. T. and Vertegaal, R. 71 - 76. New York, NY:" ACM Press.
51. Nakayama, M., Yamamoto, K. and Kobayashi, F. 2012. Estimation of sleepiness using pupillary response and its frequency components. International Journal of Bioinformatics Research and Applications, 8: 342 - 365.
52. Nhan, B. R. and Chau, T. 2010. Classifying affective states using thermal infrared imaging of the human face. IEEE Transactions on Biomedical Engineering, 57: 979 - 987. doi: 10.1109/TBME.2009.2035926
53. Palinko, O. and Kun, A. L. 2011. " Exploring the influence of light and cognitive load on pupil diameter in driving simulator studies ". In Proceedings of the Sixth International Driving Symposium on Human Factors in Driver Assessment, Training and Vehicle Design, 329 - 336. Iowa City:" Public Policy Center, University of Iowa.
54. Palinko, O. and Kun, A. L. 2012. " Exploring the effects of visual cognitive load and illumination on pupil diameter in driving simulators ". In Proceedings of the 2012 Symposium on Eye-Tracking Research & Applications, 413 - 416. New York, NY:" ACM Press.
55. Palinko, O., Kun, A. L., Shyrokov, A. and Heeman, P. 2010. " Estimating cognitive load using remote eye tracking in a driving simulator ". In Proceedings of the 2010 Symposium on Eye-Tracking Research & Applications, 141 - 144. New York, NY:" ACM Press.
56. Partala, T. and Surakka, V. 2003. Pupil size variation as an indicator of affective processing. International Journal of Human-Computer Studies, 59: 185 - 198.
57. Pedrotti, M., Lei, S., Dzaack, J. and Rötting, M. 2011. A data-driven algorithm for offline pupil signal preprocessing and eyeblink detection in low-speed eye-tracking protocols. Behavior Research Methods, 43: 372 - 383.
58. Pelli, D. G. 1997. The VideoToolbox software for visual psychophysics: Transforming numbers into movies. Spatial Vision, 10: 437 - 442.
59. th International Conference on Signal Processing, 115 - 120. Stevens Point, WI:" World Scientific and Engineering Academy and Society.
60. Ren, P., Barreto, A., Gao, Y. and Adjouadi, M. 2013. Affective assessment by digital processing of the pupil diameter. IEEE Transactions on Affective Computing, 4: 2 - 14.
61. Sato, K., Kang, W.H., Saga, K. and Sato, K. T. 1989. Biology of sweat glands and their disorders. I. Normal sweat gland function. Journal of the American Academy of Dermatology, 20: 537 - 563.
62. Sauter, S. L. 1991. Job stress and human-computer interaction. International Journal of Human-Computer Interaction, 4 (3): 3 - 4.
63. Schweitzer, M. B. and Paulhan, I. 1990. Manuel pour l'inventaire d'anxiété Trait-Etat (Forme Y). Laboratoire de Psychologie de la Santé, Université de Bordeaux II, Bordeaux:" France.
64. Shastri, D., Merla, A., Tsiamyrtzis, P. and Pavlidis, I. 2009. Imaging facial signs of neurophysiological responses. IEEE Transactions on Biomedical Engineering, 56: 477 - 484.
65. Shi, B., Moloney, K. P., Pan, Y., Leonard, V. K., Vidakovic, B., Jacko, J. A. and Sainfort, F. 2012. Wavelet classification of high frequency pupillary responses. Journal of Statistical Computation and Simulation, 76: 431 - 446.
66. Spielberger, C. D., Gorsuch, R. L., Lushene, R., Vagg, P. R. and Jacobs, G. A. 1983. Manual for the State-Trait Anxiety Inventory, Palo Alto, CA:" Consulting Psychologists Press.
67. Tournois, J., Mesnil, F. and Kop, J. L. 2000. Autotricherie et hétérotricherie: Un instrument de mesure de la désirabilité sociale. [Self-deception and other-deception: A social desirability measuring tool]. Revue Européenne de Psychologie Appliquée / European Review of Applied Psychology, 50: 219 - 232.
68. Van den Broek, E. L., Janssen, J. H. and Westerink, J. H. D. M. 2009. " Guidelines for Affective Signal Processing (ASP): From lab to life ". In Proceedings of the IEEE 3rd international conference on affective computing and intelligent interaction, Vol. 1, 704 - 709. Amsterdam:" the Netherlands: IEEE Press. ACII
69. Verney, S. P., Granholm, E. and Marshall, S. P. 2004. Pupillary responses on the visual backward masking task reflect general cognitive ability. International Journal of Psychophysiology, 52: 23 - 36.
70. Vo, M. L. H., Jacobs, A. M., Kuchinke, L., Hofmann, M., Conrad, M., Schacht, A. and Hutzler, F. 2008. The coupling of emotion and cognition in the eye: Introducing the pupil old/new effect. Psychophysiology, 45: 130 - 140.
71. Watson, A. B. and Yellot, J. I. 2012. A unified formula for light-adapted pupil size. Journal of Vision, 12 (10): 1 - 16.
72. Widrow, B., Gupta, N. K. and Maitra, S. 1973. Punish/reward: learning with a critic in adaptive threshold systems. IEEE Transactions on Systems, Man and Cybernetics, SMC-3: 455 - 465.
73. Wyatt, H. J. 2010. The human pupil and the use of video-based eyetrackers. Vision Research, 50: 1982 - 1988.
74. Zhai, J. and Barreto, A. 2006. Stress detection in computer users based on digital signal processing of noninvasive physiological variables. Engineering in Medicine and Biology Society, 2006. EMBS'06. 28th Annual International Conference of the IEEE,:" 1355 - 1358.