Extracting heart rate from videos of online participants

Conference on Human Factors in Computing Systems - Proceedings

Volumn , Issue , 2016, Pages 4562-4567

  Muender, Thomas ^a   Miller, Matthew K ^b   Birk, Max V ^b   Mandryk, Regan L ^b  

^a UNIVERSITY OF BREMEN   (Germany)

^b UNIVERSITY OF SASKATCHEWAN   (Canada)

Author keywords

Crowdsourced studies; Heart rate; Image processing; Online video; Physiological data; User experience; Webcams

Indexed keywords

HEART; HUMAN COMPUTER INTERACTION; HUMAN ENGINEERING; IMAGE PROCESSING; PHYSIOLOGY; VIDEO SIGNAL PROCESSING;

CROWDSOURCED STUDIES; HEART RATES; ONLINE VIDEO; PHYSIOLOGICAL DATA; USER EXPERIENCE; WEBCAMS;

DATA ACQUISITION;

EID: 85009419334     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2858036.2858064     Document Type: Conference Paper

References (38)

1. Jans Aasman, Gijsbertus Mulder, and Lambertus JM Mulder. 1987. Operator effort and the measurement of heart-rate variability. Human Factors: The Journal of the Human Factors and Ergonomics Society 29, 2(1987), 161-170.
2. P-O Åstrand and Irma Ryhming. 1954. A nomogram for calculation of aerobic capacity (physical fitness) from pulse rate during submaximal work. Journal of applied physiology 7, 2(1954), 218-221.
3. John T Cacioppo, Louis G Tassinary, and Gary Berntson. 2007. Handbook of psychophysiology. Cambridge University Press.
4. James A Coan and John JB Allen. 2007a. Handbook of emotion elicitation and assessment. Oxford University Press, USA, Chapter 14.
5. James A Coan and John JB Allen. 2007b. Handbook of emotion elicitation and assessment. Oxford University Press, USA, Chapter 15.
6. Lawrence T DeCarlo. 1997. On the meaning and use of kurtosis. Psychological methods 2, 3(1997), 292.
7. Anders Drachen, Lennart E Nacke, Georgios Yannakakis, and Anja Lee Pedersen. 2010. Correlation between heart rate, electrodermal activity and player experience in first-person shooter games. In Proceedings of the 5th ACM SIGGRAPH Symposium on Video Games. ACM, 49-54.
8. Clayton Epp, Michael Lippold, and Regan L Mandryk. 2011. Identifying emotional states using keystroke dynamics. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 715-724.
9. Kimmo Eriksson and Brent Simpson. 2010. Emotional reactions to losing explain gender differences in entering a risky lottery. Judgment and Decision Making 5, 3(2010), 159-163.
10. Joseph K Goodman, Cynthia E Cryder, and Amar Cheema. 2013. Data collection in a flat world: The strengths and weaknesses of Mechanical Turk samples. Journal of Behavioral Decision Making 26, 3(2013), 213-224.
11. Tristan A. Hearn. 2014. Software for Non-Contact Measurement of an Individual's Heart Rate Using a Common Camera. In NASA Tech Briefs, Vol. Vol. 38 No. 2.
12. Tristan A. Hearn. 2016. webcam-pulse-detector. Github. (4 January 2016). Retrieved January 4, 2016 from https://github.com/thearn/webcam-pulsedetector.
13. A. B. Hertzman and C. R. Spealman. 1937. Observations on the finger volume pulse recorded photoelectrically. Am. J. Physiol 119, 334(1937), 3.
14. Eckhard H Hess and James M Polt. 1964. Pupil size in relation to mental activity during simple problemsolving. Science 143, 3611(1964), 1190-1192.
15. Nis Hjortskov, Dag Rissén, Anne Katrine Blangsted, Nils Fallentin, Ulf Lundberg, and Karen Søgaard. 2004. The effect of mental stress on heart rate variability and blood pressure during computer work. European journal of applied physiology 92, 1-2(2004), 84-89.
16. Aniket Kittur, Ed H Chi, and Bongwon Suh. 2008. Crowdsourcing user studies with Mechanical Turk. In Proceedings of the SIGCHI conference on human factors in computing systems. ACM, 453-456.
17. Aniket Kittur, Boris Smus, Susheel Khamkar, and Robert E Kraut. 2011. Crowdforge: Crowdsourcing complex work. In Proceedings of the 24th annual ACM symposium on User interface software and technology. ACM, 43-52.
18. Brigitte M Kudielka, Nicole C Schommer, Dirk H Hellhammer, and Clemens Kirschbaum. 2004. Acute HPA axis responses, heart rate, and mood changes to psychosocial stress (TSST) in humans at different times of day. Psychoneuroendocrinology 29, 8(2004), 983-992.
19. Yuriy Kurylyak, Francesco Lamonaca, and Domenico Grimaldi. 2012. Smartphone based photoplethysmogram measurement. Digital Image and Signal Processing for Measurement Systems, FJ Duro and FL Pena, eds (2012), 135-164.
20. K. Lange Andersen., V. Seliger, J. Butenfranz, and I. Berndt. 1974. Physical performance capacity of children in Norway. European Journal of Applied Physiology and Occupational Physiology 33, 3(1974), 197-206. DOI: http://dx.doi.org/10.1007/BF00421147
21. Regan L. Mandryk. 2008. Game usability: advice from the experts for advancing the player experience. Elsevier/Morgan Kaufmann, Amsterdam a.o., Chapter 14, 207-235.
22. Regan L Mandryk and M. Stella Atkins. 2007. A fuzzy physiological approach for continuously modeling emotion during interaction with play technologies. International journal of human-computer studies 65, 4(2007), 329-347.
23. Regan L Mandryk, Kori M Inkpen, and Thomas W Calvert. 2006. Using psychophysiological techniques to measure user experience with entertainment technologies. Behaviour & information technology 25, 2(2006), 141-158.
24. Winter Mason and Siddharth Suri. 2012. Conducting behavioralresearchonAmazon⎜ MechanicalTurk. Behavior research methods 44, 1(2012), 1-23.
25. Tanushree Mitra, C. J. Hutto, and Eric Gilbert. 2015. Comparing Person- and Process-centric Strategies for Obtaining Quality Data on Amazon Mechanical Turk. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, 1345-1354.
26. Bilge Mutlu, Andreas Krause, Jodi Forlizzi, Carlos Guestrin, and Jessica Hodgins. 2007. Robust, low-cost, non-intrusive sensing and recognition of seated postures. In Proceedings of the 20th annual ACM symposium on User interface software and technology. ACM, 149-158.
27. Lennart E Nacke. 2015. Games User Research and Physiological Game Evaluation. In Game User Experience Evaluation. Springer, 63-86.
28. Michael J Owren and Jo-Anne Bachorowski. 2007. Measuring emotion-related vocal acoustics. Handbook of emotion elicitation and assessment (2007), 239-266.
29. Gabriele Paolacci, Jesse Chandler, and Panagiotis G Ipeirotis. 2010. Running experiments on amazon mechanical turk. Judgment and Decision making 5, 5(2010), 411-419.
30. Ming-Zher Poh, Daniel J McDuff, and Rosalind W Picard. 2010. Non-contact, automated cardiac pulse measurements using video imaging and blind source separation. Optics express 18, 10(2010), 10762-10774.
31. T. Pursche, J. Krajewski, and Reinhard Moeller. 2012. Video-based heart rate measurement from human faces. In Consumer Electronics (ICCE), 2012 IEEE International Conference on. IEEE, 544-545.
32. John E Richards and Betty Jo Casey. 1991. Heart rate variability during attention phases in young infants. Psychophysiology 28, 1(1991), 43-53.
33. Neville Anthony Stanton, Alan Hedge, Karel Brookhuis, Eduardo Salas, and Hal W Hendrick. 2004. Estimating Mental Effort Using Heart Rate and Heart Rate Variability. In Handbook of human factors and ergonomicsmethods. CRC Press, 20-1-20-8.
34. Yu Sun, Sijung Hu, Vicente Azorin-Peris, Stephen Greenwald, Jonathon Chambers, and Yisheng Zhu. 2011. Motion-compensated noncontact imaging photoplethysmography to monitor cardiorespiratory status during exercise. Journal of biomedical optics 16, 7(2011), 077010-077010.
35. Wim Verkruysse, Lars O Svaasand, and J. Stuart Nelson. 2008. Remote plethysmographic imaging using ambient light. Optics express 16, 26(2008), 21434-21445.
36. Paul Viola and Michael Jones. 2001. Rapid object detection using a boosted cascade of simple features. In Computer Vision and Pattern Recognition, 2001. CVPR 2001. Proceedings of the 2001 IEEE Computer Society Conference on, Vol. 1. IEEE, I-511.
37. Wenjin Wang, Sander Stuijk, and Gerard de Haan. 2015. Exploiting Spatial Redundancy of Image Sensor for Motion Robust rPPG. Biomedical Engineering, IEEE Transactions on 62, 2(2015), 415-425.
38. Sebastian Zaunseder, Andreas Heinke, Alexander Trumpp, and Hagen Malberg. 2014. Heart beat detection and analysis from videos. In Electronics and Nanotechnology (ELNANO), 2014 IEEE 34th International Conference on. IEEE, 286-290.