StressSense: Detecting stress in unconstrained acoustic environments using smartphones

UbiComp'12 - Proceedings of the 2012 ACM Conference on Ubiquitous Computing

Volumn , Issue , 2012, Pages 351-360

  Lu, Hong ^a   Rabbi, Mashfiqui ^b   Chittaranjan, Gokul T ^c   Frauendorfer, Denise ^d   Mast, Marianne Schmid ^d   Campbell, Andrew T ^e   Gatica Perez, Daniel ^f   Choudhury, Tanzeem ^b  

^a INTEL CORPORATION   (United States)

^b Department of Obstetrics Gynecology   (United States)

^c EPFL   (Switzerland)

^d UNIVERSITY OF NEUCHÂTEL   (Switzerland)

^e DARTMOUTH COLLEGE   (United States)

^f IDIAP RESEARCH INSTITUTE   (Switzerland)

Author keywords

Mhealth; Model adaptation; Sensing; Stress; User modeling

Indexed keywords

ACOUSTIC ENVIRONMENT; ADVERSE EFFECT; FIRST SYSTEMS; HUMAN VOICE; MHEALTH; MODEL ADAPTATION; OUTDOOR ENVIRONMENT; SENSING; SPEECH PRODUCTION; STRESS DETECTION; STRESS MODELS; USER MODELING;

STRESSES; UBIQUITOUS COMPUTING;

SMARTPHONES;

EID: 84867454858     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2370216.2370270     Document Type: Conference Paper

References (37)

1. http://www.apa.org/pubs/info/reports/2007-stress.doc.
2. S. Cohen, R.C. Kessler, and L.U. Gordon. Measuring stress: A guide for health and social scientists. Oxford University Press, USA, 1997.
3. A. Perkins. Saving money by reducing stress. Harvard Business Review, 72(6):12, 1994.
4. Michael H. L. Hecker, Kenneth N. Stevens, Gottfried von Bismarck, and Carl E. Williams. Manifestations of Task-Induced Stress in the Acoustic Speech Signal. The Journal of the Acoustical Society of America, 44(4):993-1001, 1968.
5. K.R. Scherer. Vocal affect expression: A review and a model for future research. Psychological Bulletin, 99(2):143-165, 1986.
6. K.R. Scherer. Dynamics of stress: Physiological, psychological and social perspectives, chapter 9: Voice, Stress, and Emotion, pages 157-179. Plenum Press, New York, 1986.
7. F.J. Tolkmitt and K.R. Scherer. Effect of experimentally induced stress on vocal parameters. Journal of Experimental Psychology: Human Perception and Performance, 12(3):302-313, 1986.
8. Allen D. Kanner, James C. Coyne, Catherine Schaefer, and Richard S. Lazarus. Comparison of two modes of stress measurement: Daily hassles and uplifts versus major life events. Journal of Behavioral Medicine, 4(1):1-39, 1981.
9. John H. L. Hansen. SUSAS. Linguistic Data Consortium, Philadelphia, 1999.
10. H. Teager. Some Observations on Oral Air Flow During Phonation. Acoustics, Speech and Signal Processing, IEEE Transactions on, 28(5):599-601, 1980.
11. J.F. Kaiser. Some Useful Properties of Teager's Energy Operators. In Proc. ICASSP '93, volume 3, pages 149-152, 1993.
12. G. Zhou, J.H.L. Hansen, and J.F. Kaiser. Nonlinear feature based classification of speech under stress. Speech and Audio Processing, IEEE Transactions on, 9(3):201-216, 2001.
13. Raul Fernandez and Rosalind W. Picard. Modeling drivers' speech under stress. Speech Communication, 40(1-2):145-159, 2003.
14. SA Patil. Detection of speech under physical stress: Model development, sensor selection, and feature fusion. 2008.
15. Drew Fisher, Keng-hao Chang and John Canny. Ammon: A speech analysis library for analyzing affect, stress, and mental health on mobile phones. In Proceedings of PhoneSense 2011, 2011.
16. Kiran K. Rachuri, Mirco Musolesi, Cecilia Mascolo, Peter J. Rentfrow, Chris Longworth, and Andrius Aucinas. EmotionSense: A Mobile Phones based Adaptive Platform for Experimental Social Psychology Research. In Proc. UbiComp '10, pages 281-290, 2010.
17. K.R. Scherer, D. Grandjean, T. Johnstone, G. Klasmeyer, and T. Bänziger. Acoustic correlates of task load and stress. In Proc. ICSLP2002, pages 2017-2020, 2002.
18. S. Basu. A linked-hmm model for robust voicing and speech detection. In Acoustics, Speech, and Signal Processing, 2003. Proceedings.(ICASSP'03). 2003 IEEE International Conference on, volume 1, pages I-816. IEEE, 2003.
19. D. Wyatt, T. Choudhury, and J. Bilmes. Conversation detection and speaker segmentation in privacy sensitive situated speech data. In Proceedings of Interspeech, pages 586-589. Citeseer, 2007.
20. T. Choudhury and S. Basu. Modeling conversational dynamics as a mixed memory markov process. In Proc. of Intl. Conference on Neural Information and Processing Systems (NIPS). Citeseer, 2004.
21. J.P. Henry. Stress, neuroendocrine patterns, and emotional response. 1990.
22. K.R. Scherer. Voice, stress, and emotion. Dynamics of stress: Physiological, psychological and social perspectives, pages 157-179, 1986.
23. Robert Ruiz, Emmanuelle Absil, Bernard Harmegnies, Claude Legros, and Dolors Poch. Time- and spectrum-related variabilities in stressed speech under laboratory and real conditions. Speech Communication, 20(1-2):111 - 129, 1996.
24. J.H.L. Hansen. Analysis and compensation of speech under stress and noise for environmental robustness in speech recognition. Speech communication, 20(1-2):151-173, 1996.
25. William A Jones Jr and Air Force Inst of Tech Wright-pattersonafb School of Engineer An Evaluation of Voice Stress Analysis Techniques in a Simulated AWACS Environment, 1990.
26. Lambert M Surhone, Miriam T Timpledon, and Susan F Marseken. Voice Stress Analysis, jul 2010.
27. N Morgan and E Fosler. Speech recognition using on-line estimation of speaking rate. Conference on Speech, 1997.
28. John Hansen and Sanjay Patil. Speech under stress: Analysis, modeling and recognition. In Christian M̈ller, editor, Speaker Classification I, volume 4343 of Lecture Notes in Computer Science, pages 108-137. Springer Berlin/Heidelberg, 2007.
29. John H L Hansen, Wooil Kim, Mandar Rahurkar, Evan Ruzanski, and James Meyerhoff. Robust Emotional Stressed Speech Detection Using Weighted Frequency Subbands. EURASIP Journal on Advances in Signal Processing, 2011:1-10, 2011.
30. J. Saunders. Real-time discrimination of broadcast speech/music. In Acoustics, Speech, and Signal Processing, 1996. ICASSP-96. Conference Proceedings., 1996 IEEE International Conference on, volume 2, pages 993-996. IEEE, 1996.
31. H. Lu, A. Bernheim Brush, B. Priyantha, A. Karlson, and J. Liu. Speakersense: Energy efficient unobtrusive speaker identification on mobile phones. Pervasive 2011, pages 188-205, 2011.
32. D.A. Reynolds and R.C. Rose. Robust text-independent speaker identification using gaussian mixture speaker models. Speech and Audio Processing, IEEE Transactions on, 3(1):72-83, 1995.
33. D. Yarowsky. Unsupervised word sense disambiguation rivaling supervised methods. In Proceedings of the 33rd annual meeting on Association for Computational Linguistics, pages 189-196. Association for Computational Linguistics, 1995.
34. Douglas A. Reynolds, Thomas F. Quatieri, and Robert B. Dunn. Speaker Verification Using Adapted Gaussian Mixture Models. Digital Signal Processing, 10(1-3):19-41, 2000.
35. M.A. Hall and G. Holmes. Benchmarking attribute selection techniques for discrete class data mining. IEEE Transactions on Knowledge and Data engineering, pages 1437-1447, 2003.
36. R.E. Donovan. Trainable speech synthesis. Univ. Eng. Dept, page 164, 1996.
37. N. Morgan, E. Fosler, and N. Mirghafori. Speech recognition using on-line estimation of speaking rate. In Fifth European Conference on Speech Communication and Technology, 1997.