Dyadic behavior analysis in depression severity assessment interviews

ICMI 2014 - Proceedings of the 2014 International Conference on Multimodal Interaction

Volumn , Issue , 2014, Pages 112-119

  Scherer, Stefan ^a   Hammal, Zakia ^b   Yang, Ying ^c   Morency, Louis Philippe ^a   Cohn, Jeffrey F ^c  

^a University of Southern California   (United States)

^b CARNEGIE MELLON UNIVERSITY   (United States)

^c UNIVERSITY OF PITTSBURGH   (United States)

Author keywords

Accommodation; Depression; Dyadic interaction; Voice quality

Indexed keywords

ACCOMMODATION; ACOUSTIC CHARACTERISTIC; ACOUSTIC FEATURES; BEHAVIOR ANALYSIS; DEPRESSION; DYADIC INTERACTION; MAJOR DEPRESSIONS; VOICE QUALITY;

INTERACTIVE COMPUTER SYSTEMS;

EID: 84930942617     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2663204.2663238     Document Type: Conference Paper

References (69)

1. Diagnostic and statistical manual of mental disorders. American Psychiatric Association, Washington, DC, 1994.
2. Cmu sphinx: Open source toolkit for speech recognition. Technical report, Carnegie Mellon University, Undated.
3. S. Alghowinem, R. Goecke, M. Wagner, J. Epps, M. Breakspear, and G. Parker. From joyous to clinically depressed: Mood detection using spontaneous speech. In Proceedings of International Florida Artificial Intelligence Research Society Conference (FLAIRS 2012), pages 141{146, 2012.
4. P. Alku, T. Bäckström, and E. Vilkman. Glottal wave analysis with pitch synchronous iterative adaptive inverse fitering. Speech Communication, 11(2-3):109{118, 1992.
5. P. Alku, T. Bäckström, and E. Vilkman. Normalized amplitude quotient for parameterization of the glottal flow. Journal of the Acoustical Society of America, 112(2):701{710, 2002.
6. M. Alpert, E. R. Pouget, and R. R. Silva. Reections of depression in acoustic measures of the patient's speech. Journal of Affective Disorders, 66(1):59{69, 2001.
7. C. Barras, E. Geoffrois, Z. Wu, and M. Liberman. Transcriber: development and use of a tool for assisting speech corpora production. Speech Communication special issue on Speech Annotation and Corpus Tools, 33:5{22, 2001.
8. P. Boersma. Praat, a system for doing phonetics by computer. Glot International, 5(9):341{345, 2001.
9. S. Brennan. Lexical entrainment in spontaneous dialog. Proceedings of ISSD, pages 41{44, 1996.
10. N. Campbell and P. Mokhtari. Voice quality: The 4th prosodic dimension. In Proceedings of the 15th international congress of phonetic sciences (ICPhS'03), pages 2417{2420. ICPhS, 2003.
11. M. Cannizzaro, B. Harel, N. Reilly, P. Chappell, and P. J. Snyder. Voice acoustical measurement of the severity of major depression. Brain and Cognition, 56(1):30{35, 2004.
12. C. d'Alessandro and N. Sturmel. Glottal closure instant and voice source analysis using time-scale lines of maximum amplitude. Sadhana, 36(5):601{622, 2011.
13. J. K. Darby, N. Simmons, and P. A. Berger. Speech and voice parameters of depression: A pilot study. Journal of Communication Disorders, 17(2):75{85, 1984.
14. R. J. Davidson, editor. Anxiety, Depression, and Emotion. Oxford University Press, 2000.
15. C. Looze, S. Scherer, B. Vaughan, and N. Campbell. Investigating automatic measurements of prosodic accommodation and its dynamics in social interaction. Speech Communication, 58:11{34, 2014.
16. G. Degottex, J. Kane, T. Drugman, T. Raitio, and S. Scherer. Covarep - A collaborative voice analysis repository for speech technologies. In Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2014), pages 960{964, 2014.
17. D. DeVault, R. Artstein, G. Benn, T. Dey, E. Fast, A. Gainer, K. Georgilia, J. Gratch, A. Hartholt, M. Lhommet, G. Lucas, S. Marsella, F. Morbini, A. Nazarian, S. Scherer, G. Stratou, A. Suri, D. Traum, R. Wood, Y. Xu, A. Rizzo, and L.-P. Morency. Simsensei: A virtual human interviewer for healthcare decision support. In Proceedings of Autonomous Agents and Multiagent Systems (AAMAS), pages 1061{1068, 2014.
18. T. Drugman and A. Abeer. Joint robust voicing detection and pitch estimation based on residual harmonics. In Proceedings of Interspeech 2011, pages 1973{1976. ISCA, 2011.
19. S. Duncan. Some signals and rules for taking speaking turns in conversations. Journal of Personality and Social Psychology, 23(2):283{292, 1972.
20. R. Elliott, R. Zahn, J. F. W. Deakin, and I. M. Anderson. Affective cognition and its disruption in mood disorders. Neuropsychopharmacology, 36:153{182, 2011.
21. M. B. First, R. L. Spitzer, M. Gibbon, and J. B. W. Williams. Structured clinical interview for DSM-IV axis I disorders. Biometrics Research Department, New York State Psychiatric Institute, New York, patient edition edition, 1995.
22. A. J. Flint, S. E. Black, I. Campbell-Taylor, G. F. G. Gailey, and C. Levinton. Abnormal speech articulation, psychomotor retardation, and subcortical dysfunction in major depression. Journal of Psychiatric Research, 27(3):309{319, 1993.
23. G. N. Foley and J. P. Gentile. Nonverbal communication in psychotherapy. Psychiatry, 7(6):38{44, 2010.
24. J. C. Fournier, R. J. DeRubeis, S. D. Hollon, S. Dimidjian, J. D. Amsterdam, R. C. Shelton, Antidepressant drug effects and depression severity: A patient-level meta-analysis. Journal of the American Medial Association, 303(1):47{53, 2010.
25. D. J. France, R. G. Shiavi, S. E. Silverman, M. K. Silverman, and D. M. Wilkes. Acoustical properties of speech as indicators of depression and suicidal risk. IEEE Transactions on Biomedical Engineering, 47(7):829{837, 2000.
26. R. W. Frick. Communicating emotion: The role of prosodic features. Psychological Bulletin, 97(3):412{429, 1985.
27. H. Giles, N. Coupland, and J. Coupland. Accommodation theory: Communication, context, and consequence. Contexts of accommodation: Developments in applied sociolinguistics, pages 1{68, 1991.
28. J. M. Girard, J. F. Cohn, M. H. Mahoor, S. M. Mavadati, Z. Hammal, and D. P. Rosenwald. Nonverbal social withdrawal in depression: Evidence from manual and automatic analyses. Image and Vision Computing Journal, 2014.
29. C. Gobl and A. N. Chasaide. Amplitude-based source parameters for measuring voice quality. In Proceedings of ISCA Tutorial and Research Workshop on Voice Quality: Functions, Analysis and Synthesis (VOQUAL'03), pages 151{156. ISCA, 2003.
30. C. Gobl and A. NÍ Chasaide. The role of voice quality in communicating emotion, mood and attitude. Speech Communication, 40:189{212, 2003.
31. J. Gratch, R. Artstein, G. Lucas, S. Scherer, A. Nazarian, R. Wood, J. Boberg, D. DeVault, S. Marsella, D. Traum, A. Rizzo, and L.-P. Morency. The distress analysis interview corpus of human and computer interviews. In Proceedings of Language Resources and Evaluation Conference (LREC), 2014.
32. T. Hacki. Klassifizierung von glottisdysfunktionen mit hilfe der elektroglottographie. Folia Phoniatrica, pages 43{48, 1989.
33. J. A. Hall, J. A. Harrigan, and R. Rosenthal. Nonverbal behavior in clinician-patient interaction. Applied and Preventive Psychology, 4(1):21{37, 1995.
34. M. Hamilton. A rating scale for depression. Journal of Neurology and Neurosurgery, 23:56{61, 1960.
35. H. Hanson, K. Stevens, H. Kuo, M. Chen, and J. Slifka. Towards models of phonation. Journal of Phonetics, (29):451{480, 2001.
36. N. Henrich, C. D'Alessandro, and B. Doval. Spectral correlates of voice open quotient and glottal ow asymmetry: Theory, limits and experimental data. Proceedings of EUROSPEECH, Scandanavia, pages 47{50, 2001.
37. S. D. Hollon, M. E. Thase, and J. C. Markowitz. Treatment and prevention of depression. Psychological Science in the Public Interest, 3(2):38{77, 2002.
38. J. Jaffe, B. Beebe, S. Feldstein, C. L. Crown, and M. Jasnow. Rhythms of dialogue in early infancy. Monographs of the Society for Research in Child Development, 66:1{8, 2001.
39. P. N. Juslin and P. Laukka. Communication of emotions in vocal expression and music performance: Different channels, same code? Psychological Bulletin, 129:770{814, 2003.
40. J. Kane and C. Gobl. Identifying regions of non-modal phonation using features of the wavelet transform. Proceedings of Interspeech, Florence, Italy, pages 177{180, 2011.
41. J. Kane and C. Gobl. Wavelet maxima dispersion for breathy to tense voice discrimination. IEEE Transactions on Audio Speech and Language processing, Under Review.
42. J. Kane, S. Scherer, M. Aylett, L.-P. Morency, and C. Gobl. Speaker and language independent voice quality classification applied to unlabelled corpora of expressive speech. In Proceedings of International Conference on Acoustics, Speech, and Signal Processing (ICASSP), pages 7982{7986. IEEE, 2013.
43. D. A. Kenny, L. Mannetti, A. Pierro, S. Livi, and D. A. Kashy. The statistical analysis of data from small groups. Journal of Personality and Social Psychology, 83(1):126{137, 2002.
44. R. Kessler, W. Chiu, O. Demler, and E. E. Walters. Prevalence, severity, and comorbidity of 12-month dsm-iv disorders in the national comorbidity survey replication. Archives of General Psychiatry, 62:617{627, 2005.
45. D. H. Klatt and L. C. Klatt. Analysis, synthesis, and perception of voice quality variations among female and male talkers. Journal of the Acoustical Society of America, 87(2):820{857, 1990.
46. R. Kotov, W. Gamez, F. Schmidt, and D. Watson. Linking big personality traits to anxiety, depressive, and substance use disorders: A meta-analysis. Psychological Bulletin, 136(5):768{821, 2010.
47. J. Leff and E. Abberton. Voice pitch measurements in schizophrenia and depression. Psychological Medicine, 11(4):849{852, 1981.
48. L.-S. Low, N. C. Maddage, M. Lech, L. B. Sheeber, and N. B. Allen. Detection of clinical depression in adolescents? speech during family interactions. IEEE Transactions on Biomedical Engineering, 58(3):574{586, 2010.
49. J. C. Mundt, A. P. Vogel, D. E. Feltner, and W. R. Lenderking. Vocal acoustic biomarkers of depression severity and treatment response. Biological Psychiatry, 72(7):580{587, 2012.
50. A. Nilsonne. Speech characteristics as indicators of depressive illness. Acta Psychiatrica Scandinavica, 77(3):253{263, 1988.
51. J. P. O'Reardon, P. Cristancho, and A. D. Peshek. Vagus nerve stimulation (vns) and treatment of depression: To the brainstem and beyond. Psychiatry, 3(5):54{63, 2006.
52. W. H. Organization. The global burden of disease: 2004 update. World Health Organization, 2008.
53. J. Pardo. On phonetic convergence during conversational interaction. The Journal of the Acoustical Society of America, 119:2382, 2006.
54. A. Pentland. Honest signals: How they shape our world. MIT Press, Cambridge, 2008.
55. B. S. Reed. Speech rythm across turn transitions in cross-cultural talk-in-interaction. Journal of Pragmatics, 42(4):1037{1059, 2010.
56. A. D. Rubin and R. T. Sataloff. Vocal fold paresis and paralysis. Otolaryngologic Clinics of North America, 40(5):1109{1131, 2007.
57. S. Scherer, J. Kane, C. Gobl, and F. Schwenker. Investigating fuzzy-input fuzzy-output support vector machines for robust voice quality classification. Computer Speech and Language, 27(1):263{287, 2013.
58. S. Scherer, J. P. Pestian, and L.-P. Morency. Investigating the speech characteristics of suicidal adolescents. In Proceedings of International Conference on Acoustics, Speech, and Signal Processing (ICASSP), pages 709{713. IEEE, 2013.
59. S. Scherer, G. Stratou, J. Gratch, and L.-P. Morency. Investigating voice quality as a speaker-independent indicator of depression and ptsd. In Proceedings of Interspeech 2013, pages 847{851. ISCA, 2013.
60. D. Schrijvers, W. Hulstijn, and B. G. Sabbe. Psychomotor symptoms in depression: A diagnostic, pathophysiological and therapeutic tool. Journal of A-ective Disorders, 109(1-2):1{20, 2008.
61. B. Schuller, A. Batliner, S. Steidl, and D. Seppi. Recognising realistic emotions and affect in speech: State of the art and lessons learned from the first challenge. Speech and Communication, 53(9/10):1062{1087, 2010.
62. T. Shimizu, N. Furuse, T. Yamazaki, Y. Ueta, T. Sato, and S. Nagata. Chaos of vowel/a/in japanese patients with depression: A preliminary study. Journal of Occupational Health, 47(3):267{269, 2005.
63. C. Sobin and H. A. Sackheim. Psychomotor symptoms of depression. American Journal of Psychiatry, 154(1):4{17, 1997.
64. R. Timcke, H. von Leden, and P. Moore. Laryngeal vibrations: measurements of the glottic wave. Part 1: The normal vibratory cycle. Archives of Otolaryngology - Head and Neck surgery, 68(1):1{19, 1958.
65. J. R. Williamson, T. F. Quatieri, B. S. Helfer, R. Horwitz, B. Yu, and D. D. Mehta. Vocal biomarkers of depression based on motor incoordination. In Proceedings of the 3rd ACM international workshop on Audio/visual emotion challenge, AVEC '13, pages 41{48. ACM, 2013.
66. Y. Yang, C. Fairbairn, and J. F. Cohn. Detecting depression severity from vocal prosody. IEEE Transactions on A-ective Computing, 4(2):142{150, 2013.
67. M. Yarczower, J. E. Kilbride, and A. T. Beck. Changes in nonverbal behavior of therapists and depressed patients during cognitive therapy. Psychological Reports, 69(3):915{919, 1991.
68. Z. Zeng, M. Pantic, G. Roisman, and T. S. Huang. A survey of affect recognition methods: Audio, visual, and spontaneous expressions. IEEE Transactions Pattern Analysis and Machine Intelligence, 31(1):31{58, 2009.
69. A. J. Zlochower and J. F. Cohn. Vocal timing in face-to-face interaction of clinically depressed and nondepressed mothers and their 4-month-old infants. Infant Behavior and Development, 19:373{376, 1996.