Smartphone application for the analysis of prosodic features in running speech with a focus on bipolar disorders: System performance evaluation and case study

Sensors (Switzerland)

Volumn 15, Issue 11, 2015, Pages 28070-28087

  Guidi, Andrea ^a   Salvi, Sergio ^b   Ottaviano, Manuel ^b   Gentili, Claudio ^a,c   Bertschy, Gilles ^d   de Rossi, Danilo ^a   Scilingo, Enzo Pasquale ^a   Vanello, Nicola ^a  

^a UNIVERSITY OF PISA   (Italy)

^b UNIVERSIDAD POLITÉCNICA DE MADRID   (Spain)

^c UNIVERSITY OF PADOVA   (Italy)

^d UNIVERSITY HOSPITAL OF STRASBOURG   (France)

Author keywords

Bipolar disorders; Fundamental frequency; Pitch strength; Smartphone application; Voice monitoring system; Voice segmentation

Indexed keywords

ARTIFICIAL INTELLIGENCE; AUDIO RECORDINGS; DECISION SUPPORT SYSTEMS; MONITORING; NATURAL FREQUENCIES; SIGNAL ENCODING; SMARTPHONES; SPEECH;

BIPOLAR DISORDER; FUNDAMENTAL FREQUENCIES; MONITORING SYSTEM; PITCH STRENGTH; SMART-PHONE APPLICATIONS;

QUALITY CONTROL;

ADULT; BIPOLAR DISORDER; DEVICES; FEMALE; HUMAN; MALE; MOBILE APPLICATION; PATHOPHYSIOLOGY; PHYSIOLOGIC MONITORING; PHYSIOLOGY; PILOT STUDY; PROCEDURES; SMARTPHONE; SPEECH; VOICE;

ADULT; BIPOLAR DISORDER; FEMALE; HUMANS; MALE; MOBILE APPLICATIONS; MONITORING, PHYSIOLOGIC; PILOT PROJECTS; SMARTPHONE; SPEECH; VOICE;

EID: 84946605577     PISSN: 14248220     EISSN: None     Source Type: Journal    
DOI: 10.3390/s151128070     Document Type: Article

References (34)

1. Cardoso, T.; Bauer, I.; Meyer, T.; Kapczinski, F.; Soares, J. Neuroprogression and Cognitive Functioning in Bipolar dDisorder: A Systematic Review. Curr. Psychiatry Rep. 2015, 17, 75.
2. Hasler, G.; Wolf, A. Toward stratified treatments for bipolar disorders. Eur. Neuropsychopharmacol. 2015, 25, 283-294.
3. Riva, G.; Baños, R.; Botella, C.; Gaggioli, A.; Wiederhold, B.K. Personal health systems for mental health: The European projects. Stud. Health Technol. Inform. 2011, 163, 496-502.
4. Quraishi, S.; Frangou, S. Neuropsychology of bipolar disorder: A review. J. Affect. Disord. 2002, 72, 209-226.
5. Merikangas, K.; Jin, R.; He, J.P.; Kessler, R.; Lee, S.; Sampson, N.; Viana, M.; Andrade, L.; Hu, C.; Karam, E et al. Prevalence and correlates of bipolar spectrum disorder in the World Mental Health Survey Initiative. Arch. Gen. Psychiatry 2011, 68, 241-251.
6. Ketter, T. Strategies for monitoring outcomes in patients with bipolar disorder. Prim. Care Companion J. Clin. Psychiatry 2010, 12, 10-16.
7. Schärer, L.; Hartweg, V.; Valerius, G.; Graf, M.; Hoern, M.; Biedermann, C.; Walser, S.; Boensch, A.; Dittmann, S.; Forsthoff, A. et al. Life charts on a palmtop computer: First results of a feasibility study with an electronic diary for bipolar patients. Bipolar Disord. 2002, 4, 107-108.
8. Paradiso, R.; Bianchi, A.; Lau, K.; Scilingo, E. PSYCHE: Personalised monitoring systems for care in mental health. In Proceedings of the 2010 Annual International Conference of the IEEE on Engineering in Medicine and Biology Society (EMBC), Buenos Aires, Argentina, 31 August-4 September 2010; pp. 3602-3605.
9. Mayora, O.; Arnrich, B.; Bardram, J.; Drager, C.; Finke, A.; Frost, M.; Giordano, S.; Gravenhorst, F.; Grunerbl, A.; Raring, C. et al. Personal health systems for bipolar disorder anecdotes, challenges and lessons learnt from monarca project. In Proceedings of the 2013 7th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth), Venice, Italy, 5-8 May 2013, pp. 424-429.
10. Botella, C.; Moragrega, I.; Baños, R.; García-Palacios, A. Online predictive tools for intervention in mental illness: The OPTIMI project. Stud. Health Technol. Inform. 2011, 163, 86-92.
11. Park, C.K.; Lee, S.; Park, H.J.; Baik, Y.S.; Park, Y.B.; Park, Y.J. Autonomic function, voice, and mood states. Clin. Auton. Res. 2011, 21, 103-110.
12. Scherer, K.R. Expression of emotion in voice and music. J. Voice 1995, 9, 235-248.
13. Cummins, N.; Scherer, S.; Krajewski, J.; Schnieder, S.; Epps, J.; Quatieri, T.F. A review of depression and suicide risk assessment using speech analysis. Speech Commun. 2015, 71, 10-49.
14. Low, L.S.A.; Maddage, N.C.; Lech, M.; Sheeber, L.B.; Allen, N.B. Detection of clinical depression in adolescents’ speech during family interactions. IEEE Trans. Biomed. Eng. 2011, 58, 574-586.
15. Cannizzaro, M.; Harel, B.; Reilly, N.; Chappell, P.; Snyder, P.J. Voice acoustical measurement of the severity of major depression. Brain Cogn. 2004, 56, 30-35.
16. Moore, E.; Clements, M.; Peifer, J.W.; Weisser, L. Critical analysis of the impact of glottal features in the classification of clinical depression in speech. IEEE Trans. Biomed. Eng. 2008, 55, 96-107.
17. Ozdas, A.; Shiavi, R.G.; Silverman, S.E.; Silverman, M.K.; Wilkes, D.M. Investigation of vocal jitter and glottal flow spectrum as possible cues for depression and near-term suicidal risk. IEEE Trans. Biomed. Eng. 2004, 51, 1530-1540.
18. Vanello, N.; Guidi, A.; Gentili, C.; Werner, S.; Bertschy, G.; Valenza, G.; Lanata, A.; Scilingo, E.P. Speech analysis for mood state characterization in bipolar patients. In Proceedings of the 2012 Annual International Conference of the IEEE on Engineering in Medicine and Biology Society (EMBC), San Diego, CA, USA, 28 August-1 September 2012; pp. 2104-2107.
19. Vásquez Correa, J.C.; Orozco Arroyave, J.R.; Arias-Londoño, J.D.; Vargas Bonilla, J.F.; Noth, E. New computer aided device for real time analysis of speech of people with Parkinson’s disease. Rev. Fac. Ing. 2014, 72, 87-103.
20. Carullo, A.; Vallan, A.; Astolfi, A. Design issues for a portable vocal analyzer. IEEE Trans. Instrum. Meas. 2013, 62, 1084-1093.
21. Mehta, D.D.; Zañartu, M.; Feng, S.W.; Cheyne, H.A.; Hillman, R.E. Mobile voice health monitoring using a wearable accelerometer sensor and a smartphone platform. IEEE Trans. Biomed. Eng. 2012, 59, 3090-3096.
22. Popolo, P.S.; Svec, J.G.; Titze, I.R. Adaptation of a Pocket PC for use as a wearable voice dosimeter. J. Speech Lang. Hear. Res. 2005, 48, 780-791.
23. Karam, Z.N.; Provost, E.M.; Singh, S.; Montgomery, J.; Archer, C.; Harrington, G.; Mcinnis, M.G. Ecologically valid long-term mood monitoring of individuals with bipolar disorder using speech. In Proceedings of the 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Florence, Italy, 4-9 May 2014; pp. 4858-4862.
24. Camacho, A.; Harris, J.G. A sawtooth waveform inspired pitch estimator for speech and music. J. Acoust. Soc. Am. 2008, 124, 1638-1652.
25. Lanata, A.; Valenza, G.; Nardelli, M.; Gentili, C.; Scilingo, E.P. Complexity index from a personalized wearable monitoring system for assessing remission in mental health. IEEE J. Biomed. Health Inf. 2015, 19, 132-139.
26. Tsanas, A.; Zañartu, M.; Little, M.A.; Fox, C.; Ramig, L.O.; Clifford, G.D. Robust fundamental frequency estimation in sustained vowels: Detailed algorithmic comparisons and information fusion with adaptive Kalman filtering. J. Acoust. Soc. Am. 2014, 135, 2885-2901.
27. Camacho, A. Detection of Pitched/Unpitched Sound using Pitch Strength Clustering. In Proceedings of the 9th International Conference on Music Information Retrieval (ISMIR), Philadelphia, PA, USA, 14-18 September 2008; pp. 533-537.
28. Gorman, K. Swipe. Available online: https://github.com/kylebgorman/swipe/blob/master/swipe.c(accessed on 24 July 2015).
29. Liang, S. Java Native Interface: Programmer’s Guide and Reference; Addison-Wesley: Boston, MA, USA, 1999.
30. Frigo, M.; Johnson, S.G. The design and implementation of FFTW3. IEEE Proc. 2005, 93, 216-231.
31. De Castro Lopo, E. Libsndfile. Available online: http://www.mega-nerd.com/libsndfile/ (accessed on 24 July 2015).
32. Guidi, A.; Vanello, N.; Bertschy, G.; Gentili, C.; Landini, L.; Scilingo, E. Automatic analysis of speech F0 contour for the characterization of mood changes in bipolar patients. Biomed. Signal Proc. Control 2015, 17, 29-37.
33. Vanello, N.; Martini, N.; Milanesi, M.; Keiser, H.; Calisti, M.; Bocchi, L.; Manfredi, C.; Landini, L. Evaluation of a pitch estimation algorithm for speech emotion recognition. In Proceedings of the 6th International Workshop on Models and Analysis of Vocal Emissions for Biomedical Applications (MAVEBA 2009), Firenze, Italy, 14-16 December 2009; pp. 29-32.
34. Bauer, M.S.; Crits-Christoph, P.; Ball, W.A.; Dewees, E.; McAllister, T.; Alahi, P.; Cacciola, J.; Whybrow, P.C. Independent assessment of manic and depressive symptoms by self-rating: Scale characteristics and implications for the study of mania. Arch. Gen. Psychiatry 1991, 48, 807-812.