Leveraging Multi-Modal Sensing for Mobile Health: A Case Review in Chronic Pain

IEEE Journal on Selected Topics in Signal Processing

Volumn 10, Issue 5, 2016, Pages 962-974

  Aung, Min S Hane ^a   Alquaddoomi, Faisal ^b   Hsieh, Cheng Kang ^b   Rabbi, Mashfiqui ^a   Yang, Longqi ^c   Pollak, J P ^c   Estrin, Deborah ^c   Choudhury, Tanzeem ^c  

^a Social Dynamics Laboratory   (United States)

^b Engineering IV   (United States)

^c Jacobs Technion Cornell Institute   (United States)

Author keywords

Activity monitoring; affective computing; audio sensing; behavioral signal processing; chronic pain; face expression; mobile health; mobile sensing; modular architecture; self reporting; smartphones; survey; wearable technology

Indexed keywords

FEEDBACK; IMAGE PROCESSING; SIGNAL PROCESSING; SMARTPHONES; SURVEYING; WEARABLE TECHNOLOGY;

ACTIVITY MONITORING; AFFECTIVE COMPUTING; AUDIO SENSING; CHRONIC PAIN; FACE EXPRESSIONS; MOBILE HEALTH; MOBILE SENSING; MODULAR ARCHITECTURES; SELF-REPORTING;

HEALTH;

EID: 84982746742     PISSN: 19324553     EISSN: None     Source Type: Journal    
DOI: 10.1109/JSTSP.2016.2565381     Document Type: Article

References (125)

1. D. Estrin and I. Sim, "Open mHealth architecture: An engine for health care innovation," Science, vol. 330, no. 6005, pp. 759-760, 2010.
2. W. Nilsen, S. Kumar, A. Shar, C. Varoquiers, T. Wiley, W. T. Riley, and A. A. Atienza, "Advancing the science of mHealth," J. Health Commun., vol. 17, no. sup1, pp. 5-10, 2012.
3. C. Eccleston, "Role of psychology in pain management," Brit. J. Anaesth., vol. 87, no. 1, pp. 144-152, 2001.
4. H. Merskey and N. Bogduk, Classification of Chronic Pain. Seattle,WA, USA: International Association for the Study of Pain Press, vol. 210, 1994.
5. H. Merskey, "The taxonomy of pain," Med. Clin. North Amer., vol. 91, no. 1, pp. 13-20, 2007.
6. J. D. Loeser and R. Melzack, "Pain: An overview," The Lancet, vol. 353, no. 9164, pp. 1607-1609, 1999.
7. F. J. Keefe and A. R. Block, "Development of an observation method for assessing pain behaviour in chronic low back pain patients," Behav. Ther., vol. 13, no. 4, pp. 363-375, 1982.
8. W. Fordyce, Behavioural Method for Chronic Pain and Illness. St. Louis, MO, USA: Mosby, 1976.
9. M. J. L. Sullivan, P. Thibault, A. Savard, R. Catchlove, J. Kozey, and W. D Stanish, "The influence of communication goals and physical demands on different dimensions of pain behavior," Pain, vol. 125, pp. 270-277, 2006.
10. S. Narayanan and P. G. Georgiou, "Behavioral signal processing: Deriving human behavioral informatics from speech and language," Proc. IEEE, vol. 101, no. 5, pp. 1203-1233, May 2013.
11. M. Pantic, A. Pentland, A. Nijholt, and T. S. Huang, "Human computing and machine understanding of human behavior: A survey," in Artificial Intelligence for Human Computing. Berlin, Germany: Springer, pp. 47-71, 2007.
12. Z. Zeng, M. Pantic, G. I. Roisman, and T. S. Huang, "A survey of affect recognitionmethods:Audio, visual, and spontaneous expressions," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 1, pp. 39-58, Jan. 2009.
13. E. Vyzas and R. W. Picard, "Affective pattern classification," in Proc. Assoc. Adv. Artif. Intell. Fall Symp. Ser.: Emotional Intelligent: Tangled Knot Cognit., pp. 176-182, 1998.
14. M. S. H. Aung, S. Kaltwang, B. Romera-Paredes, B. Martinez, A. Singh, M. Cella, M. Valstar, H. Meng, A. Kemp, M. Shafizadeh, A. C. Elkins, N. Kanakam, A. de. Rothschild, N. Tyler, P. J. Watson, A. C. de C. Williams, M. Panitc, N. Bianchi-Berthouze et al., "The automatic detection of chronic pain-related expression: requirements, challenges and the multimodal EmoPain dataset," in IEEE Transactions on Affective Computing, to appear.
15. J. W. S. Vlaeyen and S. J. Linton, "Fear-avoidance and its consequences in chronic musculoskeletal pain: A state of the art," Pain, vol. 85, no. 3, pp. 317-332, 2000.
16. S. Felipe, A. Singh, C. Bradley, A. Williams, and N. Bianchi-Berthouze, "Roles for personal informatics in chronic pain," in Proc. Int. Conf. Pervasive Comput. Technol. Healthcare, vol. 15, 2015, pp. 161-168.
17. M. P. Jensen, J. A. Turner, and J. M. Romano, "Changes after multidisciplinary pain treatment in patient pain beliefs and coping are associated with concurrent changes in patient functioning," Pain, vol. 131, no. 1/2, pp. 38-47, Sep. 2007.
18. P. Rainville, Q. V. H. Bao, and P. Chrétien, "Pain-related emotions modulate experimental pain perception and autonomic responses," Pain, vol. 118, no. 3, pp. 306-318, 2005.
19. W. C. King and D. S Bond. "The importance of pre and postoperative physical activity counseling in bariatric surgery," Exercise Sport Sci. Rev. vol. 41, no. 1, pp. 26-35, 2013.
20. D. M. Bravata, C. Smith-Spangler, V. Sandaram, A. L. Gienger, N. Lin, R. Lewis, C. D. Stave, I. Olkin, and J. R. Sirard, "Using pedometers to increase physical activity and improve health: A systematic review," JAMA, vol. 298, no. 19, pp. 2296-2304, 2007.
21. C. J. Greaves, K. E. Sheppard, C. Abraham, W. Hardeman, M. Roden, P. H. Evans, and P. Schwarz, "Systematic review of reviews of intervention components associated with increased effectiveness in dietary and physical activity interventions," BMC Public Health, vol. 11, no. 1, 2011.
22. M. S. Patel, D. A. Asch, and K. G. Volpp. "Wearable devices as facilitators, not drivers, of health behavior change," JAMA, vol. 313, no. 5, pp. 459-460, 2015.
23. C. R. Richardson, T. L. Newton, J. J. Abraham, A. Sen, M. Jimbo, A. M Swartz, "A meta-analysis of pedometer-based walking interventions and weight loss," Ann. Family Med. vol. 6, no. 1, pp. 69-77, 2008.
24. H. H. Dodge, N. C. Mattek, D. Austin, T. L. Hayes, and J. A. Kaye, "In-home walking speeds and variability trajectories associated with mild cognitive impairment," Neurology, vol. 78, no. 24, pp. 1946-1952, 2012.
25. J. Bort-Roig, N. D. Gilson, A. Puig-Ribera, R. S. Contreras, and S. G. Trost, "Measuring and influencing physical activity with smartphone technology: A systematic review," Sports Med., vol. 44, no. 5, pp. 671-686, 2014.
26. M. A. Case, H. A Burwick, K. G. Volpp, and M. S. Patel, "Accuracy of smartphone applications and wearable devices for tracking physical activity data," JAMA, vol. 313, no. 6, pp. 625-626, 2015.
27. N. D. Lane, E. Miluzzo, H. Lu, D. Peebles, T. Choudhury, and A. T. Campbell, "A survey of mobile phone sensing," IEEE Commun. Mag., vol. 48, no. 9, pp. 140-150, Sep. 2010.
28. T. Sohn, A. Varshavsky, A. LaMarca, M. Y. Chen, T. Choudhury, I. Smith, and E. De Lara, "Mobility detection using everyday GSM traces," in UbiComp 2006: Ubiquitous Computing. Berlin, Germany: Springer, pp. 212-224, 2006.
29. P. Say, D. M. Stein, J. S. Ancker, A. Hsieh, J. P. Pollak, and D. Estrin, "Smartphone data in rheumatoid arthritis-What do rheumatologists want?" in Proc. AMIA Annu. Symp., Nov. 2015, pp. 1130-1139.
30. H. Tangmunarunkit, C. K. Hsieh, B. Longstaff, S. Nolen, J. Jenkins, C. Ketcham, J. Selsky, F. Alquaddoomi, D. George, J. Kang, Z. Khalapyan, J. Ooms, N. Ramanathan, and D. Estrin, "Ohmage: A general and extensible end-to-end participatory sensing platform," ACM Trans. Intell. Syst. Tech., vol. 6, no. 3, article 38, 2015.
31. B. Longstaff, S. Reddy, and D. Estrin, "Improving activity classification for health applications on mobile devices using active and semisupervised learning," in Proc. Pervasive Comput. Technol. Healthcare, 2010, pp. 1-7.
32. L. R. Welch, "Hidden Markov models and the Baum-Welch algorithm," IEEE Inf. Theory Soc. Newslett., vol. 53, no. 4, pp. 10-13, Dec. 2003.
33. L. Liao, D. Fox, and H. Kautz, "Extracting places and activities from gps traces using hierarchical conditional random fields," Int. J. Robot. Res., vol. 26, no. 1, pp. 119-134, 2007.
34. Y. C. Cheng, Y. Chawathe, A. LaMarca, and J. Krumm, "Accuracy characterization for metropolitan-scale Wi-Fi localization," in Proc. 3rd Int. Conf. Mobile Syst., Appl. Services, 2005, pp. 233-245.
35. Y. Lou, C. Zhang, Y. Zheng, X. Xie, W. Wang, and Y. Huang, "Mapmatching for low-sampling-rate GPS trajectories," in Proc. 17th ACM SIGSPATIAL Int. Conf. Adv. Geographic Inform. Syst., 2009, pp. 352-361.
36. C. Hsieh, H. Tangmunarunkit, F. Alquaddoomi, J. Jenkins, J. Kang, C. Ketcham, B. Longstaff, J. Selsky, B. Dawson, D. Swendeman, D. Estrin, and N. Ramanathan, "Lifestreams: A modular sense-making toolset for identifying important patterns from everyday life," in Proc. 11th ACM Conf. Embedded Netw. Sensor Syst., 2013, vol. 11, no. 5.
37. F. Weninger, M. Wöllmer, and B. Schuller, "Emotion recognition in naturalistic speech and language-A survey," Emotion Recog., A Pattern Anal. Approach, pp. 237-267, 2014.
38. P. Rockwell, "Lower, slower, louder: Vocal cues of sarcasm," J. Psycholinguistic Res., vol. 29, no. 5, pp. 483-495, 2000.
39. J. H. Hansen, W. Kim, M. Rahurkar, E. Ruzanski, and J. Meyerhoff, "Robust emotional stressed speech detection using weighted frequency subbands," EURASIP J. Adv. Signal Process., vol. 1, pp. 1-10, 2011.
40. M. Lai, Y. Chen,M. Chu, Y. Zhao, and F. Hu, "A hierarchical approach to automatic stress detection in English sentences," in Proc. Acoust. Speech, Signal Process., 2006, vol. 1, pp. I-753-I-756.
41. M. Grimm, K. Kroschel, E. Mower, and S. Narayanan, "Primitives-based evaluation and estimation of emotions in speech," Speech Commun., vol. 49, no. 10, pp. 787-800, 2007.
42. Y. Yang, C. Fairbairn, and J. F. Cohn, "Detecting depression severity from vocal prosody," IEEE Trans. Affective Comput., vol. 4, no. 2, pp. 142-150, Apr./Jun. 2013.
43. M. Rabbi, S. Ali, T. Choudhury, and E. Berke, "Passive and in-situ assessment of mental and physical well-being using mobile sensors," in Proc. 13th Int. Conf. Ubiquitous Comput., 2011, pp. 385-394.
44. B. A. Arnow, E. M. Hunkeler, C. M. Blasey, J. Lee, M. J. Constantino, B. Fireman, H. C. Kraemer, R. Dea, R. Robinson, and C. Hayward, "Comorbid depression, chronic pain, and disability in primary care," Psychosomatic Med., vol. 68, no. 2, pp. 262-268, 2006.
45. D. M. Ehde, T. M. Dillworth, and J. A. Turner, "Cognitive-behavioral therapy for individuals with chronic pain: Efficacy, innovations, and directions for research," Amer. Psychologist, vol. 69, no. 2, pp. 153-166, 2014.
46. J. A. Turner, S. Holtzman, and L. Mancl, "Mediators, moderators, and predictors of therapeutic change in cognitive-behavioral therapy for chronic pain," Pain, vol. 127, no. 3, pp. 276-286, 2007.
47. G. Saon, S. Thomas, H. Soltau, S. Ganapathy, and B. Kingsbury, "The IBM speech activity detection system for the DARPA RATS program," in Proc. INTERSPEECH, 2013, pp. 3497-3501.
48. S. Thomas, G. Saon, M. Van Segbroeck, and S. S. Narayanan, "Improvements to the IBM speech activity detection system for the DARPA RATS program," in Proc. IEEE Int. Conf. Acoust., Speech Signal Process., 2015, pp. 4500-4504.
49. H. Lu, Hong, J. Yang, Z. Liu, N. D. Lane, T. Choudhury, and A. T. Campbell, "The Jigsaw continuous sensing engine for mobile phone applications," in Proc. 8th ACM Conf. Embedded Netw. Sensor Syst., 2010, pp. 71-84.
50. S. Basu, "Conversational scene analysis," Ph.D. dissertation, Massachusetts Inst. Technol., Cambridge, MA, USA, 2002.
51. M. D. Wyatt, "Measuring and modeling networks of human social behavior," Ph.D. dissertation , Univ. Washington, Washington, DC, USA, 2010.
52. T. Choudhury et al., "Themobile sensing platform: An embedded activity recognition system," IEEE Pervasive Comput., vol. 7, no. 2, pp. 32-41, Apr./Jun. 2008.
53. T. K. Choudhury, "Sensing and modeling human networks," Ph.D. dissertation, Massachusetts Inst. Technol., Cambridge, MA, USA, 2003.
54. D. Wyatt, T. Choudhury, , J. Bilmes, and J. A. Kitts, "Inferring colocation and conversation networks from privacy-sensitive audio with implications for computational social science," ACM Trans. Intell. Syst. Technol., vol. 2, no. 1, 2011, Art. no. 7.
55. H. Lu, A. J. Brush, B. Priyantha, A. K. Karlson, and J. Liu, "SpeakerSense: Energy efficient unobtrusive speaker identification on mobile phones," in Pervasive Computing. Berlin, Germany: Springer, 2011, pp. 188-205.
56. H. Lu, D. Frauendorfer, M. Rabbi, M. Schmid Mast, G. T. Chittaranjan, A. T. Campbell, D. Gatica-Perez, and T. Choudhury, "StressSense: Detecting stress in unconstrained acoustic environments using smartphones," in Proc. ACM Conf. Ubiquitous Comput., 2012, pp. 351-360.
57. R. Wang, F. Chen, Z. Chen, T. Li, G. Harari, S. Tignor, X. Zhou, D. Ben-Zeev, and A. T. Campbell. "StudentLife: assessing mental health, academic performance and behavioral trends of college students using smartphones," in Proc. ACM Conf. Ubiquitous Comput., 2014, pp. 3-14.
58. D. Ben-Zeev, R. Wang, S. Abdullah, R. Brian, E. A. Scherer, L. A. Mistler,M. Hauser, J. M. Kane,A. Campbell, and T. Choudhury, "Mobile behavioral sensing for outpatients and inpatients with schizophrenia," Psychiatric Services, vol. 67, no. 5, pp. 558-561, 2016.
59. T. Choudhury, "Tracking behavioral symptoms of bipolar disorder using automated sensing and delivering personalized interventions using smartphones," in Proc. 17th Annu. Conf. Int. Soc. Bipolar Disorders, 2015, vol. 17, p. 10.
60. K. M. Prkachin, "The consistency of facial expressions of pain-A comparison across modalities," Pain, vol. 51, no. 3, pp. 297-306, 1992.
61. J. Kappesser and A. C. de C. Williams, "Pain and negative emotions in the face: Judgements by health care professionals," Pain, vol. 99, nos. 1/2, pp. 197-206, 2002.
62. M. Monwar and S. Rezaei, "Pain recognition using artificial neural network," in Proc. IEEE Int. Symp. Signal Process. Inform. Technol., 2006, pp. 28-33.
63. P. Lucey, J. F. Cohn, K. M. Prkachin, P. E. Solomon, and I. Matthews, "Painful data: The UNBC-McMaster shoulder pain expression archive database," in Automatic Face&Gesture Recognition and Workshops (FG 2011), pp. 57-64, 2011.
64. K. Prkachin and P. Solomon, "The structure, reliability and validity of pain expression: The evidence from patients with shoulder pain," Pain, vol. 139, pp. 267-274, 2008.
65. A. B. Ashraf, S. Lucey, J. F. Cohn, T. Chen, Z. Ambadar, K.M. Prkachin, and P. E. Solomon, "The painful face-Pain expression recognition using active appearance models," Image Vis. Comput., vol. 27, pp. 1788-1796, 2009.
66. Z. Hammal and J. F. Cohn, "Automatic detection of pain intensity," in Proc. 14th ACM Int. Conf. Multimodal Interaction, 2012, pp. 47-52.
67. S. Kaltwang, O. Rudovic, and M. Pantic, "Continuous pain intensity estimation from facial expressions," Advances in Visual Computing. Berlin, Germany: Springer, 2012, vol. 7432, pp. 368-377.
68. B. Martinez, M. Valstar, X. Binefa, and M. Pantic, "Local evidence aggregation for regression-based facial point detection," IEEE Trans. Pattern Anal. Mach. Intelli., vol. 35, no. 5, pp. 1149-1163, May 2013.
69. T. Ahonen, A. Hadid, and M. Pietikainen, "Face description with local binary patterns: Application to face recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 12, pp. 2037-2041, Dec. 2006.
70. K. Sikka, A. Dhall, and M. Bartlett, "Weakly supervised pain localization using multiple instance learning," in Proc. 10th IEEE Int. Conf. Workshops Autom. Face Gesture Recognit., 2013, pp. 1-8.
71. K. Sikka, A. A. Ahmed, D. Diaz, M. S. Goodwin, K. D. Craig, M. S. Bartlett, and J. S. Huang, "Automated assessment of children's postoperative pain using computer vision," Pediatrics, vol. 136, no. 1, pp. e124-e131, 2015.
72. G. C. Littlewort, M. S. Barlett, and K. Lee, "Automatic coding of facial expressions displayed during posed and genuine pain," Image Vis. Comput., vol. 27, no. 12, pp. 1797-1803, 2009.
73. M. S. Bartlett, G. C. Littlewort, M. G. Frank, and K. Lee "Automatic decoding of facial movements reveals deceptive pain expressions," Current Biol., vol. 24, no. 7, pp. 738-743, 2014.
74. N. I. Eisenberger, "The pain of social disconnection: examining the shared neural underpinnings of physical and social pain," Nature Rev. Neurosci., vol. 13, no. 6, pp. 421-434, 2012.
75. M. O. Martel, P. Thibault, and M. J. L. Sullivan, "The persistence of pain behaviours in patients with chronic back pain is independent of pain and psychological factors," Pain, vol. 151, pp. 330-336, 2010.
76. J. Wu and J. M. Rehg, "Centrist: A visual descriptor for scene categorization," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 8, pp. 1489-1501, Aug. 2011.
77. A. Dhall, J. Joshi, K. Sikka, R. Goecke, and N. Sebe, "The more the merrier: Analysing the affect of a group of people in images," in Proc. IEEE Int. Conf. Automat. Face Gesture Recog., 2015, vol. 12, pp. 1-8.
78. M. Suk and B. Prabhakaran, "Real-time mobile facial expression recognition system-A case study," in Proc. IEEE Conf. Comput. Vis. Pattern Recog. Workshops, 2014, pp. 132-137.
79. D. McDuff, R. El Kaliouby, T. Senechal, D. Demirdjian, and R. Picard, "Automatic measurement of ad preferences from facial responses gathered over the internet," Image Vis. Comput., vol. 32, no. 10, pp. 630-640, 2014.
80. C. L. Hicks, C. L. von Baeyer, P. A. Spafford, I. van Korlaar, and B. Goodenough, "The faces pain scale-revised: Toward a common metric in pediatric pain measurement," Pain, vol. 93, no. 2, pp. 173-183, 2001.
81. P. Adams, M. Rabbi, T. Rahman, M. Matthews, A. Voida, G. Gay, and S. Voida, "Towards personal stress informatics: Comparing minimally invasive techniques for measuring daily stress in the wild," in Proc. 8th Int. Conf. Pervasive Comput. Technol. Healthcare, 2014, pp. 72-79.
82. M. Schiavenato, C. L. von Baeyer, and K. D. Craig, "Self-report is a primary source of information about pain, but it is not infallible a comment on "Response to voepel-lewis's letter to the editor,'bridging the gap between pain assessment and treatment: Time for a new theoretical approach?," Western J. Nursing Res., vol. 35, no. 3, pp. 384-387, 2013.
83. J. M. George, "Trait and state" affect," in Individual Differences and Behavior in Organizations, K. R. Murphy, Ed. Hoboken, NJ, USA: Wiley, 1996, pp. 145-171.
84. A. A. Stone and S. Shiffman, "Capturing momentary, self-report data: A proposal for reporting guidelines," Ann. Behavioral Med., vol. 24, no. 3, pp. 236-43, 2002.
85. D. S. Moskowitz and S. N. Young, "Ecological momentary assessment: What it is and why it is a method of the future in clinical psychopharmacology," J. Psychiatry Neurosci., vol. 31, no. 1, pp. 13-20, 2006.
86. T. Rahman, M. Zhang, S. Voida, and T. Choudhury, "Towards accurate non-intrusive recollection of stress levels using mobile sensing and contextual recall," in Proc. 8th Int. Conf. Pervasive Comput. Technol. Healthcare, 2014, pp. 166-169.
87. J. P. Pollak, P. Adams, and G. Gay, "PAM: A photographic affect meter for frequent, in situ measurement of affect," in Proc. SIGCHI Conf. Human Factors Comput. Syst., 2011, pp. 725-734.
88. L. Yang, D. Freed, A. Wu, J. Wu, J. P. Pollak, and D. Estrin, "Your activities of daily living (YADL): An image-based survey technique for patients with arthritis," ArXiv:1601.03278, 2016.
89. P. Adams, A. Adams, G. Gay, and T. Choudhury, "Keppi: A tangible user interface for the self-report of scalar values," [Online]. Available at: http://pac.cs.cornell.edu/
90. Z. Abbas and W. Yoon, "A survey on energy conserving mechanisms for the internet of things:Wireless networking aspects," Sensors, vol. 15, no. 10, pp. 24818-24847, 2015.
91. P. Klasnja, S. Consolvo, T. Choudhury, R. Beckwith, and J Hightower, "Exploring privacy concerns about personal sensing," in Pervasive Computing, Berlin, Germany: Springer, 2009, pp. 176-183.
92. M. Rabbi,T. Caetano, J. Costa, S. Abdullah,M. Zhang, and T. Choudhury, "SAINT: A scalable sensing and inference toolkit," in Proc. Hotmobile, 2015.
93. W. H. Press, S. A. Teukolsky,W. T. Vetterling, B. P. Flannery, Numerical Recipes in C: The Art of Scientific Computing, 2nd Ed., New York, NY, USA: Cambridge Univ. Press, 1992.
94. P. T. Eugster, P. A. Felber, R. Guerraoui, and A. M. Kermarrec, "The many faces of publish/subscribe," ACM Comput. Surveys, vol. 35, no. 2, pp. 114-131, 2003.
95. G. J. Ross, "Parametric and nonparametric sequential change detection in R: The CPM package," J. Statist. Softw., vol. 78, 2013.
96. U. Junker and S. Wirz, "Review article: Chronobiology: influence of circadian rhythms on the therapy of severe pain," J. Oncol. Pharmacy Practice, vol. 16, no. 2, pp. 81-87, 2010.
97. Z. Chen, M. Lin, F. Chen, N. D. Lane, G. Cardone, R. Wang, T. Li, Y. Chen, T. Choudhury, and A. T. Campbell, "Unobtrusive sleep monitoring using smartphones," in Proc. 7th Int. Conf. IEEE Pervasive Comput. Technol. Healthcare, 2013, pp. 145-152.
98. J. K. Min, A. Doryab, J. Wiese, S. Amini, J. Zimmerman, and J. I. Hong, "Toss 'N' turn: Smartphone as sleep and sleep quality detector," in Proc. SIGCHI Conf. Human Factors Comput. Syst., 2014, pp. 477-486.
99. Y. Bai, B. Xu, Y. Ma, G. Sun, and Y. Zhao, "Will you have a good sleep tonight?: Sleep quality prediction with mobile phone," in Proc. 7th Int. Conf. Body Area Netw., 2012, pp. 124-130.
100. S. Abdullah, M. Matthews, E. L. Murnane, G. Gay, and T. Choudhury, "Towards circadian computing: "Early to bed and early to rise", makes some of us unhealthy and sleep deprived," in Proc. ACM Int. Joint Conf. Pervasive Ubiquitous Comput., 2014, pp. 673-84.
101. S. Saeb, M. Zhang, C. J. Karr, S. M. Schueller, M. E. Corden, K. P. Kording, D. C. Mohr, "Mobile phone sensor correlates of depressive symptom severity in daily-life behavior: An exploratory study," J. Med. Internet Res., vol. 17, no. 7, 2015, Art. no. e175.
102. Y. Bengio, A. Courville, and P. Vincent, "Representation learning: A review and new perspectives," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 8, pp. 1798-1828, Aug. 2013.
103. B. Schuller, "Deep learning our everyday emotions," in Advances in Neural Networks: Computational and Theoretical Issues. Berlin, Germany: Springer, 2015, pp. 339-346.
104. H. P. Martinez and G. N. Yannakakis, "Deep multimodal fusion: combining discrete events and continuous signals," in Proc. Int. Conf. Multimodal Interaction, 2014, pp. 34-41.
105. N. Eagle and S. Pentland, "Eigenbehaviors: Identifying structure in routine," Behav. Ecol. Sociobiol., vol. 63, pp. 1057-66, 2009.
106. J. Zheng, S. Liu, L. M. Li, "Effective routine behavior pattern discovery from sparse mobile phone data via collaborative filtering," in Proc. IEEE Int. Conf. Pervasive Comput. Commun., 2013, pp. 29-37.
107. R. Caruana, "Multitask learning: A knowledge-based source of inductive bias," in Proc. 10th Int. Conf. Mach. Learning, 1993, pp. 41-48.
108. B. Romera-Paredes, M. S. H. Aung, M. Pontil, A. C de C. Williams, N. Bianchi-Berthouze, and P. Watson, "Transfer learning to account for idiosyncrasy in face and body expressions," in Proc. IEEE 10th Int. Conf. Workshops Autom. Face Gesture Recog., 2013, pp. 1-6.
109. B. Romera-Paredes, A. Argyriou, N. Berthouze, and M. Pontil, "Exploiting unrelated tasks in multi-task learning," in Proc. Int. Conf. Artif. Intell. Statist., 2012, pp. 951-959.
110. A. Argyriou, T. Evgeniou, and M. Pontil, "Convex multi-task feature learning," Mach. Learning, vol. 73, no. 3, pp. 243-272, 2008.
111. B. A. Rosser and C. Eccleston, "Smartphone applications for pain management," J. Telemed. Telecare, vol. 17, no. 6, pp. 308-312, 2011.
112. C. Lalloo, L. A. Jibb, J. Rivera, A. Agarwal, and J. N Stinson, "There's a pain app for that: A review of patient targeted smartphone applications for pain management," Clin. J. Pain, vol. 31, no. 6, pp. 557-563, 2015.
113. J. E. Richardson and M. C. Reid, "The promise and pitfalls of leveraging mobile health technology for pain care," Pain Med., vol. 14, pp. 1621-1626, 2013.
114. C. Reynoldson, "Assessing the quality and usability of smartphone apps for pain management," Pain Med., vol. 15, pp. 898-909, 2014.
115. A. Singh, A. Klapper, J. Jia, A. Fidalgo, A. Tajadura-Jimenez, N. Kanakam, N Bianchi-Berthouze, A Williams, "Motivating people with chronic pain to do physical activity: Opportunities for technology design," in Proc. SIGCHI Conf. Human Factors Comput. Syst., 2014, pp. 2803-2812.
116. S. Consolvo, D. W. McDonald, T. Toscos, M. Y. Chen, J. Froehlich, B. Harrison, P. Klasnja, A. LaMarca, L. LeGrand, R. Libby, and I. Smith, "Activity sensing in the wild: A field trial of ubifit garden," in Proc. SIGCHI Conf. Human Factors Comput. Syst., 2008, pp. 1797-1806.
117. N. D. Lane, M. Mohammod, M. Lin, X. Yang, H. Lu, S. Ali, A. Doryab, E. Berke, T. Choudhury, and A. Campbell, "Bewell: A smartphone application to monitor, model and promote wellbeing," in Proc. 5th Int. ICST Conf. Pervasive Comput. Technol. Healthcare, 2011, pp. 23-26.
118. S. Consolvo, D. W. McDonald, and J. A. Landay, "Theory-driven design strategies for technologies that support behavior change in everyday life," in Proc. SIGCHI Conf. Human Factors Comput. Syst., 2009, pp. 405-414.
119. M. Kay, E. K. Choe, J. Shepherd, B. Greenstein, N. Watson, S. Consolvo, and J. A. Kientz, "Lullaby: A capture & access system for understanding the sleep environment," in Proc. ACM Conf. Ubiquitous Comput., 2012, pp. 226-234.
120. E. K. Choe, B. Lee, M. Kay, W. Pratt, and J. A. Kientz, "SleepTight: Low-burden, self-monitoring technology for capturing and reflecting on sleep behaviors," in Proc. ACM Int. Joint Conf. Pervasive Ubiquitous Comput., 2015, pp. 121-132.
121. C. A. Pellegrini, S. A. Hoffman, L. M. Collins, and B. Spring, "Optimization of remotely delivered intensive lifestyle treatment for obesity using the multiphase optimization strategy: Opt-IN study protocol," Contemporary Clin. Trials, vol. 38, no. 2, pp. 251-259, 2014.
122. R. Kukafka, "Tailored health communication," Consum. Health Inform.: Inform. Consum. Improving Health Care, pp. 22-33, 2005.
123. M. Rabbi, M. S. H. Aung, M. Zhang, T. Choudhury, "MyBehavior: Automated personalized health feedback from user behavior and preference using smartphones," in Proc. ACM Int. Joint Conf. Pervasive Ubiquitous Comput., 2015, pp. 707-718.
124. B. J. Fogg, "A behavior model for persuasive design," in Proc. 4th Int. Conf. Persuasive Technol., 2009, vol. 40, pp. 1-7.
125. A. Singh, S. Piana, D. Pollarolo, V. Gualtiero, G. Varni, A. Tajadura-Jimenez, A. Williams, A. Camurri, and N. Bianchi-Berthouze, "Go-withthe- flow: Tracking, analysis and sonification of movement and breathing to build confidence in activity despite chronic pain," Human Comput. Interaction, vol. 31, no. 3/4, pp. 1-40, 2016.