Using Smartphones to Collect Behavioral Data in Psychological Science: Opportunities, Practical Considerations, and Challenges

Perspectives on Psychological Science

Volumn 11, Issue 6, 2016, Pages 838-854

  Harari, Gabriella M ^a   Lane, Nicholas D ^b,c   Wang, Rui ^d   Crosier, Benjamin S ^e   Campbell, Andrew T ^d   Gosling, Samuel D ^a,f  

^a UNIVERSITY OF TEXAS AT AUSTIN   (United States)

^b LUCENT TECHNOLOGIES   (United States)

^c UNIVERSITY COLLEGE LONDON   (United Kingdom)

^d Dartmouth College   (United States)

^e DARTMOUTH COLLEGE   (United States)

^f UNIVERSITY OF MELBOURNE   (Australia)

Author keywords

behavior; big data; mobile sensing; research design; smartphones

Indexed keywords

BEHAVIOR; COMPUTER SECURITY; DEVICES; ETHICS; HUMAN; METHODOLOGY; PROCEDURES; PSYCHOLOGY; SMARTPHONE;

BEHAVIOR; COMPUTER SECURITY; HUMANS; PSYCHOLOGY; RESEARCH DESIGN; SMARTPHONE;

EID: 85002202399     PISSN: 17456916     EISSN: 17456924     Source Type: Journal    
DOI: 10.1177/1745691616650285     Document Type: Article

References (63)

1. Bakke E., (2010). A model and measure of mobile communication competence. Human Communication Research, 36, 348–371. doi:10.1111/j.1468-2958.2010.01379.x
2. Baumeister R. F., Vohs K. D., Funder D. C., (2007). Psychology as the science of self-reports and finger movements: Whatever happened to actual behavior? Perspectives on Psychological Science, 2, 396–403. doi:10.1111/j.1745-6916.2007.00051.x
3. Ben-Zeev D., Brenner C. J., Begale M., Duffecy J., Mohr D. C., Mueser K. T., (2014). Feasibility, acceptability, and preliminary efficacy of a smartphone intervention for schizophrenia. Schizophrenia Bulletin, 40, 1244–1253. doi:10.1093/schbul/sbu033
4. Bernard H. R., Killworth P. D., Sailer L., (1980). Informant accuracy in social network data IV: A comparison of clique-level structure in behavioral and cognitive network data. Social Networks, 2, 191–218. doi:10.1016/0378-8733(79)90014-5
5. Bernard H. R., Killworth P. D., Sailer L., (1982). Informant accuracy in social-network data V. An experimental attempt to predict actual communication from recall data. Social Science Research, 11, 30–66. doi:10.1016/0049-089X(82)90006-0
6. Boase J., (2013). Implications of software-based mobile media for social research. Mobile Media & Communication, 1, 57–62. doi:10.1177/2050157912459500
7. Boase J., Ling R., (2013). Measuring mobile phone use: Self-report versus log data. Journal of Computer-Mediated Communication, 18, 508–519. doi:10.1111/jcc4.12021
8. Brown J., Broderick A. J., Lee N., (2007). Word of mouth communication within online communities: Conceptualizing the online social network. Journal of Interactive Marketing, 21(3), 2–20. doi:10.1002/dir.20082
9. Campbell A. T., Lane N. D., (2013, July). Smartphone sensing: A game changer for behavioral science. Workshop held at the Summer Institute for Social and Personality Psychology, The University of California, Davis.
10. Case M. A., Burwick H. A., Volpp K. G., Patel M. S., (2015). Accuracy of smartphone applications and wearable devices for tracking physical activity data. Journal of the American Medical Association, 313, 625–626. doi:10.1001/jama.2014.17841
11. Chen Z., Chen Y., Hu L., Wang S., Jiang X., Ma X... Campbell A. T., (2014). ContextSense: Unobtrusive discovery of incremental social context using dynamic Bluetooth data. In Brush A. J., Friday A., (Chairs), Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct publication (pp. 23–26). New York, NY: Association for Computing Machinery. doi:10.1145/2638728.2638801
12. Chen Z., Lin M., Chen F., Lane N. D., Cardone G., Wang R... Campbell A. T., (2013). Unobtrusive sleep monitoring using smartphones. 2013 7th International Conference on Pervasive Computing Technologies for Healthcare: PervasiveHealth ’13 (pp. 145–152). Brussels, Belgium: Institute for Computer Sciences, Social-Informatics, and Telecommunications Engineering.
13. Chittaranjan G., Blom J., Gatica-Perez D., (2011). Who’s who with Big-Five: Analyzing and classifying personality traits with smartphones. In Lyons K., Smailagic A., Kenn H., (Chairs), Wearable Computers (ISWC): 2011 15th Annual International Symposium (pp. 29–36). Piscataway, NJ: Institute of Electrical and Electronics Engineers. doi:10.1109/ISWC.2011.29
14. Choudhury T., Basu S., (2004). Modeling conversational dynamics as a mixed-memory Markov process. In Saul L. K., Weiss Y., Bottou L., (Eds.), Advances in neural information processing systems: Vol. 17 (pp. 281–288). Cambridge, MA: MIT Press.
15. Craik K. H., (2000). The lived day of an individual: A person-environment perspective. In Walsh W. B., Craik K. H., Price R. H., (Eds.), Person-environment psychology: New directions and perspectives (pp. 233–266). Mahwah, NJ: Erlbaum.
16. de Montjoye Y. A., Quoidbach J., Robic F., Pentland A. S. (2013). Predicting personality using novel mobile phone-based metrics. In Greenberg A. M., Kennedy W.G., Bos N. D., (Eds.), SBP ’13: Proceedings of the 6th International Conference on Social Computing, Behavioral-Cultural Modeling and Prediction (pp. 48–55). Berlin, Germany: Springer. doi:10.1007/978-3-642-37210-0_6
17. de Montjoye Y. A., Shmueli E., Wang S. S., Pentland A. S. (2014). openPDS: Protecting the privacy of metadata through SafeAnswers. PLoS ONE, 9, e98790. doi:10.1371/journal.pone.0098790
18. Eagle N., Pentland A. S., Lazer D., (2009). Inferring friendship network structure by using mobile phone data. PNAS: Proceedings of the National Academy of Sciences of the United States of America, 106, 15274–15278. doi:10.1073/pnas.0900282106
19. Farrahi K., Gatica-Perez D., (2008). What did you do today? Discovering daily routines from large-scale mobile data. In El Saddik A., Vuong S., (Chairs), Proceedings of the 16th ACM International Conference on Multimedia (pp. 849–852). New York, NY: Association for Computing Machinery. doi:10.1145/1459359.1459503
20. Funder D. C., (2006). Towards a resolution of the personality triad: Persons, situations, and behaviors. Journal of Research in Personality, 40, 21–34. doi:10.1016/j.jrp.2005.08.003
21. Furr R. M., (2009). Personality psychology as a truly behavioural science. European Journal of Personality, 23, 369–401. doi:10.1002/per.724
22. Gardy J. L., Johnston J. C., Sui S. J. H., Cook V. J., Shah L., Brodkin E., Varhol R., (2011). Whole-genome sequencing and social-network analysis of a tuberculosis outbreak. New England Journal of Medicine, 364, 730–739.
23. Gosling S. D., John O. P., Craik K. H., Robins R. W., (1998). Do people know how they behave? Self-reported act frequencies compared with on-line codings by observers. Journal of Personality and Social Psychology, 74, 1337–1349.
24. Gosling S. D., Mason W., (2015). Internet research in psychology. Annual Review of Psychology, 66, 877–902. doi:10.1146/annurev-psych-010814-015321
25. Harari G. M., Gosling S. D., Wang R., Campbell A., (2015). Capturing situational information with smartphones and mobile sensing methods. European Journal of Personality, 29, 509–511. doi:10.1002/per.2032
26. Henrich J., Heine S. J., Norenzayan A., (2010). The weirdest people in the world? Behavioral & Brain Sciences, 33, 61–83. doi:10.1017/S0140525X0999152X
27. International Data Corp. (2015). Smartphone OS market share, Q1 2015. Retrieved from http://www.idc.com/prodserv/smartphone-os-market-share.jsp
28. Kobayashi T., Boase J., (2012). No such effect? The implications of measurement error in self-report measures of mobile communication use. Communication Methods and Measures, 6(2), 126–143. doi:10.1080/19312458.2012.679243
29. Kosinski M., Matz S. C., Gosling S. D., Popov V., Stillwell D., (2015). Facebook as a research tool for the social sciences: Opportunities, challenges, ethical considerations, and practical guidelines. American Psychologist, 70, 543–556. doi:10.1037/a0039210
30. Lane N. D., Miluzzo E., Lu H., Peebles D., Choudhury T., Campbell A. T., (2010). A survey of mobile phone sensing. IEEE Communications Magazine, 48(9), 140–150. doi:10.1109/MCOM.2010.5560598
31. Lane N. D., Mohammod M., Lin M., Yang X., Lu H., Ali S... Campbell A., (2011). Bewell: A smartphone application to monitor, model and promote wellbeing. In Maitland J., Augusto J. C., Caulfield B., (Chairs), 5th International ICST Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth) (pp. 23–26). Gent, Belgium: Institute for Computer Sciences, Social Informatics and Telecommunications Engineering.
32. Lathia N., Pejovic V., Rachuri K. K., Mascolo C., Musolesi M., Rentfrow P. J., (2013). Smartphones for large-scale behavior change interventions. IEEE Pervasive Computing, 12, 66–73. doi:10.1109/MPRV.2013.56
33. Lathia N., Rachuri K. K., Mascolo C., Rentfrow P. J., (2013). Contextual dissonance: Design bias in sensor-based experience sampling methods. In Mattern F., Santini S., Proceedings of the 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing (pp. 183–192). New York, NY: Association for Computing Machinery.
34. Lee S., Konrath S., Himle J., Bennett D., (2015, March). Positive technology: Utilizing mobile devices for psychosocial intervention. Conference at the University of Michigan Institute for Social Research. Retrieved from https://sites.google.com/a/umich.edu/positive-tech/home
35. LiKamWa R., Liu Y., Lane N. D., Zhong L., (2013). Moodscope: Building a mood sensor from smartphone usage patterns. In Chu H. H., Huang P., Choudhury R. R., Zhao F., (Chairs), Proceeding of the 11th Annual International Conference on Mobile Systems, Applications, and Services (pp. 389–402). New York, NY: Association for Computing Machinery. doi:10.1145/2462456.2464449.
36. Lu H., Frauendorfer D., Rabbi M., Mast M. S., Chittaranjan G. T., Campbell A. T... Choudhury T., (2012). StressSense: Detecting stress in unconstrained acoustic environments using smartphones. In Dey A. L., Chu H. H., Hayes G., (Chairs), Proceedings of the 2012 ACM Conference on Ubiquitous Computing (pp. 351–360). New York, NY: Association for Computing Machinery. doi:10.1145/2370216.2370270
37. Madden M., Rainie L., (2015). Americans’ attitudes about privacy, security, and surveillance. Retrieved from Pew Research Center website: http://www.pewinternet.org/2015/05/20/americans-attitudes-about-privacy-security-and-surveillance/
38. Mascolo C., Rentfrow P. J., (2011). Social sensing: Mobile sensing meets social science. Workshop held at the University of Cambridge, Cambridge, England.
39. Mast M. S., Gatica-Perez D., Frauendorfer D., Nguyen L., Choudhury T., (2015). Social sensing for psychology: Automated interpersonal behavior assessment. Current Directions in Psychological Science, 24, 154–160. doi:10.1177/0963721414560811
40. Mehl M. R., Gosling S. D., Pennebaker J. W., (2006). Personality in its natural habitat: Manifestations and implicit folk theories of personality in daily life. Journal of Personality and Social Psychology, 90, 862–877. doi:10.1037/0022-3514.90.5.862
41. Mehl M. R., Pennebaker J. W., (2003). The sounds of social life: A psychometric analysis of students’ daily social environments and natural conversations. Journal of Personality and Social Psychology, 84, 857–870. doi:10.1037/0022-3514.84.4.857
42. Mehl M. R., Pennebaker J. W., Crow D. M., Dabbs J., Price J. H., (2001). The Electronically Activated Recorder (EAR): A device for sampling naturalistic daily activities and conversations. Behavior Research Methods, Instruments, & Computers, 33, 517–523.
43. Miller G., (2012). The smartphone psychology manifesto. Perspectives on Psychological Science, 7, 221–237. doi:10.1177/1745691612441215
44. Miluzzo E., Lane N. D., Fodor K., Peterson R., Lu H., Musolesi M... Campbell A. T., (2008). Sensing meets mobile social networks: The design, implementation and evaluation of the CenceMe application. In Abdelzahar T., Martonosi M., Wolisz A., (Chairs), Proceedings of the 6th ACM Conference on Embedded Network Sensor Systems (pp. 337–350). New York, NY: Association for Computing Machinery. doi:10.1145/1460412.1460445
45. Morris M. E., Aguilera A., (2012). Mobile, social, and wearable computing and the evolution of psychological practice. Professional Psychology: Research and Practice, 43, 622–626. doi:10.1037/a0029041
46. Paulhus D. L., Vazire S., (2007). The self-report method. In Robins R. W., Fraley R. C., Kruger R. F., (Eds.), Handbook of research methods in personality psychology (pp. 224–239). New York, NY: Guilford.
47. Pejovic V., Lathia N., Mascolo C., Musolesi M., (2015). Mobile-based experience sampling for behaviour research. Retrieved from https://arxivorg/pdf/1508.03725.pdf
48. Pew Research Center. (2014). Cell phone and smartphone ownership demographics. Washington, DC: Author. Retrieved from http://www.pewinternet.org/data-trend/mobile/cell-phone-and-smartphone-ownership-demographics/
49. Pew Research Center. (2015). Internet seen as positive influence on education but negative influence on morality in emerging and developing nations. Washington, DC: Author. Retrieved from http://www.pewglobal.org/2015/03/19/internet-seen-as-positive-influence-on-education-but-negative-influence-on-morality-in-emerging-and-developing-nations/
50. Rabbi M., Ali S., Choudhury T., Berke E., (2011). Passive and in-situ assessment of mental and physical well-being using mobile sensors. In Landay J., Shi Y., Patterson D. Jj., Rogers Y., Xie X., (Chairs), Proceedings of the 13th International Conference on Ubiquitous Computing (pp. 385–394). New York, NY: Association for Computing Machinery. doi:10.1145/2030112.2030164
51. Rachuri K. K., Musolesi M., Mascolo C., Rentfrow P. J., Longworth C., Aucinas A., (2010). EmotionSense: A mobile phones based adaptive platform for experimental social psychology research. In In Bardram J., Langheinrich M., (Chairs), Proceedings of the 12th ACM International Conference on Ubiquitous Computing (pp. 281–290). New York, NY: Association for Computing Machinery. doi:10.1145/1864349.1864393
52. Reddy S., Mun M., Burke J., Estrin D., Hansen M., Srivastava M., (2010). Using mobile phones to determine transportation modes. ACM Transactions on Sensor Networks (TOSN), 6(2), Article 13. doi:10.1145/1689239.1689243
53. Reis H. T., Gosling S. D., (2010). Social psychological methods outside the laboratory. In Fiske S. T., Gilbert D. T., Lindzey G., (Eds.), Handbook of social psychology (5th ed., Vol. 1, pp. 82–114). New York, NY: Wiley.
54. Rentfrow P. J., Gosling S. D., (2012, January). Using smartphones as mobile sensing devices: A practical guide for psychologists to current and potential capabilities. Preconference for the annual meeting of the Society for Personality and Social Psychology, San Diego, CA.
55. Saeb S., Zhang M., Karr C. J., Schueller S. M., Corden M. E., Kording K. P., Mohr D. C., (2015). Mobile phone sensor correlates of depressive symptom severity in daily-life behavior: An exploratory study. Journal of Medical Internet Research, 17(7), e175. doi:10.2196/jmir.4273
56. Sandstrom G. M., Lathia N., Mascolo C., Rentfrow P. J., (in press). Putting mood in context: Using smartphones to examine how people feel in different locations. Journal of Research in Personality. doi:10.1016/j.jrp.2016.06.004
57. Smith A., (2013). Smartphone ownership: 2013 update. Washington, DC: Pew Research Center. Retrieved from http://pewinternet.org/Reports/2013/Smartphone-Ownership-2013.aspx
58. Stisen A., Blunck H., Bhattacharya S., Prentow T. S., Kjærgaard M. B., Dey A... Jensen M. M., (2015). Smart devices are different: Assessing and mitigating mobile sensing heterogeneities for activity recognition. In Song J., Abdelzahar T., Mascolo C., (Chairs), Proceedings of the 13th ACM Conference on Embedded Networked Sensor Systems (SenSys) (pp. 127–140). New York, NY: Association for Computing Machinery. doi:10.1145/2809695.2809718
59. Wang R., Chen F., Chen Z., Li T., Harari G., Tignor S... Campbell A. T., (2014). Studentlife: Assessing mental health, academic performance and behavioral trends of college students using smartphones. In Brush A., Friday A., Kientz J., Scott J., Song J., (Chairs), Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing (pp. 3–14). New York, NY: Association for Computing Machinery.
60. Wang R., Harari G. M., Hao P., Zhou X., Campbell A., (2015). SmartGPA: How smartphones can assess and predict academic performance of college students. In Mase K., Langheinrich M., Gatica-Perez D., Gellersen H., Choudhury T., Yatani K., (Chairs), Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing (pp. 295–306). New York, NY: Association for Computing Machinery. doi:10.1145/2750858.2804251
61. Wrzus C., Brandmaier A. M., von Oertzen T., Müller V., Wagner G. G., Riediger M., (2012). A new approach for assessing sleep duration and postures from ambulatory accelerometry. PLoS ONE, 7, e48089. doi:10.1371/journal.pone.0048089
62. Wrzus C., Mehl M. R., (2015). Lab and/or field? Measuring personality processes and their social consequences. European Journal of Personality, 29, 250–271. doi:10.1002/per.1986
63. Yarkoni T., (2012). Psychoinformatics: New horizons at the interface of the psychological and computing sciences. Current Directions in Psychological Science, 21, 391–397.