Planned missing-data designs in experience-sampling research: Monte Carlo simulations of efficient designs for assessing within-person constructs

Behavior Research Methods

Volumn 46, Issue 1, 2014, Pages 41-54

  Silvia, Paul J ^a,c   Kwapil, Thomas R ^a   Walsh, Molly A ^a   Myin Germeys, Inez ^b  

^a UNIVERSITY OF NORTH CAROLINA AT GREENSBORO   (United States)

^b MAASTRICHT UNIVERSITY   (Netherlands)

^c Department of Psychology ^*  (United States)

Author keywords

Ecological momentary assessment; Efficient designs; Experience sampling methods; Maximum likelihood; Missing data

Indexed keywords

ARTICLE; BEHAVIORAL RESEARCH; HUMAN; METHODOLOGY; MONTE CARLO METHOD; SAMPLE SIZE; STATISTICAL ANALYSIS; STATISTICAL MODEL;

BEHAVIORAL RESEARCH; DATA INTERPRETATION, STATISTICAL; HUMANS; LIKELIHOOD FUNCTIONS; MONTE CARLO METHOD; RESEARCH DESIGN; SAMPLE SIZE;

EID: 84894669966     PISSN: 1554351X     EISSN: 15543528     Source Type: Journal    
DOI: 10.3758/s13428-013-0353-y     Document Type: Article

References (43)

1. Armey, M. F., Crowther, J. H., & Miller, I. W. (2011). Changes in ecological momentary assessment reported affect associated with episodes of nonsuicidal self-injury. Behavior Therapy, 42, 579-588.
2. Barrett, L. F., & Barrett, D. J. (2001). An introduction to computerized experience sampling in psychology. Social Science Computer Review, 19, 175-185.
3. Bolger, N., & Laurenceau, J. P. (2013). Intensive longitudinal methods: An introduction to diary and experience sampling research. New York: Guilford.
4. Bolger, N., Stadler, G., & Laurenceau, J. P. (2012). Power analysis for intensive longitudinal studies. In M. R. Mehl & T. S. Conner (Eds.), Handbook of research methods for studying daily life (pp. 285-301). New York: Guilford Press.
5. Brown, L. H., Silvia, P. J., Myin-Germeys, I., & Kwapil, T. R. (2007). When the need to belong goes wrong: The expression of social anhedonia and social anxiety in daily life. Psychological Science, 18, 778-782.
6. Buckner, J. D., Zvolensky, M. J., Smits, J. J., Norton, P. J., Crosby, R. D., Wonderlich, S. A., & Schmidt, N. B. (2011). Anxiety sensitivity and marijuana use: An analysis from ecological momentary assessment. Depression and Anxiety, 28, 420-426.
7. Burgin, C. J., Brown, L. H., Royal, A., Silvia, P. J., Barrantes-Vidal, N., & Kwapil, T. R. (2012). Being with others and feeling happy: Emotional expressivity in everyday life. Personality and Individual Differences, 63, 185-190.
8. Burgin, C. J., Silvia, P. J., Eddington, K. M., & Kwapil, T. R. (2013). Palm or cell? Comparing personal digital assistants and cell phones for experience sampling research. Social Science Computer Review, 31, 244-251.
9. Conner, T. S., & Lehman, B. J. (2012). Getting started: Launching a study in daily life. In M. R. Mehl & T. S. Conner (Eds.), Handbook of research methods for studying daily life (pp. 89-107). New York: Guilford.
10. Conner, T. S., & Reid, K. A. (2012). Effects of intensive mobile happiness reporting in daily life. Social Psychological and Personality Science, 3, 315-323.
11. Conner, T. S., Tennen, H., Fleeson, W., & Barrett, L. F. (2009). Experience sampling methods: A modern idiographic approach to personality research. Social and Personality Psychology Compass, 3, 292-313.
12. Courvoisier, D. S., Eid, M., & Lischetzke, T. (2012). Compliance to a cell phone-based ecological momentary assessment study: The effect of time and personality characteristics. Psychological Assessment, 24, 713-720.
13. Davey, A., & Savla, J. (2010). Statistical power analysis with missing data: A structural equation modeling approach. New York: Routledge/Taylor & Francis Group.
14. Duncan, T. E., Duncan, S. E., & Stryker, L. A. (2006). An introduction to latent variable growth curve modeling: Concepts, issues, and applications (2nd ed.). Mahwah: Erlbaum.
15. Eckblad, M., & Chapman, L. (1986). Development and validation of a scale for hypomanic personality. Journal of Abnormal Psychology, 95, 214-222.
16. Enders, C. K. (2010). Applied missing data analysis. New York: Guilford.
17. Fleeson, W., & Gallagher, P. (2009). The implications of Big Five standing for the distribution of trait manifestation in behavior: Fifteen experience-sampling studies and a meta-analysis. Journal of Personality and Social Psychology, 97, 1097-1114.
18. Graham, J. M. (2008). Self-expansion and flow in couples' momentary experiences: An experience sampling study. Journal of Personality and Social Psychology, 95, 679-694.
19. Graham, J. W. (2009). Missing data analysis: Making it work in the real world. Annual Review of Psychology, 60, 549-576.
20. Graham, J. W., Taylor, B. J., Olchowski, A. E., & Cumsille, P. E. (2006). Planned missing data designs in psychological research. Psychological Methods, 11, 323-343.
21. Heck, R. H., & Thomas, S. L. (2009). An introduction to multilevel modeling techniques (2nd ed.). New York: Routledge.
22. Hektner, J. M., Schmidt, J. A., & Csikszentmihalyi, M. (2007). Experience sampling method: Measuring the quality of everyday life. Thousand Oaks: Sage.
23. Kwapil, T. R. (1998). Social anhedonia as a predictor of the development of schizophrenia-spectrum disorders. Journal of Abnormal Psychology, 107, 558-565.
24. Kwapil, T. R., Barrantes-Vidal, N., & Silvia, P. J. (2008). The dimensional structure of the Wisconsin schizotypy scales: Factor identification and construct validity. Schizophrenia Bulletin, 34, 444-457.
25. Kwapil, T. R., Silvia, P. J., Myin-Germeys, I., Anderson, A. J., Coates, S. A., & Brown, L. H. (2009). The social world of the socially anhedonic: Exploring the daily ecology of asociality. Journal of Research in Personality, 43, 103-106.
26. Kwapil, T. R., Barrantes-Vidal, N., Armistead, M. S., Hope, G. A., Brown, L. H., Silvia, P. J., & Myin-Germeys, I. (2011). The expression of bipolar spectrum psychopathology in daily life. Journal of Affective Disorders, 130, 166-170.
27. Little, R. J. A., & Rubin, D. B. (2002). Statistical analysis with missing data (2nd ed.). Hoboken: Wiley.
28. Maas, C. J. M., & Hox, J. J. (2005). Sufficient sample sizes for multilevel modeling. Methodology, 1, 86-92.
29. McKnight, P. E., McKnight, K. M., Sidani, S., & Figueredo, A. J. (2007). Missing data: A gentle introduction. New York: Guilford.
30. Mehta, P. D., & Neale, M. C. (2005). People are variables too: Multilevel structural equations modeling. Psychological Methods, 10, 259-284.
31. Messiah, A., Grondin, O., & Encrenaz, G. (2011). Factors associated with missing data in an experience sampling investigation of substance use determinants. Drug and Alcohol Dependence, 114, 153-158.
32. Mooney, C. Z. (1997). Monte Carlo simulation (Sage University Paper series on Quantitative Applications in the Social Sciences, series no. 07-116). Thousand Oaks: Sage.
33. Muthén, B. O., & Asparouhov, T. (2011). Beyond multilevel regression modeling: Multilevel analysis in a general latent variable framework. In J. J. Hox & J. K. Roberts (Eds.), Handbook of advanced multilevel analysis (pp. 15-40). New York: Routledge.
34. Muthén, L. K., & Muthén, B. O. (2002). How to use a Monte Carlo study to decide on sample size and determine power. Structural Equation Modeling, 9, 599-620.
35. Oorschot, M., Kwapil, T., Delespaul, P., & Myin-Germeys, I. (2009). Momentary assessment research in psychosis. Psychological Assessment, 21, 498-505.
36. Paxton, P., Curran, P. J., Bollen, K. A., Kirby, J., & Chen, F. (2001). Monte Carlo experiments: Design and implementation. Structural Equation Modeling, 8, 287-312.
37. Rubin, D. E. (1976). Inference and missing data. Biometrika, 63, 581-592.
38. Scherbaum, C. A., & Ferreter, J. M. (2009). Estimating statistical power and required sample sizes for organizational research using multilevel modeling. Organizational Research Methods, 12, 347-367.
39. Silvia, P. J., & Kwapil, T. R. (2011). Aberrant asociality: How individual differences in social anhedonia illuminate the need to belong. Journal of Personality, 79, 1315-1332.
40. Silvia, P. J., Kwapil, T. R., Eddington, K. M., & Brown, L. H. (2013). Missed beeps and missing data: Dispositional and situational predictors of non-response in experience sampling research. Social Science Computer Review. doi: 10. 1177/0894439313479902.
41. Skrondal, A., & Rabe-Hesketh, S. (2004). Generalized latent variable modeling: Multilevel, longitudinal, and structural equation models. Boca Raton: Chapman & Hall/CRC.
42. Watson, D. (2000). Mood and temperament. New York: Guilford Press.
43. Willse, J. T., Goodman, J. T., Allen, N., & Klaric, J. (2008). Using structural equation modeling to examine group differences in assessment booklet designs with sparse data. Applied Measurement in Education, 21, 253-272.