Does assessment type matter? A measurement invariance analysis of online and paper and pencil assessment of the Community Assessment of Psychic Experiences (CAPE)

PLoS ONE

Volumn 9, Issue 1, 2014, Pages

  Vleeschouwer, Marloes ^a   Schubart, Chris D ^a   Henquet, Cecile ^c   Myin Germeys, Inez ^c   Van Gastel, Willemijn A ^a   Hillegers, Manon H J ^a   Van Os, Jim J ^c   Boks, Marco P M ^a   Derks, Eske M ^a,b  

^a UNIVERSITY MEDICAL CENTER UTRECHT   (Netherlands)

^b ACADEMIC MEDICAL CENTER   (Netherlands)

^c MAASTRICHT UNIVERSITY MEDICAL CENTER   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

ADOLESCENT; ADULT; ARTICLE; CHILD; COMMUNITY ASSESSMENT OF PSYCHIC EXPERIENCE; DATA COLLECTION METHOD; EFFECT SIZE; FEMALE; HUMAN; INTERNET; MALE; MEASUREMENT INVARIANCE ANALYSIS; METHODOLOGY; ONLINE ANALYSIS; PAPER AND PENCIL ASSESSMENT; PSYCHOMETRY; PSYCHOSIS; QUESTIONNAIRE; RATING SCALE; SCHOOL CHILD; SIGNED ITEM DIFFERENCE IN THE SAMPLE INDEX; SIGNED TEST DIFFERENCE IN THE SAMPLE; MIDDLE AGED; PAPER; PROCEDURES; PSYCHOLOGIC TEST; PSYCHOLOGY; PSYCHOTIC DISORDERS; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; STANDARDS; YOUNG ADULT;

ADOLESCENT; ADULT; CHILD; FEMALE; HUMANS; INTERNET; MALE; MIDDLE AGED; PAPER; PSYCHOLOGICAL TESTS; PSYCHOMETRICS; PSYCHOTIC DISORDERS; QUESTIONNAIRES; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; YOUNG ADULT;

EID: 84899805906     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0084011     Document Type: Article

References (47)

1. van Os J, Linscott RJ, Myin-Germeys I, Delespaul P, Krabbendam L (2009) A systematic review and meta-analysis of the psychosis continuum: evidence for a psychosis proneness-persistence-impairment model of psychotic disorder. Psychol Med 39: 179-195.
2. Cougnard A, Marcelis M, Myin-Germeys I, De Graaf R, Vollebergh W, et al. (2007) Does normal developmental expression of psychosis combine with environmental risk to cause persistence of psychosis? A psychosis proneness-persistence model. Psychol Med 37: 513-527. (Pubitemid 46359599)
3. Spauwen J, Krabbendam L, Lieb R, Wittchen HU, van Os j (2003) Sex differences in psychosis: normal or pathological? Schiz Res 62: 45-49. (Pubitemid 36588701)
4. van Os J, Hanssen M, Bijl RV, Ravelli A (2000) Strauss (1969) revisited: a psychosis continuum in the general population? Schiz Res 45: 11-20.
5. Hanssen M, Bak M, Bijl R, Vollebergh W, van Os J (2005) The incidence and outcome of subclinical psychotic experiences in the general population. Br J Clin Psychol 44: 181-191. (Pubitemid 40873432)
6. Stefanis NC, Hanssen M, Smirnis NK, Avramopoulos DA, Evdokimidis IK, et al. (2002) Evidence that three dimensions of psychosis have a distribution in the general population. Psychol Med 32: 347-358. (Pubitemid 34162592)
7. Konings M, Bak M, Hanssen M, van Os J, Krabbendam L (2006) Validity and reliability of the CAPE: a self-report instrument for the measurement of psychotic experiences in the general population. Acta Psychiatr Scand 114: 55-61. (Pubitemid 43885486)
8. Boonstra N, Wunderink L, Sytema S, Wiersma D (2009) Improving detection of first-episode psychosis by mental health-care services using a self-report questionnaire. Early Interv Psychiatry 3: 289-295.
9. Mossaheb N, Becker J, Schaefer MR, Klier CM, Schloegelhofer M, et al. (2012) The Community Assessment of Psychic Experience (CAPE) questionnaire as a screening-instrument in the detection of individuals at ultra-high risk for psychosis. Schiz Res 141:210-214.
10. Bollen KA (1989) A new incremental fit index for general structural equation models. Sociological Methods & Research 16: 303-316.
11. Musch J, Reips U (2000) A brief history of web experimenting. In:Birnbaum MH, editors. Psychological experiments on the internet. New York: Academic Press. pp. 61-78.
12. Cronk BC, West JL (2002) Personality research on the Internet: a comparison of Web-based and traditional instruments in take-home and in-class settings. Behav Res Methods Instrum Comput 34: 177-180.
13. Kongsved SM, Basnov M, Holm-Christensen K, Hjollund NH (2007) Response rate and completeness of questionnaires: a randomized study of Internet versus paper-and-pencil versions. J Med Internet Res 9: e25.
14. Andersson G, Kaldo-Sandstrom V, Strom L, Stromgren T (2003) Internet administration of the Hospital Anxiety and Depression Scale in a sample of tinnitus patients. J Psychosom Res 55: 259-262. (Pubitemid 38366229)
15. Vispoel WP, Boo J, Bleiler T (2001) Computerized and paper-and-pencil versions of the Rosenberg Self- Esteem Scale. Educational and Psychological Measurement 61: 461-474.
16. Bartram D (2006) Testing on the Internet: Issues, Challenges and Opportunities in the Field of Occupational Assessment. In Bartram D, Hambelton RK. Computer-Based Testing and the Internet: Issues and Advances. John Wiley & Sons, Ltd. pp. 13-37.
17. Buchanan T (2003) Internet-based questionnaire assessment: appropriate use in clinical contexts. Cogn Behav Ther 32: 100-109.
18. Buchanan T, Heffernan TM, Parrott AC, Ling J, Rodgers J, et al. (2010) A short self-report measure of problems with executive function suitable for administration via the Internet. Behav Res Methods 42: 709-714.
19. Bartram D (2005) The Great Eight competencies: a criterion-centric approach to validation. J Appl Psychol 90: 1185-1203.
20. Buchanan T, Ali T, Heffernan TM, Ling J, Parrott AC, et al. (2005) Nonequivalence of on-line and paper-and-pencil psychological tests: the case of the prospective memory questionnaire. Behav Res Methods 37: 148-154. (Pubitemid 41560269)
21. Coles ME, Cook LM, Blake TR (2007) Assessing obsessive compulsive symptoms and cognitions on the internet: evidence for the comparability of paper and Internet administration. Behav Res Ther 45: 2232-2240. (Pubitemid 47210946)
22. Meade AW, Michels LC, Lautenschlager GJ (2007) Are internet and paper-and-pencil personality tests truly comparable? : An experimental design measurement invariance study. Organizational Research Methods 10: 322-345.
23. Meyerson P, Tryon WW (2003) Validating internet research: a test of the psychometric equivalence of internet and in-person samples. Behav Res Methods Instrum Comput 35: 614-620. (Pubitemid 38203113)
24. Hannon R, Adams P, Harrington S, Fries-Dias C, Gipson MT (1995) Effects of Brain Injury and Age on Prospective Memory Self-Rating and Performance. Rehabilitation Psychology 40: 289-298. (Pubitemid 26117235)
25. Wu RC, Thorpe K, Ross H, Micevski V, Marquez C, et al. (2009) Comparing administration of questionnaires via the internet to pen-and-paper in patients with heart failure: randomized controlled trial. J Med Internet Res 11: e3.
26. Vecchione M, Alessandri G, Barbaranelli C (2012) Paper-and-Pencil and Web- Based Testing: The Measurement Invariance of the Big Five Personality Tests in Applied Settings. Assessment 19: 243-246.
27. Meredith W (1993) Measurement Invariance, factor analysis and factorial invariance. Psychometrika 58: 525-543.
28. Schubart CD, van Gastel WA, Breetvelt EJ, Beetz SL, Ophoff RA, et al. (2010) Cannabis use at a young age is associated with psychotic experiences. Psychol Med 41: 1301-1310.
29. Schubart CD, Boks MP, Breetvelt EJ, van Gastel WA, Groenwold RH, et al. (2011) Association between cannabis and psychiatric hospitalization. Acta Psychiatr Scand 123: 368-375.
30. Cheung GW, Rensvold RB (2002) Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling 9: 233-255.
31. Vandenberg RJ (2002) Toward a further understanding of and improvement in measurement invariance methods and procedures. Organizational Research Methods 5: 139-158.
32. Meade AW (2010) A taxonomy of effect size measures for the differential functioning of items and scales. J Appl Psychol 95: 728-743.
33. Hanssen M, Peeters F, Krabbendam L, Radstake S, Verdoux H, et al. (2003) How Psychotic are individuals with non-psychotic disorders? Soc Psychiatry Psychiatr Epidemiol 38:149-154. (Pubitemid 37160778)
34. Thewissen V, Bentall RP, Lecomte T, van Os J, Myin-Germeys I (2008) Fluctuations in self-esteem and paranoia in the context of daily life. J of Abn Psychol 1:143-153. (Pubitemid 351274095)
35. Muthen B, Asparouhov T (2002) Latent Variable Analysis With Categorical, Outcomes: Multiple-Group And Growth Modeling In Mplus. Mplus Web Notes4: 1-22.
36. Muthén LK, Muthén BO (1998-2010) Mplus User's Guide, 6 edn. Los Angeles, CA: Muthén, Muthén. 752 p.
37. Bentler PM (1990) Comparative fit indexes in structural models. Psychol Bull 107: 238-246.
38. Bollen K, Long JS (1993) Testing structural equation models. Newbury Park, CA: Sage Publications Inc. 308 p.
39. Hu LT, Bentler PM (1995) Evaluating model fit. In: Hoyle RH. Structural Equation Modeling. Concepts, Issues, and Applications. London: Sage. pp. 76-99.
40. Browne MW, Cudeck R (1993) Alternative ways of assessing model fit. In:Bollen K, Long J.S. In Testing structural equation models. Newbury Park, CA: Sage Publications, Inc.pp. 136-162.
41. Schermelleh-Engel K, Moosbrugger H, Müller H (2003) Evaluating the fit of structural equation models: Tests of significance and descriptive goodness-of-fit measures. Methods of Psychological Research Online 8: 23-74. (Pubitemid 39064999)
42. Asparouhov T, Muthen B, Muthen L (2006) Robust Chi-Square Difference Testing with Mean and Variance Adjusted Test Statistics. Mplus Web Notes 10: 1-6.
43. Brenner K, Schmitz N, Pawliuk N, Fathalli F, Joober R, et al. (2007)Validation of the English and French versions of the Community Assessment of Psychic Experiences (CAPE) with a Montreal community sample. Schizophr Res 95: 86-95. (Pubitemid 47313653)
44. Horn JL, McArdle JJ (1992) A practical and theoretical guide to measurement invariance in aging research. Exp Aging Res 18: 117-144.
45. Meade AW, Lautenschlager GJ (2004) A Monte-Carlo study of confirmatory factor analytic tests of measurement equivalence/invariance. Structural Equation Modeling 11: 60-72. (Pubitemid 38710304)
46. R Development Core Team (2012) R: A language and Environment for Statistical Computing [2.15.1] R Foundation for Statistical Computing. Vienna, Austria.
47. Sekhon JS (2011) Multivariate and Propensity Score Matching Software with Automated Balance Optimization: the Matching Package for R. Journal of Statistical Software 42:1-52.