Effects of sample size and distributional assumptions on competing models of the factor structure of the PANSS and BPRS

International Journal of Methods in Psychiatric Research

Volumn 26, Issue 4, 2017, Pages

  Tueller, Stephen J ^a   Johnson, Kiersten L ^a   Grimm, Kevin J ^b   Desmarais, Sarah L ^c   Sellers, Brian G ^d   Van Dorn, Richard A ^a  

^a RTI INTERNATIONAL   (United States)

^b ARIZONA STATE UNIVERSITY   (United States)

^c NORTH CAROLINA STATE UNIVERSITY   (United States)

^d EASTERN MICHIGAN UNIVERSITY   (United States)

Author keywords

BPRS; data integration; factor analysis; PANSS; psychopathology

Indexed keywords

BRIEF PSYCHIATRIC RATING SCALE; FACTOR ANALYSIS; HUMAN; MENTAL DISEASE; PSYCHOLOGICAL RATING SCALE; SAMPLE SIZE; STATISTICAL DISTRIBUTION; STATISTICAL MODEL; STATISTICS AND NUMERICAL DATA;

BRIEF PSYCHIATRIC RATING SCALE; FACTOR ANALYSIS, STATISTICAL; HUMANS; MENTAL DISORDERS; MODELS, STATISTICAL; PSYCHIATRIC STATUS RATING SCALES; SAMPLE SIZE; STATISTICAL DISTRIBUTIONS;

EID: 85006314748     PISSN: 10498931     EISSN: 15570657     Source Type: Journal    
DOI: 10.1002/mpr.1549     Document Type: Article

References (67)

1. Archer, J. O., & Jennrich, R. I. (1973). Standard errors for orthogonally rotated factor loadings. Psychometrika, 38(4), 581–592. doi:10.1007/BF02291496
2. Barch, D. M., Bustillo, J., Gaebel, W., Gur, R., Heckers, S., Malaspina, D., … Carpenter, W. (2013). Logic and justification for dimensional assessment of symptoms and related clinical phenomena in psychosis: relevance to DSM-5. Schizophrenia Research, 150(1), 15–20. doi:10.1016/j.schres.2013.04.027
3. Beauducel, A., & Herzberg, P. Y. (2006). On the performance of maximum likelihood versus means and variance adjusted weighted least squares estimation in CFA. Structural Equation Modeling, 13(2), 186–203. doi:10.1207/s15328007sem1302_2
4. Biancosino, B., Picardi, A., Marmai, L., Biondi, M., & Grassi, L. (2010). Factor structure of the Brief Psychiatric Rating Scale in unipolar depression. Journal of Affective Disorders, 124(3), 329–334. doi:10.1016/j.jad.2009.11.019
5. Boomsma, A. (2009). The robustness of maximum likelihood estimation in structural equation models. In P. Cuttance, & R. Ecob (Eds.), Structural Modeling by Example: Applications in Educational, Sociological, and Behavioral Research. (pp. 160–188). Cambridge: Cambridge University Press.
6. Browne, M. W., & Cudeck, R. (1992). Alternative ways of assessing model fit. Sociological Methods & Research, 21(2), 230–258.
7. Browne, M. W., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. Bollen, & J. Long (Eds.), Testing Structural Equation Models. (pp. 136–162). Newbury Park, CA: Sage.
8. Burger, G. K., Calsyn, R. J., Morse, G. A., Klinkenberg, W. D., & Trusty, M. L. (1997). Factor structure of the expanded Brief Psychiatric Rating Scale. Journal of Clinical Psychology, 53(5), 451–454. doi:10.1002/(SICI)1097-4679(199708)53:5<451::AID-JCLP5>3.0.CO;2-Q
9. Chen, F., Curran, P. J., Bollen, K. A., Kirby, J., & Paxton, P. (2008). An empirical evaluation of the use of fixed cutoff points in RMSEA test statistic in structural equation models. Sociological Methods & Research, 36(4), 462–494. doi:10.1177/0049124108314720
10. Cohen, J. (1973). Eta-squared and partial eta-squared in fixed factor ANOVA designs. Educational and Psychological Measurement, 33(1), 107–112. doi:10.1177/001316447303300111
11. Copas, J. B. (1983). Regression, prediction and shrinkage. Journal of the Royal Statistical Society: Series B, 45(3), 311–354.
12. Costello, A. B., & Osborn, J. W. (2005). Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Practical Assessment, Research & Evaluation, 10(7), 1–9.
13. Czobor, P., & Volavka, J. (1996). Dimensions of the Brief Psychiatric Rating Scale: An examination of stability during haloperidol treatment. Comprehensive Psychiatry, 37(3), 205–215. doi:10.1016/S0010-440X(96)90037-1
14. Curran, P. J., Bollen, K. A., Chen, F., Paxton, P., & Kirby, J. B. (2003). Finite sampling properties of the point estimates and confidence intervals of the RMSEA. Sociological Methods & Research, 32(2), 208–252.
15. Dingemans, P. M., Linszen, D. H., Lenior, M. E., & Smeets, R. M. (1995). Component structure of the expanded Brief Psychiatric Rating Scale (BPRS-E). Psychopharmacology (Berlin), 122(3), 263–267. doi:10.1007/BF02246547
16. Efron, B., & Tibshirani, R. J. (1994). An Introduction to the Bootstrap. Boca Raton, FL: CRC Press.
17. Fabrigar, L. R., Wegener, D. T., MacCallum, R. C., & Strahan, E. J. (1999). Evaluating the use of exploratory factor analysis in psychological research. Psychological Methods, 4(3), 272–299. doi:10.1037/1082-989X.4.3.272
18. Flora, D. B., & Curran, P. J. (2004). An empirical evaluation of alternative methods of estimation for confirmatory factor analysis with ordinal data. Psychological Methods, 9(4), 466–491. doi:10.1037/1082-989X.9.4.466
19. Hallquist, M., & Wiley, J. (2013). MplusAutomation: Automating Mplus model estimation and interpretation. R package version 0.6–2. http://CRAN.R-project.org/package=MplusAutomation
20. Harvey, P. D., Davidson, M., White, L., Keefe, R. S., Hirschowitz, J., Mohs, R. C., & Davis, K. L. (1996). Empirical evaluation of the factorial structure of clinical symptoms in schizophrenia: Effects of typical neuroleptics on the brief psychiatric rating scale. Biological Psychiatry, 40(8), 755–760. doi:10.1016/0006-3223(95)00486-6
21. Hsueh, I. P., Wang, W. C., Sheu, C. F., & Hsieh, C. L. (2004). Rasch analysis of combining two indices to assess comprehensive ADL function in stroke patients. Stroke, 35(3), 721–726. doi:10.1161/01.STR.0000117569.34232.76
22. Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1–55. doi:10.1080/10705519909540118
23. Hurvich, C. M., & Tsai, C. L. (1990). The impact of model selection on inference in linear regression. American Statistician, 44(3), 214–217. doi:10.2307/2685338
24. Insel, T., Cuthbert, B., Garvey, M., Heinssen, R., Pine, D. S., Quinn, K., … Wang, P. (2010). Research domain criteria (RDoC), toward a new classification framework for research on mental disorders. American Journal of Psychiatry, 167(7), 748–751. doi:10.1176/appi.ajp.2010.09091379
25. Jacobs, M. S., Ryba, N. L., & Zapf, P. A. (2008). Competence-related abilities and psychiatric symptoms: An analysis of the underlying structure and correlates of the MacCAT-CA and the BPRS. Law and Human Behavior, 32(1), 64–77. doi:10.1007/s10979-007-9086-8
26. Kay, S. R., Fiszbein, A., & Opler, L. A. (1987). The positive and negative syndrome scale (PANSS) for schizophrenia. Schizophrenia Bulletin, 13(2), 261–276. doi:10.1093/schbul/13.2.261
27. Kelley, M. E., White, L., Compton, M. T., & Harvey, P. D. (2013). Subscale structure for the Positive and Negative Syndrome Scale (PANSS): A proposed solution focused on clinical validity. Psychiatry Research, 205(1–2), 137–142. doi:10.1016/j.psychres.2012.08.019
28. Keren, G., & Lewis, C. (1979). Partial omega squared for ANOVA designs. Educational and Psychological Measurement, 39(1), 119–128. doi:10.1177/001316447903900116
29. Lei, P. W. (2009). Evaluating estimation methods for ordinal data in structural equation modeling. Quality & Quantity, 43(3), 495–507. doi:10.1007/s11135-007-9133-z
30. Long, J. D., & Brekke, J. S. (1999). Longitudinal factor structure of the Brief Psychiatric Rating Scale in schizophrenia. Psychological Assessment, 11(4), 498–506. doi:10.1037/1040-3590.11.4.498
31. Lyne, J. P., Kinsella, A., & O'Donoghue, B. (2012). Can we combine symptom scales for collaborative research projects? Journal of Psychiatric Research, 46(2), 233–238. doi:10.1016/j.jpsychires.2011.10.002
32. MacCallum, R. C., Browne, M. W., & Sugawara, H. M. (1996). Power analysis and determination of sample size for covariance structure modeling. Psychological Methods, 1(2), 130–149. doi:10.1037/1082-989X.1.2.130
33. MacCallum, R. C., Widaman, K. F., Zhang, S., & Hong, S. (1999). Sample size in factor analysis. Psychological Methods, 4(1), 84–99. doi:10.1037/1082-989X.4.1.84
34. Meulman, J. J., & Heiser, W. J. (2001). SPSS Categories 11.0. Chicago, IL: SPSS.
35. Mueser, K. T., Corrigan, P. W., Hilton, D. W., Tanzman, B., Schaub, A., Gingerich, S., … Herz, M. I. (2002). Illness management and recovery: A review of the research. Psychiatric Services, 53(10), 1272–1284. doi:10.1176/appi.ps.53.10.1272
36. Muthén, B. (1984). A general structural equation model with dichotomous, ordered categorical, and continuous latent variable indicators. Psychometrika, 49(1), 115–132. doi:10.1007/BF02294210
37. Muthén, B., & Kaplan, D. (1985). A comparison of some methodologies for the factor analysis of non-normal Likert variables. British Journal of Mathematical and Statistical Psychology, 38(2), 171–189. doi:10.1111/j.2044-8317.1985.tb00832.x
38. Muthén, L. K., & Muthén, B. O. (1998–2012). Mplus User's Guide (7th ed.). Los Angeles, CA: Muthén & Muthén.
39. Nakaya, M., Suwa, H., & Ohmori, K. (1999). Latent structures underlying schizophrenic symptoms: A five-dimensional model. Schizophrenia Research, 39(1), 39–50. doi:10.1016/S0920-9964(99)00018-3
40. Overall, J. E. (1974). The Brief Psychiatric Rating Scale in psychopharmacology research. In P. Pichot, & R. Olivier-Martin (Eds.), Psychological Measurements in Psychopharmacology: Modern Problems in Psychopharmacology (pp. 67–78). Oxford: Karger.
41. Overall, J. E., & Beller, S. A. (1984). The Brief Psychiatric Rating Scale (BPRS) in geropsychiatric research: I. Factor structure on an inpatient unit. Journals of Gerontology, 39(2), 187–193. doi:10.1093/geronj/39.2.187
42. Ownby, R. L., & Seibel, H. P. (1994). A factor analysis of the Brief Psychiatric Rating Scale in an older psychiatric population: Exploratory and confirmatory analyses. Multivariate Experimental Clinical Research, 10, 145–156.
43. Picardi, A., Battisti, F., de Girolamo, G., Morosini, P., Norcio, B., Bracco, R., & Biondi, M. (2008). Symptom structure of acute mania: a factor study of the 24-item Brief Psychiatric Rating Scale in a national sample of patients hospitalized for a manic episode. Journal of Affective Disorders, 108(1–2), 183–189. doi:10.1016/j.jad.2007.09.010
44. Preacher, K. J., Zhang, G., Kim, C., & Mels, G. (2013). Choosing the optimal number of factors in exploratory factor analysis: A model selection perspective. Multivariate Behavioral Research, 48(1), 28–56.
45. R Core Team (2014). R: A language and environment for statistical computing. Vienna:. http://www.R-project.org/R Foundation for Statistical Computing.
46. Rencher, A. C., & Pun, F. C. (1980). Inflation of R2 in best subset regression. Technometrics, 22(1), 49–54. doi:10.2307/1268382
47. Rodriguez-Jimenez, R., Bagney, A., Mezquita, L., Martinez-Gras, I., Sanchez-Morla, E. M., Mesa, N., … Palomo, T. (2013). Cognition and the five-factor model of the positive and negative syndrome scale in schizophrenia. Schizophrenia Research, 143(1), 77–83. doi:10.1016/j.schres.2012.10.020
48. Roecker, E. B. (1991). Prediction error and its estimation for subset – selected models. Technometrics, 33(4), 459–468. doi:10.1080/00401706.1991.10484873
49. Rouquette, A., & Falissard, B. (2011). Sample size requirements for the internal validation of psychiatric scales. International Journal of Methods in Psychiatric Research, 20(4), 235–249. doi:10.1002/mpr.352
50. Savalei, V., & Rhemtulla, M. (2013). The performance of robust test statistics with categorical data. British Journal of Mathematical and Statistical Psychology, 66(2), 201–223. doi:10.1111/j.2044-8317.2012.02049.x
51. Schmitt, T. A. (2011). Current methodological considerations in exploratory and confirmatory factor analysis. Journal of Psychoeducational Assessment, 29(4), 304–321. doi:10.1177/0734282911406653
52. Schwarz, G. E. (1978). Estimating the dimension of a model. Annals of Statistics, 6(2), 461–464. doi:10.1214/aos/1176344136
53. Shafer, A. (2005). Meta-analysis of the brief psychiatric rating scale factor structure. Psychological Assessment, 17(3), 324–335. doi:10.1037/1040-3590.17.3.324
54. Shtasel, D. L., Gur, R. E., Gallacher, F., Heimberg, C., Cannon, T., & Gur, R. C. (1992). Phenomenology and functioning in first-episode schizophrenia. Schizophrenia Bulletin, 18(3), 449–462. doi:10.1093/schbul/18.3.449
55. Stochl, J., Jones, P. B., Perez, J., Khandaker, G. M., Bohnke, J. R., & Croudace, T. J. (2016). Effects of ignoring clustered data structure in confirmatory factor analysis of ordered polytomous items: A simulation study based on PANSS. International Journal of Methods in Psychiatric Research, 25(3), 205–219. doi:10.1002/mpr.1474
56. Stochl, J., Jones, P. B., Plaistow, J., Reininghaus, U., Priebe, S., Perez, J., & Croudace, T. J. (2014). Multilevel ordinal factor analysis of the positive and negative syndrome scale (PANSS). International Journal of Methods in Psychiatric Research, 23(1), 25–35. doi:10.1002/mpr.1429
57. Stuart, G. W., Malone, V., Currie, J., Klimidis, S., & Minas, I. H. (1995). Positive and negative symptoms in neuroleptic-free psychotic inpatients. Schizophrenia Research, 16(3), 175–188. doi:10.1016/0920-9964(94)00083-K
58. Thomas, A., Donnell, A. J., & Young, T. R. (2004). Factor structure and differential validity of the expanded Brief Psychiatric Rating Scale. Assessment, 11(2), 177–187. doi:10.1177/1073191103262893
59. van der Gaag, M., Cuijpers, A., Hoffman, T., Remijsen, M., Hijman, R., de Haan, L., … Wiersma, D. (2006). The five-factor model of the Positive and Negative Syndrome Scale I: Confirmatory factor analysis fails to confirm 25 published five-factor solutions. Schizophrenia Research, 85(1–3), 273–279. doi:10.1016/j.schres.2006.04.001
60. van der Gaag, M., Hoffman, T., Remijsen, M., Hijman, R., de Haan, L., van Meijel, B., … Wiersma, D. (2006). The five-factor model of the Positive and Negative Syndrome Scale II: A ten-fold cross-validation of a revised model. Schizophrenia Research, 85(1–3), 280–287. doi:10.1016/j.schres.2006.03.021
61. Van Dorn, R. A., Desmarais, S. L., Grimm, K., Tueller, S., Johnson, K. L., Sellers, B., & Swartz, M. (2016). The latent structure of psychiatric symptoms across mental disorders as measured with the PANSS and BPRS. Psychiatric Research, 245, 83–90.
62. Venables, W. N., & Ripley, B. D. (2002). Modern Applied Statistics with S. New York: Springer.
63. Ventura, J., Nuechterlein, K. H., Subotnik, K. L., Gutkind, D., & Gilbert, E. A. (2000). Symptom dimensions in recent-onset schizophrenia and mania: a principal components analysis of the 24-item Brief Psychiatric Rating Scale. Psychiatry Research, 97(2–3), 129–135. doi:10.1016/S0165-1781(00)00228-6
64. Wallwork, R. S., Fortgang, R., Hashimoto, R., Weinberger, D. R., & Dickinson, D. (2012). Searching for a consensus five-factor model of the Positive and Negative Syndrome Scale for schizophrenia. Schizophrenia Research, 137(1–3), 246–250. doi:10.1016/j.schres.2012.01.031
65. White, L., Harvey, P. D., Opler, L., & Lindenmayer, J. P. (1997). Empirical assessment of the factorial structure of clinical symptoms in schizophrenia. A multisite, multimodel evaluation of the factorial structure of the Positive and Negative Syndrome Scale. The PANSS Study Group. Psychopathology, 30(5), 263–274. doi:10.1159/000285058
66. Wilkinson, L., & Dallal, G. E. (1981). Tests of significance in forward selection regression with an F-to enter stopping rule. Technometrics, 23(4), 377–380. doi:10.2307/1268227
67. Willem Van der Does, A. J., Dingemans, P. M., Linszen, D. H., Nugter, M. A., & Scholte, W. F. (1995). Dimensions and subtypes of recent-onset schizophrenia. A longitudinal analysis. Journal of Nervous and Mental Disease, 183(11), 681–687. doi:10.1097/00005053-199511000-00002