Application of group-level item response models in the evaluation of consumer reports about health plan quality

Multivariate Behavioral Research

Volumn 41, Issue 1, 2006, Pages 85-102

  Reise, Steven P ^a,c   Meijer, Rob R ^b   Ainsworth, Andrew T ^a   Morales, Leo S ^a   Hays, Ron D ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF TWENTE   (Netherlands)

^c UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 33745697592     PISSN: 00273171     EISSN: None     Source Type: Journal    
DOI: 10.1207/s15327906mbr4101_6     Document Type: Review

References (40)

1. AHRQ. (1999). CAHPS 2.0 survey and reporting kit. Rockville, MD: Agency for Healthcare Policy and Research.
2. AHRQ. (2000). From the pipeline of health services research-CAHPS6: The story of the Consumer Assessment of Health Plans Study. Translating research into practice fact sheet. AHRQ Publication No. 00-P014, Rockville, MD: Author.
3. Bock, R. D., & Mislevy, R. J. (1981). An item response curve model for matrix-sampling data: The California grade-three assessment. In D. Carlson (Ed.), Testing in the states: Beyond accountability (pp. 65-90). San Francisco: Jossey-Bass.
4. Bock, R. D., & Mislevy, R. J. (1982). Adaptive EAP estimation of ability in a microcomputer environment. Applied Psychological Measurement, 6, 431-444.
5. Bock, R. D., & Mislevy, R. J. (1988). Comprehensive educational assessment for the states: The duplex design. Educational Evaluation and Policy Analysis, 10, 89-105.
6. Brown, J. A., Nederend, S. E., Hays, R. D., Short, P. F., & Parley, D. O. (1999). Special issues in assessing care of Medicaid recipients. Medical Care, 37, MS79-88.
7. Buchner, D. A., & Probst, L. Y. (1999). The member satisfaction survey as a measure of health plan accountability. Quality Management in Health Care, 7, 41-49.
8. Cleary, P. D. (1999). The increasing importance of patient surveys. Quality in Health Care, 8, 212.
9. Embretson, S. E., & Reise, S. P. (2000). Item response theory for psychologists. Mahwah, NJ: Lawrence Erlbaum Associates, Inc.
10. Grayson, D. A. (1988). Two-group classification in latent trait theory: Scores with monotone likelihood ration. Psychometrika, 53, 383-392.
11. Guttman, L. (1944). A basis for scaling qualitative data. American Sociological Review, 9, 383-392.
12. Guttman, L. (1950). The basis for scalogram analysis. In S. A. Stouffer, L. Guttman, E. A. Suchman, P. F. Lazarsfeld, S. A. Star, & I. A. Claussen (Eds.), Measurement and prediction (pp. 60-90). Princeton, NJ: Princeton University Press.
13. Hargraves, J. L., Palmer, R. H., Zapka, J., Nerenz, D., Frazier, H., Orav, E. J., et al. (1993). Using patient reports to measure health care system performance. Clinical Performance and Quality Health Care, 1, 208-213.
14. Hays, R. D., & Revicki, D. (2005). Reliability and validity (including responsiveness). In P. Payers & R. Hays (Eds.), Assessing quality of life in clinical trials: Methods and practice, 2nd edition (pp. 25-39). Oxford, England: Oxford University Press.
15. Hays, R. D., Shaul, J. A., Williams, V. S., Lubalin, J. S., Harris-Kojetin, L. D., Sweenly, S. F., et al. (1999). Psychometric properties of the CAHPS® 1.0 survey measures. Consumer Assessment of Health Plans Study. Medical Care, 37(3 Suppl), MS22-31.
16. Heck, R. H. (1999). Multilevel modeling with SEM. In S. L. Thomas & R. H. Heck (Eds.), Introduction to multilevel modeling techniques (pp. 89-127). Mahwah, NJ: Lawrence Erlbaum Associates, Inc.
17. Hemker, B. T., Sijtsma, K., Molenaar, I. W., & Junker, B. W. (1997). Stochastic ordering using the latent trait and the sum score in polytomous IRT models. Psychometrika, 62, 331-347.
18. Huynh, H. (1994). A new proof for monotone likelihood ratio for the sum of independent Bernoulli random variables. Psychometrika, 59, 77-79.
19. Loevinger, J. (1948). The technique of homogeneous tests compared with some aspects of "scale analysis" and factor analysis. Psychological Bulletin, 45, 507-530.
20. Marshall, G. N., Morales, L. S., Elliott, M., Spritzer, K., & Hays, R. D. (2001). Confirmatory factor analysis of the Consumer Assessment of Health Plans Study (CAHPS) 1.0 core survey. Psychological Assessment, 13, 216-229.
21. Meijer, R. R., Sijtsma, K., & Smid, N. G. (1990). Theoretical and empirical comparison of the Mokken and the Rasch approach to IRT. Applied Psychological Measurement, 14, 283-298.
22. Mislevy, R. J. (1983). Item response models for grouped data. Journal of Educational Statistics, 8, 271-288.
23. Mislevy, R. J., & Bock, R. D. (1989). A hierarchical item-response model for educational testing. In R. D. Bock (Ed.), Multilevel analysis of educational data (pp. 57-74). San Diego, CA: Academic Press.
24. Mokken, R. J. (1971). A theory and procedure of scale analysis. Berlin: De Gruyter.
25. Mokken, R. J., & Lewis, C. (1982). A nonparametric approach to the analysis of dichotomous item responses. Applied Psychological Measurement, 6, 417-430.
26. Mokken, R. J., Lewis, C., & Sijtsma, K. (1986). Rejoinder to "The Mokken Scale: A critical discussion." Applied Psychological Measurement, 10, 279-285.
27. Molenaar, I. W., & Sijtsma, K. (2000). User's manual MSP5 for Windows. Groningen: iecProGAMMA.
28. Morales, L. S., Elliott, M. N., Weech-Maldonado, R., Spritzer, K. L., & Hays, R. D. (2001). Differences in CAPHS® adult survey ratings and reports by race and ethnicity: An analysis of the national CAHPS® benchmarking data 1.0. Health Services Research, 36, 595-617.
29. Morales, L., Reise, S., & Hays, R.D. (2000). Evaluating the equivalence of health care ratings by whites and Hispanics. Medical Care, 38, 517-527.
30. Muthén, B. O. (1991). Multilevel factor analysis of class and student achievement components. Journal of Educational Measurement, 28, 338-354.
31. Muthén, B. O. (1994). Multilevel covariance structure analysis. Sociological Methods & Research, 22, 376-398.
32. Muthén, B. O., & Muthén, L. (2001). MPLUS user's guide. Los Angeles CA: Authors.
33. Reiser, M. (1983). An item response model for the estimation of demographic effects. Journal of Educational Statistics, 8, 165-186.
34. Shapiro, M. P., Berk, M. L., Berry, S. H., Emmons, C. A., Athey, L. A., Hsia, D. C., et al. (1999). National probability samples in studies of low-prevalence diseases. Part I: Perspectives and lessons from the HIV cost and services utilization study. Health Services Research, 34(5 Pt 1), 951-1068.
35. Shoemaker, D. M., & Shoemaker, S. S. (1981). Applicability of multiple matrix sampling to estimating effectiveness of educational programs. Evaluation and Program Planning, 4, 151-161.
36. Sijtsma, K. (1998). Methodology review: Nonparametric IRT approaches to the analysis of dichotomous item scores. Applied Psychological Measurement, 22, 3-31.
37. Sijtsma, K., & Molenaar, I. W. (2002). Introduction to nonparametric item response theory. Thousand Oaks, CA: Sage.
38. Snijders, T. A. B. (2001). Two-level nonparametric scaling for dichotomous data. In A. Boomsma, M. A. J. van Duijn, & T. A. B. Snijders (Eds.), Essays on item response theory (pp. 319-338). New York: Springer.
39. Tate, R. L. (1995). Robustness of the school-level IRT model. Journal of Educational Measurement, 32, 145-162.
40. Tate, R. L., & King, F. J. (1994). Factors which influence precision of school-level IRT ability estimates. Journal of Educational Measurement, 31, 1-15.