Numerical Differentiation Methods for Computing Error Covariance Matrices in Item Response Theory Modeling: An Evaluation and a New Proposal

Educational and Psychological Measurement

Volumn 73, Issue 3, 2013, Pages 412-439

  Tian, Wei ^a   Cai, Li ^b   Thissen, David ^c   Xin, Tao ^a  

^a BEIJING NORMAL UNIVERSITY   (China)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c UNIVERSITY OF NORTH CAROLINA   (United States)

Author keywords

EM algorithm; forward difference; numerical differentiation; Richardson extrapolation; Supplemented EM algorithm; variance covariance matrix

Indexed keywords

EID: 84876963675     PISSN: 00131644     EISSN: 15523888     Source Type: Journal    
DOI: 10.1177/0013164412465875     Document Type: Article

References (37)

1. Baker F.,Kim S.-H.Item response theory: Parameter estimation techniques. New York, NY: Dekker; 2004:.
2. Bishop Y. M. M.,Fienberg S. E.,Holland P. W.Discrete multivariate analysis: Theory and practice. Cambridge: MIT Press; 1975:.
3. Bock R. D.Estimating item parameters and latent ability when responses are scored in two or more nominal categories.Psychometrika. 1972;37:29-51.
4. Bock R. D.,Aitkin M.Marginal maximum likelihood estimation of item parameters: Application of an EM algorithm.Psychometrika. 1981;46:443-459.
5. Bock R. D.,Lieberman M.Fitting a response model for n dichotomously scored items.Psychometrika. 1970;35:179-197.
6. Bock R. D.,Muraki E.,Pfeiffenberger W.Item pool maintenance in the presence of item parameter drift.Journal of Educational Measurement. 1988;25:275-285.
7. Cai L.SEM of another flavour: Two new applications of the supplemented EM algorithm.British Journal of Mathematical and Statistical Psychology. 2008;61:309-329.
8. Cai L.A two-tier full-information item factor analysis model with applications.Psychometrika. 2010;75:581-612.
9. Cai L.Seattle, WA: Vector Psychometric Group; 2012:.
10. Cai L.,Maydeu-Olivares A.,Coffman D. L.,Thissen D.Limited-information goodness-of-fit testing of item response theory models for sparse 2p tables.British Journal of Mathematical and Statistical Psychology. 2006;59:173-194.
11. Cai L.,Thissen D.,du Toit S. H. C.Lincolnwood, IL: Scientific Software International; 2011:.
12. Cai L.,Yang J.,Hansen M.Generalized full-information item bifactor analysis.Psychological Methods. 2011;16:221-248.
13. Cheng Y.,Yuan K.-H.The impact of fallible item parameter estimates on latent trait recovery.Psychometrika. 2010;75:280-291.
14. Dempster A. P.,Laird N. M.,Rubin D. B.Maximum likelihood estimation from incomplete data via the EM algorithm.Journal of the Royal Statistical Society: Series B. 1977;39:1-38.
15. Fisher R. A.Theory of statistical estimation.Proceedings of the Cambridge Philosophical Society. 1925;22:699-725.
16. Hambleton R. K.,Jones R. W.Item parameters estimation errors and their influence on test information functions.Applied Measurement in Education. 1994;7:171-186.
17. Hoshino T.,Shigemasu K.Standard errors of estimated latent variable scores with estimated structural parameters.Applied Psychological Measurement. 2008;32:181-189.
18. Jamshidian M.,Jennrich R. I.Standard errors for EM estimation.Journal of the Royal Statistical Society: Series B. 2000;62:257-270.
19. Kim S.-H.,Cohen A. S.,Park T.-H.Detection of differential item functioning in multiple groups.Journal of Educational Measurement. 1995;32:261-276.
20. LangerM. M. (2008). A reexamination of Lord's Wald test for differential item functioning using item response theory and modern error estimation (Unpublished doctoral dissertation). University of North Carolina at Chapel Hill.
21. Louis T. A.Finding the observed information matrix when using the EM algorithm.Journal of the Royal Statistical Society: Series B. 1982;44:226-233.
22. The EM algorithm and extensions. McLachlan G. J.Krishnan T., ed. New York, NY: Wiley; 1996:.
23. Meilijson I.A fast improvement to the EM algorithm on its own terms.Journal of the Royal Statistical Society: Series B. 1989;51:127-138.
24. Meng X.-L.,Rubin D. B.Using EM to obtain asymptotic variance-covariance matrices: The SEM algorithm.Journal of the American Statistical Association. 1991;86:899-909.
25. Mislevy R. J.,Wingersky M. S.,Sheehan K. M.Dealing with uncertainty about item parameters: Expected response functions. Princeton, NJ: Educational Testing Service; 1993:.
26. PISA 2000 technical report. Paris, France: Author; 2002:.
27. Orchard, T., & Woodbury, M. A. (1972). A missing information principle: Theory and application. In L. M. Lecam, J. Neyman, & E. L. Scott (Eds.), Proceedings of the sixth Berkeley Symposium on Mathematical Statistics and Probability (pp. 697-715). Berkeley: University of California Press.
28. Preston K.,Reise S.,Cai L.,Hays R.Using the nominal response model to evaluate response category discrimination in the PROMIS emotional distress item pools.Educational and Psychological Measurement. 2011;71:523-550.
29. Rao C. R.Linear statistical inference and its applications. 1973). Linear statistical inference and its applications (2nd ed.). New York, NY: John Wiley.New York, NY: John Wiley; 1973:.
30. Samejima F.Estimation of latent ability using a response pattern of graded scores.Psychometric Monographs. 1969;17:1-100.
31. Smith C. A. B.Discussion of "Maximum likelihood estimation from incomplete data via the EM algorithm" by A. P. Dempster, N. M. Laird, & D. B. Rubin.Journal of the Royal Statistical Society: Series B. 1977;39:24-25.
32. Thissen D.Marginal maximum likelihood estimation for the one-parameter logistic model.Psychometrika. 1982;47:175-186.
33. Thissen D.,Cai L.,Bock R. D.Handbook of polytomous item response theory models: Developments and applications. Nering M.Ostini R., ed. New York, NY: Taylor & Francis; 2011:43-75.
34. Thissen D.,Steinberg L.A taxonomy of item response models.Psychometrika. 1986;51:567-577.
35. Thissen D.,Wainer H.Confidence envelopes for item response theory.Journal of Educational Statistics. 1990;15:113-128.
36. Tsutakawa R. K.,Johnson J. C.The effect of uncertainty of item parameter estimation on ability estimates.Psychometrika. 1990;55:371-390.
37. Yang J.,Hansen M.,Cai L.Characterizing sources of uncertainty in item response theory scale scores.Educational and Psychological Measurement. 2012;72:264-290.