Calibrating Item Families and Summarizing the Results Using Family Expected Response Functions

Journal of Educational and Behavioral Statistics

Volumn 28, Issue 4, 2003, Pages 295-313

  Sinharay, Sandip ^a   Johnson, Matthew S ^b   Williamson, David M ^a  

^a EDUCATIONAL TESTING SERVICE   (United States)

^b CITY UNIVERSITY OF NEW YORK   (United States)

Author keywords

Automatic item generation; Bayesian methods; Family expected response function; Item model; Markov Chain Monte Carlo

Indexed keywords

EID: 1642295779     PISSN: 10769986     EISSN: None     Source Type: Journal    
DOI: 10.3102/10769986028004295     Document Type: Article

References (18)

1. Bradlow, E. T., Wainer, H., & Wang, X. (1999). A Bayesian random effects model for testlets. Psychometrika, 64, 153-168.
2. Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (1995). Bayesian data analysis. New York: Chapman & Hall.
3. Gelman, A., & Rubin, D. B. (1992). Inference from iterative simulation using multiple sequences. Statistical Science, 7, 457-511.
4. Gilks, W. R., Richardson, S., & Spiegelhalter, D. J. (1996). Markov chain Monte Carlo in practice. London, UK: Chapman and Hall.
5. Glas, C. A. W., & van der Linden, W. J. (2001). Modeling variability in item parameters in CAT. Paper presented at the North American Psychometric Society Meeting, King of Prussia, PA.
6. Hombo, C., & Dresher, A. (April, 2001). A simulation study of the impact of automatic item generation under NAEP-like data conditions. Paper presented at the Annual Meeting of the National Council on Measurement in Education, Seattle, WA.
7. Irvine, S. H., & Kyllonen, P. C. (Eds.). (2002). Item generation for test development. Mahwah, NJ: Lawrence Earlbaum Associates.
8. Janssen, R., Tuerlinckx, F., Meulders., M., & De Boeck, P. (2000). A hierarchical IRT model for criterion-referenced measurement. Journal of Educational and Behavioral Statistics, 25(3), 285-306.
9. Johnson, M. S., & Sinharay, S. (April, 2003). Calibration of automatically generated items using Bayesian hierarchical modeling. Paper presented at the annual meeting of the National Council on Measurement in Education, Chicago, IL.
10. Lord, F. M. (1980). Applications of item response theory to practical testing problems. Hillsdale, NJ: Lawrence Erlbaum Associates.
11. Muraki, E., & Bock,R. D. (1991). PARSCALE: parametric scaling of rating data. Chicago, IL: Scientific Software International.
12. Patz, R., & Junker, B. (1999). Applications and extensions of MCMC in IRT: Multiple item types, missing data, and rated responses. Journal of Educational and Behavioral Statistics, 24, 342-366.
13. Rizavi, S., Way, W. D., Davey, T., & Herbert, E. (April, 2002). Tolerable variation in item parameter estimation. Paper presented at the annual meeting of the National Council on Measurement in Education, New Orleans, LA.
14. Sandene, B., Bennett, R. E., Braswell, J., & Oranje, A. (in press). The Math Online study: Final report. Washington, DC: National Center for Educational Statistics, Office of Educational Research and Improvement, US Department of Education.
15. Singley, M. K., & Bennett, R. E. (2002). Item generation and beyond: Applications of schema theory to mathematics assessment. In S. H. Irvine & P. C. Kyllonen (Eds.), Item generation for test development (pp. 361-384). Hillsdale, NJ: Lawrence Erlbaum Associates.
16. Sinharay, S., Johnson, M. S., & Williamson, D. M. (2003). An application of a Bayesian hierarchical model for item family calibration (ETS RR-03-04). Princeton, NJ: Educational Testing Service.
17. Williamson, D. M., Johnson, M. S., Sinharay, S., & Bejar, I. (April, 2002). Hierarchical IRT examination of isomorphic equivalence of complex constructed response tasks. Paper presented at the annual meeting of the American Educational Research Association, New Orleans, LA.
18. Wright, D. (2002). Scoring tests when items have been generated. In S. H. Irvine & P. C. Kyllonen (Eds.), Item generation for test development (pp. 277-286). Hillsdale, NJ: Lawrence Erlbaum Associates.