Testlet response theory and its applications

Testlet Response Theory and its Applications

Volumn , Issue , 2007, Pages 1-267

  Wainer, Howard ^a   Bradlow, Eric T ^b   Wang, Xiaohui ^c  

^a National Board of Medical Examiners   (United States)

^b UNIVERSITY OF PENNSYLVANIA   (United States)

^c UNIVERSITY OF VIRGINIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84929724869     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1017/CBO9780511618765     Document Type: Book

References (229)

1. Albert, J. H. (1992). Bayesian estimation of normal ogive item response curves using Gibbs sampling. Journal of Educational Statistics, 17, 251–269.
2. Albert, J. H., & Chib, S. (1993). Bayesian analysis of binary and polychotomous response data. Journal of the American Statistical Association, 88, 669–679.
3. American Psychological Association. (1966). Standards for educational and psychological tests and manuals. Washington, DC: Author.
4. American Psychological Association. (1974). Standards for educational and psychological tests. Washington, DC: Author.
5. American Psychological Association. (1985). Standards for educational and psychological testing. Washington, DC: Author.
6. Anastasi, A. (1961). Psychological testing (2nd ed.). New York: Macmillan.
7. Anastasi, A. (1976). Psychological testing (4th ed.). New York: Macmillan.
8. Andersen, E. B. (1970). Asymptotic properties of conditional maximum likelihood estimators. Journal of the Royal Statistical Society, Series B, 32, 283–301.
9. Anderson, T. W. (1971). The statistical analysis of time series. New York: Wiley.
10. Angoff, W. H. (1971). Scales, norms and equivalent scores. In R. L. Thorndike (Ed.), Educational measurement (pp. 508–600). Washington, DC: American Council on Education.
11. Angoff, W. H. (1982). Use of difficulty and discrimination indices for detecting item bias. In R. A. Berk (Ed.), Handbook of methods for detecting item bias (pp. 96–116) Baltimore, MD: Johns Hopkins University Press.
12. Angoff, W. H. (1993). Perspectives on the theory and application of differential item functioning methodology. In P. W. Holland & H. Wainer (Eds.), Differential item functioning (pp. 3–23). Hillsdale, NJ: Erlbaum.
13. Bell, E. T. (1937). Men of mathematics. New York: Simon & Schuster.
14. Bentler, P. M., & Bonett, D. G. (1980). Significance tests and goodness of fit in the analysis of covariance structures. Psychological Bulletin, 88, 588–606.
15. Birnbaum, A. (1968). Some latent trait models and their use in inferring an examinee’s ability. In F. M. Lord & M. R. Novick (Eds.), Statistical theories of mental test scores (pp. 392–479). Reading, MA: Addison-Wesley.
16. Bishop, Y. M. M., Fienberg, S. E., & Holland, P.W. (1975). Discrete multivariate analysis. Cambridge, MA: MIT Press.
17. Bock, R. D. (1967, March). Fitting a response model for n dichotomous items. Paper presented at the annual meeting of the Psychometric Society, Madison, WI.
18. Bock, R. D. (1972). Estimating item parameters and latent ability when responses are scored in two or more latent categories. Psychometrika, 37, 29–51.
19. Bock, R. D. (1993). Different DIFs: Comment on the papers read by Neil Dorans and David Thissen. In P. W. Holland & H. Wainer (Eds.), Differential item functioning (pp. 115–122). Hillsdale, NJ: Erlbaum.
20. Bock, R. D., & Aitkin, M. (1981). Marginal maximum likelihood estimation of item parameters: An application of an EM algorithm. Psychometrika, 46, 443–459.
21. Bock, R. D., Gibbons, R., & Muraki, E. (1988). Full information item factor analysis. Applied Psychological Measurement, 12, 261–280.
22. Bock, R. D., & Kolakowski, R. (1973). Further evidence of sex-linked major-gene influence on human spatial visualizing ability. American Journal of Human Genetics, 25, 1–14.
23. Bock, R. D., & Lieberman, M. (1970). Fitting a response model for n dichotomously scored items. Psychometrika, 35, 179–197.
24. Boulet, J. R., Ben David, M. F., Ziv, A., Burdick, W. P., Curtis, M., Peitzman, S., & Gary, N. C. (1998). Using standardized patients to assess the interpersonal skills of physicians. Academic Medicine, 73, S94–S96.
25. Bradlow, E. T., & Wainer, H. (1998). Some statistical and logical considerations when rescoring tests. Statistica Sinica, 8, 713–728.
26. Bradlow, E. T., Wainer, H., & Wang, X. (1999). A Bayesian random effects model for testlets. Psychometrika, 64, 153–168.
27. Brown, W. (1910). Some experimental results in the correlation of mental abilities. British Journal of Psychology, 3, 296–322.
28. Brown, W., & Thomson, G. H. (1925). The essentials of mental measurement (3rd ed.). London: Cambridge University Press.
29. Bush, R. R., & Mosteller, F. (1955). Stochastic models for learning. New York: Wiley.
30. Chang, H.-H., & Mazzeo, J. (1994). The unique correspondence of item response functions and item category response function in polytomously scored item response models. Psychometrika, 59, 391–404.
31. Chib, S., & Greenberg, E. (1995). Understanding the Metropolis–Hastings algorithm. The American Statistician, 49, 327–335.
32. Clauser, B. E., Mazor, K. M., & Hambleton, R. K. (1991). Influence of the criterion variable on the identification of differentially functioning test items using the Mantel–Haenszel statistic. Applied Psychological Measurement, 15, 353–359.
33. Clauser, B. E., Mazor, K. M., & Hambleton, R. K. (1993). The effects of purification of the matching criterion on the identification of DIF using the Mantel–Haenszel procedure. Applied Measurement in Education, 6, 269–279.
34. Clauser, B. E., Mazor, K. M., & Hambleton, R. K. (1994). The effect of score group width on the detection of differentially functioning items with the Mantel–Haenszel procedure. Journal of Educational Measurement, 31, 67–78.
35. Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20, 37–46.
36. Congdon, P. (2001). Bayesian statistical modeling (pp. 465–493). England: Wiley.
37. Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16, 297–334.
38. Cronbach, L. J., Gleser, G. C., Nanda, H., & Rajaratnam, N. (1972). The dependability of behavioral measurements: Theory of generalizability for scores and profiles. New York: Wiley.
39. Crumm, W. L. (1923). Note on the reliability of a test, with a special reference to the examinations set by the College Entrance Board. The American Mathematical Monthly, 30(6), 296–301.
40. Damien, P., Wakefield, J. C., & Walker, S. G. (1999). Gibbs sampling for Bayesian nonconjugate and hierarchical models by using auxiliary variables. Journal of the Royal Statistical Society, B Statistical Methodology, 61, 331–344.
41. Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977).Maximumlikelihood from incomplete data via the EM algorithm (with discussion). Journal of the Royal Statistical Society, shape Series B, 39, 1–38.
42. Donlon, T. F., & Angoff, W. H. (1971). The Scholastic Aptitude Test. In W. H. Angoff (Ed.), The College Board Admissions Testing Program (pp. 15–47). New York: College Entrance Examination Board.
43. Donoghue, J. R., Holland, P. W., & Thayer, D. T. (1993). A Monte Carlo study of factors that affect the Mantel–Haenszel and standardization measures of differential item functioning. In P. W. Holland & H. Wainer (Eds.), Differential item functioning (pp. 137–166). Hillsdale, NJ: Erlbaum.
44. Dorans, N. J., & Holland, P. W. (1993). DIF detection and description: Mantel–Haenszel and standardization. In P.W. Holland &H. Wainer (Eds.), Differential item functioning (chap. 3, pp. 35–66). Hillsdale, NJ: Erlbaum.
45. Duhachek, A., Coughlan, A. T., & Iacobucci, D. (2005). Results on the Standard Error of the Coefficient Alpha Index of Reliability. Marketing Science, 24(2), 294–301.
46. Efron, B., & Morris, C. (1973). Stein’s estimation rule and its competitors – An empirical Bayes approach. Journal of the American Statistical Association, 68, 117–130.
47. Efron, B., & Morris, C. (1975). Data analysis using Stein’s estimator and its generalizations. Journal of the American Statistical Association, 70, 311–319.
48. Eignor, D. R., & Cook, L. L. (1983, April). An investigation of the feasibility of using item response theory in the preequating of aptitude tests. Paper presented at the annual meeting of the American Educational Research Association, Montreal, Canada.
49. Ferguson, T. S. (1973, March), A Bayesian analysis of some nonparametric problems. The Annals of Statistics, 1(2), 209–230.
50. Fisher, R. A. (1922). On the mathematical foundations of theoretical statistics. Philosophical Transactions of the Royal Society of London A, 222, 309–368.
51. Fisher, R. A. (1925). Theory of statistical estimation. Proceedings of the Cambridge Philosophic Society, 22, 700–725.
52. Gelfand, A. E., & Smith, A. F. M. (1990). Sampling-based approaches to calculating marginal densities. Journal of the American Statistical Association, 85, 398–409.
53. Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (1995). Bayesian data analysis. London: Chapman & Hall.
54. Gelman, A., Carlin, J. B., Stern, H.S., & Rubin, D. B. (2003). Bayesian data analysis (2nd ed.). New York: Chapman & Hall.
55. Gelman, A., Roberts, G., & Gilks, W. (1995). Efficient Metropolis jumping rules. In Bayesian statistics 5. New York: Oxford University Press.
56. Gelman, A., & Rubin, D. B. (1992). Inference from iterative simulation using multiple sequences. Statistical Science, 7, 457–472.
57. Geman, S., & Geman, D. (1984). Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images. IEEE Transactions on Pattern Analysis and Machine Intelligence, 6, 721–741.
58. Gessaroli, M. E., & Folske, J. C. (2002). Generalizing the reliability of tests comprised of testlets. International Journal of Testing, 2, 277–295.
59. Geyer, C. J. (1994). On the convergence of Monte Carlo maximum likelihood calculations. Journal of the Royal Statistical Society, Series B, 56, 261–274.
60. Ghosh, B. K. (1970). Sequential tests of statistical hypotheses. Reading, MA: Addison-Wesley.
61. Gibbons, R. D., & Hedeker, D. R. (1992). Full-information bi-factor analysis. Psychometrika, 57, 423–436.
62. Gilks, W. R. (1992). Derivative-free adaptive rejection sampling for Gibbs sampling. In J. M. Bernardo, J. O. Berger, A. P. Dawid, & A. F. M. Smith (Eds.), Bayesian statistics 4 (pp. 169–194). Oxford, UK: Clarendon Press.
63. Gilks, W. R., Richardson, S., & Spiegelhalter, D. J. (1995). Markov chain Monte Carlo in practice. New York: Chapman & Hall.
64. Glas, C. A. W., Wainer, H., & Bradlow, E. T. (2000). Maximum marginal likelihood and expected a posteriori estimation in testlet-based adaptive testing. In W. J. van der Linden, & C. A. W. Glas (Eds.), Computerized adaptive testing, theory and practice (pp. 271–288). Boston, MA: Kluwer-Nijhoff.
65. Green, B. F. (1988). Construct validity of computer-based tests. In H. Wainer & H. Braun (Eds.), Test validity (pp. 77–86). Hillsdale, NJ: Erlbaum.
66. Green, B. F., Bock, R. D., Humphreys, L. G., Linn, R. L., & Reckase, M. D. (1984). Technical guidelines for assessing computerized adaptive tests. Journal of Educational Measurement, 21, 347–360.
67. Guilford, J. P. (1936). Psychometric methods (1st ed.). New York: McGraw-Hill.
68. Gulliksen, H. O. (1950). Theory of mental tests. New York: Wiley. (Reprinted, 1987, Hillsdale, NJ: Erlbaum).
69. Haberman, S. J. (1978). Analysis of qualitative data. Volume I: Introductory topics. New York: Academic Press.
70. Hambleton, R. K. (1986, February). Effects of item order and anxiety on test performance and stress. Paper presented at the annual meeting of Division D, the American Educational Research Association, Chicago.
71. Hambleton, R. K., & Novick, M. R. (1973). Toward an integration of theory and method for criterion-referenced tests. Journal of Educational Measurement, 10, 159–170.
72. Harmon, H. H. (1976). Modern factor analysis (3rd ed.). Chicago: University of Chicago Press.
73. Hastings, W. K. (1970). Monte Carlo sampling methods using Markov chains and their applications. Biometrika, 54, 93–108.
74. Hedeker D., & Gibbons, R. D. (1994). A random-effects ordinal regression model for multilevel analysis. Biometrics, 50, 933–944.
75. Heisenberg, W. (1958). Physics and philosophy. New York: Harper & Row.
76. Holland, P.W. (1990). On the sampling theory foundations of item response theory models. Psychometrika, 55, 577–601.
77. Holland, P. W., & Thayer, D. T. (1988). Differential item performance and the Mantel–Haenszel procedure. In H. Wainer & H. Braun (Eds.), Test validity (pp. 129–146). Hillsdale, NJ: Erlbaum.
78. Holland, P. W., & Wainer, H. (Eds.). (1993). Differential item functioning. Hillsdale, NJ: Erlbaum.
79. Holzinger, K. (1923). Note on the use of Spearman’s prophecy formula for reliability. The Journal of Educational Psychology, 14, 302–305.
80. Holzinger, K. J., & Swineford, F. (1937). The bi-factor method. Psychometrika, 2, 41–54.
81. Humphreys, L. G. (1962). The organization of human abilities. American Psychologist, 17, 475–483.
82. Humphreys, L. G. (1970). A skeptical look at the factor pure test. In C. E. Lunneborg (Ed.), Current problems and techniques in multivariate psychology: Proceedings of a conference honoring Professor Paul Horst (pp. 23–32). Seattle: University of Washington.
83. Humphreys, L. G. (1981). The primary mental ability. In M. P. Friedman, J. P. Das, & N. O’Connor (Eds)., Intelligence and learning (pp. 87–102). New York: Plenum Press.
84. Humphreys, L. G. (1986). An analysis and evaluation of test and item bias in the prediction context. Journal of Applied Psychology, 71, 327–333.
85. Huynh, H. (1976). On the reliability of decisions in domain-referenced testing. Journal of Educational Measurement, 13, 253–264.
86. Huynh, H. (1990). Computation and statistical inference for decision consistency indexes based on the Rasch model. Journal of Educational Statistics, 15(4), 353–368.
87. Jöreskog, K. G. (1969). A general approach to confirmatory maximum likelihood factor analysis. Psychometrika, 34, 183–202.
88. Jöreskog, K. G. (1974). Analyzing psychological data by structural analysis of covariance matrices. In D. H. Krantz, R. C. Atkinson, R. D. Luce, & P. Suppes (Eds.), Contemporary developments in mathematical psychology (Vol. II, pp. 1–56). San Francisco: W. F. Freeman.
89. Jöreskog, K. G., & Sörbom, D. (1979). Advances in factor analysis and structural equation models. Cambridge, MA: Abt Books.
90. Kelley, T. L. (1924). Note on the reliability of a test: A reply to Dr. Crumm’s criticism. The Journal of Educational Psychology, 15, 193–204.
91. Kelley, T. L. (1947). Fundamentals of statistics. Cambridge: Harvard University Press.
92. Kendall, M. G., & Stuart, A. (1967). The advanced theory of statistics (Vol. II). London: Charles Griffin.
93. Kingston, N. (1987). Feasibility of using IRT-based methods for Divisions D, E and I of the Architect Registration Examination. Report prepared for the National Council of Architectural Registration Boards. Princeton, NJ: Educational Testing Service.
94. Kingston, N. M., & Dorans, N. J. (1984). Item location effects and their implications for IRT and adaptive testing. Applied Psychological Measurement, 8, 146–154.
95. Kolen, M. J., Hanson, B. A., & Brennan, R. L. (1992). Conditional standard errors of measurement for scale scores. Journal of Educational Measurement, 29, 285–307.
96. Kuder, G. F., & Richardson, M. W. (1937). The theory of the estimation of test reliability. Psychometrika, 2, 151–160.
97. Lee, W-C., Hanson, B. A., & Brennan, R. L. (2002). Estimating consistency and indices for multiple classifications. Applied Psychological Measurement, 26, 412–432.
98. Levine, M. (1985). The trait in latent trait theory. In D. J. Weiss (Ed.), Proceedings of the 1982 Item Response Theory and Computerized Adaptive Testing Conference (pp. 41–65). Minneapolis, MN: Computerized Adaptive Testing Laboratory, Department of Psychology, University of Minnesota.
99. Lewis, C. (2006). Validity-based scoring. Manuscript in preparation. Princeton, NJ: Educational Testing Service.
100. Lewis, C., & Sheehan, K. (1990). Using Bayesian decision theory to design a computerized mastery test. Applied Psychological Measurement, 14, 367–386.
101. van der Linden, W. J., & Boekkooi-Timminga, E. (1989). A maximin model for test design with practical constraints. Psychometrika, 54, 237–248.
102. Linn, R. E., Baker, E. L., & Dunbar, S. B. (1991). Complex, performance-based assessment: Expectations and validation criteria. Educational Researcher, 20(8), 15–21.
103. Little, R. J. A., & Rubin, D. B. (1987). Statistical analysis with missing data. New York: Wiley.
104. Liu, J. (1993). The collapsed Gibbs sampler with applications to a gene regulation problem. Journal of the American Statistical Association, 89, 958–966.
105. Livingston, S. A., & Lewis, C. (1995). Estimating the consistency and accuracy of classifications based on test scores. Journal of Educational Measurement, 32, 179–197.
106. Loevinger, J. (1947). A systematic approach to the construction and evaluation of tests of ability (Psychological Monographs 61, No. 4). Richmond, VA: Psychometric Society.
107. Lord, F. M. (1967). An analysis of the Verbal Scholastic Aptitude Test using Birnbaum’s three-parameter logistic model (ETS Research Bulletin RB-67-34). Princeton, NJ: Educational Testing Service.
108. Lord, F. M. (1971a). The self-scoring flexilevel test. Journal of Educational Measurement, 8, 147–151.
109. Lord, F. M. (1971b). Robbins–Munro procedures for tailored testing. Educational and Psychological Measurement, 31, 3–31.
110. Lord, F. M. (1974). Estimation of latent ability and item parameters when there are omitted responses. Psychometrika, 39, 247–264.
111. Lord, F. M. (1980). Applications of item response theory to practical testing problems. Hillsdale, NJ: Erlbaum.
112. Lord, F. M., & Novick, M. R. (1968). Statistical theories of mental test scores. Reading, MA: Addison-Wesley.
113. Lukhele, R., Thissen, D., & Wainer, H. (1994). On the relative value of multiplechoice, constructed response, and examinee-selected items on two achievement tests. Journal of Educational Measurement, 31, 234–250.
114. MacNicol, K. (1956). Effects of varying order of item difficulty in an unspeeded verbal test. Unpublished manuscript, Educational Testing Service, Princeton, NJ.
115. Mantel, N., & Haenszel, W. (1959). Statistical aspects of the analysis of data from retrospective studies of disease. Journal of the National Cancer Institute, 22, 719–748.
116. Mazor, K. M., Clauser, B. E., & Hambleton, R. K. (1992). The effect of sample size on the functioning of the Mantel–Haenszel statistic. Educational and Psychological Measurement, 52, 443–451.
117. Mazor, K. M., Clauser, B. E., & Hambleton, R. K. (1994). Identification of non-uniform differential item functioning using a variation of the Mantel–Haenszel statistic. Educational and Psychological Measurement, 54, 284–291.
118. McDonald, R. P. (1985). Factor analysis and related methods. Hillsdale, NJ: Erlbaum.
119. McDonald, R. P. (2000). A basis for multidimensional item response theory. Applied Psychological Measurement, 24, 99–114.
120. Messick, S. (1989). Validity. In R. Linn (Ed.), Educational measurement (pp. 13–104), Washington, DC: American Council on Education.
121. Metropolis, N., Rosenblith, A. W., Rosenblith, M. N., Teller, A. H., & Teller, E. (1953). Equation of state calculations by fast computing machines. Journal of Chemical Physics, 21, 1087–1092.
122. Metropolis, N., & Ulan, S. (1949). The Monte Carlo method. Journal of the American Statistical Association, 44, 335–341.
123. Mislevy, R. J. (1986). Bayes modal estimation in item response models. Psychometrika, 51, 177–195.
124. Mislevy, R. J., Beaton, A., Kaplan, B. A., & Sheehan, K. (1992). Estimating population characteristics from sparse matrix samples of item responses. Journal of Educational Measurement, 29(2), 133–161.
125. Mislevy, R. J., & Bock, R. D. (1983). BILOG: Item analysis and test scoring with binary logistic models [Computer program]. Mooresville, IN: Scientific Software.
126. Mislevy, R. J., & Stocking, M. L. (1987). A consumer’s guide to LOGIST and BILOG (ETS Research Report 87-43). Princeton, NJ: Educational Testing Service.
127. Mollenkopf, W. G. (1950). An experimental study of the effects on item analysis data of changing item placement and test-time limit. Psychometrika, 15, 291–315.
128. Monk, J. J., & Stallings, W. M. (1970). Effect of item order on test scores. Journal of Educational Research, 63, 463–465.
129. Moreno, K. E., & Segall, D. O. (1997). Reliability and construct validity of CAT-ASVAB. In W. A. Sands, B. K. Waters, & J. R. McBride (Eds.), Computerized adaptive testing: From inquiry to operation (chap. 17, pp. 169–174). Washington, DC: American Psychological Association.
130. Morris, C. N. (1983). Parametric empirical Bayes inference: Theory and applications with discussion. Journal of the American Statistical Association, 78, 47–65.
131. National Council of Teachers of Mathematics. (1989). Curriculum and evaluation standards for school mathematics. Reston, VA: Author.
132. Neyman, J., & Pearson, E. S. (1928). On the use and interpretation of certain test criteria for purposes of statistical inference. Biometrika, 20A, 174–240, 263–294.
133. Novick, M. R., & Lewis, C. (1967). Coefficient alpha and the reliability of composite measurements. Psychometrika, 32, 1–13.
134. Phillips, A., & Holland, P. W. (1987). Estimators of the variance of the Mantel–Haenszel log-odds-ratio estimate. Biometrics, 43, 425–431.
135. Popper, K. (1987). The logic of scientific discovery. London: Hutchinson Publishing Company Ltd. (12th printing).
136. Ramsay, J. O. (1991). Kernel smoothing approaches to nonparametric item characteristic curve estimation. Psychometrika, 56, 611–630.
137. Ramsay, J. O. (1992). TESTGRAF: A program for the graphical analysis of multiple choice test and questionnaire data. Technical report. Montreal, Quebec, Canada: McGill University.
138. Ramsay, J. O., & Silverman, B.W. (1997). Functional data analysis. New York: Springer-Verlag.
139. Rasch, G. (1960). Probabilistic models for some intelligence and attainment tests. Copenhagen: Denmarks Paedagogiske Institut.
140. Reckase, M. D. (1985). The difficulty of test items that measure more than one ability. Applied Psychological Measurement, 9, 401–412.
141. Reckase, M. D. (1997). The past and future of multidimensional item response theory. Applied Psychological Measurement, 21, 25–36.
142. Ree, M. J., & Earles, J. A. (1991). Predicting training success: Not much more than g. Personnel Psychology, 44, 321–332.
143. Ree, M. J., & Earles, J. A. (1992). Intelligence is the best predictor of job performance. Current Directions in Psychological Science, 1, 86–89.
144. Ree, M. J., & Earles, J. A. (1993). g is to psychology what carbon is to chemistry: Areply to Sternberg and Wagner, McClelland, and Calfee. Current Directions in Psychological Science, 2, 11–12.
145. Resnick, L. B. (1987). Education and learning to think. Committee on Mathematics, Science, and Technology Education, Commission on Behavioral and Social Sciences and Education, National Research Council. Washington, DC: National Academies Press.
146. Ritter, C., & Tanner, M. A. (1992). Facilitating the Gibbs sampler: The Gibbs stopper and the Griddy–Gibbs sampler. Journal of the American Statistical Association, 87, 861–868.
147. Robins, J., Breslow, N. E., & Greenland, S. (1986). Estimators of the Mantel–Haenszel variance consistent in both sparse data and large-strata limiting models. Biometrics, 42, 311–324.
148. Rogers, H. J., & Swaminathan, H. (1993). A comparison of the logistic regression and Mantel–Haenszel procedures for detecting differential item functioning. Applied Psychological Measurement, 17(2), 105–116.
149. Rosa, K., Nelson, L., Swygert, K., & Thissen, D. (2001). Item response theory applied to combinations of multiple-choice and constructed-response items – Scale scores for patterns of summed scores. In D. Thissen & H. Wainer (Eds.), Test scoring (chap. 7, pp. 253–292). Hillsdale, NJ: Erlbaum.
150. Rosenbaum, P. R. (1988). A note on item bundles. Psychometrika, 53, 349–360.
151. Roznowski, M. (1988). Review of test validity. Journal of Educational Measurement, 25, 357–361.
152. Samejima, F. (1969). Estimation of latent ability using a response pattern of graded scores (Psychometrika Monographs Whole No. 17). Richmond, VA: Psychometric Society.
153. Samejima, F. (1983). Some methods and approaches of estimating the operating characteristics of discrete item responses. In H. Wainer & S. Messick (Eds.), Principals of modern psychological measurement (pp. 159–182). Hillsdale, NJ: Erlbaum.
154. Sands, W. A., Waters, B. K., & McBride, J. R. (Eds.). (1997). Computerized adaptive testing: From inquiry to operation. Washington, DC: American Psychological Association.
155. Sax, G., & Carr, A. (1962). An investigation of response sets on altered parallel forms. Educational and Psychological Measurement, 22, 371–376.
156. Segall, D. O. (2001). General ability measurement: An application of multidimensional item response theory. Psychometrika, 66, 79–97.
157. Shealy, R., & Stout, W. (1993). A model-based standardization approach that separates true bias/DIF from group ability differences and detects test bias/DIF as well as item bias/DIF. Psychometrika, 58, 159–194.
158. Sinharay, S. (2004). Experiences with Markov chain Monte Carlo convergence assessment in two psychometric examples. Journal of Educational and Behavioral Statistics, 29, 461–488.
159. Sireci, S. G., Thissen, D., & Wainer, H. (1991). On the reliability of testlet-based tests. Journal of Educational Measurement, 28, 237–247.
160. Sireci, S. G., Wainer, H., & Braun, H. (1998). Psychometrics: An overview. In P. Armitage & T. Colton (Eds.), Encyclopedia of biostatistics (pp. 327–351). London: Wiley.
161. Sireci, S. G., & Zenisky, A. L. (2006). Innovative item formats in computer-based testing: In pursuit of improved construct representation. In S. M. Downing & T. M. Haladyna (Eds.), Handbook of test development (pp. 329–348). Mahwah, NJ: Erlbaum.
162. Spearman, C. (1904). “General intelligence” objectively determined and measured. American Journal of Psychology, 15, 201–293.
163. Spearman, C. (1910). Correlation calculated with faulty data. British Journal of Psychology, 3, 271–295.
164. Spiegelhalter, D. J., Thomas, A., Best, N. G., & Gilks, W. R. (1994). BUGS: Bayesian inference using Gibbs sampling (Version 0.30). Cambridge, England: Medical Research Council Biostatistics Unit.
165. Stein, C. (1956). Inadmissability of the usual estimator for the mean of a multivariate normal distribution. Proceedings Third Berkeley Symposium on Mathematical Statistics and Probability, 1, 197–206. Berkeley: University of California Press.
166. Stigler, S. M. (1980). Stigler’s Law of Eponymy. Transactions of the New York Academy of Sciences, 2nd Series, 39, 147–157.
167. Subkoviak, M. (1976). Estimating reliability from a single administration of a criterionreferenced test. Journal of Educational Measurement, 13, 265–275.
168. Swaminathan, H., Hambleton, R. K., & Algina, J. (1974). Reliability of criterion-referenced tests: A decision-theoretic formulation. Journal of Educational Measurement, 11, 263–268.
169. Swaminathan, H., & Rogers, H. J. (1990). Detecting differential item functioning using logistic regression procedures. Journal of Educational Measurement, 27, 361–370.
170. Tanner, M. A., & Wong, W. H. (1987). The calculation of posterior distributions by data augmentation (with discussion). Journal of the American Statistical Association, 82, 528–550.
171. Tedeschi, R. G., & Calhoun, L. G. (1996). The Posttraumatic Growth Inventory: Measuring the positive legacy of trauma. Journal of Traumatic Stress, 9(3), 455–472.
172. Thissen, D. (1990). MULTILOG user’s guide (Version 6.0). Mooresville, IN: Scientific Software.
173. Thissen, D. (1991). MULTILOG user’s guide (Version 6.1). Mooresville, IN: Scientific Software.
174. Thissen, D. (1993). Repealing rules that no longer apply to psychological measurement. In N. Frederiksen, R. J. Mislevy & I. Bejar (Eds.), Test theory for a new generation of tests (pp. 79–97). Hillsdale, NJ: Erlbaum.
175. Thissen, D., Chen, W-H., & Bock, R. D., (n.d). MULTILOG 7 – Analysis of multiplecategory response data. Retrieved from http://www.assess.com/Software/MULTILOG.htm
176. Thissen, D., & Steinberg, L. (1984). A response model for multiple choice items. Psychometrika, 49, 501–519.
177. Thissen, D., & Steinberg, L. (1988). Data analysis using item response theory. Psychological Bulletin, 104, 385–395.
178. Thissen, D., Steinberg, L., & Fitzpatrick, A. R. (1989). Multiple-choice models: The distractors are also part of the item. Journal of Educational Measurement, 26, 161–176.
179. Thissen, D., Steinberg, L., & Mooney, J. A. (1989). Trace lines for testlets: A use of multiple-categorical-response models. Journal of Educational Measurement, 26, 247–260.
180. Thissen, D., Steinberg, L., & Wainer, H. (1988). Use of item response theory in the study of group differences in trace lines. In H.Wainer & H. Braun (Eds.), Test validity (pp. 147–169). Hillsdale, NJ: Erlbaum.
181. Thissen, D., Steinberg, L., & Wainer, H. (1993). Detection of differential item functioning using the parameters of item response models. In P. W. Holland & H. Wainer (Eds.), Differential item functioning (pp. 67–113). Hillsdale, NJ: Erlbaum.
182. Thissen, D., & Wainer, H. (Eds.). (2001). Test scoring. Hillsdale, NJ: Erlbaum.
183. Thorndike, R. L. (1951). Reliability. In E. F. Lindquist (Ed.), Educational measurement (pp. 569–620). Washington, DC: American Council on Education.
184. Thurstone, L. L. (1938). Primary mental abilities (Psychometric Monograph No. 1). Chicago: University of Chicago Press.
185. Tierney, L. (1990). LISP-STAT: An object-oriented environment for statistical computing and dynamic graphics. New York: Wiley.
186. Towle, N. J., & Merrill, P. F. (1975). Effects of anxiety type and item difficulty sequencing on mathematics test performance. Journal of Educational Measurement, 12, 241–249.
187. Traub, R. E. & Rowley, G. L. (1991). Understanding reliability. Educational Measurement: Issues and Practice, 10, 37–45.
188. Tucker, L. R. (1958). An interbattery method of factor analysis. Psychometrika, 23(2), 111–136.
189. Wainer, H. (1993). Model-based standardized measurement of an item’s differential impact. In P. W. Holland & H. Wainer (Eds.), Differential item functioning (pp. 121–135). Hillsdale, NJ: Erlbaum.
190. Wainer, H. (1995). Precision & differential item functioning on a testlet-based test: The 1991 LawSchool AdmissionsTest as an example. Applied Measurement in Education, 8(2), 157–187.
191. Wainer, H. (2000a). Rescuing computerized testing by breaking Zipf’s Law. Journal of Educational and Behavioral Statistics, 25, 203–224.
192. Wainer, H. (2000b). Visual revelations: Graphical tales of fate and deception from Napoleon Bonaparte to Ross Perot (2nd ed.). Hillsdale, NJ: Erlbaum.
193. Wainer, H. (2005). Graphic discovery: A trout in the milk and other visual adventures. Princeton, NJ: Princeton University Press.
194. Wainer, H., Bradlow, E. T., & Du, Z. (2000). Testlet response theory: An analog for the 3-PL useful in testlet-based adaptive testing. In W. J. van der Linden & C. A.W. Glas (Eds.), Computerized adaptive testing, theory and practice (pp. 245–270). Boston, MA: Kluwer-Nijhoff.
195. Wainer, H., Bridgeman, B., Najarian, M., & Trapani, C. (2004). How much does extra time on the SAT help? Chance, 17(2), 17–23.
196. Wainer, H., Brown, L. M., Bradlow, E. T., Wang, X., Skorupski, W. P., Boulet, J., & Mislevy, R. M. (2006). An application of testlet response theory in the scoring of a complex certification exam. In D. M. Williamson, R. J. Mislevy, & I. I. Bejar (Eds.), Automated scoring of complex tasks in computer based testing (pp. 169–200). Hillsdale, NJ: Erlbaum, Chapter 6.
197. Wainer, H., Dorans, D. J., Eignor, D., Flaugher, R., Green, B. F., Mislevy, R. J., Steinberg, L., & Thissen, D. (2000). Computerized adaptive testing: A primer (2nd ed.). Hillsdale, NJ: Erlbaum.
198. Wainer, H., Dorans, D. J., Flaugher, R., Green, B. F., Mislevy, R. J., Steinberg, L., & Thissen, D. (1990). Computerized adaptive testing: A primer. Hillsdale, NJ: Erlbaum.
199. Wainer, H., & Kiely, G. (1987). Item clusters and computerized adaptive testing: A case for testlets. Journal of Educational Measurement, 24, 185–202.
200. Wainer, H., & Lewis, C. (1990).Toward a psychometrics for testlets. Journal of Educational Measurement, 27, 1–14.
201. Wainer, H., & Lichten, W. (2000). The Aptitude-Achievement Function: An aid for allocating educational resources, with an advanced placement example. Educational Psychology Review, 12(2), 201–228.
202. Wainer, H., Lukele, R., & Thissen, D. (1994). On the relative value of multiple-choice, constructed response, and examinee-selected items on two achievement tests. Journal of Educational Measurement, 31, 234–250.
203. Wainer, H., & Mislevy, R. J. (2000). Item response theory, item calibration and proficiency estimation. In H. Wainer, D. J. Dorans, R. Flaugher, B. F. Green, R. J. Mislevy, L. Steinberg, & D. Thissen, Computerized adaptive testing: A primer (2nd ed.) (chap. 4, pp. 65–102). Hillsdale, NJ: Erlbaum.
204. Wainer, H., Morgan, A., & Gustafsson, J-E. (1980). A review of estimation procedures for the Rasch model with an eye toward longish tests. Journal of Educational Statistics, 5, 35–64.
205. Wainer, H., & Schacht, S. (1978). Gapping. Psychometrika, 43, 203–212.
206. Wainer, H., Sireci, S. G., & Thissen, D. (1991). Differential testlet functioning: Definitions and detection. Journal of Educational Measurement, 28, 197–219.
207. Wainer, H., & Thissen, D. (1996). How is reliability related to the quality of test scores? What is the effect of local dependence on reliability? Educational Measurement: Issues and Practice, 15(1), 22–29.
208. Wainer, H., Wang, X., Skorupski, W., & Bradlow, E. T. (2005). A Bayesian method for evaluating passing scores: The PPoP curve. Journal of Educational Measurement, 42(3), 271–281.
209. Wald, A. (1947). Sequential analysis. New York: Wiley.
210. Wang, M. D., & Stanley, J. C. (1970). Differential weighting: A review of methods and empirical studies. Review of Educational Research, 40, 663–705.
211. Wang, X., Bradlow, E. T., & Wainer, H. (2002). A general Bayesian model for testlets: Theory and applications. Applied Psychological Measurement, 26(1), 190–128. Also listed as ETS GRE Technical Report 98-01.
212. Wang, X., Bradlow, E. T., & Wainer, H. (2004). A user’s guide for SCORIGHT (Version 3.0): A computer program built for scoring tests built of testlets including a module for covariate analysis (ETS Research Report RR 04-49). Princeton, NJ: Educational Testing Service.
213. Weiss, D. J. (1974). Strategies of adaptive ability measurement (Research Report 74-5). Minneapolis: University of Minnesota, Psychometric Methods Program.
214. Weiss, D. J. (1982). Improving measurement quality and efficiency with adaptive testing. Applied Psychological Measurement, 6, 473–492.
215. Weiss, D. J., & Kingsbury, G. G. (1984). Application of computerized adaptive testing to educational problems. Journal of Educational Measurement, 21, 361–375.
216. Whitely, S. E., & Dawis, R.V. (1976). The influence of test context effects on item difficulty. Educational and Psychological Measurement, 36, 329–337.
217. Win BUGS. Retrieved from http://www.mrc-bsu.cam.ac.uk/bugs/welcome.shtml
218. Wishart, J. (1928). The generalized product moment distribution in samples from a normal multivariate population. Biometrika, 20A(32), 424.
219. van denWollenberg, A. L. (1982). Two new test statistics for the Rasch model. Psychometrika, 47, 123–140.
220. Wright, B. D., & Douglas, G. A. (1977). Best procedures for sample-free item analysis. Applied Psychological Measurement, 14, 281–295.
221. Wright, B. D., & Stone, M. H. (1979). Best test design. Chicago: MESA Press.
222. Yamamoto, K. (1989). Hybrid model of IRT and latent class models (Research Report RR-89-41). Princeton, NJ: Educational Testing Service.
223. Yen, W. M. (1980). The extent, causes, and importance of context effects on item parameters for two latent trait models. Journal of Educational Measurement, 17, 297–311.
224. Yen, W. M. (1984). Effects of local item dependence on the fit and equating performance of the three-parameter logistic model. Applied Psychological Measurement, 8, 125–145.
225. Yen, W. M. (1992, April). Scaling performance assessments: Strategies for managing local item dependence. Invited address presented at the annual meeting of the National Council on Measurement in Education, San Francisco, CA.
226. Yen, W. M. (1993). Scaling performance assessments: Strategies for managing local item dependence. Journal of Educational Measurement, 30, 187–213.
227. Zenisky, A. L., & Sireci, S. G. (2002). Technological innovations in large-scale assessment. Applied Measurement in Education, 15, 337–362.
228. Zhang, J., & Stout, W. F. (1999). The theoretical DETECT index of dimensionality and its application to approximate simple structure. Psychometrika, 64, 213–249.
229. Zwick, R. (1990). When do item response function and Mantel–Haenszel definitions of differential item functioning coincide? Journal of Educational Statistics, 15, 185–198.