Population invariance in equating and linking: Concept and history

Journal of Educational Measurement

Volumn 41, Issue 1, 2004, Pages 3-14

  Kolen, Michael J ^a  

^a UNIVERSITY OF IOWA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 3142782098     PISSN: 00220655     EISSN: None     Source Type: Journal    
DOI: 10.1111/j.1745-3984.2004.tb01155.x     Document Type: Review

References (40)

1. Angoff, W. H. (1957). The "equating" of non-parallel tests. Journal of Experimental Education, 25, 241-247.
2. Angoff, W. H. (1964). Technical problems of obtaining equivalent scores on tests. Journal of Educational Measurement, 1(1), 11-13.
3. Angoff, W. H. (1966). Can useful general-purpose equivalency tables be prepared for different college admissions tests? In A. Anastasi (Ed.), Testing problems in perspective (pp. 251-264). Washington, DC: American Council on Education.
4. Angoff, W. H. (1971). Scales, norms, and equivalent scores. In R. L. Thorndike (Ed.), Educational measurement (2nd ed., pp. 508-600). Washington, DC: American Council on Education.
5. Angoff, W. H., & Cowell, W. R. (1986). An examination of the assumption that the equating of parallel forms is population-independent. Journal of Educational Measurement, 23(4), 327-345.
6. Beaton, A. E., & Gonzalez, E. (1994, April). Comparing the NAEP trial state assessment results with the IAEP international results. Paper presented at the annual meeting of the National Council on Measurement in Education, New Orleans.
7. Bloxom, B., Pashley, P. J., Nicewander, W. A., & Yan, D. (1995). Linking to a large-scale assessment: An empirical evaluation. Journal of Educational and Behavioral Statistics, 20(1), 1-26.
8. Braun, H. I., & Holland, P. W. (1982). Observed-score test equating: A mathematical analysis of some ETS equating procedures. In P. W. Holland & D. B. Rubin (Eds.), Test equating (pp. 9-49). New York: Academic.
9. Brennan, R. L. (1994). A new SAT I and PSAT/NMSQT: A discussion of some psychometric issues. In I. M. Lawrence, N. J. Dorans, M. D. Feigenbaum, N. J. Feryok, A. P. Schmitt, & N. K. Wright (Eds.), Technical issues related to the introduction of the new SAT and PSAT/NMSQT. Research Memorandum 94-10. Princeton, NJ: Educational Testing Service.
10. Cook, L. L., Eignor, D. R., & Taft, H. L. (1988). A comparative study of the effects of recency of instruction on the stability of IRT and conventional item parameter estimates. Journal of Educational Measurement, 25(1), 31-45.
11. Cook, L. L., & Petersen, N. S. (1987). Problems related to the use of conventional and item response theory equating methods in less than optimal circumstances. Applied Psychological Measurement, 11(3), 225-244.
12. Dorans, N. J. (2000). Distinctions among classes of linkages (Research Notes RN-11). New York: The College Board.
13. Dorans, N. J., & Feigenbaum, M. D. (1994). Equating issues engendered by changes to the new SAT I and PSAT/NMSQT. In I. M. Lawrence, N. J. Dorans, M. D. Feigenbaum, N. J. Feryok, A. P. Schmitt, & N. K. Wright (Eds.), Technical issues related to the introduction of the new SAT and PSAT/NMSQT. Research Memorandum 94-10. Princeton, NJ: Educational Testing Service.
14. Dorans, N. J., & Holland, P. W. (2000). Population invariance and the equatability of tests: Basic theory and the linear case. Journal of Educational Measurement, 37(4), 281-306.
15. Dorans, N. J., Holland, P. W., Thayer, D. T., & Tateneni, K. (2003). Invariance of scoring across gender groups for three Advanced Placement Program examinations. In N. J. Dorans, (Ed.), Population invariance of score linking: Theory and applications to Advanced Placement Program examinations. (ETS RR-03-27, pp. 79-118). Princeton, NJ: Educational Testing Service.
16. Ercikan, K. (1997). Linking statewide tests to the National Assessment of Educational Progress: Accuracy of combining test results across states. Applied Measurement in Education, 10(2), 145-159.
17. Feuer, M. J., Holland, P. W., Green, B. F., Bertenthal, M. W., & Hemphill, F. C. (Eds.). (1999). Uncommon measures: Equivalence and linkage among educational tests. Washington, DC: National Academy Press.
18. Flanagan, J. C. (1951). Units, scores, and norms. In E. F. Lindquist (Ed.), Educational measurement (pp. 695-763). Washington DC: American Council on Education.
19. Flanagan, J. C. (1964). Obtaining useful comparable scores for non-parallel tests and test batteries. Journal of Educational Measurement, 1(1), 1-4.
20. Green, B. F. (2003). Comments on population invariance of score linking. In N. J. Dorans (Ed.), Population invariance of score linking: Theory and applications to Advanced Placement Program examinations. (ETS RR-03-27, pp. 127-130). Princeton, NJ: Educational Testing Service.
21. Harris, D. J., & Kolen, M. J. (1986). Effect of examinee group on equating relationships. Applied Psychological Measurement, 10, 35-43.
22. Houston, W., & Sawyer, R. (1991). Relating scores on the Enhanced ACT Assessment and the SAT test batteries. College and University, 66, 195-200.
23. Johnson, E. G., & Owen, E. (1998). Linking the National Assessment of Educational Progress (NAEP) and the Third International Mathematics and Science Study (TIMSS): A technical report. Washington, DC: U.S. Department of Education Office of Educational Research and Improvement, National Center for Education Statistics.
24. Kolen, M. J., & Brennan, R. L. (1995). Test equating: Methods and practices. New York: Springer-Verlag.
25. Lindquist, E. F. (1964). Equating scores on non-parallel tests. Journal of Educational Measurement, 1(1), 5-9.
26. Linn, R. L. (1993). Linking results of distinct assessments. Applied Measurement in Education, 6, 83-102.
27. Linn, R. L., & Kiplinger, V. L. (1995). Linking statewide tests to the National Assessment of Educational Progress: Stability of results. Applied Measurement in Education, 8(2), 135-155.
28. Lord, F. M. (1950). Notes on comparable scales for test scores (Research Bulletin 50-48). Princeton, NJ: Educational Testing Service.
29. Lord, F. M. (1980). Applications of item response theory to practical testing problems. Hillsdale, NJ: Erlbaum.
30. Lord, F. M., & Wingersky, M. S. (1984). Comparison of IRT true-score and equipercentile observed-score "equatings". Applied Psychological Measurement, 8(4), 453-461.
31. Loret, P. G., Seder, J. C., Bianchini, J. C., & Vale, C. A. (1973). Anchor Test Study final report. Project report and volumes 1 through 30. Berkeley, CA: Educational Testing Service. (ERIC Document Nos. ED 092601 through ED 092631)
32. Maxey, E. J., & Lenning, O. T. (1974). Another look at concordance tables between ACT and SAT. Journal of College Student Personnel, 15(4), 300-304.
33. Mislevy, R. J. (1992). Linking educational assessments: Concepts, issues, methods, and prospects. Princeton, NJ: ETS Policy Information Center.
34. Pashley, P. J., & Phillips, G. W. (1993). Toward world class standards. A research study linking international and national assessments. Princeton, NJ: Educational Testing Service.
35. Segall, D. O. (1997). Chapter 19. Equating the CAT-ASVAB. In W. A. Sands, B. K. Waters, & J. R. McBride (Eds.), Computerized adaptive testing: From inquiry to operation (pp. 181-198). Washington, DC: American Psychological Association.
36. Tateneni, K., & Dorans, N. J. (2003). Invariance of linkages for the free-response, multiple-choice and composite scores on Advanced Placement Program examinations. In N. J. Dorans, (Ed.), Population invariance of score linking: Theory and applications to Advanced Placement Program examinations. (ETS RR-03-27, pp. 37-56). Princeton, NJ: Educational Testing Service.
37. van der Linden, W. J. (2000). A test-theoretic approach to observed-score equating. Psychometrika, 65(4), 437-456.
38. Williams, V. S. L., Rosa, K. R., McLeod, L. D., Thissen, D., & Sanford, E. E. (1998). Projecting to the NAEP scale: Results from the North Carolina end-of-grade testing program. Journal of Educational Measurement, 35(4), 277-296.
39. Yang, W-L, Dorans, N. J., & Teteneni, K. (2003). Effect of sample selection on AP multiple-choice score to composite score linking. In N. J. Dorans (Ed.), Population invariance of score linking: Theory and applications to Advanced Placement Program examinations. (ETS RR-03-27, pp. 57-78). Princeton, NJ: Educational Testing Service.
40. Yin, P., Brennan, R. L., & Kolen, M. J. (2004). Concordance between ACT and ITED from different populations. Applied Psychological Measurement, 28(4), 273-289.