A nonparametric framework for comparing trends and gaps across tests

Journal of Educational and Behavioral Statistics

Volumn 34, Issue 2, 2009, Pages 201-228

  Ho, Andrew Dean ^a  

^a UNIVERSITY OF IOWA   (United States)

Author keywords

Data analysis; High stakes testing; NAEP

Indexed keywords

EID: 68049132624     PISSN: 10769986     EISSN: None     Source Type: Journal    
DOI: 10.3102/1076998609332755     Document Type: Article

References (33)

1. Bamber, D. (1975). The area above the ordinal dominance graph and the area below the receiver operating characteristic graph. Journal of Mathematical Psychology, 12, 387-415.
2. Braun, H. I., & Qian, J. (2007). An enhanced method for mapping state standards onto the NAEP scale. In N. J. Dorans, M. Pommerich, & P. W. Holland (Eds.), Linking and aligning scores and scales (pp. 313-338). New York: Springer.
3. Feuer, M. J., Holland, P. W., Green, B. F., Bertenthal, M. W., & Hemphill, F. C. (1999). Uncommon measures: Equivalence and linkage among educational tests. Washington, DC: National Academy Press.
4. Gibbons, J. D., & Chakraborti, S. (2003). Nonparametric statistical inference (4th ed.). New York: Marcel Dekker.
5. Gini, C. (1921). Measurement of inequality of incomes. The Economic Journal, 31, 124-126.
6. Haertel, E. H., & Lorie, W. A. (2004). Validating standards-based test score interpretations. Measurement: Interdisciplinary Research and Perspectives, 2, 61-103.
7. Haertel, E. H., Thrash, W. A., & Wiley, D. E. (1978). Metric-free distributional comparisons. Chicago: ML-Group for Policy Studies in Education.
8. Hanley, J. A., & McNeil, B. J. (1982). The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology, 143, 29-36.
9. Hedges, L. V., & Olkin, I. (1985). Statistical methods for meta-analysis. Orlando, FL: Academic Press.
10. Holland, P. W. (2002). Two measures of change in the gaps between the CDFs of testscore distributions. Journal of Educational and Behavioral Statistics, 27, 3-17.
11. Kolen, M. J., & Brennan, R. L. (2004). Test equating, scaling, and linking: Methods and practices (2nd ed.). New York: Springer-Verlag.
12. Koretz, D., & Hamilton, L. (2006). Testing for accountability in K-12. In R. L. Brennan (Eds.), Educational measurement (pp. 531-578). Westport, CT: American Council on Education and Praeger Publishers.
13. Kotz, S., Lumelskii, Y., & Pensky, M. (2003). The stress-strength model and its generalizations. River Edge, NJ: World Scientific Publishing.
14. Lehmann, E. L. (1955). Ordered families of distributions. The Annals of Mathematical Statistics, 26, 399-419.
15. Livingston, S. A. (2006). Double P-P plots for comparing differences between two groups. Journal of Educational and Behavioral Statistics, 31, 431-435.
16. Lord, F. M. (1975). The "ability" scale in item characteristic curve theory. Psychometrika, 20, 299-326.
17. Lord, F. M. (1980). Applications of item response theory to practical testing problems. Hillsdale, NJ: Erlbaum.
18. Lorenz, M. O. (1905). Methods of measuring the concentration of wealth. Publication of the American Statistical Association, 9, 209-219.
19. Macmillan, N. A., & Creelman, C. D. (1996). Triangles in ROC space: History and theory of "nonparametric" measures of sensitivity and response bias. Psychonomic Bulletin and Review, 3, 164-170.
20. Mann, H. B., & Whitney, D. R. (1947). On a test whether one of two random variables is stochastically larger than the other. Annals of Mathematical Statistics, 18, 50-60.
21. McClellan, C. A., & Harris, N. A. (2005). Data analysis for the NAEP 1999 long-term trend mathematics assessment. In N. L. Allen, C. A. McClellan, & J. J. Stoeckel (Eds.), NAEP 1999 long-term trend technical analysis report: Three decades of student performance (NCES 2005-484, pp. 61-74). U.S. Department of Education, National Center for Education Statistics, Washington, DC: US Government Printing Office.
22. Metz, C. E., Herman, B. A., & Shen, J. H. (1998). Maximum likelihood estimation of receiver operating characteristic (ROC) curves from continuously distributed data. Statistics in Medicine, 17, 1033-1053.
23. Mislevy, R. M., Johnson, E. G., & Muraki, E. (1992). Scaling procedures in NAEP. Journal of Educational Statistics, 17, 131-154.
24. Simonoff, J. S., Hochberg, Y., & Reiser, B. (1986). Alternative estimation procedures for P(X
25. Smith, W. D. (1995). Clarification of sensitivity measure A. Journal of Mathematical Psychology, 39, 82-89.
26. Spencer, B. D. (1983a). Test scores as social statistics: Comparing distributions. Journal of Educational Statistics, 8, 249-269.
27. Spencer, B. D. (1983b). On interpreting test scores as social indicators: Statistical considerations. Journal of Educational Measurement, 20, 317-333.
28. Swets, J. A., & Pickett, R. M. (1982). Evaluation of diagnostic systems: Methods from signal detection theory. New York: Academic Press.
29. Tukey, J. W. (1977). Exploratory data analysis. Cambridge, MA: Addison-Wesley.
30. von Davier, A. A., Holland, P. W., & Thayer, D. T. (2004). The kernel method of test equating. New York: Springer-Verlag.
31. Wilk, M. B., & Gnanadesikan, R. (1968). Probability plotting methods for the analysis of data. Biometrika, 55, 1-17.
32. Yen, W. M. (1986). The choice of scale for educational measurement: An IRT perspective. Journal of Educational Measurement, 23, 299-326.
33. Zwick, R. (1992). Statistical and psychometric issues in the measurement of educational achievement trends: Examples from the National Assessment of Educational Progress. Journal of Educational Measurement, 20, 299-326.