A proposed framework for evaluating alignment studies

Educational Measurement: Issues and Practice

Volumn 32, Issue 1, 2013, Pages 23-33

  Davis Becker, Susan L ^a   Buckendahl, Chad W ^a  

^a Alpine Testing Solutions Inc   (United States)

Author keywords

Alignment; Validity

Indexed keywords

EID: 84875682333     PISSN: 07311745     EISSN: 17453992     Source Type: Journal    
DOI: 10.1111/emip.12002     Document Type: Article

References (37)

1. American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (1999). Standards for educational and psychological testing . Washington, DC : American Educational Research Association.
2. Badgett, B. A., Davis, S. L., & Buckendahl, C. W. (2008). Alignment in higher education: Matching assessments to program goals of an online university . Paper presented at the annual meeting of the National Council on Measurement in Education, New York, NY .
3. Bhola, D. S., Impara, J. C., & Buckendahl, C. W. (2003). Aligning tests with states' content standards: Methods and issues. Educational Measurement: Issues and Practice, 22(3), 21-29.
4. Buckendahl, C. W., Plake, B. S., Impara, J. C., & Irwin, P. I. (2000, April). Alignment of standardized achievement tests to state content standards: A comparison of publishers' and teachers' perspectives . Paper presented at the annual meeting of the National Council on Measurement in Education, New Orleans, LA .
5. Chin, T., Rodeck, E. M., Buckendahl, C. W., & Foley, B. P. (2008, March). The impact of consensus on alignment judgments . Paper presented at the annual meeting of the National Council on Measurement in Education, New York, NY .
6. Cohen, A., & Wollack, J. (2006). Test administration, security, scoring, and reporting. In R. Brennan (Ed.). Educational measurement (4th ed., pp. 356-386) Westport CT : American Council on Education and Praeger.
7. Davis, S. L., & Buckendahl, C. W. (2007, April). Evaluating NCLB's peer review process: A comparison of state compliance decisions . Paper presented at the annual meeting of the National Council on Measurement in Education, Chicago, IL .
8. DePascale, C. (2007, June). Alignment: Their's not to reason why . Paper presented at the National Conference on Large Scale Assessment, Nashville, TN .
9. Frisbie, D. A. (2003). Checking the alignment of an assessment tool and a set of content standards . Iowa Technical Adequacy Project (ITAP). Iowa City, IA : University of Iowa.
10. Green, D. R., Trimble, C. S., & Lewis, D. M. (2003). Interpreting the results of three different standard setting procedures. Educational Measurement: Issues and Practice, 22(1), 22-32.
11. Hambleton, R. K. (2001). Setting performance standards on educational assessments and criteria for evaluating the process. In G. J. Cizek (Ed.), Setting performance standards: Concepts, methods, and perspectives (pp. 89-116). Mahwah, NJ : Lawrence Erlbaum.
12. Hambleton, R. K., & Pitoniak, M. J. (2006). Setting performance standards. In R. L. Brennan (Ed.), Educational measurement (4th ed., pp. 433-470). Westport, CT : American Council on Education and Praeger.
13. Herman, J., & Webb, N. (Eds.). (2007). Alignment methodologies [Special Issue]. Applied Measurement in Education, 20(1), 1-135.
14. Herman, J. L., Webb, N. M., & Zuniga, S. A. (2007). Measurement issues in the alignment of standards and assessment: A case study. Applied Measurement in Education, 20(1), 101-126.
15. Kane, M. T. (1994). Validating the performance standards associated with passing scores. Review of Educational Research, 64, 425-461.
16. Kane, M. T. (2001). So much remains the same: Conception and status of validation in setting standards. In G. J. Cizek (Ed.) Setting performance standards: Concepts, methods, and perspectives (pp. 53-88). Mahwah, NJ : Lawrence Erlbaum.
17. Kane, M. T. (2006). Validation. In R. L. Brennan (Ed.), Educational measurement (4th ed., pp. 17-64). Westport, CT : American Council on Education and Praeger.
18. Koretz, D. M., & Hamilton, L.S. (2006). Testing for accountability in K-12. In R. L. Brennan (Ed.), Educational measurement (4th ed., pp. 531-578). Westport, CT : American Council on Education and Praeger.
19. La Marca, P. M. (2001). Alignment of standards and assessments as an accountability criterion. Practical Assessment, Research & Evaluation, 7(21). Retrieved March 13, 2008 from http://PAREonline.net/getvn.asp?v=7&n=21
20. La Marca, P. M., Redfield, D., Winter, P., Bailey, A., & Despriet, L. (2000). State standards and state assessment systems: A guide to alignment . Washington, DC : Council of Chief State School Officers.
21. Martineau, J., Paek, P., Keene, J., & Hirsch, T. (2007). Integrated, comprehensive alignment as a foundation for measuring student progress. Educational Measurement: Issues and Practice, 26(1), 28-35.
22. Martone, A., & Sireci, S. (2009). Evaluation alignment between curriculum, assessment, and instruction. Review of Educational Research, 79, 1332-1361.
23. Messick, S. (1989). Validity. In R. Linn (Ed.), Educational measurement (3rd ed., pp. 13-103). Washington, DC : American Council on Education.
24. NCES. (2011). National Assessment of Educational Progress (NAEP): NAEP item scoring process. Retrieved May 23, 2011 from http://nces.ed.gov/nationsreportcard/contracts/item_score.asp#ensuring
25. Norman, R. L., & Buckendahl, C. W. (2008). Determining sufficient measurement opportunities when using multiple cut scores. Educational Measurement: Issues and Practice, 27(1), 37-46.
26. Porter, A. C. (2002). Measuring the content of instruction: Uses in research and practice. Educational Researcher, 31(7), 3-14.
27. Porter, A., Polikoff, M., Zeidner, T., & Smithson, J. (2008). The quality of content analyses of state student achievement tests and content standards. Educational Measurement: Issues and Practice, 27(4), 2-14.
28. Porter, A., & Smithson, J. (2002, March). Alignment of assessments, standards and instruction using curriculum indicator data . Paper presented at the annual meeting of the American Educational Research Association, New Orleans, LA .
29. Rothman, R., Slattery, J. B., Vranek, J. L., & Resnick, L. B. (2002). Benchmarking and alignment of standards and testing . Los Angeles, CA : National Center for Research on Evaluation, Standards, and Student Testing.
30. Shavelson, R., & Webb, N. (1991). Generalizability theory: A primer . Newbury Park, CA : Sage.
31. Shepard, L. (2000). The role of assessment in a learning culture. Educational Researcher, 29(1), 4-14.
32. U.S. Congress. (2002). Public Law 107-110: No Child Left Behind Act of 2001 . Accessed May 15, 2010 from http://www.ed.gov/policy/elsec/leg/esea02/index.html.
33. U.S. Department of Education. (2004). Standards and assessments peer review guidance: Information and examples for meeting requirements of the No Child Left Behind Act of 2001 . Washington, SC : Office of Elementary and Secondary Education.
34. Webb, N. L. (1997). Criteria for alignment of expectations and assessments in mathematics and science education (Council of Chief State School Officers and National Institute for Science Education Research Monograph No. 6). Madison, WI : University of Wisconsin, Wisconsin Center for Education Research.
35. Webb, N. L. (1999). Alignment of science and mathematics standards and assessments in four states (Council of Chief State School Officers and National Institute for Science Education Research Monograph No. 18). Madison, WI : University of Wisconsin, Wisconsin Center for Education Research.
36. Webb, N. L. (2007). Issues related to judging the alignment of curriculum standards and assessments. Applied Measurement in Education, 20(1), 7-26.
37. Webb, N. M., Herman, J. L., & Webb, N. L. (2007). Alignment of mathematics state-level standards and assessments: The role of reviewer agreement. Educational Measurement: Issues and Practice, 26(2), 17-29.