Evaluating alignment between curriculum, assessment, and instruction

Review of Educational Research

Volumn 79, Issue 4, 2009, Pages 1332-1361

  Martone, Andrea ^a   Sireci, Stephen G ^b  

^a The College of Saint Rose   (United States)

^b UNIVERSITY OF MASSACHUSETTS   (United States)

Author keywords

Assessment; Psychometrics; Teacher education and development; Test theory and development; Test validity and reliability

Indexed keywords

EID: 77951010359     PISSN: 00346543     EISSN: None     Source Type: Journal    
DOI: 10.3102/0034654309341375     Document Type: Article

References (53)

1. Achieve, Inc. (2006). An alignment analysis of Washington State's college readiness mathematics standards with various local placement tests. Cambridge, MA: Author.
2. American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (1999). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.
3. Ananda, S. (2003a). Achieving alignment. Leadership, 33(1), 18-22.
4. Ananda, S. (2003b). Rethinking issues of alignment under No Child Left Behind. San Francisco, CA: WestEd.
5. Anderson, L.W. (2002). Curricular alignment: A re-examination. Theory Into Practice, 41(4), 255-260.
6. Bhola, D.S., Impara, J.C., & Buckendahl, C.W. (2003). Aligning tests with states' content standards: Methods and issues. Educational Measurement: Issues and Practice, 22(3), 21-29.
7. Blank, R.K. (2004, April). Findings on alignment of instruction using enacted curriculum data: Results from urban schools. Paper presented at the annual meeting of American Educational Research Association, San Diego, CA.
8. Blank, R.K., Porter, A.C., & Smithson, J.L. (2001). New tools for analyzing teaching, curriculum and standards in mathematics and science. Washington, DC: Council of Chief State School Officers.
9. Buckendahl, C.W., Plake, B.S., Impara, J.C., & Irwin, P.M. (2000, April). Alignment of standardized achievement tests to state content standards: A comparison of publishers' and teachers' perspectives. Paper presented at the Annual Meeting of the National Council on Measurement in Education, New Orleans, LA.
10. Cizek, G.J. (2001). More unintended consequences of high-stakes testing. Educational Measurement: Issues and Practice, 20(4), 19-27.
11. Cohen, S. (1987). Instructional alignment: Searching for a magic bullet. Educational Researcher, 16(8), 16-20.
12. Council of Chief State School Officers. (2002). Models for alignment analysis and assistance to states. Retrieved August 28, 2005, from www.ccsso.org/content/pdfs/AlignmentModels.pdf.
13. Council of Chief State School Officers. (2004). Coding procedures for curriculum content analyses. Retrieved March 3, 2009, from www.ccsso.org/content/pdfs/CodingProcedures.pdf.
14. Crocker, L.M., Miller, M.D., & Franks, E.A. (1989). Quantitative methods for assessing the fit between test and curriculum. Applied Measurement in Education, 2, 179-194.
15. D'Agostino, J.V., Welsh, M.E., Cimetta, A.D., Falco, L.D., Smith, S., VanWinkle, W.H.,et al.(2008). The rating and matching item-objective alignment methods. Applied Measurement in Education, 21, 1-21.
16. Eastman, C. (2008). Case study: A district using SEC: A vital part of the comprehensive data analysis process. Retrieved March 2, 2009, from the Council of Chief State School Officers website at http://www.ccsso.org/projects/surveys_of_enacted_curriculum/SEC_Resources/#guides.
17. Herman, J.L., Webb, N.M., & Zuniga, S.A. (2007). Measurement issues in the alignment of standards and assessments: A case study. Applied Measurement in Education, 20, 101-126.
18. Johnson, H. (2005). South Dakota assessment letter. Retrieved March 13, 2009, from http://www.ed.gov/admins/lead/account/nclbfinalassess/sd.html.
19. Leffler, J.C., Carr, M., Griffin, L., & Gates, C. (2005). Alignment of Montana state standards with state assessments. Portland, OR: Northwest Regional Educational Laboratory.
20. La Marca, P.M. (2001). Alignment of standards and assessments as an accountability criterion. ERIC Development Team. (ERIC Document Reproduction Service No. ED458288).
21. La Marca, P.M., Redfield, D., Winter, P.C., & Despriet, L. (2000). State standards and state assessment systems: A guide to alignment. Series on standards and assessments. Washington, DC: Council of Chief State School Officers.
22. Linn, R. (2000). Assessments and accountability. Educational Researcher, 29(2), 4-16.
23. Martone, A. (2007). Exploring the impact of teachers' involvement in an assessment-standards alignment study. Unpublished doctoral dissertation, University of Massachusetts Amherst.
24. McGehee, J.J., & Griffith, L.K. (2001). Large-scale assessments combined with curriculum alignment: Agents of change. Theory into Practice, 40(2), 137-144.
25. McLaughlin, D., de Mello, V.B., Blankenship, C., Chaney, K., Hikawa, H., Rojas, D., William, P., & Wolman, M. (2005, February). Comparison between NAEP and state mathematics assessment results: 2003. Final report Volume II: Appendix D State Profiles. Washington, DC: American Institutes for Research.
26. Popham, W.J. (1992). Appropriate expectations for content judgments regarding teacher licensure tests. Applied Measurement in Education, 5, 285-301.
27. Porter, A.C. (2002). Measuring the content of instruction: Uses in research and practice. Educational Researcher, 31(7), 3-14.
28. Porter, A.C. (2006). Curriculum assessment. In J. Green, G. Camilli, & P. Elmore (Eds.), Handbook of complementary methods in education research (pp. 141-160). Washington, DC: American Educational Research Association.
29. Porter, A.C., & Smithson, J.L. (2001). Defining, developing, and using curriculum indicators. CPRE Research Report Series (No. RR-048). Philadelphia, PA: Consortium for Policy Research in Education.
30. Porter, A.C., & Smithson, J.L. (2002). Alignment of assessments, standards and instruction using curriculum indicator data. Paper presented at the Annual Meeting of American Educational Research Association, New Orleans, LA.
31. Porter, A.C., Polikoff, M., Zeidner, T., & Smithson, J. (2008). The quality of content analyses of state student achievement tests and content standards. Educational Measurement: Issues and Practice, 27(4), 2-14.
32. Porter, A.C., Smithson, J.L., Blank, R.K., & Zeidner, T. (2007). Alignment as a teacher variable. Applied Measurement in Education, 20, 27-51.
33. Resnick, L.B., Rothman, R., Slattery, J.B., & Vranek, J.L. (2004). Benchmarking and alignment of standards and testing. Educational Assessment, 9(1&2), 1-27.
34. Roach, A.T., Elliott, S.N., & Webb, N.L. (2005). Alignment of an alternate assessment with state academic standards: Evidence for the content validity of the Wisconsin Alternate Assessment. The Journal of Special Education, 38, 218-231.
35. Roach, A.T., Niebling, B.C., & Kurz, A. (2008). Evaluating the alignment among curriculum, instruction, and assessments: Implications and applications for research and practice. Psychology in the Schools, 45, 158-176.
36. Rothman, R. (2003). Imperfect matches: The alignment of standards and tests. National Research Council.
37. Rothman, R., Slattery, J.B., Vranek, J.L., & Resnick, L.B. (2002). Benchmarking and alignment of standards and testing (CSE Technical Report No. CSE-TR-566). Los Angeles, CA: National Center for Research on Evaluation, Standards, and Student Testing.
38. Sireci, S.G. (1998a). The construct of content validity. Social Indicators Research, 45, 83-117.
39. Sireci, S.G. (1998b). Gathering and analyzing content validity data. Educational Assessment, 5, 299-321.
40. Sireci, S.G. (in press). Packing and unpacking sources of validity evidence: History repeats itself again. In R. Lissitz (Ed.), The concept of validity: Revisions, new directions and applications. Charlotte, NC: Information Age.
41. Sireci, S.G., Robin, F., Meara, K., Rogers, H.J., & Swaninathan, H. (2000). An external evaluation of the 1996 Grade 8 NAEP Science Framework. In N. Raju, J. W. Pelligrino, M. W. Bertenthal, K. J. Mitchell, & L. R. Jones (Eds.), Grading the nation's report card: Research from the evaluation of NAEP (pp. 74-100). Washington, DC: National Academies Press.
42. Smith, M.L., & Rottenberg, C. (1991). Unintended consequences of external testing in elementary schools. Educational Measurement: Issues and Practice, 10(4), 7-11.
43. Smith, M.S., & O'Day, J. (1991). Systemic school reform. In S. H. Fuhrman & B. Malen (Eds.), The politics of curriculum and testing: The 1990 yearbook of the Politics of Education Association (pp. 233-267). Bristol, PA: Taylor & Francis.
44. Tyler, R.W. (1949). Basic principles of curriculum and instruction. Chicago: University of Chicago Press.
45. U.S. Department of Education. (2002). No Child Left Behind Act of 2001, Pub. L. No. 107-110. 115 Stat. 1425 (2002). Retrieved on July 30. 2008, from http://www.ed.gov/policy/elsec/leg/esea02/107-110.pdf.
46. Webb, N.L. (1997). Criteria for alignment of expectations and assessments in mathematics and science education (Research Monograph No. 6). Washington, DC: Council of Chief State School Officers.
47. Webb, N.L. (1999). Alignment of science and mathematics standards and assessments in four states (Research Monograph No. 18). Washington, DC: Council of Chief State School Officers.
48. Webb, N.L. (2002, April). An analysis of the alignment between mathematics standards and assessments for three states. Paper presented at the meeting of the American Educational Research Association, New Orleans, LA.
49. Webb, N.L. (2007). Issues related to judging the alignment of curriculum standards and assessments. Applied Measurement in Education, 20, 7-25.
50. Webb, N.L., Alt, M., Ely, R., Cormier, M., & Vesperman, B. (2005). The Web alignment tool: Development, refinement, and dissemination. Washington, DC: Council of Chief State School Officers.
51. Webb, N.L., Alt, M., Ely, R., & Vesperman, B. (2005). Web alignment tool (WAT): Training manual draft 1.1. Retrieved March 17, 2006, from http://www.wcer.wisc.edu/WAT/Training%20Manual%202.1%20Draft%20091205.doc.
52. Webb, N.M., Herman, J.L., & Webb, N.L. (2007). Alignment of mathematics state-level standards and assessments: The role of reviewer agreement. Educational Measurement: Issues and Practice, 26(2), 17-29.
53. Winfield, L.F. (1993). Investigating test content and curriculum content overlap to assess opportunity to learn. Journal of Negro Education, 62, 288-310.