An introduction to the use of evidence-centered design in test development

Psicologia Educativa

Volumn 20, Issue 2, 2014, Pages 79-87

  Zieky, Michael J ^a  

^a EDUCATIONAL TESTING SERVICE   (United States)

Author keywords

Evidence centered design; Evidentiary reasoning; Test construction Validity; Test design; Test development

Indexed keywords

EID: 84924525446     PISSN: 1135755X     EISSN: 21740526     Source Type: Journal    
DOI: 10.1016/j.pse.2014.11.003     Document Type: Short Survey

References (29)

1. Almond, R. G.; Steinberg, L. S.; & Mislevy, R. J. (2002). Enhancing the design and delivery of assessment systems: A four-process architecture. Journal of Technology, Learning, and Assessment, 1(5). Available from http://www.jtla.org.
2. American Educational Research Association, American Psychological Association, & National Council on Measurement in Education (2014). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.
3. Bejar, I. (2011). A validity-based approach to quality control and assurance of automated scoring. Assessment in Education: Principles, Policy & Practice, 18, 319-341. Retrieved from http://dx.doi.org/10.1080/0969594X.2011.555329.
4. Bennett, R. E. (2010). Cognitively based assessment of, for, and as learning (CBAL): A preliminary theory of action for summative and formative assessment. Measurement: Interdisciplinary Research and Perspectives, 8, 70-91. doi: 10.1080/15366367.2010.508686.
5. P. Deane, and Y. Song A case study in principled assessment design: Designing assessments to measure and support the development of argumentative reading and writing skills Psicología Educativa 20 2014 99 108
6. J. de la Torre, and N. Minchen Cognitively diagnostic assessments and the cognitive diagnosis model framework Psicología Educativa 20 2014 89 97
7. Graf, E. A. (2009). Defining mathematics competency in the service of cognitively based assessment for grades 6 through 8 (Research Report 09-42). Princeton, NJ: Educational Testing Service.
8. Hansen, E. G.; Mislevy, R. J.; & Steinberg, L. S. (2008). Evidence-centered assessment design for reasoning about accommodations for individuals with disabilities in NAEP reading and math (Research Report 08-38). Princeton, NJ: Educational Testing Service. Hines, S. (2010). Evidence-centered design: The TOEIC® speaking and writing tests (Re-search Report 10-07). Princeton, NJ: Educational Testing Service.
9. K. Huff The promises and challenges of implementing evidence-centered design in large-scale assessment Applied Measurement in Education 23 2010 310 324
10. Huff, K.; Alves, C. B.; Pellegrino, J.; & Kaliski, P. (2013). Using evidence-centered design task models in automatic item generation. In M. J. Gierl & T. M. Haladyna (Eds.), Automatic item generation Theory and practice (pp. 102-118). New York: Routledge.
11. rd ed.; pp. 13-104). Washington, DC: American Council on Education.
12. Mislevy, R. J. (1994). Evidence and inference in educational assessment. Psychometrika, 59, 439-483.
13. th ed.; pp. 257-306). Washington, DC: American Council on Education/Praeger.
14. Mislevy, R. J.; Almond, R. G.; & Lukas, J. F. (2003). A brief introduction to evidence-centered design (Research Report 03-16). Princeton, NJ: Educational Testing Service.
15. Mislevy, R. J.; Almond, R. G.; Yan, D.; & Steinberg, L. S. (1999). Bayes nets in educational assessment: Where do the numbers come from? In K. B. Laskey & H. Prade (Eds.), Proceedings of the fifteenth conference on uncertainty in artificial intelligence (pp. 437-446). San Francisco, CA: Morgan Kaufmann.
16. rd ed.; volume 8, pp. 56-65). Amsterdam, Netherlands: Elsevier.
17. Mislevy, R. J.; & Haertel, G. (2006). Implications of evidence-centered design for educational testing. Menlo Park, CA: SRI International.
18. Mislevy, R.; Haertel, G.; Yarnall, L.; & Wentland, E. (2011). Evidence-centered task design in test development. In C. Secolsky (Ed.), Measurement, assessment, and evaluation in higher education (pp. 257-276). New York, NY: Routledge.
19. Mislevy, R. J.; & Riconscente, M. M. (2005). Evidence-centered design: Layers, structures, and terminology. Menlo Park, CA: SRI International.
20. Mislevy, R. J.; Steinberg, L. S.; & Almond, R. G. (1999). Evidence-centered assessment design. Princeton, NJ: Educational Testing Service.
21. Mislevy, R. J.; Steinberg, L. S.; & Almond, R. G. (2003). On the structure of educational assessments. Measurement: Interdisciplinary Research and Perspectives, 1, 3-67.
22. Mislevy, R. J.; & Yin, C. (2012). Evidence-centered design in language testing. In G. Fulcher & F. Davidson (Eds.), Routledge handbook of language testing (pp. 208-222). London, England: Routledge.
23. Pellegrino, J. W. (2014). Assessment as a positive influence on 21st century teaching and learning: A systems approach to progress. Psicología Educativa, 20, 65-77.
24. Scalise, K.; & Wilson, M. (2006). Analysis and comparison of automated scoring approaches: Addressing evidence-based assessment principles. In D. M. Williamson, R. J. Mislevy, & I. I. Bejar (Eds.), Automated scoring of complex tasks in computer-based testing (pp. 15-47). Mahwah, NJ: Lawrence Erlbaum Associates.
25. Sheehan, K. M.; Kostin, I.; & Futagi, Y. (2007). Supporting efficient, evidence-centered item development for the GRE® verbal measure (Research Report 07-29). Princeton, NJ: Educational Testing Service.
26. Stocking, M.; & Swanson, L. (1993). A method for severely constrained item selection in adaptive testing. Applied Psychological Measurement, 17, 277-292.
27. Tannenbaum, R. J.; Robustelli, S. L.; & Baron, P. A. (2008). Evidence-centered design: A lens through which the process of job analysis may be focused to guide the development of knowledge-based content specifications. CLEAR Exam Review, 19, 26-33.
28. Toulmin, S. E. (1958). The uses of argument. Cambridge, England: Cambridge University Press.
29. Van Rijn, P. W.; Graf, E. A.; & Deane, P. (2014). Empirical recovery of argumentation learning progressions in scenario-based assessments of english language arts. Psicología Educativa, 20, 109-115.