Comparing Graphical and Verbal Representations of Measurement Error In Test Score Reports

Educational Assessment

Volumn 19, Issue 2, 2014, Pages 116-138

  Zwick, Rebecca ^a   Zapata Rivera, Diego ^a   Hegarty, Mary ^b  

^a EDUCATIONAL TESTING SERVICE   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84900829097     PISSN: 10627197     EISSN: None     Source Type: Journal    
DOI: 10.1080/10627197.2014.903653     Document Type: Article

References (21)

1. Allalouf, A. (2007). Quality control procedures in the scoring, equating, and reporting of test scores. Educational Measurement: Issues and Practice, 26, 36-46.
2. American Educational Research Association, American Psychological Association, & National Council on Measurement in Education (1999). Standards for educational and psychological testing. Washington, DC: Author.
3. Belia, S., Fidler, F., Williams, J., & Cumming, G. (2005). Researchers misunderstand confidence intervals and standard error bars. Psychological Assessment, 10, 389-396.
4. Cumming, G. (2007). Inference by eye: Pictures of confidence intervals and thinking about levels of confidence. Teaching Statistics, 29, 89-93.
5. Feldt, L. S., & Brennan, R. L. (1989). Reliability. In R. L. Linn (Ed.), Educational measurement (3rd ed., pp. 105-146). New York: American Council on Education/Macmillan.
6. Goodman, D. P., & Hambleton, R. K. (2004). Student test score reports and interpretive guides: Review of current practices and suggestions for future research. Applied Measurement in Education, 17, 145-220.
7. Hambleton, R. K., & Slater, S. (1997). Are NAEP executive summary reports understandable to policy makers and educators? (CSE Tech. Rep. No. 430). Los Angeles, CA: National Center for Research on Evaluation, Standards, & Student Teaching.
8. Hegarty, M. (2011). The cognitive science of visual displays: Implications for design. Topics in Cognitive Science, 3, 446-474.
9. Hegarty, M., Smallman, H. S., & Stull, A. T. (2012). Choosing and using geospatial displays: Effects of design on performance and metacognition. Journal of Experimental Psychology: Applied, 18, 1-17.
10. Kosslyn, S. (2006). Graph design for the eye and mind. New York, NY: Oxford University Press.
11. Lukin, L. E., Bandalos, D. L., Eckhout, T. J., & Mickelson, K. (2004). Facilitating the development of assessment literacy. Educational Measurement: Issues and Practice, 23, 26-32.
12. MacEachren, A. M., Robinson, A., Hopper, S., Gardner, S., Murray, R., Gahegan, M., & Hetzler, E. (2005). Visualizing geospatial information uncertainty: What we know and what we need to know. Cartography and Geographic Information Science, 32, 139-160.
13. Mayer, R. E. (2001). Multimedia learning. New York, NY: Cambridge University Press.
14. Roberts, M., & Gierl, M. J. (2010). Developing Score Reports for Cognitive Diagnostic Assessments. Educational Measurement: Issues and Practice, 29(3), 25-38.
15. Shah, P., Freedman, E. G., & Vekiri, I. (2005). The comprehension of quantitative information in graphical displays. In P. Shah & A. Miyake (Eds.), The Cambridge handbook of visuospatial thinking (pp. 426-476). New York, NY: Cambridge University Press.
16. Sklar, J., & Zwick, R. (2009). Multimedia presentations in educational measurement and statistics: Design considerations and instructional approaches. Journal of Statistics Education, 17(3). Available from http://www.amstat.org/publications/jse/v17n3/sklar.html
17. Wainer, H., Hambleton, R. K., & Meara, K. (1999). Alternative displays for communicating NAEP results: A redesign and validity study. Journal of Educational Measurement, 36, 301-335.
18. Zapata-Rivera, D., VanWinkle, W., & Zwick, R. (2010). Exploring effective communication and appropriate use of assessment results through teacher score reports. Paper presented at the annual meeting of the National Council on Measurement in Education, Denver, CO.
19. Zapata-Rivera, D., & Zwick, R. (Eds.). (2011). Improving test score reporting: Perspectives from the ETS Score Reporting Conference (ETS Research Rep. No. 11-45). Princeton, NJ: Educational Testing Service.
20. Zenisky, A., & Hambleton, R. (2012). Developing test score reports that work: The process and best practices for effective communication. Educational Measurement: Issues & Practice, 31(2), 21-26.
21. Zwick, R., Sklar, J., Wakefield, G., Hamilton, C., Norman, A., & Folsom, D. (2008). Instructional tools in educational measurement and statistics (ITEMS) for school personnel: Evaluation of three web-based training modules. Educational Measurement: Issues and Practice, 27, 14-27.