Multitrait-multimethod analysis of FCAT reading and writing: Or is it writing and reading?

Journal of Psychoeducational Assessment

Volumn 27, Issue 4, 2009, Pages 296-311

  Shermis, Mark D ^a   Long, Susanne K ^a  

^a UNIVERSITY OF FLORIDA   (United States)

Author keywords

High stakes testing; Multi trait multi method technique; Reading; Test validity; Writing

Indexed keywords

EID: 68349142953     PISSN: 07342829     EISSN: None     Source Type: Journal    
DOI: 10.1177/0734282908328639     Document Type: Article

References (31)

1. Attali, Y., & Powers, D.E. (2008, March 24-28). A developmental writing scale. Paper presented at the American Educational Research Association, New York, NY.
2. Bacon, D.R. (2003). Assessing learning outcomes: A comparison of multiple-choice and short-answer questions in a marketing context. Journal of Marketing Education, 25 (1). 31-37.
3. Bennett, R.E., Rock, D.A., & Wang, M. (1991). Equivalence of free-response and multiple-choice items. Journal of Educational Measurement, 28 (1). 77-92.
4. Braddock, R., Lloyd-Jones, R., & Schoer, L. (1963). Research in written composition. Urbana, IL: National Council of Teachers of English.
5. Breland, H.M., & Gaynor, J.L. (1979). A comparison of direct and indirect assessments of writing. Journal of Educational Measurement, 16 (2). 119-128.
6. Byrne, B.M. (2001). Structural equation modeling with AMOS: Basic concepts, applications, and programming. Mahwah, NJ: Lawrence Erlbaum.
7. Cooper, P.L. (1984). The assessment of writing ability: A review of research (GRE Board Research Report). Princeton, NJ: Educational Testing Service.
8. Fitzgerald, J., & Shanahan, T. (2000). Reading and writing relations and their development. Educational Psychologist, 35 (1). 39-50.
9. Fleiss, J.L., & Cohen, J. (1973). The equivalence of weighted kappa and the intraclass correlation coefficient as measures of reliability. Educational and Psychological Measurement, 33, 613-619.
10. Florida Department of Education. (1996). Sunshine state standards. Retrieved September 20, 2002, from http://www.firn.edu/doe/curric/prek12/frame2. htm
11. Florida Department of Education. (2000). FCAT sample test materials (reading). Tallahassee: Florida Department of Education.
12. Florida Department of Education. (2005 a). FCAT handbook-A resource for educators. Retrieved from http://fcat.fldoe.org/handbk/developconstruct.pdf
13. Florida Department of Education. (2005 b). FCAT sample questions. Retrieved from http://fcat.fldoe.org/fcatsmpl.asp
14. Florida Department of Education. (2005 c). Florida Comprehensive Assessment Test. Retrieved September 12, 2007, from http://fcat.fldoe.org
15. Heck, R.H., & Crislip, M. (2001). Direct and indirect writing assessments: Examining issues of equity and utility. Educational Evaluation and Policy Analysis, 23 (1). 275-292. (Pubitemid 33576229)
16. Hogan, T.P. (1991). Relationship between free-response and choice-type tests of achievement: A review of the literature. Washington, DC: National Institute of Education.
17. Hogan, T.P., & Mishler, C. (1980). Relationships between essay tests and objective tests of language skills for elementary school students. Journal of Educational Measurement, 17 (3). 219-227.
18. Human Resources Research Organization & Harcourt Assessment, Inc. (2007 a). Reading and mathematics technical report for 2006 FCAT test administrations. San Antonio, TX: Author.
19. Human Resources Research Organization & Harcourt Assessment, Inc. (2007 b). Writing+ technical report for 2006 FCAT test administrations. San Antonio, TX: Author.
20. Jenkins, J.R., Johnson, E., & Hileman, J. (2004). When is reading also writing: Sources of individual differences on the new reading performance assessments. Scientific Studies of Reading, 8 (2). 125-151.
21. Martinez, M. (1999, Fall99). Cognition and the question of test item format. Educational Psychologist, 34 (4). 207-218.
22. Messick, S. (1993). Validity. In R. L. Linn (Ed.), Educational measurement (3 rd ed., pp. 13-103). New York: American Council of Education.
23. Middleton, H. (2006). On a scale: A social history of writing assessment in America. Composition Studies, 34 (2). 135-137.
24. No Child Left Behind Act of 2001, No. 107-110, 115 Stat. 1444-1446 C.F.R. (2002).
25. Olson, L. (2004). Three states in New England to produce common tests. Education Week, 23 (38). 10-10.
26. Parodi, G. (2007). Reading-writing connections: Discourse-oriented research. Reading and Writing, 20, 225-250.
27. Qian, D.D. (2002). Investigating the relationship between vocabulary knowledge and academic reading performance: An assessment perspective. Language Learning, 52 (3). 513-536.
28. Shanahan, T. (1984). Nature of the reading-writing relation: An exploratory multivariate analysis. Journal of Educational Psychology, 76 (3). 466-477.
29. Tan, X., Ricker, K.L., & Puhan, G. (2008, March 25-27). Single versus double scoring trend responses in trend score equating with constructed response tests. Paper presented at the National Council on Measurement in Education, New York, NY.
30. Van den Bergh, H. (1990). On the construct validity of multiple-choice items for reading comprehension. Applied Psychological Measurement, 14, 1-12.
31. Yancey, K.B. (1999). Looking back as we look forward: Historicizing writing assessment. College Composition and Communication, 50 (3). 483-503.