Does it matter if I take my writing test on computer? An empirical study of mode effects in NAEP

Journal of Technology, Learning, and Assessment

Volumn 5, Issue 2, 2006, Pages 1-48

  Horkay, Nancy ^a   Bennett, Randy Elliot ^a   Allen, Nancy ^a   Kaplan, Bruce ^a   Yan, Fred ^a  

^a EDUCATIONAL TESTING SERVICE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 34547585667     PISSN: 15402525     EISSN: 15402525     Source Type: Journal    
DOI: None     Document Type: Article

References (28)

1. Allen, N. L., Carlson, J. E., & Zelenak, C. A. (1999). The NAEP 1996 technical report (NCES 1999-452). Washington, DC: National Center for Education Statistics, US Department of Education.
2. Bangert-Drowns, R. L. (1993). The Word Processor as an instructional tool: A meta-analysis of word processing in writing instruction. Review of Educational Research, 63(1), 69-93.
3. Bridgeman, B., & Cooper, P. (1998, April). Comparability of scores on word-processed and handwritten essays on the Graduate Management Admission Test Paper presented at the annual meeting of the American Educational Research Association, San Diego, CA.
4. Bridgeman, B., Lennon, M. L., & Jackenthal, A. (2003). Effects of screen size, screen resolution, and display rate on computer-based test performance. Applied Measurement in Education, 16(3), 191-205.
5. Burton, N., & Ramist, L. Predicting success in college: SAT studies of classes graduating since 1980 (Research Report No. 2001-2). New York: College Board. Retrieved January 31, 2006 from http://www.collegeboard.com/research/ pdf/rdreport200_3919.pdf
6. nd ed.). Hillsdale, NJ: Lawrence Erlbaum Associates.
7. Computer-based testing. (2006, May 4). Education Week, 25(35), 52.
8. Goldberg, A., Russell, M., & Cook, A. (2003). The effect of computers on student writing: A meta-analysis of studies from 1992 to 2002. Journal of Technology, Learning, and Assessment, 2(1). Retrieved November 24, 2003, from http://www.bc.edu/research/intasc/jtla/journal/v2n1.shtml.
9. Harrington, S., Shermis, M. D., & Rollins, A. L. (2000). The influence of word processing on English placement test results. Computers and Composition, 17(2), 197-210.
10. Horkay, N., Bennett, R. E., Allen, N., & Kaplan, B. (2005). Online assessment in writing. In B. Sandene, N. Horkay, R. E. Bennett, N. Allen, J. Braswell, B. Kaplan, & A. Oranje (Eds.), Online assessment in mathematics and writing: Reports from the NAEP Technology-Based Assessment Project (NCES 2005-457). Washington, DC: National Center for Education Statistics, US Department of Education. Retrieved January 31, 2005 from http://nces.ed.gov/ pubsearch/pubsinfo.asp?pubid=2005457
11. MacCann, R., Eastment, B., & Pickering, S. (2002). Responding to free response examination questions: Computer versus pen and paper. British Journal of Educational Technology, 33(2), 173-188.
12. Noble, J., & Sawyer, R. (2002). Predicting different levels of academic success in college using high school GPA and ACT composite score (ACT Research Report Series 2002-4). Iowa City: ACT. Retrieved January 31, 2006 from http://www.act.org/research/reports/pdf/ACT_RR2002-4.pdf
13. Persky, H. R., Daane, M. C., & Jin, Y. (2003). The nation's report card: Writing 2002. Washington, DC: National Center for Education Statistics, US Department of Education. Retrieved September 21, 2006 from http://nces.ed.gov/ pubsearch/pubsinfo.asp?pubid=2003529.
14. Powers, D., & Farnum, M. (1997). Effects of mode of presentation on essay scores (RM-97-8). Princeton, NJ: Educational Testing Service.
15. Powers, D., Fowles, M., Farnum, M., & Ramsey, P. (1994). Will they think less of my handwritten essay if others word process theirs? Effects on essay scores of intermingling handwritten and word-processed essays. Journal of Educational Measurement, 31(3), 220-233.
16. Powers, D., & Potenza, M. T. (1996). Comparability of testing using laptop and desktop computers (RR-96-15). Princeton, NJ: Educational Testing Service.
17. Russell, M. (1999). Testing on computers: A follow-up study comparing performance on computer and on paper. Education Policy Analysis Archives, 7(20). Retrieved June 27, 2003, from http://epaa.asu.edu/epaa/v7n20/.
18. Russell, M., & Haney, W. (1997). Testing writing on computers: An experiment comparing student performance on tests conducted via computer and via paper-and-pencil. Education Policy Analysis Archives, 5(3). Retrieved June 27, 2003, from http://epaa.asu.edu/epaa/v5n3.html.
19. Russell, M., & Plati, T. (2001). Effects of computer versus paper administration of a state-mandated writing assessment. TCRecord. Retrieved June 27, 2003, from http://www.tcrecord.org/Content.asp?ContentID=10709.
20. Russell, M., & Tao, W. (2004a). Effects of handwriting and computer-print on composition scores: A follow-up to Powers et al. Practical Assessment, Research and Evaluation, 9(1). Retrieved July 8, 2004, from http://pareonline.net/getvn.asp?v=9&n=1.
21. Russell, M., & Tao, W. (2004b). The influence of computer-print on rater scores. Practical Assessment, Research and Evaluation, 9(1). Retrieved July 8, 2004, from http://pareonline.net/getvn.asp?v=9&n=10.
22. State: Online testing helped raise scores. (2005, August 18). eSchool News Online. Retrieved August 18, 2005 from http://www.eschoolnews.com/news/ showStoryts.cfm?ArticleID=5826.
23. Taylor, C., Jamieson, J., Eignor, D., & Kirsch, I. (1998). The relationship between computer familiarity and performance on computer-based TOEFL test tasks (Report 61). Princeton, NJ: Educational Testing Service.
24. Thorndike, R. L. (1982). Applied psychometrics. Boston: Houghton Mifflin.
25. Virginia Department of Education, (undated). Virginia Standards of Learning assessment program: Update for Spring 2005. Retrieved February 7, 2006 from http://www.doe.virginia.gov/VDOE/Technology/soltech/docs/ RegionalWorkshop_Spr05.ppt.
26. Wolfe, E. W., Bolton, S., Feltovich, B., & Bangert, A. W. (1996). A study of word processing experience and its effects on student essay writing. Journal of Educational Computing Research, 14(3), 269-283.
27. Wolfe, E. W., Bolton, S., Feltovich, B., & Niday, D. M. (1996). The influence of student experience with word processors on the quality of essays written for a direct writing assessment. Assessing Writing, 3(2), 123-147.
28. Wolfe, E. W, & Manalo, J. R. (2004). Composition medium comparability in a direct writing assessment of non-native english speakers. Language Learning and Technology, 8(1), 53-65. Retrieved January 6, 2004, from http://llt.msu.edu/vol8num1/wolfe/default.html.