AUTOMATED SCORING OF SHORT-ANSWER OPEN-ENDED GRE® SUBJECT TEST ITEMS

ETS Research Report Series

Volumn 2008, Issue 1, 2008, Pages i-22

  Attali, Yigal ^a   Powers, Don ^a   Freedman, Marshall ^a   Harrison, Marissa ^a   Obetz, Susan ^a  

^a EDUCATIONAL TESTING SERVICE   (United States)

Author keywords

automated scoring; c rater; constructed response; GRE Subject test

Indexed keywords

EID: 85164569713     PISSN: None     EISSN: 23308516     Source Type: Journal    
DOI: 10.1002/j.2333-8504.2008.tb02106.x     Document Type: Article

References (13)

1. Attali, Y., & Burstein, J. (2006). Automated essay scoring with e-rater V.2. Journal of Technology, Learning, and Assessment, 4(3). Retrieved March 21, 2008, from http://escholarship.bc.edu/jtla/vol4/3/.
2. Attali, Y., & Powers, D. (2008). Effect of immediate feedback and revision on psychometric properties of open-ended GRE Subject Test items (GRE Board Research Rep. No GRE-04-05). Princeton, NJ: ETS.
3. Bridgeman, B. (1991). A comparison of quantitative questions in open-ended and multiple-choice formats. Journal of Educational Measurement, 29, 253–271.
4. Briel, J. B., O'Neill, K. A., & Scheuneman, J. D. (Eds.). (1993). GRE technical manual: Test development, score interpretation, and research for the Graduate Record Examinations Program (pp. 67–88). Princeton, NJ: ETS.
5. Cicchetti, D.V., & Allison, T. (1971). A new procedure for assessing reliability of scoring EEG sleep recordings. American Journal of EEG Technology, 11, 101–109.
6. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.
7. ETS. (2006). GRE guide to the use of scores. Princeton, NJ: Author.
8. Glanz, J. (1996). How not to pick a physicist? Science, 274, 710–712.
9. GRE psychology test practice book. (2001). Retrieved March 21, 2008, from http://ftp.ets.org/pub/gre/Psychology.pdf.
10. Kaplan, R. M., & Bennett, R. E. (1994). Using the free-response scoring tool to automatically score the formulating-hypotheses item (ETS Research Rep. No. RR-94-08). Princeton, NJ: ETS.
11. Kuncel, N. R., Hezlett, S. A., & Ones, D. S. (2000). Comprehensive meta-analysis of the predictive validity of the Graduate Record Examinations: Implications for graduate student selection and performance. Psychological Bulletin, 127, 162–181.
12. Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33, 159–174.
13. Leacock, C., & Chodorow, M (2003). C-rater: Automated scoring of short-answer questions. Computers and the Humanities, 37, 389–405.