The application of the cumulative logistic regression model to automated essay scoring

Journal of Educational and Behavioral Statistics

Volumn 35, Issue 5, 2010, Pages 586-602

  Haberman, Shelby J ^a   Sinharay, Sandip ^a  

^a EDUCATIONAL TESTING SERVICE   (United States)

Author keywords

cross validation; deleted residual; PRESS; regression

Indexed keywords

EID: 79953034466     PISSN: 10769986     EISSN: None     Source Type: Journal    
DOI: 10.3102/1076998610375839     Document Type: Article

References (16)

1. Attali Y.,Burstein J.Automated essay scoring with e-rater v.2.Journal of Technology, Learning and Assessment. 2006;4:1-29.
2. Attali Y.,Burstein J.,Andreyev S.E-rater version 2.0: Combining writing analysis feedback with automated essay scoring. Princeton, NJ: Educational Testing Service; 2003:.
3. Burstein J.,Chodorow M.,Leacock C.Automated essay evaluation: the criterion online writing service.AI Magazine. 2004;25:27-36.
4. Cohen J.A coefficient of agreement for nominal scales.Educational and Psychological Measurement. 1960;20:37-46.
5. Davey T. Considering fairness and validity in evaluating automated scoring. Paper presented at the Annual meeting of the National Council of Measurement in Education, April; 2009San Diego, CA; 2009.
6. Draper N. R.,Smith H.Applied regression analysis. 3rd ed.New York, NY: Wiley; 1998:.
7. Feng X.,Dorans N. J.,Patsula L. N.,Kaplan B.Improving the statistical aspects of e-rater®: Exploring alternative feature reduction and combination rules (ETS Research Rep. No. RR-03-15). Princeton, NJ: ETS; 2003:.
8. Gilula Z.,Haberman S. J.Models for analyzing categorical panel data.Journal of the American Statistical Association. 1994;89:645-656.
9. Haberman S. J.Concavity and estimation.The Annals of Statistics. 1989;17:1631-1661.
10. Haberman S. J., Electronic essay grading. In, Handbook of statistics. Rao C. R.Sinharay S., ed. Amsterdam, Netherlands: North-Holland; 2007:205-233.
11. Haberman S. J.When can subscores have value?.Journal of Educational and Behavioral Statistics. 2008;33:204-229.
12. Johnson V. E.On Bayesian analysis of multirater ordinal data: An application of automated essay scoring.Journal of the American Statistical Association. 1996;91:42-51.
13. McCullagh P.,Nelder J. A.Generalized linear models. 2nd ed.Boca Raton, FL: Chapman and Hall; 1989:.
14. Neter J.,Kutner M. H.,Nachtsheim C. J.,Wasserman W.Applied linear regression models. Homewood, IL: Irwin; 1996:.
15. Pratt J. W.Concavity of the log likelihood.Journal of the American Statistical Association. 1981;76:103-109.
16. Spitzer R. L.,Cohen J.,Fleiss J. L.,Endicott J.Quantification of agreement in psychiatric diagnosis.Archives of General Psychiatry. 1967;17:83-87.