On-line grading of student essays: PEG goes on the World Wide Web

Assessment and Evaluation in Higher Education

Volumn 26, Issue 3, 2001, Pages 247-259

  Shermis, Mark D ^a   Mzumara, Howard R ^a   Olson, Jennifer ^a   Harrington, Susanmarie ^a  

^a INDIANA UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0038551403     PISSN: 02602938     EISSN: 1469297X     Source Type: Journal    
DOI: 10.1080/02602930120052404     Document Type: Article

References (26)

1. ANON (1996) Study finds that 29% of freshmen take remedial instruction, The Chronicle of Higher Education, 1 November, pp. A42.
2. BRENNAN, R. L. (1992) Elements of Generalizability Theory, 2nd edn (Iowa City, IA, American College Testing).
3. BURSTEIN, J. C. & KAPLAN, R. M. (1995) On the application of context to natural language processing applied to the analysis of test responses. Proceedings from the Workshop on Context in Natural Language Processing, IJCAI, Montreal, Canada.
4. HARRINGTON, S., SHERMIS, M. D. & ROLLINS, A. (1998) The Influence of Word Processing on English Placement Test Results (Indianapolis, IN, Indiana University Purdue University Indianapolis).
5. HASWELL, R. & WYCHES-MITH, S. (1995) A two-tiered rating procedure for placement essays, in: T. BANTA (Ed.) Assessment in Practice: putting principles to work on college campuses, pp. 204-207 (San Francisco, Jossey-Bass).
6. HOYT, W. T. (2000) Rater bias in psychological research: when is it a problem and what can we do about it? Psychological Methods, 5(1), pp. 64-86.
7. HSU, T. C. & SHERMIS, M. D. (1989) The development and evaluation of a micro computerize d adaptive placement testing system for college mathematics, Journal of Educational Computing Research, 5(4), pp. 473-485.
8. JOHNSON, V. E. (1996) On Bayesian analysis of multi rater ordinal data: an application to automated essay grading, Journal of the American Statistical Association, 91(433), pp. 42-51.
9. LANDAUER, T., LAHAM, D. & FOLTZ, P. (1998) The Goldilocks principle for vocabulary acquisition and learning: satent Semantic Analysis theory and applications. Paper presented at the annual meeting of the American Educational Research Association, April, San Diego, CA.
10. MZUMARA, H. R., SHERMIS, M. D. & WIMER, D. (1996) Validity of the IUPUI Placement Test Scores for Course Placement: 1995-1996 (Indianapolis, IN, IUPUI Testing Center).
11. NATIONAL CENTER FOR EDUCATION STATISTICS (1995) Postsecondary Education Quick Information System: survey on remedial education in higher education institutions (Washington, DC, US Department of Education).
12. NICHOLS, P. D. & SMITH, P. L. (1998) Contextualizin g the inter pretation of reliability data, Educational Measurement: Issues and Practice, 17(1), pp. 24-36.
13. PAGE, E. B. (1966) The imminence of grading essays by computer, Phi Delta Kappan, 48(1), pp. 238- 243.
14. PAGE, E. B. (1994) Computer grading of student prose, using modern concepts and software, Journal of Experimental Education, 62(2), pp. 27-142.
15. PAGE, E. B. (1996) Grading essays by computer: why the controversy? Paper presented at the annual meeting of the National Council on Measurement in Education, April New York, NY.
16. PAGE, E. B. & PETERSEN, N. S. (1995) The computer moves into essay grading: updating the ancient test, Phi Delta Kappan, 76(7), pp. 561-565.
17. PAGE, E. B., LAVOIE, M. J. & KEITH, T. Z. (1996) Computer grading of essay traits in student writing. Paper presented at the annual meeting of the National Council on Measurement in Education, April, New York, NY.
18. PAGE, E. B., POGGIO, J. P. & KEITH, T. Z. (1997) Computer analysis of student essays: Finding trait difference s in the student profile. Paper presented at the annual meeting of the American Eduational Research Association, March, Chicago, IL.
19. SHERMIS, M. D. (1997) Recent developments in college placement testing: assessments via the World Wide Web. Paper presented at the annual meeting of the American Educational Research Association, March, Chicago, IL.
20. SHERMIS, M. D. & CHANG, S. H. (1997) The use of IRT to investigate the hierarchical nature of a college mathematics curriculum, Educational and Psychological Measurement, 57(3), pp. 450-458.
21. SHERMIS, M. D., WOLTING, M. & LOMBARD, D. (1996) Development of a computerized test for college reading placement, Journal of Developmental Education, 20(2), pp. 18-24.
22. SHERMIS, M. D., MZUMARA, H. R., LILLIG, C. & BROWN, M. (1997) Computerized adaptive testing through the World Wide Web. Paper presented at the annual meeting of the American Psychological Association, August, Chicago, IL.
23. SHERMIS, M. D., RASMUSSEN, J. L., RAJECKI, D. W., OLSON, J. & MARSIGLIO, C. (1999) Prompts and themes as sources of variance in grading college placement essays. Manuscript submitted for publication.
24. SMITH, W. (1993) Assessing the reliability and adequacy of using holistic scoring of essays as a college composition placement technique, in: M. M. WILLIAMSON & B. HUOT (Eds) Validating Holistic Scoring for Writing Assessment: theoretical and empirical foundation s, pp. 142-205 (Cresskill, NJ, Hampton Press).
25. SPSS Inc. (1997) SPSS Advanced Statistics 7.5 (Chicago, IL, Author).
26. WHITE, E. (1995) Teaching and Assessing Writing, 2nd edn (San Francisco, Jossey-Bass).