A comparison of generalizability theory and many-facet Rasch measurement in an analysis of college sophomore writing

Assessing Writing

Volumn 9, Issue 3, 2004, Pages 239-261

  Sudweeks, Richard R ^a   Reeve, Suzanne ^a   Bradshaw, William S ^a  

^a BRIGHAM YOUNG UNIVERSITY   (United States)

Author keywords

Generalizability theory; Many Facet Rasch Model; Reliability of essay ratings; Writing assessment

Indexed keywords

EID: 13244284746     PISSN: 10752935     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.asw.2004.11.001     Document Type: Article

References (29)

1. Advanced Placement Program, The College Board. (1996). AP English language and composition. Free-response scoring guide with multiple choice section. Princeton, NJ: Educational Testing Services.
2. T.G. Bond C.M. Fox Applying the Rasch model: Fundamental measurement in the human sciences 2001 Lawrence Erlbaum Associates Mahwah, NJ
3. R.L. Brennan Generalizability theory 2001a Springer New York
4. R.L. Brennan Manual for urGENOVA 2001b Iowa Testing Programs, University of Iowa Iowa City, IA
5. R.L. Brennan E.G. Johnson Generalizability of performance assessments Educational Measurement: Issues and Practice 14 1995 9-12
6. J.E. Crick R.L. Brennan Manual for GENOVA: A generalized analysis of variance system (ACT technical bulletin no. 43) 1983 American College Testing Program Iowa City, IA
7. L. Crocker J. Algina Introduction to classical and modern test theory 1986 Holt, Rinehart & Winston New York
8. L.J. Cronbach G.C. Gleser H. Nanda N. Rajaratnam The dependability of behavioral measurements: Theory of generalizability of scores and profiles 1972 John Wiley New York
9. R.L. Ebel Estimation of the reliability of ratings Psychometrika 16 1951 407-424
10. Se.D. Embretson S.P. Reise Item response theory for psychologists 2000 Erlbaum Mahwah, NJ
11. G. Engelhard Jr. Monitoring raters in performance assessments In: G. Tindal & T.M. Haladyna (Eds.) Large-scale assessment programs for all students: Validity, technical adequacy, and implementation 2002 Erlbaum Mahwah, NJ 261-287
12. W.P. Fisher Jr. Reliability statistics Rasch Measurement Tranasactions 6 3 1992 238
13. E. Hart The need beyond reason Brigham Young University Studies 16 1976 517-526
14. W.T. Hoyt Rater bias in psychological research: When is it a problem and what can we do about it? Psychological Methods 5 2000 64-86
15. J.M. Linacre Many-facet Rasch measurement 1989 MESA Press Chicago
16. J.M. Linacre A user's guide to FACETS [computer program manual] 2003 MESA Press Chicago
17. Linacre, J. M. (2003b). Minifac [computer program, version 3.48.0]. Chicago: MESA Press.
18. Lunz, M. E., Stahl, J. A., Wright B. D. (1996). The invariance of judge severity calibrations. In: G. Engelhard Jr. & M. Wilson (Eds.), Objective measurement: Theory into practice (Vol. 3, pp. 99-112). Norwood, NJ: Ablex.
19. G.A. Marcoulides Estimating variance components in generalizability theory: The covariance structure analysis approach Structural Equation Modeling 3 1996 290-299
20. T.F. McNamara Measuring second language performance 1996 Addison Wesley Longman New York
21. A. Miller Tragedy and the common man In: R.A. Martin (Ed.) The theater essays of Arthur Miller 1978 Viking Press New York 3-7
22. C.M. Myford E.W. Wolfe Detecting and measuring rater effects using many-facet Rasch measurement: Part I Journal of Applied Measurement 4 2003 386-422
23. C.M. Myford E.W. Wolfe Detecting and measuring rater effects using many-facet Rasch measurement: Part II Journal of Applied Measurement 5 2004 189-227
24. A. Oosterhoff Developing and using classroom assessments 1996 Merrill Englewood Cliffs, NJ
25. G. Rasch Probabilistic models for some intelligence and attainment tests 1980 MESA Press Chicago
26. R.J. Shavelson N.M. Webb Generalizability theory: A primer 1991 Sage Newbury Park, CA
27. E.V. Smith Jr. Evidence for the reliability of measures and validity of measure interpretation: A Rasch measurement perspective Journal of Applied Measurement 2 2001 281-311
28. B.D. Wright J.M. Linacre Observations are always ordinal: Measurement, however, must be interval Archives of Physical Measurement and Rehabilitation 70 12 1989 857-860
29. B.D. Wright J.M. Linacre Reasonable mean-square fit values Rasch Measurement Transactions 8 1994 370