A Prelude to Modeling the Expert: A Generalizability Study of Expert Ratings of Performance on Computerized Clinical Simulations

Advances in Health Sciences Education

Volumn 4, Issue 3, 1999, Pages 261-270

  Kreiter, Clarence D ^a   Gordon, Joel A ^a   Elliott, Scott T ^a   Ferguson, Kristi J ^a  

^a UNIVERSITY OF IOWA   (United States)

Author keywords

Expert raters; Generalizability; Patient simulations; Performance assessment; Reliability

Indexed keywords

EID: 0345757913     PISSN: 13824996     EISSN: None     Source Type: Journal    
DOI: 10.1023/A:1009821027260     Document Type: Article

References (12)

1. nd ed. American College Testing Program Publication, Iowa City.
2. Clauser, B.E., Margolis, M.J., Clyman, S.G. & Ross, L.P. (1997). Development of Automated Scoring Algorithms for Complex Performance Assessments: A Comparison of Two Approaches. Journal of Educational Measurement 34(2): 141-161.
3. Clauser, B.E., Subhiyah, R.G., Nungester, R.J., Ripkey, D.R., Clyman, S.G. & McKinley, D. (1995). Scoring a Performance-based Assessment by Modeling the Judgments of Experts. Journal of Educational Measurement 32: 397-415.
4. Clauser, B.E., Swanson, D.B. & Clyman, S.G. (1998). A Comparison of the Generalizability of Scores Produced by Expert Raters and Automated Scoring Systems. Paper presented at AERA, San Diego - April 1998.
5. Crick, J.E. & Brennan, R.L. (1993). Manual for GENOVA: A Generalized Analysis of Variance System. ACT Publication, Iowa City, IA.
6. Dunbar, S.B., Koetz, D.M. & Hoover, H.D. (1991). Quality Control in the Development and Use of Performance Assessments. Applied Measurement in Education 4: 289-303.
7. Gordon, J.A. & Elliott, S.T. (1997). Integration of Self-directed Computerized Patient Simulations via ClinicSoft into a Medical Curriculum. Presentation at Clerkship Directors of Internal Medicine Annual Meeting. Chicago, IL. September 1997.
8. Gordon, J.A. & Elliott, S.T. (1998). Integration of Self Directed Computerized Patient Simulations via ClinicSoft into a Medical Curriculum. Presentation at Association for Surgical Educators Annual Meeting. Vancouver, 1998.
9. Linn, R.L. & Burton, E. (1994). Performance-based Assessment: Implications of Task Specificity. Educational Measurement: Issues and Practice 13(15): 5-8.
10. Ruiz-Primo, M.A., Baxter, G.P. & Shavelson, R.J. (1993). On the Stability of Performance Assessment. Journal of Educational Measurement 30(1): 41-53.
11. Swanson, D.B., Norman, G.R. & Linn, R.L. (1995). Performance-based Assessment: Lessons From the Health Professions. Educational Researcher 24(5): 5-11.
12. Wainer, H. & Thissen, D. (1993). Combining Multiple-choice and Constructed Response Test Scores: Toward A Marxist Theory of Test Construction. Applied Measurement in Education 6: 103-118.