메뉴 건너뛰기




Volumn 15, Issue 4, 2002, Pages 391-412

A Review of Strategies for Validating Computer-Automated Scoring

Author keywords

[No Author keywords available]

Indexed keywords


EID: 0036960437     PISSN: 08957347     EISSN: None     Source Type: Journal    
DOI: 10.1207/S15324818AME1504_04     Document Type: Review
Times cited : (90)

References (51)
  • 1
    • 0003600480 scopus 로고    scopus 로고
    • Washington, DC: Author
    • American Educational Research Association, American Psychological Association, and National Council on Measurement in Education. (1999). Standards for educational and psychological testing. Washington, DC: Author.
    • (1999) Standards for Educational and Psychological Testing
  • 3
    • 0003051128 scopus 로고
    • Evolving concepts of test validation
    • Anastasi, A. (1986). Evolving concepts of test validation. Annual Review of Psychology, 37, 1-15.
    • (1986) Annual Review of Psychology , vol.37 , pp. 1-15
    • Anastasi, A.1
  • 4
    • 85079741832 scopus 로고
    • Validity: An evolving concept
    • H. Wainer & H. Braun (Eds.). Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
    • Angoff, W. H. (1988). Validity: An evolving concept. In H. Wainer & H. Braun (Eds.), Test validity (pp. 19-32). Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
    • (1988) Test Validity , pp. 19-32
    • Angoff, W.H.1
  • 6
    • 85039646806 scopus 로고    scopus 로고
    • [Draft]. Retrieved DATE
    • [Draft]. Retrieved DATE from http://www.testpublishers.org/MembersOnly/Members/computer_testing.htm
  • 7
    • 0001330641 scopus 로고
    • A methodology for scoring open-ended architectural design problems
    • Bejar, I. I. (1991). A methodology for scoring open-ended architectural design problems. Journal of Applied Psychology, 76, 522-532.
    • (1991) Journal of Applied Psychology , vol.76 , pp. 522-532
    • Bejar, I.I.1
  • 8
    • 0009215208 scopus 로고
    • On the synergy between assessment and instruction: Early lessons from computer-based simulations
    • Bejar, I. I., & Braun, H. I. (1994). On the synergy between assessment and instruction: Early lessons from computer-based simulations. Machine-Mediated Learning, 4, 5-25.
    • (1994) Machine-mediated Learning , vol.4 , pp. 5-25
    • Bejar, I.I.1    Braun, H.I.2
  • 10
    • 0030555167 scopus 로고    scopus 로고
    • The accuracy of expert-system diagnoses of mathematical problem solutions
    • Bennett, R. E., & Sebrechts, M. M. (1996). The accuracy of expert-system diagnoses of mathematical problem solutions. Applied Measurement in Education, 9, 133-150.
    • (1996) Applied Measurement in Education , vol.9 , pp. 133-150
    • Bennett, R.E.1    Sebrechts, M.M.2
  • 18
    • 0034257275 scopus 로고    scopus 로고
    • The generalizability of scores for a performance assessment scored with a computer-automated scoring system
    • Clauser, B. E., Harik, P., & Clyman, S. G. (2000). The generalizability of scores for a performance assessment scored with a computer-automated scoring system. Journal of Educational Measurement, 37, 245-261.
    • (2000) Journal of Educational Measurement , vol.37 , pp. 245-261
    • Clauser, B.E.1    Harik, P.2    Clyman, S.G.3
  • 19
    • 0031287726 scopus 로고    scopus 로고
    • Development of automated scoring algorithms for complex performance assessments: A comparison of two approaches
    • Clauser, B. E., Margolis, M. J., Clyman, S. G., & Ross, L. P. (1997). Development of automated scoring algorithms for complex performance assessments: A comparison of two approaches. Journal of Educational Measurement, 34, 141-161.
    • (1997) Journal of Educational Measurement , vol.34 , pp. 141-161
    • Clauser, B.E.1    Margolis, M.J.2    Clyman, S.G.3    Ross, L.P.4
  • 20
  • 22
    • 0041526020 scopus 로고    scopus 로고
    • A comparison of the generalizability of scores produced by expert raters and automated scoring systems
    • Clauser, B. E., Swanson, D. B., & Clyman, S. G. (1999). A comparison of the generalizability of scores produced by expert raters and automated scoring systems. Applied Measurement in Education, 12, 281-299.
    • (1999) Applied Measurement in Education , vol.12 , pp. 281-299
    • Clauser, B.E.1    Swanson, D.B.2    Clyman, S.G.3
  • 23
    • 0001960725 scopus 로고
    • Test validation
    • R. L. Thorndike (Ed.). Washington, DC: American Council on Education
    • Cronbach, L. J. (1971). Test validation. In R. L. Thorndike (Ed.), Educational measurement (2nd ed., pp. 443-507). Washington, DC: American Council on Education.
    • (1971) Educational Measurement (2nd Ed.) , pp. 443-507
    • Cronbach, L.J.1
  • 24
    • 85079739842 scopus 로고
    • Five perspectives on validity argument
    • H. Wainer & H. Braun (Eds.). Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
    • Cronbach, L. J. (1988). Five perspectives on validity argument. In H. Wainer & H. Braun (Eds.), Test validity (pp. 3-17). Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
    • (1988) Test Validity , pp. 3-17
    • Cronbach, L.J.1
  • 26
    • 58149367997 scopus 로고
    • Construct validity: Construct representation versus nomothetic span
    • Embretson, S. E. (1983). Construct validity: Construct representation versus nomothetic span. Psychological Bulletin, 93, 179-197.
    • (1983) Psychological Bulletin , vol.93 , pp. 179-197
    • Embretson, S.E.1
  • 27
    • 0001068410 scopus 로고
    • The metamorphosis of test validation
    • Geisinger, K. F. (1992). The metamorphosis of test validation. Educational Psychologist, 27, 197-222.
    • (1992) Educational Psychologist , vol.27 , pp. 197-222
    • Geisinger, K.F.1
  • 28
    • 0032201575 scopus 로고    scopus 로고
    • Dental Interactive Simulations Corporation (DISC): Simulations for education, continuing education, and assessment
    • Johnson, L. A., Wohlgemuth, B., Cameron, C. A., Caughtman, F., Koertge, T., Barna, J., et al. (1998). Dental Interactive Simulations Corporation (DISC): Simulations for education, continuing education, and assessment. Journal of Dental Education, 62, 919-928.
    • (1998) Journal of Dental Education , vol.62 , pp. 919-928
    • Johnson, L.A.1    Wohlgemuth, B.2    Cameron, C.A.3    Caughtman, F.4    Koertge, T.5    Barna, J.6
  • 29
    • 11944265202 scopus 로고
    • An argument-based approach to validation
    • Kane, M. (1992). An argument-based approach to validation. Psychological Bulletin, 112, 527-535.
    • (1992) Psychological Bulletin , vol.112 , pp. 527-535
    • Kane, M.1
  • 31
    • 0002916739 scopus 로고    scopus 로고
    • Beyond automated essay scoring
    • Retrieved May 6, 2002
    • Kukich, K. (2000). Beyond automated essay scoring. IEEE Intelligent Systems, 15(5), 22-27. Retrieved May 6, 2002, from http://www.computer.org/intelligent/ex2000/pdf/x5022.pdf
    • (2000) IEEE Intelligent Systems , vol.15 , Issue.5 , pp. 22-27
    • Kukich, K.1
  • 32
    • 85039633124 scopus 로고    scopus 로고
    • Automated scoring and annotation of essays with the Intelligent Essay Assessor
    • April, Seattle, WA
    • Laham, D. (2001, April). Automated scoring and annotation of essays with the Intelligent Essay Assessor. Paper presented at the annual meeting of National Council of Measurement in Education, Seattle, WA.
    • (2001) Annual Meeting of National Council of Measurement in Education
    • Laham, D.1
  • 33
    • 0000600219 scopus 로고    scopus 로고
    • A solution to Plato's problem: The latent semantic analysis theory of acquisition, induction, and representation of knowledge
    • Landauer, T. K., & Dumais, S. T. (1997). A solution to Plato's problem: The latent semantic analysis theory of acquisition, induction, and representation of knowledge. Psychological Review 104, 211-240.
    • (1997) Psychological Review , vol.104 , pp. 211-240
    • Landauer, T.K.1    Dumais, S.T.2
  • 34
    • 80053431219 scopus 로고    scopus 로고
    • An introduction to latent semantic analysis
    • Landauer, T. K., Foltz, P. W., & Laham, D. (1998). An introduction to latent semantic analysis. Discourse Processes, 25, 259-284.
    • (1998) Discourse Processes , vol.25 , pp. 259-284
    • Landauer, T.K.1    Foltz, P.W.2    Laham, D.3
  • 35
    • 0010975190 scopus 로고    scopus 로고
    • The Intelligent Essay Assessor
    • Retrieved May 6, 2002
    • Landauer, T. K., Laham, D., & Foltz, P. W. (2000). The Intelligent Essay Assessor. IEEE Intelligent Systems, 15(5), 27-31. Retrieved May 6, 2002, from http://www.computer.org/intelligent/ex2000/pdf/x5022.pdf
    • (2000) IEEE Intelligent Systems , vol.15 , Issue.5 , pp. 27-31
    • Landauer, T.K.1    Laham, D.2    Foltz, P.W.3
  • 37
    • 85079807120 scopus 로고
    • The once and future issues of validity: Assessing the meaning and consequences of measurement
    • H. Wainer & H. Braun (Eds.). Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
    • Messick, S. (1988). The once and future issues of validity: Assessing the meaning and consequences of measurement. In H. Wainer & H. Braun (Eds.), Test validity (pp. 33-48). Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
    • (1988) Test Validity , pp. 33-48
    • Messick, S.1
  • 38
    • 0002353120 scopus 로고
    • Validity
    • R. L. Linn (Ed.). Phoenix, AZ: The Oryx Press
    • Messick, S. (1989). Validity. In R. L. Linn (Ed.), Educational measurement (pp. 13-103). Phoenix, AZ: The Oryx Press.
    • (1989) Educational Measurement , pp. 13-103
    • Messick, S.1
  • 39
    • 11944265594 scopus 로고
    • Validity of psychological assessment: Validation of inferences from person's responses and performances as scientific inquiry into score meaning
    • Messick, S. (1995). Validity of psychological assessment: Validation of inferences from person's responses and performances as scientific inquiry into score meaning. American Psychologists, 50, 741-749.
    • (1995) American Psychologists , vol.50 , pp. 741-749
    • Messick, S.1
  • 41
    • 0001596906 scopus 로고
    • The imminence of grading essays by computer
    • Page, E. B. (1966). The imminence of grading essays by computer. Phi Delta Kappan, 48, 238-243.
    • (1966) Phi Delta Kappan , vol.48 , pp. 238-243
    • Page, E.B.1
  • 42
    • 21344490742 scopus 로고
    • Computer grading of student prose, using modern concepts and software
    • Page, E. B. (1994). Computer grading of student prose, using modern concepts and software. Journal of Experimental Education, 62, 127-142.
    • (1994) Journal of Experimental Education , vol.62 , pp. 127-142
    • Page, E.B.1
  • 43
    • 0001378653 scopus 로고
    • The computer moves into essay grading: Updating the ancient test
    • Page, E. B., & Petersen, N. S. (1995). The computer moves into essay grading: updating the ancient test. Phi Delta Kappan, 77, 561-565.
    • (1995) Phi Delta Kappan , vol.77 , pp. 561-565
    • Page, E.B.1    Petersen, N.S.2
  • 45
    • 0042046704 scopus 로고    scopus 로고
    • March (GRE Board Professional Rep. No. 98-08bP, ETS Research Rep. No. 01-03). Princeton, NJ: Educational Testing Service. Retrieved May 6, 2002
    • Powers, D. E., Burstein, J. C., Chodorow, M., Fowles, M. E., & Kukich, K. (2001, March). Stumping e-rater: Challenging the validity of automated essay scoring (GRE Board Professional Rep. No. 98-08bP, ETS Research Rep. No. 01-03). Princeton, NJ: Educational Testing Service. Retrieved May 6, 2002, from http://www.ets.org/research/dload/powers_0103.pdf
    • (2001) Stumping E-rater: Challenging the Validity of Automated Essay Scoring
    • Powers, D.E.1    Burstein, J.C.2    Chodorow, M.3    Fowles, M.E.4    Kukich, K.5
  • 46
    • 0042547498 scopus 로고
    • From testing to training: Evaluating automated diagnosis in statistics and algebra
    • C. Frasson, G. Gauthier, & G. I. McCalla (Eds.). Hiedelberg, Germany: Springer-Verlag
    • Sebrechts, M. M. (1992). From testing to training: Evaluating automated diagnosis in statistics and algebra. In C. Frasson, G. Gauthier, & G. I. McCalla (Eds.), Intelligent tutoring systems (pp. 560-566). Hiedelberg, Germany: Springer-Verlag.
    • (1992) Intelligent Tutoring Systems , pp. 560-566
    • Sebrechts, M.M.1


* 이 정보는 Elsevier사의 SCOPUS DB에서 KISTI가 분석하여 추출한 것입니다.