Automatic scoring of constructed-response items with latent semantic analysis;Automatische Bewertung Offener Antworten Mittels Latenter Semantischer Analyse

Diagnostica

Volumn 53, Issue 3, 2007, Pages 155-165

  Lenhard, Wolfgang ^a   Baier, Herbert ^a   Hoffmann, Joachim ^a   Schneider, Wolfgang ^a  

^a UNIVERSITY OF WÜRZBURG   (Germany)

Author keywords

Automated essay scoring; Automatic categorization; Latent semantic analysis; LSA

Indexed keywords

EID: 38749099464     PISSN: 00121924     EISSN: None     Source Type: Journal    
DOI: 10.1026/0012-1924.53.3.155     Document Type: Article

References (35)

1. Apache Lucene 2.0 (2006). Lucene Java. The Apache Software Foundation, verfügbar unter: http://lucene.apache.org/ [25.07.2006].
2. Berry, M. W, Dumais, S. T. & O'Brien, G. W. (1995). Using linear algebra for intelligent information retrieval. SIAMRe-view, 37 (4), 573-595.
3. Bortz, J. (1999). Statistikfir Sozialwissenschaftler (5. vollstän-dig überarbeitete und aktualisierte Auflage). Berlin: Springer.
4. Bühner, M. (2004). Einführung in die Test- und Fragebogen-konstruktion. München: Pearson.
5. Burstein, J., Kukich, K., Wolff, S., Lu, C. & Chodorow, M. (1998). Enriching automated scoring using discourse marking. Proceedings of the Workshop on Discourse Relations and Discourse Marking, 36th Annual Meeting of the Association for Computational Linguistics and the 17th International Conference on Computational Linguistics.
6. Caumanns, J. (1999). A Fast and Simple Stemming Algorithm. Technical Report Nr. TR-B-99-16 des Fachbereichs Informatik der Freien Universität Berlin, verfügbar unter: http://www.inf.fu-berlin.de/inst/pubs/tr-b-99- 16.abstract.html [25.07.2006].
7. Chase, CL(1979). The impact of achievement expectations and handwriting quality on scoring essay tests. Journal of Educational Measurement, 16, 293-297.
8. Chase, C. I. (1986). Essay test scoring : interaction of relevant variables. Journal of Educational Measurement, 23, 33-41.
9. Coffman, W. (1971). On the reliability of ratings of essay examinations in English. Research in the Teaching of English, 5, 24-36.
10. Deerwester, S., Dumais, S. T., Furnas, G. W., Landauer, T. K. & Harshman, R. (1990). Indexing by Latent Semantic Analysis. Journal of the A merican Society For Information Science, 41, 391-407.
11. Denhière, G. & Lemaire, B. (2006). Representing children's semantic knowledge from a multisource corpus. Vortrag im Rahmen eines Workshops in Würzburg, 05.02.2006.
12. Foltz, P. W., Kintsch, W. & Landauer, T. K. (1998). The measurement of textual Coherence with latent Semantic Analysis. Discourse Processes, 25, 285-307.
13. Haladyna, T. (1999). Developing and validating multiple-choice test Items. Mawhwah, NJ: Erlbaum.
14. Hughes, D. C., Keeling B. & Tuck, B. F. (1983). The effects of instructions to scorers intended to reduce context effects in essay scoring. Educational and Psychological Measurement, 43, 1047-1050.
15. Ishioka, T. & Kameda, M. (2006). Automated Japanese Essay Scoring System based on Articles Written by Experts. Coling-ACL 2006 Conference.
16. Kintsch, E., Steinhart, D., Stahl, G., LSA Research Group, Matthews, C. & Lamb, R. (2000). Developing summarization skills through the use of LSA-Based feedback. Interactive Learning Environments, 8, 87-109.
17. Kontostathis, A. & Pottenger, W. M. (2002). Detecting patterns in the LSI term-term matrix. Workshop on the Foundation of Data Mining and Discovery, IEEE International Conference on Data Mining.
18. Landauer, T. K. & Dumais, S. T. (1997). A solution to Plato's problem: The Latent Semantic Analysis theory of the acquisition, induction, and representation of knowledge. Psychological Review, 104, 211-240.
19. Landauer, T. K., Foltz, P. W. & Laham, D. (1998). Introduction to Latent Semantic Analysis. Discourse Processes, 25, 259-284.
20. Landauer, T. K., Laham, D., Rehder, B. & Schreiner, M. E., (1997). How well can passage meaning be derived without using word order? A comparison of Latent Semantic Analysis and humans. In M. G. Shafto & P. Langley (Eds.), Proceedings of the 19th annual meeting of the Cognitive Science Society (pp. 412-417). Mawhwah, NJ: Erlbaum.
21. Lemaire, B. & Denhière, G. (2004) Incremental Construction of an Associative Network from a Corpus. In K. Forbus, D. Gentner & T. Regier (Eds.), Proceedings 26th Annual Meeting of the Cognitive Science Society (pp. 825-830), Chicago.
22. Lenhard, W., Baier, H. Schneider, W. & Hoffmann, J. (2006). Forschungsprojekt "Förderung des Textverständnisses": LSA-Modul. verfügbar unter: http://www.summa.psycho-logie.uni-wuerzburg.de/ summa/coa/login/[20.07.2006].
23. Lienert, G. & Ratz, U. (1998). Testaufbau und Testanalyse (6. Auflage). Weinheim: Beltz.
24. Marshall, J. C. & Powers, J. M. (1969). Writing neatness, composition errors and essay grades. Journal of Educational Measurement, 6, 97-101.
25. Martin, D. & Berry, M. (in press). Mathematical Foundations Behind Latent Semantic Analysis. In T. K. Landauer, D. S. McNamara, S. Dennis & W. Kintsch (Eds.), The handbook of latent semantic analysis. Mahwah, NJ: Erlbaum.
26. Meyer, G. (1939). The choice of questions on essay examinations. Journal of Educational Psychology, 30, 161-171.
27. Miller, T. (2003). Essay assessment with latent semantic analysis. Journal of Educational Computing Research, 29, 495-512.
28. Nakov, P., Popova, A. & Mateev P. (2001). Weight functions impact on LSA performance. Proceedings of the EuroConference Recent Advances in Natural Language Processing, RANLP'01, 187-193.
29. Olkin, J. & Siotani, M. (1964). Asymptotic distribution functions of a correlation matrix. CA: Stanford University Laboratory for Quantitive Research in Education. Report No. 6.
30. Page, E. B. (1966). The imminence of grading essays by computer. Phi Delta Kappa, 47, 238-243.
31. Rehder, B., Schreiner, M. E., Wolfe, M. B., Laham, D., Landauer, T. K. & Kintsch, W. (1998). Using Latent Semantic Analysis to assess knowledge: Some technical considerations. Discourse Processes, 25, 337-354.
32. Wade-Stein, D. & Kintsch, E. (2004). Summary Street: Interactive computer support for writing. Cognition and Instruction, 22, 333-362.
33. Wild, F., Stahl, Ch., Stermsek, G. & Neumann, G. (2005). Parameters Driving Effectiveness of Automated Essay Scoring with LSA. Proceedings of the 9th International Computer Assisted Assessment Conference, 485-494.
34. Wittgenstein, L. (1953). Philosophical investigations. New York: Macmillan.
35. Wolfe, M. B., Schreiner, M. E., Rehder, B., Laham, D., Foltz, P. W., Kintsch, W. & Landauer, T. K. (1998). Learning from text: Matching readers and text by Latent Semantic Analysis, Discourse Processes, 25, 309-336.