Assessing creative problem-solving with automated text grading

Computers and Education

Volumn 51, Issue 4, 2008, Pages 1450-1466

  Wang, Hao Chuan ^a,c   Chang, Chun Yen ^a   Li, Tsai Yen ^b  

^a NATIONAL TAIWAN NORMAL UNIVERSITY   (Taiwan)

^b NATIONAL CHENGCHI UNIVERSITY   (Taiwan)

^c Carnegie Mellon University ^*  (United States)

Author keywords

Automated grading; Computer aided assessment; Creative problem solving; Machine learning application; Science learning assessment

Indexed keywords

ARTIFICIAL INTELLIGENCE; AUTOMATION; EARTH SCIENCES; EDUCATION; LEARNING SYSTEMS; LINGUISTICS; PROGRAMMING THEORY; STATISTICAL METHODS; STUDENTS; TEACHING; TECHNOLOGY;

AUTOMATED GRADING; COMPUTER-AIDED ASSESSMENT; CONCEPT IDENTIFICATION; CREATIVE PROBLEM-SOLVING; DOMAIN CONCEPTS; EMPIRICAL EVALUATIONS; LANGUAGE TECHNOLOGIES; MACHINE LEARNING APPLICATION; NATURAL LANGUAGES; NEW TECHNOLOGIES; OPEN-ENDED QUESTIONS; RELIABLE PERFORMANCE; SCIENCE EDUCATION; SCIENCE LEARNING; SCIENCE LEARNING ASSESSMENT; STATISTICAL MACHINE LEARNING; SUB-TASKS;

GRADING;

EID: 49449115241     PISSN: 03601315     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.compedu.2008.01.006     Document Type: Article

References (51)

1. Aleven V., Popescu O., and Koedinger K.R. Toward tutorial dialog to support self-explanation: Adding natural language understanding to a cognitive tutor. Proceedings of the international conference on artificial intelligence in education (2001), IOS Press
2. Anderson J.R., Corbett A.T., Koedinger K.R., and Pelletier R. Cognitive tutors: Lessons learned. Journal of Learning Sciences 4 2 (1995) 167-207
3. Basadur M. Optimal ideation-evaluation ratios. Creativity Research Journal 8 1 (1995) 63-75
4. Bishop C.M. Pattern recognition and machine-learning (2006), Springer, New York
5. Burges C. A tutorial on support vector machines for pattern recognition. Data Mining and Knowledge Discovery 2 (1998) 121-167
6. Chang C.-Y. Taiwanese science and life technology curriculum standards and earth systems education. International Journal of Science Education 27 5 (2005) 625-638
7. Chang C.-Y., Barufaldi J.P., Lin M.-C., and Chen Y.-C. Assessing 10th-grade students' problem solving ability online in the area of Earth sciences. Computers in Human Behavior 23 (2007) 1971-1981
8. Chang S.-N., and Chiu M.-H. The development of authentic assessment to investigate ninth graders' scientific literacy: In the case of scientific cognition concerning the concepts of chemistry and physics. International Journal of Science and Mathematics Education 3 (2005) 117-140
9. Chang C.-Y., and Weng Y.-H. An exploratory study on students' problem-solving ability in Earth sciences. International Journal of Science Education 24 5 (2002) 441-451
10. Chi M.H., De Leeuw N., Chiu M., and Lavancher C. Eliciting self-explanations improves understanding. Cognitive Science 18 (1994) 439-488
11. Chi M.T.H., and Glaser R. Problem-solving ability. In: Sternberg R. (Ed). Human abilities: An information-processing approach (1985), W.H. Freeman & Co, San Francisco 227-257
12. Cohen, W. W., Ravikumar, P., & Fienberg, S. E. (2003). A comparison of string distance metrics for name-matching tasks. In Proceedings of the 18th international joint conference on artificial intelligence, workshop on information integration on the web (pp. 73-78).
13. Cristianini N., and Shawe-Taylor J. An introduction to support vector machines and other kernel-based learning methods (2000), Cambridge University Press, Cambridge, UK
14. D'Amore R.J., and Mah C.P. One-time complete indexing of text: Theory and practice. Proceedings of the 8th annual international ACM SIGIR conference on research and development in information retrieval (1985), ACM Press, New York
15. Donmez P., Rosé C.P., Stegmann K., Weinberger A., and Fischer F. Supporting CSCL with automatic corpus analysis technology. Proceedings of computer supported collaborative learning conference (2005), International Society of the Learning Sciences
16. Fogel, D., Hanson, J. C., Kick, R., Malki, H. A., Sigwart, C., Stinson, M., et al. (1993). The impact of machine-learning on expert systems. In Proceedings of the 1993 ACM conference on computer science (pp. 522-527).
17. Grasser A.C., Chipman P., Haynes B.C., and Olney A. AutoTutor: An intelligent tutoring system with mixed-initiative dialogue. IEEE Transactions on Education 48 4 (2005) 612-618
18. Grasser A.C., VanLehn K., Rosé C.P., Jordan P.W., and Harter D. Intelligent tutoring systems with conversational dialogue. AI Magazine 22 4 (2001) 39-51
19. Guyon I., and Elisseeff A. An introduction to variable and feature selection. Journal of Machine Learning Research 3 (2003) 1157-1182
20. Hastie T., Tibshirani R., and Friedman J. The elements of statistical learning (2001), Springer, New York
21. Hearst H., Kukich K., Landauer T.K., Lahan D., Foltz P., Hirschman L., et al. The debate on automated essay grading. IEEE Intelligent Systems 15 5 (2000) 22-37
22. Huang, C.-C., Wang, H.-C., Li, T.-Y., & Chang, C.-Y. (2006). An online testing and analysis system for creative problem-solving ability in sciences. In Proceedings of the 10th annual global Chinese conference on computers in education.
23. Joachims T. Text categorization with support vector machines: Learning with many relevant features. Proceedings of the European conference on machine-learning (ECML) (1998), Springer
24. Kohavi, R. (1995). A study of cross-validation and bootstrap for accuracy estimation and model selection. In Proceedings of the international joint conference on artificial intelligence (IJCAI).
25. Ma, W. & Chen, K. (2003). Introduction to CKIP Chinese word segmentation system for the first international Chinese word segmentation bakeoff. In Proceedings of the second SIGHAN workshop on Chinese language processing.
26. Ministry of Education. The 1-9 grades science and life technology curriculum standards (2001), MOE, Taipei
27. Mitchell T. Machine learning (1997), McGraw-Hill, New York
28. Mitchell, T. (2006). The discipline of machine learning. Technical Report, Machine-learning Department, Carnegie Mellon University, CMU-ML-06-108.
29. National Research Council. National science education standards (1996), National Academy Press, Washington, DC
30. Nijstad B.A., and Stroebe W. How the group affects the mind: A cognitive model of idea generation in groups. Personality and Social Psychology Review 10 3 (2006) 186-213
31. Osborn A. Applied imagination: Principles and procedures of creative problem-solving (1963), Charles Scribner's Sons, New York
32. Osterlind S.J., and Merz W.R. Building a taxonomy for constructed-response test items. Educational Assessment 2 2 (1994) 133-148
33. Platt J. Fast training of support vector machines using sequential minimal optimization. In: Schoelkopf C.B.B., and Smola A. (Eds). Advances in kernel methods - Support vector learning (1998), MIT Press
34. Popescu O., and Koedinger K. Towards understanding geometry explanations. Building dialogue systems for tutorial applications. Papers of the 2000 AAAI fall symposium (2000), AAAI Press, Menlo Park, CA 80-86
35. Raghavan V.V., and Wong S.K.M. A critical analysis of the vector space model for information retrieval. Journal of the American Society for Information Science 37 5 (1986) 279-287
36. Roediger H.L., and Karpicke J. Test-enhanced learning: Taking memory tests improves long-term retention. Psychological Science 17 3 (2006) 249-255
37. Roediger H.L., and Marsh E.J. The positive and negative consequences of multiple-choice testing. Journal of Experimental Psychology: Learning, Memory, and Cognition 31 5 (2005) 1155-1159
38. Rousseeuw P.J. Least median of squares regression. Journal of the American Statistical Association 79 388 (1984) 871-880
39. Salton G., and McGill M. Introduction to modern information retrieval (1983), McGraw-Hill, New York
40. Salton G., Wong A., and Yang C.S. A vector space model for automatic indexing. Communication of the ACM 18 11 (1975) 613-620
41. Sebastiani F. Machine-learning in automatic text categorization. ACM Computing Surveys 34 1 (2002) 1-47
42. Shermis M.D., and Burstein J.C. Automated essay scoring: A cross-disciplinary perspective (2003), LEA, NJ
43. Shermis M.D., Koch C.M., Page E.B., Keith T.Z., and Harrington S. Trait ratings for automated essay grading. Educational and Psychological Measurement 62 1 (2002) 5-18
44. Simon H.A. The structure of ill-structured problems. Artificial Intelligence 4 (1973) 181-201
45. Singley M.K., and Taft H.L. Open-ended approaches to science assessment using computers. Journal of Science Education and Technology 4 1 (1995) 7-20
46. Tsai C.-C., and Chang C.-Y. Learning effects of instruction guided by the conflict map: Experimental study of learning about the causes of the seasons. Journal of Research in Science Teaching 42 10 (2005) 1089-1111
47. Vapnik V. The nature of statistical learning theory (1995), Springer-Verlag, Berlin
48. Wang, H.-C., Li, T.-Y., Rosé, C. P., Huang, C.-C., & Chang, C.-Y. (2006). VIBRANT: A brainstorming agent for computer supported creative problem-solving. In Proceedings of the 8th intelligent tutoring systems conference.
49. Wang H.-C., Rosé C.P., Cui Y., Chang C.-Y., Li T.-Y., and Huang C.-C. Thinking hard together: The long and short of collaborative idea generation in scientific inquiry. Proceedings of the computer-supported collaborative learning conference (2007), International Society of the Learning Sciences
50. Witten I.H., and Frank E. Data mining: Practical machine-learning tools and techniques (2005), Elsevier, San Francisco
51. Zenisky A.L., and Sireci S.G. Technological innovations in large-scale assessment. Applied Measurement in Education 15 4 (2002) 337-362