Exploring formative feedback on textual assignments with the help of automatically created visual representations

Journal of Computer Assisted Learning

Volumn 28, Issue 2, 2012, Pages 146-160

  Berlanga, A J ^a   van Rosmalen, P ^a   Boshuizen, H P A ^a   Sloep, P B ^a  

^a OPEN UNIVERSITY OF THE NETHERLANDS   (Netherlands)

Author keywords

Concept map; Expertise development; Formative feedback; Language technology; Learning; Word cloud

Indexed keywords

EID: 84858296353     PISSN: 02664909     EISSN: 13652729     Source Type: Journal    
DOI: 10.1111/j.1365-2729.2011.00425.x     Document Type: Article

References (43)

1. Arts A.J., Gijselaers W.H. & Boshuizen H. (2006) Understanding managerial problem-solving, knowledge use and information processing: investigating stages from school to the workplace. Contemporary Educational Psychology 31, 387-410.
2. Black P. & Wiliam D. (2009) Developing the theory of formative assessment. Educational Assessment, Evaluation and Accountability 21, 5-31.
3. Berlanga A.J., Brouns F., Van Rosmalen P., Rajagopal K., Kalz M. & Stoyanov S. (2009a) Making use of language technologies to provide formative feedback. Workshops Proceedings Volume 10. Natural Language Processing in Support of Learning: Metrics, Feedback and Connectivity. Proceedings of the 14th International Conference in Artificial Intelligence in Education, Workshops Proceedings, pp. 1-8. Brighton, UK.
4. Berlanga A.J., Kalz M., Stoyanov S., Van Rosmalen P., Smithies A. & Braidman I. (2009b) Using Language Technologies to Diagnose Learner's Conceptual Development. Paper presented at the conference Proceedings of the 9th IEEE International Conference on Advanced Learning Technologies Riga, Latvia, IEEE.
5. Boisot M. (1998) Knowledge Assets: Securing Competitive Advantage in the Information Economy. Oxford University Press, New York, NY.
6. Boshuizen H.P.A. & Schmidt H.G. (1992) On the role of biomedical knowledge in clinical reasoning by experts, intermediates and novices. Cognitive Science 16, 153-184.
7. Boshuizen H.P.A. & Schmidt H.G. (2008) The development of clinical reasoning expertise: implications for teaching. In Clinical Reasoning in the Health Professions, 3rd. Revised edition (eds J. Higgs, M. Jones, S. Loftus & N. Christensen ), pp. 113-121. Butterworth-Heinemann/Elsevier, Oxford.
8. Boshuizen H.P.A., Bromme R. & Gruber H. (2004) On the long way from novice to expert and how travelling changes the traveller. In Professional Learning: Gaps and Transitions on the Way from Novice to Expert (eds H.P.A. Boshuizen, R. Bromme & H. Gruber ), pp. 3-8. Kluwer, Dordrecht.
9. Brown J.S. & Duguid P. (1991) Organizational learning and communities-of-practice: toward a unified view of working, learning, and innovation. Organization Science 2, 40-57.
10. Chi M.T.H., Feltovich P.J. & Glaser R. (1981) Categorization and representation of physics problems by experts and novices. Cognitive Science 5, 121-152.
11. Clariana R. & Wallace P. (2007) A computer-based approach for deriving and measuring individual and team knowledge structure from essay questions. Journal of Educational Computing Research 37, 211-227.
12. Clariana R., Koul R. & Salehi R. (2006) The criterion-related validity of a computer-based approach for scoring concept maps. International Journal of Instructional Media 33, 317-325.
13. Dawson S. (2008) A study of the relationship between student social networks and sense of community. Educational Technology & Society 11, 224-238.
14. Ertmer P.A. & Newby T.J. (1993) Behaviorism, cognitivism, constructivism: comparing critical features from an instructional design perspective. Performance Improvement Quarterly 6, 50-70.
15. Goldsmith T.E., Johnson P.J. & Acton W.H. (1991) Assessing structural knowledge. Journal of Educational Psychology 83, 88-96.
16. Ifenhaler D. & Seel N.M. (2005) The measurement of change: learning-dependent progression of mental models. Technology, Instruction, Cognition and Learning 2, 317-336.
17. Jeong A. (2008) jMap v. 104. Available at: (last accessed 15 June 2011).
18. Jonassen D.H. & Carr C.S. (2000) Mindtools: affording multiple knowledge representations for learning. In Computers as Cognitive Tools: No More Walls, Vol. 2 (ed. S.P. Lajoie ), pp. 165-196. Lawrence Erlbaum Associates, Mahwah, NJ.
19. Jonassen D.H., Beissner K. & Yacci M. (1993a) Structural Knowledge: Techniques for Representing, Conveying, and Acquiring Structural Knowledge. Lawrence Erlbaum Associates, Hillsdale, NJ.
20. Jonassen D.H., McAleese T.M.R. & Duffy T.M. (1993b) Manifesto for a constructivist approach to technology in higher education. In Designing Environments for Constructive Learning: Implications for Instructional Design and the Use of Technology (eds T.M. Duffy, J. Lowyck & D.H. Jonassen ), pp. 231-247. Springer-Verlag, Heidelburg, FRG.
21. Jonassen D.H., Reeves T., Hong N., Harvey D. & Peter K. (1997) Concept mapping as cognitive learning and assessment tools. Journal of Interactive Learning Research 8, 289-308.
22. Landauer T.K., McNamara D.S., Dennis S. & Kintsch W. (2007) Handbook of Latent Semantic Analysis. Lawrence Erlbaum Associates, Mahwah, NJ.
23. Lave J. & Wenger E. (1991) Situated Learning: Legitimate Peripheral Participation. Cambridge University Press, Cambridge, MA.
24. Nesbit J. & Adesope O. (2006) Learning with concept and knowledge maps: a meta-analysis. Review of Educational Research 76, 413-448.
25. Nievelstein F., Van Gog T., Boshuizen H.P.A. & Prins F.J. (2008) Expertise-related differences in ontological and conceptual knowledge development in the legal domain. European Journal of Cognitive Psychology 20, 1043-1064.
26. Nonaka I., Nayana R. & Konno N. (2000) SECI, Ba and leadership: a unified model of dynamic knowledge creation. Long Range Planning 30, 5-34.
27. Novak J.D. (1998) Learning, Creating and Using Knowledge: Concept Maps as Facilitative Tools in Schools and Corporations. Erlbaum, Mahwah, NJ.
28. Oberholzer R., Egloff S., Ryf S. & Läge D. (2008) Prodax. Datenauswertung im Bereich der Skalierung. Benutzerhandbuch.
29. Pirnay-Dummer P. (2006) Expertise and model building. MITOCAR. Unpublished doctoral dissertation, University of Freiburg, Filburg.
30. Rovai A.P. (2002) Building a sense of community at a distance. International Review of Research in Open and Distance Learning 3. [Electronic Version]. Available at: (last accessed 5 May 2011).
31. Ruiz-Primo M.A., Shavelson R.J. & Schultz S.E. (1997) On the validity of concept map-base assessment interpretations: an experiment testing the assumption of hierarchical concept maps. Science, CSE Technical Report 455. Available at: (last accessed 14 February 2011).
32. Shute V.J. (2008) Focus on formative feedback. Review of Educational Research 78, 153-189.
33. Shute V.J., Jeong A.C., Spector J.M., Seel N.M. & Johnson T.E. (2009) Model-based methods for assessment, learning, and instruction: innovative educational technology at Florida State University. In 2009 Yearbook Educational Media and Technology (ed. M. Orey ), pp. 61-80. Greenwood Publishing Group, Westport, CT.
34. Sloep P.B. (2008) Netwerken voor lerende professionals; hoe leren in netwerken kan bijdragen aan een leven lang leren. Inaugural address. Open Universiteit Nederland. Available at: (last accessed 15 June 2011).
35. Sloep P.B., Boon J., Cornu B., Klebl M., Lefrère P., Naeve A., Scott P. & Tinoca L. (2011) A European research agenda for lifelong learning. International Journal of Technology Enhanced Learning(IJTEL) 2, 204-228.
36. Smith A.E. & Humphreys M.S. (2006) Evaluation of unsupervised semantic mapping of natural language with Leximancer concept mapping. Behavior Research Methods 38, 262-279.
37. Spector J.M. & Koszalka T.A. (2004) The DEEP Methodology for Assessing Learning in Complex Domains. Syracuse University, Syracuse, NY.
38. Stahl G. (2006) Group Cognition: Computer Support for Building Collaborative Knowledge. MIT Press, Cambridge.
39. Sweller J., Van Merrienboer J. & Paas F. (1998) Cognitive architecture and instructional design. Educational Psychology Review 10, 251-296.
40. Underwood J.S. & Tregidgo A.P. (2006) Improving student writing through effective feedback: best practices and recommendations. Journal of Teaching Writing 22, 73-97.
41. Van de Wiel M.W.J., Schmidt H.G. & Boshuizen H.P.A. (2000) Knowledge restructuring in expertise development: evidence from pathophysiological representations of clinical cases by students and physicians. European Journal of Cognitive Psychology 12, 323-355.
42. Van Rosmalen P., Sloep P., Kester L., Brouns F., De Croock M., Pannekeet K. & Koper R. (2008) A learner support model based on peer tutor selection. Journal of Computer Assisted Learning 24, 74-86.
43. Vygotsky L.S. (1978) Mind in Society. Harvard University Press, Cambridge, MA.