Effects of a computer-assisted formative assessment intervention based on multiple-tier diagnostic items and different feedback types

Computers and Education

Volumn 95, Issue , 2016, Pages 85-98

  Maier, Uwe ^a   Wolf, Nicole ^b   Randler, Christoph ^c  

^a University of Education Schwäbisch Gmünd   (Germany)

^b UNIVERSITY OF ERLANGEN NUREMBERG   (Germany)

^c UNIVERSITY OF EDUCATION HEIDELBERG   (Germany)

Author keywords

Computer assisted testing; Feedback; Formative assessment; Science education; Secondary education

Indexed keywords

COMPUTER AIDED INSTRUCTION; COMPUTER TESTING; EDUCATION; FEEDBACK; MULTIVARIANT ANALYSIS; REGRESSION ANALYSIS; TEACHING;

COMPUTER ASSISTED TESTING; CONCEPTUAL UNDERSTANDING; DECLARATIVE KNOWLEDGE; EVOLUTIONARY ADAPTATION; FORMATIVE ASSESSMENT; MULTI VARIATE ANALYSIS; SCIENCE EDUCATION; VERIFICATION FEEDBACKS;

STUDENTS;

EID: 84961879795     PISSN: 03601315     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.compedu.2015.12.002     Document Type: Article

References (52)

1. E. Adadan, and F. Savasci An analysis of 16-17-year-old students' understanding of solution chemistry concepts using a two-tier diagnostic instrument International Journal of Science Education 34 4 2012 513 544
2. P.D. Allison Missing data 2001 Sage Thousand Oaks, CA
3. R.L. Bangert-Drowns, C. Kulik, J.A. Kulik, and M.T. Morgan The instructional effect of feedback in test-like events Review of Educational Research 61 1991 213 238
4. R.E. Bennett Formative assessment: a critical review Assessment in Education 18 1 2011 5 25
5. P. Black, and D. Wiliam Assessment and classroom learning Assessment in Education 5 1 1998 7 74
6. P. Black, and D. Wiliam Developing the theory of formative assessment Educational Assessment, Evaluation and Accountability 21 1 2009 5 31
7. A.L. Chandrasegaran, D.F. Treagust, and M. Mocerino The development of a two-tier multiple-choice diagnostic instrument for evaluating secondary school students' ability to describe and explain chemical reactions using multiple levels of representation Chemistry Education Research and Practice 8 3 2007 293 307
8. I.P. Cheong, D.F. Treagust, I.J. Kyeleve, and P.-Y. Oh Evaluation of students' conceptual understanding of malaria International Journal of Science Education 32 18 2010 2497 2519
9. I. Clark Formative assessment: assessment is for self-regulated learning Educational Psychology Review 24 2 2012 205 249
10. J.V. Dempsey, M.P. Driscoll, and B.C. Litchfield Feedback, retention, discrimination error, and feedback study time Journal of Research on Computing in Education 25 3 1993 303 326
11. R. Duit, and D.F. Treagust Conceptual change: a powerful framework for improving science teaching and learning International Journal of Science Education 25 6 2010 671 688
12. L.S. Fuchs, and D. Fuchs Effects of systematic formative evaluation: a meta-analysis Exceptional Children 53 1986 199 208
13. E.M. Furtak Linking a learning progression for natural selection to teachers' enactment of formative assessment Journal of Research in Science Teaching 49 9 2012 1181 1210
14. E.R. Fyfe, M.S. DeCaro, and B. Rittle-Johnson The effects of feedback during exploratory mathematics problem solving: prior knowledge matters Journal of Educational Psychology 104 4 2012 1094 1108
15. E.R. Fyfe, M.S. DeCaro, and B. Rittle-Johnson When feedback is cognitively demanding: the importance of working memory capacity Instructional Science 43 1 2015 73 91
16. M. Gläser-Zikuda, S. Fuß, M. Laukenmann, K. Metz, and C. Randler Promoting students' emotions and achievement - instructional design and evaluation of the ECOLE approach Learning & Instruction 15 2005 481 495
17. O. Halldén The evolution of the species: pupil perspectives and school perspectives International Journal of Science Education 10 5 1988 541 552
18. T.E. Hancock, R.A. Thurman, and D.C. Hubbard An expanded control model for the use of instructional feedback Contemporary Educational Psychology 20 4 1995 410 425
19. J. Hattie Visible learning. A synthesis of over 800 meta-analyses relating to achievement 2009 Routledge, Taylor & Francis Group London & New York
20. J. Hattie, and H. Timperley The power of feedback Review of Educational Research 77 1 2007 81 112
21. S. Jordan Student engagement with assessment and feedback: some Lessons from short-answer free-text e-assessment questions Computers & Education 58 2 2012 818 834
22. N. Kingston, and B. Nash Formative assessment: a meta-analysis and a call for research Educational Measurement: Issues and Practice 30 4 2011 28 37
23. A.N. Kluger, and A. DeNisi The effects of feedback interventions on performance: a historical review, a meta-analysis, and a preliminary feedback intervention theory Psychological Bulletin 119 2 1996 254 284
24. R.W. Kulhavy, and W.A. Stock Feedback in written instruction: the place of response certitude Educational Psychology Review 1 1989 279 308
25. A. Lai, and D. Chen Web-based two-tier diagnostic test and remedial learning experiment International Journal of Distance Education Technologies 8 1 2010 31 53
26. H. Lee, A. Feldman, and I.D. Beatty Factors that affect science and mathematics teachers' initial implementation of technology-enhanced formative assessment using a classroom response system Journal of Science Education and Technology 21 5 2012 523 539
27. K. Ludvigsen, R. Krumsvik, and B. Furnes Creating formative feedback spaces in large lectures Computers & Education 88 2015 48 63
28. U. Maier Computergestützte, formative Leistungsdiagnostik in Primar- und Sekundarschulen. Ein Forschungsüberblick zu Entwicklung, implementation und Effekten Unterrichtswissenschaft 42 1 2014 69 86
29. D.A. McConnell, D.N. Steer, K.D. Owens, J.R. Knott, S. Van Horn, and W. Borowski P.J. Heaney Using conceptests to assess and improve student conceptual understanding in introductory geoscience courses Journal of Geoscience Education 54 1 2006 61 68
30. J.H. McMillan, J.C. Venable, and D. Varier Studies of the effect of formative assessment on student achievement: so much more is needed Practical Assessment, Research & Evaluation 18 2 2013 1 15
31. J. Merrill Levels of questioning and forms of feedback: instructional factors in courseware design Journal of Computer-Based Instruction 14 1 1987 18 22
32. E.H. Mory Feedback research revisited D. Jonassen, Handbook of research on educational communications and technology 2004 Erlbaum Associates Mahwah, NJ 745 783
33. N. Nagata Intelligent computer feedback for second language instruction The Modern Language Journal 77 3 1993 330 339
34. S. Narciss, S. Sosnovsky, L. Schnaubert, E. Andrès, A. Eichelmann, G. Goguadze, and et al. Exploring feedback and student characteristics relevant for personalizing feedback strategies Computers & Education 71 2014 56 76
35. G.D. Phye The processing of informative feedback about multiple-choice test performance Contemporary Educational Psychology 4 1979 381 394
36. D.R. Pridemore, and J.D. Klein Control of practice and level of feedback in computer-based instruction Contemporary Educational Psychology 20 1995 444 450
37. C. Randler Field experiments in learning research Part F N.M. Seel, Encyclopedia of the sciences of learning 2012 Springer Berlin 1293 1297
38. C. Randler, and E. Hummel Vögel in unserer Umgebung? Wir erforschen die Geheimnisse des Fliegens [Birds in our environment? We study the secrets of flying] RAAbits Realschule Biologie Tiere 3 2011 1 30
39. M.K. Russell Technology-aided formative assessment of learning: new developments and applications H.L. Andrade, G.J. Cizek, Handbook of formative assessment 2010 Routledge New York and London 125 138
40. K. Scalise, and B. Gifford Computer-based assessment in e-learning: a framework for constructing "intermediate constraint" questions and tasks for technology platforms Journal of Technology, Learning, and Assessment 4 6 2006 44 Retrieved from http://www.jtla.org
41. P. Tamir An alternative approach to the construction of multiple-choice test items Journal of Biological Education 5 1971 305 307
42. A. Thissen-Roe, E. Hunt, and J. Minstrell The Diagnoser project: combining assessment and learning Behavior Research Methods, Instruments, and Computers 36 2 2004 234 240
43. C.F. Timmers, J. Braber-van den Broek, and S.M. van den Berg Motivational beliefs, student effort, and feedback behaviour in computer-based formative assessment Computers & Education 60 2013 25 31
44. C. Timmers, and B. Veldkamp Attention paid to feedback provided by a computer-based assessment for learning on information literacy Computers & Education 56 3 2011 923 930
45. C.F. Timmers, A. Walraven, and B.P. Veldkamp The effect of regulation feedback in a computer-based formative assessment on information problem solving Computers & Education 87 2015 1 9
46. C.-Y. Tsui, and D.F. Treagust Evaluating secondary students' scientific reasoning in genetics using a two-tier diagnostic instrument International Journal of Science Education 32 8 2010 1073 1098
47. F.M. Van der Kleij, T.J.H.M. Eggen, C.F. Timmers, and B.P. Veldkamp Effects of feedback in a computer-based assessment for learning Computers & Education 58 1 2012 263 272
48. M. Walker The quality of written peer feedback on undergraduates' draft answers to an assignment, and the use made of the feedback Assessment & Evaluation in Higher Education 40 2 2015 232 247
49. S.S. Yeh Class size reduction or rapid formative assessment? A comparison of cost-effectiveness Educational Research Review 4 1 2009 7 15
50. J. Zabel, and H. Gropengießer Darwins konzeptuelle Landkarte: Lernfortschritt im Evolutionsunterricht [Darwin's conceptual map: learning progressions in teaching units on evolution] U. Harms, I. Mackensen-Friedrichs, Lehr- und Lernforschung in der Biologiedidaktik (Band 4), Heterogenität erfassen - Individuell fördern im Biologieunterricht [Research on learning and instruction in biology education Measuring individual differences and tutoring in biology education](S. 209-224) Vol. 4 2010 Studienverlag Innsbruck
51. M. Zlatovic, I. Balaban, and D. Kermek Using online assessments to stimulate learning strategies and achievement of learning goals Computers & Education 91 2015 32 45
52. X. Zou, and X. Zhang Effect of different score reports of web-based formative test on students' self-regulated learning Computers & Education 66 2013 54 63