Effects of pre-tests and feedback on performance outcomes and persistence in Massive Open Online Courses

Computers and Education

Volumn 161, Issue , 2021, Pages

  Janelli, Maria ^a,b   Lipnevich, Anastasiya A ^b  

^a DIVISION OF INVERTEBRATE ZOOLOGY   (United States)

^b CITY UNIVERSITY OF NEW YORK   (United States)

Author keywords

Assessment; Feedback; Instructional design; MOOCs; Pre tests

Indexed keywords

CLIMATE CHANGE; FEEDBACK; TESTING;

EXPERIMENTAL CONDITIONS; LEARNING OUTCOME; MASSIVE OPEN ONLINE COURSE; NATURAL HISTORY; PERFORMANCE OUTCOME; POST TEST; SECOND GROUP;

E-LEARNING;

EID: 85096711325     PISSN: 03601315     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.compedu.2020.104076     Document Type: Article

References (40)

1. Bangert-Drowns, R.L., Kulik, C.-L.C., Kulik, J.A., Morgan, M., The instructional effect of feedback in test-like events. Review of Educational Research 61:2 (1991), 213–238.
2. Beckman, W.S., Pre-testing as a method of conveying learning objectives. Journal of Aviation/Aerospace Education & Research, 17(172), 2008.
3. Bjork, E.L., Storm, B.C., deWinstanley, P.A., Learning from the consequences of retrieval: Another test effect. Benjamin, A.S., (eds.) Successful remembering and successful forgetting: A festschrift in honor of Robert A. Bjork, 1st ed., 2010, Psychology Press.
4. Black, P., Wiliam, D., Assessment and classroom learning. Assessment in education: Principles, policy & practice, Vol. 5, 1998.
5. de Boer, J., Kommers, P.A.M., de Brock, B., Tolboom, J., The influence of prior knowledge and viewing repertoire on learning from video. Education and Information Technologies 21:5 (2016), 1135–1151.
6. Bull, J., Stephens, D., The use of question mark software for formative and summative assessment in two universities. Innovations in Education and Training International 36:2 (1999), 128–136.
7. Butler, A.C., Roediger, H.L. III, Feedback enhances the positive effects and reduces the negative effects of multiple-choice testing. Memory & Cognition 36:3 (2008), 604–616.
8. Chauhan, A., Massive open online courses (MOOCS): Emerging trends in assessment and accreditation. Digital Education Review 25 (2014), 7–17.
9. Dunlosky, J., Rawson, K.A., Marsh, E.J., Nathan, M.J., Willingham, D.T., Improving, participants' learning with effective learning techniques: Promising directions from cognitive and educational psychology. Psychological Science in the Public Interest 14:1 (2013), 4–58.
10. Friedman, T., Keynote address. 2019, Coursera Conference, London, UK.
11. Gené, O.B., Núñez, M.M., Blanco, Á.F., Gamification in MOOC: Challenges, opportunities and proposals for advancing MOOC model. Proceedings of the 2nd international conference on technological ecosystems for enhancing multiculturality (TEEM), 2014.
12. Gikandi, J.W., Morrow, D., Davis, N.E., Online formative assessment in higher education: A review of the literature. Computers and Education, 2011.
13. Glover, J.A., The “testing” phenomenon: Not gone but nearly forgotten. Journal of Educational Psychology 81:3 (1989), 392–399.
14. Hattie, J., Timperley, H., The power of feedback. Review of Educational Research 77:1 (2007), 16–17.
15. Hew, K.F., Cheung, W.S., Students' and instructors' use of massive open online courses (MOOCs): Motivations and challenges. Educational Research Review 12 (2014), 45–58.
16. Hickey, A., Urban, A., The machine learning advantage. 2019, Coursera Conference, London, UK.
17. Kalkanis, I., Learner pathways: Exploring clickstream data to understand how learners personalise their experiences. 2019, Coursera Conference, London, UK.
18. Kanuka, H., University student perceptions of the use of the web in distance-delivered programs. Canadian Journal of Higher Education 31:3 (2001), 49–71.
19. Kornell, N., Hays, M.J., Bjork, R.A., Unsuccessful retrieval attempts enhance subsequent learning. Journal of Experimental Psychology: Learning, Memory, and Cognition 35:4 (2009), 989–998.
20. Lerís, D., Sein-Echaluce, M.L., Hernández, M., Bueno, C., Validation of indicators for implementing an adaptive platform for MOOCs. Computers in Human Behavior 72 (2017), 783–795.
21. Leu, D.J., Castek, J., Hartman, D.K., Henry, L.a., Reinking, D., Coiro, J., Research on instruction and assessment in the new literacies of online reading comprehension. 2008, Comprehension Instruction: Research-Based Best Practices.
22. Lipnevich, A.A., Berg, D.A.G., Smith, J.K., Toward a model of student response to feedback. Brown, G.T.L., Harris, L.R., (eds.) The handbook of human and social conditions in assessment, 2016, Routledge, New York, 169–185.
23. Lipnevich, A.A., Smith, J.K., Response to assessment feedback: The effects of grades, praise, and source of information. 2008 (Princeton, NJ).
24. Maggioncalda, J., Keynote address. 2019, Coursera Conference, London, UK.
25. Munshi, C., Deneen, C.C., Technology-enhanced feedback. Lipnevich, A.A., Smith, J.K., (eds.) The Cambridge handbook of instructional feedback, 2018, Cambridge University Press.
26. Narciss, S., Huth, K., How to design informative tutoring feedback for multi-media learning. Niegemann, H., Brünken, R., Leutner, D., (eds.) Instructional design for multimedia learning, 2002, Waxmann, Münster, 2–16.
27. Nicol, D.J., Macfarlane-Dick, D., Formative assessment and self-regulated learning: A model and seven principles of good feedback practice. Studies in Higher Education 31:2 (2006), 199–218.
28. Pappano, L., The year of the MOOC. 2012, November 4, The New York Times, New York, NY, ED26 Retrieved from https://www.nytimes.com/2012/11/04/education/edlife/massive-open-online-courses-are-multiplying-at-a-rapid-pace.html.
29. Undergraduate Retention and Graduation Rates. (2018). Retrieved March 24, 2019, from https://nces.ed.gov/programs/coe/indicator_ctr.asp.
30. Richland, L.E., Kornell, N., Kao, L.S., The pretesting effect: Do unsuccessful retrieval attempts enhance learning?. Journal of Experimental Psychology: Applied 15:3 (2009), 243–257.
31. Shah, D., By the numbers: MOOCs in 2018. Class central. 2018.
32. Shute, V.J., Focus on formative feedback. Review of Educational Research 78:1 (2008), 153–189.
33. Smith, J.K., Lipnevich, A.A., Instructional feedback: Analysis, synthesis, and extrapolation. Lipnevich, A.A., Smith, J.K., (eds.) The Cambridge handbook of instructional feedback, 2018, Cambridge University Press.
34. Smits, M.H.S.B., Boon, J., Sluijsmans, D.M.A., van Gog, T., Content and timing of feedback in a web-based learning environment: Effects on learning as a function of prior knowledge. Interactive Learning Environments 16:2 (2008), 183–193.
35. Special report: Lifelong education. The economist. 2017, January.
36. Stobart, G., Becoming proficient: An alternative perspective on the role of feedback. Lipnevich, A.A., Smith, J.K., (eds.) The Cambridge handbook of instructional feedback, 2018, Cambridge University Press.
37. Williams, K.M., Stafford, R.E., Corliss, S.B., Reilly, E.D., Examining student characteristics, goals, and engagement in massive open online courses. Computers and Education 126 (2018), 433–442.
38. Winstone, N.E., Nash, R.A., Rowntree, J., Parker, M., “It'd be useful, but I wouldn't use it”: Barriers to university students' feedback seeking and recipience. Studies in Higher Education 42:11 (2017), 2026–2041.
39. Wisniewski, B., Zierer, K., Hattie, J., The power of feedback revisited: A meta- analysis of educational feedback research. Frontiers in Psychology 10 (2020), 1–14.
40. Xiong, Y., Li, H., Kornhaber, M.L., Pursel, B., Goins, D.D., Examining the relations among student motivation, engagement, and retention in a MOOC: A structural equation modeling approach. Global Education Review 2:3 (2015), 23–33.