A review to identify key perspectives in PBL meta-analyses and reviews: trends, gaps and future research directions

Advances in Health Sciences Education

Volumn 24, Issue 5, 2019, Pages 943-957

  Hung, Woei ^a   Dolmans, Diana H J M ^b   van Merriënboer, Jeroen J G ^b  

^a UNIVERSITY OF NORTH DAKOTA   (United States)

^b MAASTRICHT UNIVERSITY   (Netherlands)

Author keywords

Meta analyses; Narrative review; Problem based learning; Reflection; Systematic reviews; Trends and future directions

Indexed keywords

CURRICULUM; HUMAN; META ANALYSIS; NARRATIVE; OUTCOME ASSESSMENT; POLARIZATION; PROBLEM BASED LEARNING; REVIEW; SPECIALIZATION; SYSTEMATIC REVIEW; CULTURAL ANTHROPOLOGY; LITERATURE; MEDICAL EDUCATION; META ANALYSIS (TOPIC); RESEARCH;

CULTURE; EDUCATION, MEDICAL; META-ANALYSIS AS TOPIC; PROBLEM-BASED LEARNING; RESEARCH; REVIEW LITERATURE AS TOPIC;

EID: 85076199714     PISSN: 13824996     EISSN: 15731677     Source Type: Journal    
DOI: 10.1007/s10459-019-09945-x     Document Type: Review

References (75)

1. The references with an asterisk are the meta-analyses or systematic reviews included in this review.
2. *Al-Azri, H., & Ratnapalan, S. (2014). Problem-based learning in continuing medical education: Review of randomized controlled trials. Canadian Family Physician, 60, 157–165.
3. *Albanese, M. A., & Dast, L. (2014). Problem-based learning: Outcomes evidence from the health professions. Journal on Excellence in College Teaching, 25(3&4), 239–252.
4. *Albanese, M. A., & Mitchell, S. (1993). Problem-based learning: A review of literature on its outcomes and implementation issues. Academic Medicine, 68, 52–81.
5. *Azer, S. A., & Azer, D. (2015). Group interaction in problem-based learning tutorials: A systematic review. European Journal of Dental Education, 19, 194–208. 10.1111/eje.12121.
6. Barrows, H. S. (1986). A taxonomy of problem-based learning methods. Medical Education, 20(6), 481–486.
7. Barrows, H. S. (1996). Problem-based learning in medicine and beyond: A brief overview. In L. Wilkerson & W. H. Gijselaers (Eds.), Bring problem-based learning to higher education: Theory and practice. New directions for teaching and learning (Vol. 68, pp. 3–12). San Francisco: Jossey-Bass.
8. Barrows, H. S., & Tamblyn, R. (1980). Problem-based learning: An approach to medical education. New York: Springer.
9. *Belland, B., French, B., & Ertmer, P. A. (2009). Validity and problem-based learning research: A review of instruments used to assess intended learning outcomes. The Interdisciplinary Journal of Problem-Based Learning, 3(1), 59–89.
10. *Berkson, L. (1993). Problem-based learning: Have the expectations been met? Academic Medicine, 68, S79–S88.
11. *Car, L. T., Kyaw, B. M., Dunleavy, G., Smart, N. A., Semwal, M., Rotgans, J. I., et al. (2019). Digital problem-based learning in health professions: Systematic review and meta-analysis by the digital health education collaboration. Journal of Medical Internet Research, 21(2), e12945. 10.2196/12945.
12. Ciancolo, A. T., & Regehr, G. (2019). Learning theory and educational intervention: Producing meaningful evidence of impact through layered analysis. Academic Medicine, 94, 789–794.
13. *Colliver, J. A. (2000). Effectiveness of problem-based learning curricula: Research and theory. Academic Medicine, 75(3), 259–266.
14. Cook, D. A., Bordage, G., & Schmidt, H. G. (2008). Description, justification and clarification: A framework for classifying the purposes of research in medical education. Medical Education, 42, 128–133.
15. Cook, D. J., Mulrow, C. D., & Haynes, R. B. (1997). Systematic reviews: Synthesis of best evidence for clinical decisions. Annals of Internal Medicine, 126(5), 376–380. 10.7326/0003-4819-126-5-199703010-00006.
16. Czabanowska, K., Moust, J. H., Meijer, A., Schröder-Bäck, P., & Roebertsen, H. (2012). Problem-based learning revisited, introduction of active and self-directed learning to reduce fatigue among students. Journal of University Teaching & Learning Practice, 9(1), 6.
17. *Demirel, M., & Dagyar, M. (2016). Effects of problem-based learning on attitude: A meta-analysis study. Eurasia Journal of Mathematics, Science & Technology Education, 12(8), 2115–2137. 10.12973/eurasia.2016.1293a.
18. *Dochy, F., Segers, M., Van den Bossche, P., & Gijbels, D. (2003). Effects of problem-based learning: A meta-analysis. Learning and Instruction, 13, 533–568.
19. *Dolmans, D. H. J. M., Loyens, S. M. M., Marcq, H., & Gijbels, D. (2016). Deep and surface learning in problem-based learning: A review of the literature. Advances in Health Science Education, 21, 1087–1112. 10.1007/s10459-015-9645-6.
20. Engeström, Y. (1987). Learning by expanding: An activity theoretical approach to developmental research. Helsinki: Orienta-Konsultit.
21. *Eslami, E., Bassir, S. H., & Sadr-Eshkevari, P. (2014). Current state of the effectiveness of problem-based learning in prosthodontics: A systematic review. Journal of Dental Education, 78(5), 723–734.
22. Fonteijn, H. T. H., & Dolmans, D. H. J. M. (2019). Group work and group dynamics in PBL. In M. Moallem, W. Hung, & N. Baddagh (Eds.), The Wiley handbook of problem-based learning (pp. 199–219). Hoboken, NJ: Wiley.
23. Francom, G. M. (2017). Principles for task-centered instruction. In C. M. Reigeluth, B. J. Beatty, & R. D. Myers (Eds.), Instructional design theories and models: The learner-centered paradigm of education (Vol. 4, pp. 65–91). New York: Routledge.
24. *Galvao, T. F., Silva, M. T., Neiva, C. S., Ribeiro, L. M., & Pereira, M. G. (2014). Problem-based learning in pharmaceutical education: A systematic review and meta-analysis. The Scientific World Journal. 10.1155/2014/578382.
25. *Gao, X., Luo, S., Mu, D., Xiong, Y., Guanjian, L., & Wan, C. (2016). Effects of problem-based learning in paediatric education in China: A meta-analysis. Journal of Evidence-Based Medicine, 9, 136–143.
26. *Gavgani, V. Z., Hazrati, H., & Ghojazadeh, M. (2015). The efficacy of digital case scenario versus paper case scenario on clinical reasoning in problem-based learning: A systematic review and meta-analysis. Research and Development in Medical Education, 4(1), 17–22.
27. *Gijbels, D., Dochy, F., van den Bossche, P., & Segers, M. (2005). Effects of problem-based learning: A meta-analysis from the angle of assessment. Review of Educational Research, 75(1), 27–61.
28. Gordon, M., Daniel, M., & Patricio, M. (2018). What do we mean by ‘systematic’ in health education systematic reviews and why it matters! Medical Teacher. 10.1080/0142159x.2018.1504164.
29. Grant, M. J., & Booth, A. (2009). A typology of reviews: an analysis of 14 review types and associated methodologies. Health Information & Libraries Journal, 26(2), 91–108.
30. *Hartling, L., Spooner, C., Tjosvold, L., & Oswald, A. (2010). Problem-based learning in pre-clinical medical education: 22 years of outcome research. Medical Teacher, 32, 28–35.
31. Hmelo-Silver, C. E., Duncan, R. G., & Chinn, C. A. (2007). Scaffolding and achievement in problem-based and inquiry learning: A response to Kirschner, Sweller, and Clark (2006). Educational Psychologist, 42(2), 99–107.
32. *Huang, B., Zheng, L., Li, C., Li, L., & Yu, H. (2013). Effectiveness of problem-based learning in Chinese dental education: A meta-analysis. Journal of Dental Education, 77(3), 377–383.
33. Hung, W., & Loyens, S. M. M. (2012). Global development of problem-based learning: Adoption, adaptation, and advancement. Interdisciplinary Journal of Problem-Based Learning, 6(1), 4–9.
34. *Jerzembek, G., & Murphy, S. (2013). A narrative review of problem-based learning with school-aged children: Implementation and outcomes. Educational Review, 65(2), 206–218.
35. *Jia, X., Zeng, W., & Zeng, Q. (2018). Combined administration of problem- and lecture-based learning teaching models in medical education in China: A meta-analysis of randomized controlled trials. Medicine, 97, 43.
36. Jonassen, D. H. (2000). Toward a design theory of problem solving. ETR&D, 48(4), 63–85.
37. *Kalaian, H. A., Mullan, P. B., & Kasim, R. M. (1999). What can studies of problem-based learning tell us? Synthesizing and modeling PBL effects on National Board of Medical Examination performance: Hierarchical linear modeling meta-analytic approach. Advances in Health Sciences Education, 4, 209–221.
38. Kelley, H. H. (1973). The process of causal attribution. American Psychologist, 28, 107–128.
39. *Kim, N. J., Belland, B. R., & Walker, A. E. (2018). Effectiveness of computer-based scaffolding in the context of problem-based learning for Stem education: Bayesian meta-analysis. Educational Psychology Review, 30, 397–429.
40. Kirschner, P. A., Sweller, J., & Clark, R. (2006). Why minimal guidance during instruction does not work: An analysis of the failure of constructivist, discovery, problem-based, experiential, and inquiry-based teaching. Educational Psychologist, 41(2), 75–86.
41. *Koh, G. C.-H., Khoo, H. E., Wong, M. L., & Koh, D. (2008). The effects of problem-based learning during medical school on physician competency: A systematic review. Canadian Medical Association Journal, 178(1), 34–41.
42. *Kong, L.-N., Qin, B., Zhou, Y.-Q., Mou, S.-Y., & Gao, H.-M. (2014). The effectiveness of problem-based learning on development of nursing students’ critical thinking: A systematic review and meta-analysis. International Journal of Nursing Studies, 51, 458–469.
43. *Leary, H., Walker, A., Shelton, B. E., & Fitt, M. H. (2013). Exploring the relationships between tutor background, tutor training, and student learning: A problem-based learning meta-analysis. The Interdisciplinary Journal of Problem-Based Learning, 7(1), 44–66.
44. *Liu, L., Du, X., Zhang, Z., & Zhou, J. (2019). Effect of problem-based learning in pharmacology education: A meta-analysis. Studies in Educational Evaluation, 60, 43–58.
45. Loyens, S., & Rikers, R. (2011). Instruction based on inquiry. In R. Mayer & P. Alexander (Eds.), Handbook of research on learning and instruction (pp. 361–381). New York, NY: Routledge.
46. *Ma, Y., & Lu, X. (2019). The effectiveness of problem-based learning in pediatric medical education in China: A meta-analysis of randomized controlled trials. Medicine, 98, 2.
47. *Neville, A. J. (2009). Problem-based learning and medical education forth years on. Medical Principles and Practice, 18, 1–9.
48. *Newman, M. (2003). A pilot systematic review and meta-analysis on the effectiveness of problem-based learning. Special report 2. London: Middlesex University. Retrieved 14 May 2019, from https://eric.ed.gov/?id=ED476146.
49. *Norman, G. R., & Schmidt, H. G. (1992). The psychological basis of problem-based learning: A review of the evidence. Academic Medicine, 67, 557–565.
50. Pawson, R., Greenhalgh, T., Harvey, G., & Walshe, K. (2005). Realist review: A new method of systematic review designed for complex policy interventions. Journal of Health Services Research & Policy, 10(Suppl 1), 21–34.
51. *Polyzois, I., Claffey, N., & Mattheos, N. (2010). Problem-based learning in academic health education: A systematic literature review. European Journal of Dental Education, 14, 55–64.
52. *Qin, Y., Wang, Y., & Floden, R. E. (2016). The effect of problem-based learning on improvement of the medical educational environment: A systematic review and meta-analysis. Medical Principles and Practice, 25, 525–532. 10.1159/000449036.
53. *Sayyah, M., Shirbandi, K., Saki-Malehi, A., & Rahim, F. (2017). Use of a problem-based learning teaching model for undergraduate medical and nursing education: A systematic review and meta-analysis. Advances in Medical Education and Practice, 8, 691–700.
54. Servant-Miklos, V. F. C., Norman, G. R., & Schmidt, H. G. (2019). A short intellectual history of problem-based learning. In M. Moallem, W. Hung, & N. Dabbagh (Eds.), The Wiley handbook of Problem-based Learning (pp. 3–24). Hoboken, NJ: Wiley-Blackwell.
55. Schmidt, H. G. (1983). Problem-based learning: Rationale and description. Medical Education, 17, 11–16.
56. Schmidt, H. G., Loyen, S. M. M., van Gog, T., & Paas, F. (2007). Problem-based learning is compatible with human cognitive architecture: Commentary on Kirschner, Sweller, and Clark (2006). Educational Psychologist, 42(2), 91–97.
57. *Schmidt, H. G., van der Molen, H. T., te Winkel, W. W. R., & Wijnen, W. H. F. W. (2009). Constructivist, problem-based learning does work: A meta-analysis of curriculum comparisons involving a single medical school. Educational Psychologist, 44(4), 227–249.
58. *Shin, I.-S., & Kim, J.-H. (2013). The effect of problem-based learning in nursing education: A meta-analysis. Advances in Health Science Education, 18, 1103–1120. 10.1007/s10459-012-9436-2.
59. *Strobel, J., & van Barneveld, A. (2009). When is PBL more effective? A meta-synthesis of meta-analyses comparing PBL to conventional classrooms. Interdisciplinary Journal of Problem-Based Learning, 3(1), 44–58.
60. Tawfik, A. A., Hung, W., & Giabbanelli, P. J. Comparing how different inquiry-based approaches impact learning outcomes. Interdisciplinary Journal of Problem-Based Learning (in press).
61. Thagard, P. (2000). Explaining disease: Correlations, causes, and mechanisms. In F. C. Keil & R. A. Wilson (Eds.), Explanation and cognition (pp. 254–276). Cambridge, MA: MIT Press.
62. *Tsai, C.-W., & Chiang, Y.-C. (2013). Research trends in problem-based learning (PBL) research in e-learning and online education environments: A review of publications in SSCI-indexed journals from 2004 to 2012. British Journal of Educational Technology, 44(6), E185–E190. 10.1111/bjet.12038.
63. *Tsigarides, J., Wingfield, L. R., & Kulendran, M. (2017). Does a PBL-based medical curriculum predispose training in specific career paths: A systematic review of the literature. BMC Research Notes, 10, 24. 10.1186/s13104-016-2348-0.
64. van Merriënboer, J. J. G. (2013). Perspectives on problem solving and instruction. Computers & Education, 64, 153–160.
65. van Merrienboer, J. J. G., & Kirschner, P. A. (2018). Ten steps to complex learning: A systematic approach to four-component instructional design (3rd ed.). New York: Routledge.
66. Vardi, I., & Ciccarelli, M. (2008). Overcoming problems in problem-based learning: A trial of strategies in an undergraduate unit. Innovations in Education and Teaching International, 45(4), 345–354.
67. *Vernon, D. T. A., & Blake, R. L. (1993). Does problem-based learning work: A meta-analysis of evaluative research. Academic Medicine, 68, 550–563.
68. *Walker, A., & Leary, H. (2009). A problem based learning meta analysis: Differences across problem types, implementation types, disciplines, and assessment levels. Interdisciplinary Journal of Problem-Based Learning, 3(1). Retrieved 14 May 2019, from http://docs.lib.purdue.edu/ijpbl/vol3/iss1/3.
69. Wijnia, L., Loyens, S. M. M., & Rikers, R. M. J. P. (2019). The problem-based learning process: An overview of different models. In M. Moallem, W. Hung, & N. Baddagh (Eds.), The Wiley handbook of problem-based learning (pp. 273–294). Hoboken, NJ: Wiley.
70. *Wilder, S. (2015). Impact of problem-based learning on academic achievement in high school: A systematic review. Educational Review, 67(4), 414–435. 10.1080/00131911.2014.974511.
71. *Wolf, F. M. (1993). Problem-based learning and meta-analysis: Can we see the forest through the trees? Academic Medicine, 68(7), 542–544.
72. *Wosinski, J., Belcher, A. E., Durrenberger, Y., Allin, A.-C., Stormacq, C., & Gerson, L. (2018). Facilitating problem-based learning among undergraduate nursing students: A qualitative systematic review. Nurse Education Today, 60, 67–74.
73. *Zhang, S., Xu, J., Wang, H., Zhang, D., Zhang, Q., & Zou, L. (2018). Effects of problem-based learning in Chinese radiology education: A systeamtic review and meta-analysis. Medicine, 97, 9.
74. *Zhang, Y., Zhou, L., Liu, X., Liu, L., Wu, Y., Zhao, Z., et al. (2015). The effectiveness of the problem-based learning teaching model for use in introductory Chinese undergraduate medical courses: A systematic review and meta-Analysis. PLoS ONE, 10(3), e0120884. 10.1371/journal.pone.0120884.
75. *Zhou, J., Zhou, S., Huang, C., Xu, R., Zhang, Z., Zeng, S., et al. (2016). Effectiveness of problem-based learning in China pharmacy education: A meta-analysis. BMC Medical Education, 16, 23. 10.1186/s12909-016-0546-z.