University teacher judgments in problem-based learning: Their accuracy and reasoning

Teaching and Teacher Education

Volumn 59, Issue , 2016, Pages 203-212

  Wijnia, Lisette ^a,b   Loyens, Sofie M M ^a,b   Derous, Eva ^c   Schmidt, Henk G ^a  

^a ERASMUS UNIVERSITY ROTTERDAM   (Netherlands)

^b UTRECHT UNIVERSITY   (Netherlands)

^c GHENT UNIVERSITY   (Belgium)

Author keywords

Higher education; Judgment accuracy; Problem based learning; Teacher judgments

Indexed keywords

EID: 84976595691     PISSN: 0742051X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.tate.2016.06.005     Document Type: Article

References (54)

1. Abidin, R.R., Robinson, L.L., Stress, biases, or professionalism: What drives teachers’ referral judgments of students with challenging behaviors?. Journal of Emotional and Behavioral Disorders 10 (2002), 204–212.
2. Alvidrez, J., Weinstein, R.S., Early teacher perceptions and later student academic achievement. Journal of Educational Psychology 91 (1999), 731–746.
3. Barrows, H.S., Problem-based learning in medicine and beyond: A brief overview. Wilkerson, L., Gijselaers, W.H., (eds.) New directions in teaching and Learning: Issue 68. Bringing problem-based learning to higher education: Theory and practice, 1996, Jossey-Bass, San Francisco, CA, 3–12.
4. Begeny, J.C., Eckert, T.L., Montarello, S.A., Storie, M.S., Teachers’ perceptions of students’ reading abilities: An examination of the relationship between teachers’ judgments and students’ performance across a continuum of rating methods. School Psychology Quarterly 23 (2008), 43–55.
5. Central Bureau for Statistics, Jaarboek onderwijs in cijfers (Trans.) Yearbook education in figures, 2009, CBS, Voorburg.
6. Chamorro-Premuzic, T., Furnham, A., Personality predicts academic performance: Evidence from two longitudinal university samples. Journal of Research in Personality 37 (2003), 319–338.
7. Coladarci, T., Accuracy of teacher judgments of student responses to standardized test items. Journal of Educational Psychology 78 (1986), 141–146.
8. Demaray, M.K., Elliott, S.N., Teachers’ judgments of students’ academic functioning: A comparison of actual and predicted performances. School Psychology Quarterly 13 (1998), 8–24.
9. De Koning, B.B., Loyens, S.M.M., Rikers, R.M.J.P., Smeets, G., Van der Molen, H.T., Generation Psy: Student characteristics and academic achievement in a three-year problem-based learning bachelor program. Learning and Individual Differences 22 (2012), 313–323.
10. De Koning, B.B., Loyens, S.M.M., Rikers, R.M.J.P., Smeets, G., Van der Molen, H.T., Impact of binding study advice on study behavior and pre-university education qualification factors in a problem-based psychology bachelor program. Studies in Higher Education 39 (2014), 835–847.
11. Dicke, A.-L., Lüdtke, O., Trautwein, U., Nagy, G., Nagy, N., Judging students‘ achievement goal orientations: Are teacher ratings accurate?. Learning and Individual Differences 22 (2012), 844–849.
12. Doherty, J., Conolly, M., How accurately can primary school teachers predict the scores of their pupils in standardised tests of attainment? A study of non-cognitive factors that influence specific judgments. Educational Studies 11 (1985), 41–60.
13. Eckert, T.L., Dunn, E.K., Codding, R.S., Begeny, J.C., Kleinmann, A.E., Assessment of mathematics and reading performance: An examination of the correspondence between direct assessment of student performance and teacher report. Psychology in the Schools 43 (2006), 247–265.
14. Educational Inspectorate, Onderwijsverslag 2011/2012 (Trans.) Educational report 2011/2012, 2013, Educational Inspectorate, Zoetermeer, the Netherlands file:///E:/ov11-12-hfdst-5-hoger-onderwijs.pdf.
15. Flynn, J.M., Rahbar, M.H., Improving teacher prediction of children at risk for reading failure. Psychology in the School 35 (1998), 163–172.
16. Fredricks, J.A., Blumenfeld, P.C., Paris, A.H., School engagement: Potential of the concept, state of the evidence. Review of Educational Research 74 (2004), 59–109.
17. Funder, D.C., Accurate personality judgment. Current Directions in Psychological Science 21 (2012), 177–182.
18. Furnham, A., Medhurst, S., Personality correlates of academic seminar behaviour: A study of four instruments. Personality and Individual Differences 19 (1995), 197–208.
19. Gagné, F., St Père, F., When IQ is controlled, does motivation still predict achievement?. Intelligence 30 (2001), 71–100.
20. Gerber, M.M., Semmel, M.J., Teacher as imperfect test: Reconceptualizing the referral process. Educational Psychologist 19 (1984), 137–148.
21. Gijsel, M.A.R., Bosman, A.M.T., Verhoeven, L., Kindergarten risk factors, cognitive factors, and teacher judgments as predictors of early reading in Dutch. Journal of Learning Disabilities 39 (2006), 558–571.
22. Givvin, K.B., Stipek, D.J., Salmon, J.M., MacGyvers, V.L., In the eyes of the beholder: Students’ and teachers’ judgments of students’ motivation. Teaching and Teacher Education 17 (2001), 321–331.
23. Hinnant, J.B., O'Brien, M., Ghazarian, S.R., The longitudinal relations of teacher expectations to achievement in the early school teachers. Journal of Educational Psychology 101 (2009), 662–670.
24. Hoge, R.D., Coladarci, T., Teacher-based judgments of academic achievement: A review of literature. Review of Educational Research 59 (1989), 297–313.
25. Hovdhaugen, E., Transfer and dropout: Different forms of student departure in Norway. Studies in Higher Education 34 (2009), 1–17.
26. Hox, J.J., Maas, C.J.M., Brinkhuis, M.J.S., The effect of estimation method on sample size in multilevel structural equation modeling. Statistica Neerlandica 64 (2010), 157–170.
27. Impara, J.C., Plake, B.S., Teachers’ ability to estimate item difficulty: A test of the assumptions in the Angoff standard setting method. Journal of Educational Measurement 35 (1998), 69–81.
28. Jansen, E.P.W.A., The influence of the curriculum organization on study progress in higher education. Higher Education 47 (2004), 44–435.
29. Jansen, E.P.W.A., Bruinsma, M., Explaining achievement in higher education. Educational Research and Evaluation 11 (2005), 235–252.
30. Jussim, L., Teacher expectations: Self-fulfilling prophecies, perceptual biases, and accuracy. Journal of Personality and Social Psychology 57 (1989), 469–480.
31. Jussim, L., Social perception and social reality: A reflection-construction model. Psychological Review 98 (1991), 54–73.
32. Jussim, L., Harber, K.D., Teacher expectations and self-fulfilling prophecies: Knowns and unknowns, resolved and unresolved controversies. Personality and Social Psychology Review 9 (2005), 131–155.
33. Kaiser, J., Retelsdorf, J., Südkamp, A., Möller, J., Achievement and engagement: How student characteristics influence teacher judgments. Learning and Instruction 28 (2013), 73–84.
34. Kaufman, D.M., Hansell, M.M., Can non-expert PBL tutors predict their students’ achievement? an exploratory study. Academic Medicine 72:Suppl. 1 (1997), S16–S18.
35. Loyens, S.M.M., Kirschner, P.A., Paas, F., Problem-based learning. Harris, K.R., Graham, S., Urdan, T., (eds.) APA Educational Psychology Handbook: Vol 3. Applications to learning and teaching, 2012, American Psychological Association, Washington, DC, 403–425.
36. Loyens, S.M.M., Rikers, R.M.J.P., Schmidt, H.G., The impact of students’ conceptions of constructivist assumptions on academic achievement and drop-out. Studies in Higher Education 32 (2007), 581–602.
37. Muthén, L.K., Muthén, B.O., Mplus user's guide. 7th ed., 2012, Muthén & Muthén, Los Angeles, CA.
38. Organisation for Economic Co-Operation and Development, Education at a glance 2013: OECD indicators. 2013, OECD Publishing, Paris.
39. Poropat, A.E., A meta-analysis of the five-factor model of personality and academic performance. Psychological Bulletin 135 (2009), 322–338.
40. Reeve, J., A self-determination theory perspective on student engagement. Christenson, S.L., Reschly, A.L., Wylie, C., (eds.) Handbook of research on student engagement, 2012, Springer, New York, NY, 149–172.
41. Richardson, M., Abraham, C., Bond, C., Psychological correlates of university students’ academic performance: A systematic review and meta-analysis. Psychological Bulletin 138 (2012), 353–387.
42. Sadler, D.R., Interpretations of criteria-based assessment and grading in higher education. Assessment & Evaluation in Higher Education 30 (2005), 175–194.
43. Schmidt, H.G., Van der Molen, H.T., Te Winkel, W.W.R., Wijnen, W.H.F.W., Constructivist, problem-based learning does work: A meta-analysis of curricular comparisons involving a single medical school. Educational Psychologist 44 (2009), 227–249.
44. Südkamp, A., Kaiser, J., Möller, J., Accuracy of teachers’ judgments of students’ academic achievement: A meta-analysis. Journal of Educational Psychology 104 (2012), 743–762.
45. Taylor, H.G., Anselmo, M., Foreman, A.L., Schatschneider, C., Angelopoulos, J., Utility of kindergarten teacher judgments in identifying early learning problems. Journal of Learning Disabilities 33 (2000), 200–210.
46. Thiede, K.W., Brendefur, J.L., Osguthorpe, R.D., Carney, M.B., Bremner, A., Strother, S., et al. Can teachers accurately predict student performance?. Teaching and Teacher Education 49 (2015), 36–44.
47. Tinto, V., Leaving college: Rethinking the causes and cures of student attrition. 1993, The University of Chicago Press, Chicago, IL.
48. Tinto, V., Colleges as communities: Taking research on student persistence seriously. The Review of Higher Education 21 (1998), 167–177.
49. Trouilloud, D.O., Sarrazin, P.G., Martinek, T.J., Guillet, E., The influence of teacher expectations on student achievement in physical education classes: Pygmalion revisited. European Journal of Social Psychology 32 (2002), 591–607.
50. Urhahne, D., Teacher behavior as a mediator of the relationship between teacher judgment and students’ motivation and emotion. Teaching and Teacher Education 45 (2015), 73–82.
51. Van den Berg, M.N., Hofman, W.H.A., Student success in university education: A multi-measurement study of the impact of student faculty factors on study progress. Higher Education 5 (2005), 413–446.
52. Van de Watering, G.A., Claessens, S., Verschillen tussen de perceptie van tutoren op de leerprestatie en de toetsprestatie van hun studenten (Trans.) Differences between tutors’ perceptions of performance and students’ actual achievement Tijdschrift voor Hoger Onderwijs 21 (2003), 199–214.
53. Whitfield, C.F., Xie, S.X., Correlation of problem-based learning facilitators’ scores with student performance on written exams. Advances in Health Sciences Education 7 (2002), 41–51.
54. Wijnia, L., Loyens, S.M.M., Derous, E., Koendjie, N.S., Schmidt, H.G., Predicting educational success and attrition in problem-based learning: Do first impressions count. Studies in Higher Education 39 (2014), 967–982.