Using Value-Added Models to Measure Teacher Effects on Students’ Motivation and Achievement

Journal of Early Adolescence

Volumn 35, Issue 5-6, 2015, Pages 852-882

  Ruzek, Erik A ^a   Domina, Thurston ^b   Conley, AnneMarie M ^b   Duncan, Greg J ^b   Karabenick, Stuart A ^c  

^a UNIVERSITY OF VIRGINIA   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c UNIVERSITY OF MICHIGAN   (United States)

Author keywords

educational policy; middle school; motivation; transitions

Indexed keywords

EID: 84937243008     PISSN: 02724316     EISSN: 15525449     Source Type: Journal    
DOI: 10.1177/0272431614525260     Document Type: Article

References (80)

1. D.AaronsonL.BarrowW.Sander (2007). Teachers and student achievement in the Chicago public high schools. Journal of Labor Economics, 25, 95-135. doi:10.1086/508733
2. C.Adelman (1999). Answers in the tool box: Academic intensity, attendance patterns, and bachelor’s degree attainment. Washington, DC: U.S. Department of Education.
3. C.Ames (1992). Classrooms: Goals, structures, and student motivation. Journal of Educational Psychology, 84, 261-271. doi:10.1037//0022-0663.84.3.261
4. C.AmesR.Ames (1984). Systems of student and teacher motivation: Toward a qualitative definition. Journal of Educational Psychology, 76, 535-556. doi:10.1037//0022-0663.76.4.535
5. C.AmesJ.Archer (1988). Achievement goals in the classroom: Students’ learning strategies and motivation processes. Journal of Educational Psychology, 80, 260-267. doi:10.1037//0022-0663.80.3.260
6. E.M.AndermanM.L.Maehr (1994). Motivation and schooling in the middle grades. Review of Educational Research, 64, 287-309. doi:10.3102/00346543064002287
7. E.M.AndermanM.L.MaehrC.Midgley (1999). Declining motivation after the transition to middle school: Schools can make a difference. Journal of Research and Development in Education, 32, 131-147.
8. E.M.AndermanC.Midgley (1997). Changes in achievement goal orientations, perceived academic competence, and grades across the transition to middle-level schools. Contemporary Educational Psychology, 22, 269-298. doi:10.1006/ceps.1996.0926
9. E.M.AndermanA.J.Young (1994). Motivation and strategy use in science: Individual differences and classroom effects. Journal of Research in Science Teaching, 31, 811-831. doi:10.1002/tea.3660310805
10. L.H.AndermanE.M.Anderman (1999). Social predictors of changes in students’ achievement goal orientations. Contemporary Educational Psychology25, 21-37. doi:10.1006/ceps.1998.0978
11. D.A.BlythR.G.SimmonsS.Carlton-Ford (1983). The adjustment of early adolescents to school transitions. Journal of Early Adolescence, 3, 105-120. doi:10.1177/027243168331008
12. M.Bong (2005). Within-grade changes in Korean girls’ motivation and perceptions of the learning environment across domains and achievement levels. Journal of Educational Psychology, 97, 656-672. doi:10.1037/0022-0663.97.4.656
13. W.G.BowenM.M.ChingosM.S.McPherson (2009). Crossing the finish line: Completing college at America’s public universities. Princeton, NJ: Princeton University Press.
14. D.J.BoydP.L.GrossmanH.LankfordS.LoebJ.Wyckoff (2009). Teacher preparation and student achievement. Education Evaluation and Policy Analysis, 31, 416-440. doi:10.3102/0162373709353129
15. H.BraunN.ChudowskyJ.Koenig (2010). Getting value out of value-added: Report of a workshop. Washington, DC: National Academies Press.
16. J.Brophy (2005). Goal theorists should move on from performance goals. Educational Psychologist, 40, 167-176. doi:10.1207/s15326985ep4003_3
17. R.BuddinG.Zamarro (2008, May). Teacher quality, teacher licensure tests and student achievement (RAND Working Paper). Retrieved from http://www.rand.org/pubs/working_papers/2008/RAND_WR555.pdf
18. R.BuddinG.Zamarro (2009). Teacher qualifications and student achievement in urban elementary schools. Journal of Urban Economics, 66, 103-115. doi:10.1016/j.jue.2009.05.001
19. V.ByrnesA.Ruby (2007). Comparing achievement between K-8 and middle schools: A large-scale empirical study. American Journal of Education, 114, 101-135. doi:10.1086/520693
20. California Department of Education. (2011). DataQuest. Retrieved from http://dq.cde.ca.gov/dataquest/
21. B.V.CarolanC.C.WeissJ.S.Matthews (2013). Which middle school model works best? Evidence from the Early Childhood Longitudinal Study. Youth & Society. doi:10.1177/0044118X13478625
22. A.M.Conley (2012). Patterns of motivation beliefs: Combining achievement goal and expectancy-value perspectives. Journal of Educational Psychology, 104, 32-47. doi:10.1037/a0026042
23. A.L.DuckworthC.PetersonM.D.MatthewsD.R.Kelly (2007). Grit: Perseverance and passion for long-term goals. Journal of Personality and Social Psychology, 92, 1087-1101. doi:10.1037/0022-3514.92.6.1087
24. G.J.DuncanC.J.DowsettA.ClaessensK.MagnusonA.C.HustonP.KlebanovC..Japel (2007). School readiness and later achievement. Developmental Psychology, 43, 1428-1446. doi:10.1037/0012-1649.43.6.1428
25. C.S.DweckE.L.Leggett (1988). A social-cognitive approach to motivation and personality. Psychological Review, 95, 256-273. doi:10.1037//0033-295X.95.2.256
26. J.S.EcclesC.Midgley (1989). Stage-environment fit: Developmentally appropriate classrooms for young adolescents. In C.AmesR.Ames (Eds.), Research on motivation in education: Goals and cognitions (Vol. 3, pp. 139-186). New York, NY: Academic Press.
27. J.S.EcclesC.MidgleyA.WigfieldC.M.BuchananD.ReumanC.FlanaganD.Mac Iver (1993). Development during adolescence: The impact of stage-environment fit on young adolescents’ experiences in schools and families. American Psychologist, 48, 90-101. doi:10.1037//0003-066X.48.2.90
28. Educational Testing Service. (2006). California Standardized Testing program technical report spring 2005 administration. Retrieved from http://www.cde.ca.gov/ta/tg/sr/documents/startechrpt05.pdf
29. Educational Testing Service. (2007). California Standardized Testing program technical report spring 2006 administration. Retrieved from http://www.cde.ca.gov/ta/tg/sr/documents/startechrpt06.pdf
30. A.J.ElliotJ.M.Harackiewicz (1996). Approach and avoidance achievement goals and intrinsic motivation: A mediational analysis. Journal of Personality and Social Psychology, 70, 461-475. doi:10.1037/0022-3514.70.3.461
31. C.A.FarringtonM.RoderickE.AllensworthJ.NagaokaT.S.KeyesD.W.JohnsonN.O.Beechum (2012). Teaching adolescents to become learners. The role of noncognitive factors in shaping school performance: A critical literature review. Chicago, IL: University of Chicago Consortium on Chicago School Research.
32. A.E.GottfriedJ.S.FlemingA.W.Gottfried (2001). Continuity of academic intrinsic motivation from childhood through late adolescence: A longitudinal study. Journal of Educational Psychology, 93, 3-13.
33. A.E.GottfriedG.A.MarcoulidesA.W.GottfriedP.H.OliverD.W.Guerin (2007). Multivariate latent change modeling of developmental decline in academic intrinsic math motivation and achievement: Childhood through adolescence. International Journal of Behavioral Development, 31, 317-327. doi:10.1177/0165025407077752
34. P.GrossmanS.LoebJ.CohenK.HammernessJ.WyckoffD.BoydH.Lankford (2010). Measure for measure: The relationship between measures of instructional practice in middle school English language arts and teachers’ value-added scores (NBER Working Paper No. 16015). Cambridge, MA: National Bureau of Economic Research.
35. E.A.HanushekJ.KainD.M.O’BrienS.G.Rivkin (2005). The market for teacher quality (NBER Working Paper No. 11154). Retrieved from the National Bureau of Economic Research website: http://www.nber.org/papers/w11154
36. J.M.HarackiewiczK.E.BarronP.R.PintrichA.J.ElliotT.M.Thrash (2002). Revision of achievement goal theory: Necessary and illuminating. Journal of Educational Psychology, 94, 638-645. doi:10.1037//0022-0663.94.3.638
37. D.N.HarrisT.R.Sass (2011). Teacher training, teacher quality and student achievement. Journal of Public Economics, 95(7–8), 798–812. doi:10.1016/j.jpubeco.2010.11.009
38. H.C.HillL.KapitulaK.Umland (2010). A validity argument approach to evaluating teacher value-added scores. American Educational Research Journal, 48, 1-38. doi:10.3102/0002831210387916
39. B.A.JacobL.Lefgren (2008). Can principals identify effective teachers? Evidence on subjective performance evaluation in education. Journal of Labor Economics, 26, 101-136. doi:10.1086/522974
40. J.L.JenningsT.A.DiPrete (2010). Teacher effects on social and behavioral skills in early elementary school. Sociology of Education, 83, 135-159. doi:10.1177/0038040710368011
41. T.J.KaneD.O.Staiger (2008). Estimating teacher impacts on student achievement: An experimental evaluation (NBER Working Paper No. 14607). Retrieved from the National Bureau of Economic Research website: http://www.nber.org/papers/w14607
42. T.J.KaneD.O.Staiger (2012). Gathering feedback about teaching: Combining high quality observations with student surveys and achievement gains. Seattle, WA: The Bill & Melinda Gates Foundation. Retrieved from http://www.metproject.org/reports.php
43. T.J.KaneE.S.TaylorJ.H.TylerA.L.Wooten (2010). Identifying effective classroom practices using student achievement data (NBER Working Paper No. 15803). Retrieved from the National Bureau of Economic Research website: http://www.nber.org/papers/w15803
44. A.KaplanM.L.Maehr (2007). The contributions and prospects of goal orientation theory. Educational Psychology Review, 19, 141-184. doi:10.1007/s10648-006-9012-5
45. S.A.Karabenick (2003). Seeking help in large college classes: A person-centered approach. Contemporary Educational Psychology, 28, 37-58. doi:10.1016/S0361-476X(02)00012-7
46. T.D.KeysA.M.ConleyG.J.DuncanT.D.Domina (2012). The role of goal o orientations for adolescent mathematics achievement. Contemporary Educational Psychology, 37, 47-54. doi:10.1016/j.cedpsych.2011.09.002.
47. C.KoedelJ.R.Betts (2009). Does student sorting invalidate value-added models of teacher effectiveness? An extended analysis of the Rothstein critique (Working Paper). Retrieved from http://ideas.repec.org/p/umc/wpaper/0902.html
48. R.Larson (2000). Toward a psychology of positive youth development. American Psychologist, 55, 170-183. doi:10.1037//0003-066X.55.1.170
49. S.LauY.Nie (2008). Interplay between personal goals and classroom goal structures in predicting student outcomes: A multilevel analysis of person-context interactions. Journal of Educational Psychology, 100, 15-29. doi:10.1037/0022-0663.100.1.15
50. E.A.Linnenbrink (2005). The dilemma of performance-approach goals: The use of multiple goal contexts to promote students’ motivation and learning. Journal of Educational Psychology, 97, 197-213. doi:10.1037/0022-0663.97.2.197
51. E.A.LinnenbrinkP.R.Pintrich (2002). Motivation as an enabler for academic success. School Psychology Review, 31, 313-327.
52. M.McCaslin (2008). Learning motivation: The role of opportunity. Teachers College Record, 110, 2408-2422.
53. M.McCaslinH.L.Burross (2008). Student motivational dynamics. Teachers College Record, 110, 2452-2463.
54. J.L.MeeceE.M.AndermanL.H.Anderman (2006). Classroom goal structure, student motivation, and academic achievement. Annual Review of Psychology, 57, 487-503. doi:10.1146/annurev.psych.56.091103.070258
55. C.MidgleyA.KaplanM.Middleton (2001). Performance-approach goals: Good for what, for whom, under what circumstances, and at what cost?Journal of Educational Psychology, 93, 77-86. doi:10.1037//0022-0663.93.1.77
56. C.MidgleyM.L.MaehrL.Z.HrudaE.AndermanL.AndermanK.E.FreemanT..Urdan (2000). Manual for the Patterns of Adaptive Learning Scales. Retrieved from http://www.umich.edu/~pals/PALS%202000_V13Word97.pdf
57. K.MurayamaA.J.Elliot (2009). The joint influence of personal achievement goals and classroom goal structures on achievement-related outcomes. Journal of Instructional Psychology, 101, 432-447. doi:10.1037/a0014221
58. J.G.Nicholls (1984). Achievement motivation: Conceptions of ability, subjective experience, task choice, and performance. Psychological Review, 91, 328-346. doi:10.1037//0033-295X.91.3.328
59. B.NyeS.KonstantopoulosL.V.Hedges (2004). How large are teacher effects?Educational Evaluation and Policy Analysis, 26, 237-257. doi:10.3102/01623737026003237
60. D.A.PastorK.E.BarronB.J.MillerS.L.Davis (2007). A latent profile analysis of college students’ achievement goal orientation. Contemporary Educational Psychology, 32, 8-47. doi:10.1016/j.cedpsych.2006.10.003
61. H.Patrick (2004). Re-examining classroom mastery goal structure. In P.R.PintrichM.L.Maehr (Eds.), Advances in motivation: Vol. 13. Motivating students, improving schools: The legacy of Carol Midgley (pp. 233-263). Amsterdam, The Netherlands: Elsevier.
62. H.PatrickA.M.RyanA.Kaplan (2007). Early adolescents’ perceptions of the classroom social environment, motivational beliefs, and engagement. Journal of Educational Psychology, 99, 83-98. doi:10.1037/0022-0663.99.1.83
63. R.C.PiantaJ.P.Allen (2009). Building capacity for positive youth development in secondary school classrooms: Changing teachers’ interactions with students. In M.Shinn (Ed.), Toward positive youth development: Transforming schools and community programs (pp. 21-39). New York, NY: Oxford University Press.
64. P.R.Pintrich (2003). A motivational science perspective on the role of student motivation in learning and teaching contexts. Journal of Educational Psychology, 95, 667-686. doi:10.1037/0022-0663.95.4.667
65. S.Rabe-HeskethA.Skrondal (2008). Multilevel and longitudinal modeling using Stata. Austin, TX: Stata Press.
66. L.M.RaphaelM.PressleyL.Mohan (2008). Engaging instruction in middle school classrooms: An observational study of nine teachers. The Elementary School Journal, 109, 61-81. doi:10.1086/592367
67. J.E.Rockoff (2004). The impact of individual teachers on student achievement: Evidence from panel data. American Economic Review, 94, 247-252. doi:10.1257/0002828041302244
68. J.E.RockoffB.B.Lockwood (2010). Stuck in the middle: Impacts of grade configuration in public schools. Journal of Public Economics, 94, 1051-1061. doi:10.1016/j.jpubeco.2010.06.017
69. R.W.RoeserJ.S.EcclesA.J.Sameroff (1998). Academic and emotional functioning in early adolescence: Longitudinal relations, patterns, and prediction by experience in middle school. Development and Psychopathology, 10, 321-352. doi:10.1017/S0954579498001631
70. R.W.RoeserC.MidgleyT.C.Urdan (1996). Perceptions of the school psychological environment and early adolescents’ psychological and behavioral functioning in school: The mediating role of goals and belonging. Journal of Educational Psychology, 88, 408-422. doi:10.1037//0022-0663.88.3.408
71. H.RoseJ.R.Betts (2004). The effect of high school courses on earnings. The Review of Economics and Statistics, 86, 497-513. doi:10.1162/003465304323031076
72. J.Rothstein (2010). Teacher quality in educational production: Tracking, decay, and student achievement. The Quarterly Journal of Economics, 125, 175-214. doi:10.1162/qjec.2010.125.1.175
73. A.M.RyanH.Patrick (2001). The classroom social environment and changes in adolescent motivation and engagement during middle school. American Educational Research Journal, 38, 437-460. doi:10.3102/00028312038002437
74. A.E.SchwartzL.StiefelR.RubensteinJ.Zabel (2011). The path not taken: How does school organization affect eighth-grade achievement?Educational Evaluation and Policy Analysis, 33, 293-317. doi:10.3102/0162373711407062
75. C.SenkoC.S.HullemanJ.M.Harackiewicz (2011). Achievement goal theory at the crossroads: Old controversies, current challenges, and new directions. Educational Psychologist, 46, 26-47. doi:10.1080/00461520.2012.538646
76. S.S.ShimA.M.RyanC.J.Anderson (2008). Achievement goals and achievement during early adolescence: Examining time-varying predictor and outcome variables in growth-curve analysis. Journal of Educational Psychology, 100(3), 655-671. doi: 10.1037/0022-0663.100.3.65
77. R.G.SimmonsD.A.Blyth (1987). Moving into adolescence. Hawthorne, NY: de Gruyter.
78. C.C.WeissL.Kipnes (2006). Reexamining middle school effects: A comparison of middle grades students in middle schools and K-8 schools. American Journal of Education, 112, 239-272. doi:10.1086/498996
79. C.A.Wolters (2004). Advancing achievement goal theory: Using goal structures and goal orientations to predict students’ motivation, cognition, and achievement. Journal of Educational Psychology, 96, 236-250. doi:10.1037/0022-0663.96.2.236
80. P.Youngs (2013). Using teacher evaluation reform and professional development to support common core assessments. Washington, DC: Center for American Progress.