Principal turnover: Are there different types of principals who move from or leave their schools? A latent class analysis of the 2007–2008 schools and staffing survey and the 2008–2009 principal follow-up survey

Leadership and Policy in Schools

Volumn 15, Issue 3, 2016, Pages 237-272

  Boyce, Jared ^a   Bowers, Alex J ^a  

^a Columbia University ^*  (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84958534416     PISSN: 15700763     EISSN: 17445043     Source Type: Journal    
DOI: 10.1080/15700763.2015.1047033     Document Type: Article

References (119)

1. M.Akiba,, & R.Reichardt, (2004). What predicts the mobility of elementary school leaders? An analysis of longitudinal data in Colorado. Education Policy Analysis Archives, 12(18), n18. doi:10.14507/epaa.v12n18.2004
2. S.E.Anderson, (2006). The school district’s role in educational change. International Journal of Educational Reform, 15(1), 13–37.
3. T.Asparouhov,, & B.Muthen, (2008). Multilevel mixture models. Advances in Latent Variable Mixture Models, 27–51.
4. T.Asparouhov,, & B.Muthén, (2013). Auxiliary variables in mixture modeling: 3-step approaches using Mplus. Mplus Web Notes, 15, 1–24.
5. T.Asparouhov,, & B.Muthén, (2014). Auxiliary variables in mixture modeling: Three-step approaches using Mplus. Structural Equation Modeling: A Multidisciplinary Journal, 21(3), 329–341. doi:10.1080/10705511.2014.915181
6. B.D.Baker,, E.Punswick,, & C.Belt, (2010). School leadership stability, principal moves, and departures: Evidence from Missouri. Educational Administration Quarterly, 46(4), 523–557. doi:10.1177/0013161X10383832
7. D.Battle,, & K.Gruber, (2010). Principal attrition and mobility: Results from the 2008–09 principal follow-up survey (NCES 2010-337). National Center for Education Statistics, Institute of Education Sciences, U.S. Department of Education. Washington, DC: US Government Printing Office.
8. D.J.Bauer,, & P.J.Curran, (2003). Distributional assumptions of growth mixture models: Implications for overextraction of latent trajectory classes. Psychological Methods, 8(3), 338–363. doi:10.1037/1082-989X.8.3.338
9. D.A.Berrong, (2012). The relationship between principal turnover and student achievement in reading/English language arts and math grades six through eight. Lynchburg, VA: Liberty University.
10. T.Béteille,, D.Kalogrides,, & S.Loeb, (2012). Stepping stones: Principal career paths and school outcomes. Social Science Research, 41(4), 904–919. doi:10.1016/j.ssresearch.2012.03.003
11. A.J.Bowers, (2010). Toward addressing the issues of site selection in district effectiveness research: A two-level hierarchical linear growth model. Educational Administration Quarterly, 46(3), 395–425.
12. A.J.Bowers, (2015). Site selection in school district research: A measure of effectiveness using hierarchical longitudinal growth models of performance. School Leadership & Management, 35(1), 39–61.
13. A.J.Bowers,, M.Blitz,, M.Modeste,, J.Salisbury,, & R.Halverson, (in press). How leaders agree with teachers in schools on measures of leadership practice: A two-level latent class analysis of the comprehensive assessment of leadership for learning. Teachers College Record.
14. A.J.Bowers,, & R.Sprott, (2012). Why tenth graders fail to finish high school: A dropout typology latent class analysis. The Journal of Education for Students Placed at Risk, 17(3), 129–148. doi:10.1080/10824669.2012.692071
15. A.Bowers,, & B.White, (2014). Do principal preparation and teacher qualifications influence different types of school growth trajectories in Illinois? A growth mixture model analysis. Journal of Educational Administration, 52(5), 705–736.
16. J.Boyce, & A.J.Bowers, (2013). Examining the evolving research on instructional leadership from 25 years of the Schools and Staffing Survey (SASS). A paper presented at the annual convention of the University Council for Educational Administration (UCEA), Indianapolis, IA: November 2013.
17. G.F.Branch,, E.A.Hanushek,, & S.G.Rivkin, (2012). Estimating the effect of leaders on public sector productivity: The case of school principals (No. w17803). Cambridge, MA: National Bureau of Economic Research.
18. D.Clark,, P.Martorell,, & J.Rockoff, (2009). School principals and school performance. Working Paper 38. Washington, DC: National Center for Analysis of Longitudinal Data in Education Research.
19. C.Claycomb,, & W.D.Hawley, (2000). Recruiting and retaining effective teachers for urban schools: Developing a strategic plan for action. Washington, DC: National Partnership for Excellence and Accountability in Teaching.
20. C.Clotfelter,, H.F.Ladd,, J.Vigdor,, & J.Wheeler, (2006). High poverty schools and the distribution of teachers and principals. Sanford Working Paper Series. SAN06-08. Sanford School of Public Policy Durham, NC.
21. M.Coelli,, & D.A.Green, (2012). Leadership effects: School principals and student outcomes. Economics of Education Review, 31(1), 92–109. doi:10.1016/j.econedurev.2011.09.001
22. J.Cohen, (1977). Statistical power analysis for the behavioral sciences (revised ed.). Lawrence Erlbaum Associates.
23. J.Cohen, (2013). Statistical power analysis for the behavioral sciences. New York, NY: Routledge Academic.
24. B.E.Cox,, K.McIntosh,, R.D.Reason,, & P.T.Terenzini, (2014). Working with missing data in higher education research: A primer and real-world example. The Review of Higher Education, 37(3), 377–402. doi:10.1353/rhe.2014.0026
25. J.B.Cullen,, & M.J.Mazzeo, (2008). Implicit performance awards: An empirical analysis of the labor market for public school administrators. San Diego, CA: University of California.
26. S.H.Davis, (1998). Superintendents’ perspectives on the involuntary departure of public school principals: The most frequent reasons why principals lose their jobs. Educational Administration Quarterly, 34(1), 58–90. doi:10.1177/0013161X98034001005
27. K.J.DeAngelis,, & B.R.White, (2011). Principal turnover in Illinois public schools, 2001–2008. Policy Research: IERC 2011-1. Edwardsville, IL: Illinois Education Research Council.
28. N.Denson,, & M.Ing, (2014). Latent class analysis in higher education: An illustrative example of pluralistic orientation. Research in Higher Education, 1–19.
29. M.DiPaola,, & M.Tschannen-Moran, (2003). The principalship at a crossroads: A study of the conditions and concerns of principals. NASSP Bulletin, 87(634), 43–65. doi:10.1177/019263650308763404
30. J.J.Dziak,, S.T.Lanza,, & X.Tan, (2014). Effect size, statistical power, and sample size requirements for the bootstrap likelihood ratio test in latent class analysis. Structural Equation Modeling: A Multidisciplinary Journal, 21(4), 534–552. doi:10.1080/10705511.2014.919819
31. D.E.Evans, (2010). Understanding why principals leave or stay in challenging urban schools. Berkeley, CA: University of California Press.
32. J.Everitt, (2005). Control in the classroom and influence on school policies: Types of teacher autonomy and teacher attrition. Philadelphia, PA: American Sociological Association.
33. E.N.Farley-Ripple,, J.A.Raffel,, & J.C.Welch, (2012). Administrator career paths and decision processes. Journal of Educational Administration, 50(6), 788–816. doi:10.1108/09578231211264694
34. J.R.Fauske,, & R.T.Ogawa, (1987). Detachment, fear, and expectation: A faculty’s response to the impending succession of its principal. Educational Administration Quarterly, 23(2), 23–44. doi:10.1177/0013161X87023002004
35. E.Fuller,, M.Young,, & M.T.Orr, (2007). Career pathways of principals in Texas. In annual meeting of the American Educational Research Association, Chicago, IL.
36. E.J.Fuller,, & M.D.Young, (2009). Tenure and retention of newly hired principals in Texas. University Council for Educational Administration, Department of Educational Administration, University of Texas at Austin.
37. E.J.Fuller,, M.D.Young,, & B.Baker, (2007). The relationship between principal characteristics, principal turnover, teacher quality, and student achievement. In annual meeting of the American Educational Research Association. Chicago, IL.
38. S.M.Gates,, C.M.Guarino,, L.Santibañez,, & B.Ghosh-Dastidar, (2004). The careers of public school administrators. Santa Monica, CA: RAND Education.
39. S.M.Gates,, J.S.Ringel,, L.Santibañez,, K.E.Ross,, & C.H.Chung, (2003). Who is leading our schools? An overview of school administrators and their careers. Santa Monica, CA: RAND Education.
40. R.Goldring,, S.Taie,, & C.Owens, (2014). Principal attrition and mobility: Results from the 2012–13 principal follow-up survey. First Look. NCES 2014-064. Washington, D.C.: National Center for Education Statistics.
41. J.W.Graham,, P.E.Cumsille,, & E.Elek‐Fisk, (2003). Methods for handling missing data. In Research Methods in Psychology, ed. JA Schinka, WF Velicer, pp. 87–114. Volume 2 of Handbook of Psychology, ed. IB Weiner. New York, NY: Wiley.
42. J.Griffith, (1999). The school leadership/school climate relation: Identification of school configurations associated with change in principals. Educational Administration Quarterly, 35(2), 267–291. doi:10.1177/00131619921968545
43. A.W.Hart, (1990). The social and organizational influence of principals: Evaluating principals in context. Peabody Journal of Education, 68(1), 37–57. doi:10.1080/01619569209538710
44. R.H.Heck,, & P.Hallinger, (2009). Assessing the contribution of distributed leadership to school improvement and growth in math achievement. American Educational Research Journal, 46(3), 659–689. doi:10.3102/0002831209340042
45. R.H.Heck,, & P.Hallinger, (2014). Modeling the longitudinal effects of school leadership on teaching and learning. Journal of Educational Administration, 52(5), 653–681. doi:10.1108/JEA-08-2013-0097
46. M.I.Honig, (2012). District central office leadership as teaching: How central office administrators support principals’ development as instructional leaders. Educational Administration Quarterly, 48(4), 733–774. doi:10.1177/0013161x12443258
47. E.Horng,, D.Kalogrides,, & S.Loeb, (2009). Principal preferences and the unequal distribution of principals across schools. Working Paper 36. National Center for Analysis of Longitudinal Data in Education Research.
48. A.Howley,, & E.D.Pendarvis, (2002). Recruiting and retaining rural school administrators. Las Cruce, NM: ERIC Clearinghouse on Rural Education and Small Schools, AEL.
49. D.Jackson,, I.R.White,, D.Mason,, & S.Sutton, (2014). A general method for handling missing binary outcome data in randomized controlled trials. Addiction, 109(12), 1986–1993. doi:10.1111/add.2014.109.issue-12
50. L.A.Johnson, (2005). Why principals quit: There are many reasons why principals voluntarily leave the positions they worked so hard to earn. Principal, 84(3), 21–23.
51. J.C.Jones,, & C.F.Webber, (2001, April). Principal succession: A case study. Paper presented at the annual meeting of the American Educational Research Association, Seattle, WA.
52. T.Jung,, & K.A.S.Wickrama, (2008). An introduction to latent class growth analysis and growth mixture modeling. Social and Personality Psychology Compass, 2(1), 302–317. doi:10.1111/j.1751-9004.2007.00054.x
53. W.Kearney,, A.Valdez,, & L.Garcia, (2012). Leadership for the long haul: The impact of administrator longevity on student achievement. School Leadership Review, 7(2), 24–33.
54. C.Kelley,, R.Halverson,, E.Camburn,, M.Blitz,, J.Salisbury,, S.Dikkers,, & M.Clifford, (2012, April). The design and validation of the Comprehensive Assessment of Leadership for Learning (CALL) formative school leader assessment. In American Education Research Association Conference, Vancouver, British Columbia (pp. 13–17).
55. S.T.Lanza,, X.Tan,, & B.C.Bray, (2013). Latent class analysis with distal outcomes: A flexible model-based approach. Structural Equation Modeling: A Multidisciplinary Journal, 20(1), 1–26. doi:10.1080/10705511.2013.742377
56. K.Leithwood,, A.Harris,, & D.Hopkins, (2008). Seven strong claims about successful school leadership. School Leadership & Management, 28(1), 27–42. doi:10.1080/13632430701800060
57. K.Leithwood,, & D.Jantzi, (2008). Linking leadership to student learning: The contributions of leader efficacy. Educational Administration Quarterly, 44(4), 496–528.
58. R.J.A.Little,, & D.B.Rubin, (1987). Statistical analysis with missing data. New York, NY: Wiley.
59. Y.Lo, (2005). Likelihood ratio tests of the number of components in a normal mixture with unequal variances. Statistics & Probability Letters, 71(3), 225–235. doi:10.1016/j.spl.2004.11.007
60. Y.Lo,, N.R.Mendell,, & D.B.Rubin, (2001). Testing the number of components in a normal mixture. Biometrika, 88(3), 767–778. doi:10.1093/biomet/88.3.767
61. S.Loeb,, D.Kalogrides,, & E.L.Horng, (2010). Principal preferences and the uneven distribution of principals across schools. Educational Evaluation and Policy Analysis, 32(2), 205–229. doi:10.3102/0162373710369833
62. S.Lovely, (2004). The art of retention. Leadership, 33(3), 16–18.
63. P.A.Luebke, (2013). High school principals who stay: Stability in a time of change. Milwaukee, WI: University of Wisconsin.
64. R.Macmillan,, M.Meyer,, & S.Northfield, (2005). Principal succession and the continuum of trust in schools. In H. Armstrong (Ed.), Examining the Practice of School Administrators in Canada (pp. 85–102). Calgary, AB: Detselig Enterprises Ltd.
65. J.Magidson,, & J.K.Vermunt, (2004). Latent class models. In D. Kaplan (Ed.), The Sage Handbook of Quantitative Methodology for the Social Sciences (pp. 175–198). Thousand Oaks, CA: Sage.
66. B.Mascall,, & K.Leithwood, (2010). Investing in leadership: The district’s role in managing principal turnover. Leadership and Policy in Schools, 9(4), 367–383. doi:10.1080/15700763.2010.493633
67. K.Masyn, (2003). Discrete-time survival mixture analysis for single and recurrent events using latent variables. Los Angeles, CA: University of California.bk_AQCmts51b
68. K.Masyn, (2013). Latent class analysis and finite mixture modeling. In T. Little (Ed.), The Oxford Handbook of Quantitative Methods in Psychology (pp. 551–611). Oxford, UK: Oxford University Press.
69. D.Matthews, (2002). Why Principals Fail and What We Can Learn From It. Principal, 82(1), 38–40.
70. A.Miller, (2009). Principal turnover, student achievement and teacher retention. Princeton, NJ: Princeton University Press.
71. A.Miller, (2013). Principal turnover and student achievement. Economics of Education Review, 36, 60–72. doi:10.1016/j.econedurev.2013.05.004
72. L.D.Mitgang, (2003). Beyond the pipeline: Getting the principals we need, where they are needed most. Policy Brief. New York, NY: Wallace Foundation.
73. B.Muthén, (2002). Beyond SEM: General latent variable modeling. Behaviormetrika, 29(1), 81–117. doi:10.2333/bhmk.29.81
74. B.Muthén, (2004). Latent variable analysis. The Sage handbook of quantitative methodology for the social sciences. Thousand Oaks, CA: Sage Publications (pp. 345–368).
75. B.Muthen,, & T.Asparouhov, (2006). Item response mixture modeling: Application to tobacco dependence criteria. Addictive Behaviors, 31(6), 1050–1066. doi:10.1016/j.addbeh.2006.03.026
76. B.Muthén,, & T.Asparouhov, (2002). Latent variable analysis with categorical outcomes: Multiple-group and growth modeling in Mplus. Mplus Web Notes, 4(5), 1–22.
77. L.Muthén,, & B.Muthén, (1998-2012). Mplus user’s guide (7th ed.). Los Angeles, CA: Muthén & Muthén.
78. L.Muthén,, & B.Muthén, (2013). Version 7.1 Mplus language addendum. Retrieved from: http://www.statmodel.com/download/Version7.1xLanguage.pdf
79. National Center of Education Statistics (NCES). (2008). Public School Principal Questionnaire, 2007-08. Retrieved from: http://nces.ed.gov/surveys/sass/pdf/0708/sass2a.pdf
80. National Center of Education Statistics (NCES). (2010). Documentation for the 2007–08 Schools and Staffing Survey. Retrieved from: http://nces.ed.gov/pubs2010/2010332.pdf
81. K.L.Nylund,, T.Asparouhov,, & B.O.Muthén, (2007). Deciding on the number of classes in latent class analysis and growth mixture modeling: A Monte Carlo simulation study. Structural Equation Modeling: A Multidisciplinary Journal, 14(4), 535–569. doi:10.1080/10705510701575396
82. K.Nylund-Gibson,, R.Grimm,, M.Quirk,, & M.Furlong, (2014). A latent transition mixture model using the three-step specification. Structural Equation Modeling: A Multidisciplinary Journal, 21(3), 439–454. doi:10.1080/10705511.2014.915375
83. K.Nylund-Gibson,, & K.Masyn, (2011, April). Including auxiliary variables in latent class analysis. Paper presented at the annual meeting of the Western Psychological Association, Los Angeles, CA.
84. R.T.Ogawa, (1991). Enchantment, disenchantment, and accommodation: How a faculty made sense of the succession of its principal. Educational Administration Quarterly, 27(1), 30–60. doi:10.1177/0013161X91027001003
85. F.Papa,, Jr (2007). Why do principals change schools? A multivariate analysis of principal retention. Leadership and Policy in Schools, 6(3), 267–290. doi:10.1080/15700760701263725
86. F.C.Papa,, Jr., H.Lankford,, & J.Wyckoff, (2002). The attributes and career paths of principals: Implications for improving policy. Albany, NY: Teacher Policy Research Center.
87. M.C.Partlow, (2007). Contextual factors related to elementary principal turnover. Planning and Changing, 38, 60–76.
88. M.C.Partlow,, & C.S.Ridenour, (2008). Frequency of principal turnover in Ohio’s elementary schools. Mid-Western Educational Researcher, 21(2), 15.
89. M.L.Plecki,, A.M.Elfers,, H.Loeb,, A.Zahir,, & M.S.Knapp, (2005). Teacher retention and mobility: A look inside and across districts and schools in Washington State. Center for the Study of Teaching and Policy.
90. N.P.Podsakoff,, J.A.LePine,, & M.A.LePine, (2007). Differential challenge stressor-hindrance stressor relationships with job attitudes, turnover intentions, turnover, and withdrawal behavior: A meta-analysis. Journal of Applied Psychology, 92(2), 438–454. doi:10.1037/0021-9010.92.2.438
91. A.C.Porter,, M.S.Polikoff,, E.Goldring,, J.Murphy,, S.N.Elliott,, & H.May, (2010). Developing a psychometrically sound assessment of school leadership: The VAL-ED as a case study. Educational Administration Quarterly, 46(2), 135–173. doi:10.1177/1094670510361747
92. V.M.Robinson,, C.A.Lloyd,, & K.J.Rowe, (2008). The impact of leadership on student outcomes: An analysis of the differential effects of leadership types. Educational Administration Quarterly, 44, 635–674. doi:10.1177/0013161X08321509
93. M.Ronfeldt,, S.Loeb,, & J.Wyckoff, (2013). How teacher turnover harms student achievement. American Educational Research Journal, 50(1), 4–36. doi:10.3102/0002831212463813
94. T.G.Ryan,, & M.Gallo, (2011). A descriptive examination and synthesis of leadership succession. International Journal of Educational Reform, 20(2), 132–152.
95. K.Samuelsen,, & K.Raczynski, (2013). Latent class/profile analysis. In Applied Quantitative Analysis in Education and the Social Sciences (pp. 304–328) New York, NY: Routledge.
96. School Leaders Network. (2014). Churn: The high cost of principal turnover. Hinsdale, MA: School Leaders Network.
97. K.Seashore Louis,, B.Dretzke,, & K.Wahlstrom, (2010). How does leadership affect student achievement? Results from a national US survey. School Effectiveness and School Improvement, 21(3), 315–336. doi:10.1080/09243453.2010.486586
98. K.Seashore Louis,, K.Leithwood,, K.Wahlstrom,, & S.E.Anderson, (2010). Learning from leadership: Investigating the links to improved student learning. St. Paul, MN: The Center for Applied Research and Educational Improvement, University of Minnesota.
99. R.Sheppard, (2010). Determining factors that influence high school principal turnover over a five year period. Denton, TX: University of North Texas.
100. R.P.Steel,, & N.K.Ovalle, (1984). A review and meta-analysis of research on the relationship between behavioral intentions and employee turnover. Journal of Applied Psychology, 69(4), 673–686. doi:10.1037/0021-9010.69.4.673
101. J.A.Sterne,, I.R.White,, J.B.Carlin,, M.Spratt,, P.Royston,, M.G.Kenward, … J.R.Carpenter, (2009). Multiple imputation for missing data in epidemiological and clinical research: Potential and pitfalls. British Medical Journal, 338, b2393. doi:10.1136/bmj.b2393
102. H.Stevenson, (2006). Moving towards, into and through principalship: developing a framework for researching the career trajectories of school leaders. Journal of Educational Administration, 44(4), 408–420.
103. H.Stevenson,, & A.Walker, (2006). Moving towards, into and through principalship: Developing a framework for researching the career trajectories of school leaders. Journal of Educational Administration, 44(4), 408–420. doi:10.1108/09578230610676604
104. S.R.Stoelinga,, H.Hart,, & D.Schalliol, (2008). The work of Chicago public schools’ principals: Leading in a complex context with high stakes. Chicago, IL: Consortium on Chicago School Research, University of Chicago Urban Education Institute.
105. E.M.Stotko,, R.Ingram,, & M.E.Beaty-O’Ferrall, (2007). Promising strategies for attracting and retaining successful urban teachers. Urban Education, 42(1), 30–51. doi:10.1177/0042085906293927
106. A.A.Tekleselassie,, & P.Villarreal,, III (2011). Career mobility and departure intentions among school principals in the United States: Incentives and disincentives. Leadership and Policy in Schools, 10(3), 251–293. doi:10.1080/15700763.2011.585536
107. A.Thapa,, J.Cohen,, S.Guffey,, & A.Higgins-D’Alessandro, (2013). A review of school climate research. Review of Educational Research, 83(3), 357–385. doi:10.3102/0034654313483907
108. D.Tofighi,, & C.K.Enders, (2008). Identifying the correct number of classes in growth mixture models. In Advances in Latent Variable Mixture Models (pp. 317–341). Charlotte, NC: Information Age Publishing.
109. T.Trujillo, (2013). The reincarnation of the effective schools research: rethinking the literature on district effectiveness. Journal of Educational Administration, 51(4), 426–452. doi:10.1108/09578231311325640
110. T.Trujillo,, & A.J.Daly, (2013). The reincarnation of the effective schools research: Rethinking the literature on district effectiveness. Journal of Educational Administration, 51(4), 426–452. doi:10.1108/09578231311325640
111. A.M.Urick, (2012). To what extent do typologies of school leaders across the US predict teacher attrition? A multilevel latent class analysis of principals and teachers. San Antonio, TX: University of Texas.
112. A.Urick,, & A.J.Bowers, (2011). What influences principals' perceptions of academic climate? A nationally representative study of the direct effects of perception on climate. Leadership and Policy in Schools, 10(3), 322–348.
113. A.Urick,, & A.J.Bowers, (2014a). How does principal perception of academic climate measure up? The impact of principal perceptions on student academic climate and achievement in high school. Journal of School Leadership, 24(2), 386–414.
114. A.Urick,, & A.J.Bowers, (2014b, April). How teacher and principal perceptions influence instructional leadership internationally: A multilevel factor analysis of TALIS 2008. A paper presented at the annual meeting of the American Educational Research Association, Philadelphia, PA.
115. A.Urick,, & A.J.Bowers, (2014c). What are the different types of principals across the United States? A latent class analysis of principal perception of leadership. Educational Administration Quarterly, 50(1), 96–134.
116. J.E.Vanderhaar,, M.A.Muñoz,, & R.J.Rodosky, (2006). Leadership as accountability for learning: The effects of school poverty, teacher experience, previous achievement, and principal preparation programs on student achievement. Journal of Personnel Evaluation in Education, 19(1–2), 17–33. doi:10.1007/s11092-007-9033-8
117. J.K.Vermunt, (2010). Latent class modeling with covariates: Two improved three-step approaches. Political Analysis, 18(4), 450–469. doi:10.1093/pan/mpq025
118. M.Weinstein,, R.Jacobowitz,, T.Ely,, K.Landon,, & A.E.Schwartz, (2009). New schools, new leaders: A study of principal turnover and academic achievement at new high schools in New York City. New York, NY: The Institute for Education and Social Policy, New York University.
119. A.M.Wood,, I.R.White,, & S.G.Thompson, (2004). Are missing outcome data adequately handled? A review of published randomized controlled trials in major medical journals. Clinical Trials, 1(4), 368–376. doi:10.1191/1740774504cn032oa