Level models of continuing professional development evaluation: A grounded review and critique

Professional Development in Education

Volumn 37, Issue 1, 2011, Pages 143-157

  Coldwell, Mike ^a   Simkins, Tim ^a  

^a SHEFFIELD HALLAM UNIVERSITY   (United Kingdom)

Author keywords

Evaluation; Evaluation theory; Level models; Professional development

Indexed keywords

EID: 78651068867     PISSN: 19415257     EISSN: 19415265     Source Type: Journal    
DOI: 10.1080/19415257.2010.495497     Document Type: Review

References (56)

1. Alkin, M., 2004. Evaluation roots: testing theorists' roots and influences. London: Sage.
2. Alkin, M. and Ellett, F., 1985. Evaluation models and their development. In: T. Husen and N. Postlethwaite, eds. International encyclopaedia of education: research and studies. Oxford: Pergamon, 1760-1766.
3. Alliger, G. and Janak, E., 1994. Kirkpatrick's levels of training criteria: thirty years later. In: C. Scheier, C. Russell, R. Beatty, and C. Baird, eds. The training and development sourcebook. Amherst, MA: HRD Press, 219-228.
4. Archer, M., 1995. Realist social theory: the morphogenetic approach. Cambridge: Cambridge University Press.
5. Bennett, J., 2003. Evaluation methods in research. London: Continuum.
6. Berger, P.L. and Luckmann, T., 1966. The social construction of reality: a treatise in the sociology of knowledge. Garden City, NY: Anchor Books.
7. Bhaskar, R.A., 1998. The possibility of naturalism. 3rd ed. London: Routledge.
8. Blamey, A. and Mackenzie, M., 2007. Theories of change and realistic evaluation: peas in a pod or apples and oranges. Evaluation, 13 (4), 439-455.
9. Campbell, D.T., 1976. Assessing the impact of planned social change. Occasional Paper Series 8. Hanover, NH: Dartmouth College Public Affairs Centre.
10. Carpenter, D.P., et al., 1989. Using knowledge of children's mathematics thinking in classroom teaching: an experimental study. American journal of educational research, 26 (4), 499-531.
11. Centre for Education and Inclusion Research, Sheffield Hallam University, 2008. Evaluation of the CEL/NCSL 14-19 Leadership and Management Development Programme, final report. Internal report. Nottingham: National College for School Leadership.
12. Cochran-Smith, M. and Lytle, S., 1999. Relationships of knowledge and practice: teacher learning in communities. Review of research in education, 24 (1), 249-306.
13. Connell, J. and Kubisch, A., 1998. Applying a theory of change approach to the evaluation of comprehensive community initiatives: progress, prospects and problems. In: K. Fulbright-Anderson, A. Kubisch, and J. Connell, eds. New approaches to evaluating community initiatives: Vol 2. Theory, measurement and analysis. Washington DC: Aspen Institute, 15-44.
14. Cook, T.D., et al., 2010. Contemporary thinking about causation in evaluation: a dialogue with Tom Cook and Michael Scriven. American journal of evaluation, 31 (1), 105-117.
15. Coote, A., Allen, J., and Woodhead, D., 2004. Finding out what works: building knowledge about complex community-based initiatives. London: King's Fund.
16. Cousins, J. and Earl, L., eds., 1995. Participatory evaluation in education: studies in evaluation use and organizational learning. London: Falmer.
17. Cronbach, L., 1982. Designing evaluations of educational and social programs. San Francisco, CA: Jossey-Bass.
18. Denzin, N.K., 2001. Interpretive interactionism. 2nd ed. London: Sage.
19. Easterby-Smith, M., 1994. Evaluation of management development, education, and training. London: Gower.
20. Edlenbos, J. and van Buuren, A., 2005. The learning evaluation: a theoretical and empirical exploration. Evaluation review, 29 (6), 591-612.
21. Eisner, E., 1985. The art of educational evaluation: a personal view. London: The Falmer Press.
22. Elliott, J. and Kushner, S., 2007. The need for a manifesto for educational programme evaluation. Cambridge journal of education, 37 (3), 321-336.
23. Fetterman, D., 1996. Empowerment evaluation: an introduction to theory and practice. In: D.M. Fetterman, S.J. Kaftarian, and A. Wandersman, eds. Empowerment evaluation: knowledge and tools for self-assessment and accountability. Thousand Oaks, CA: Sage, 3-48.
24. Fraser, C., et al., 2007. Teachers' continuing professional development: contested concepts, understandings and models. Journal of in-service education, 33 (2), 153-169.
25. Guba, Y. and Lincoln, E., 1989. Fourth generation evaluation. London: Sage.
26. Guskey, T., 2000. Evaluating professional development. Thousand Oaks, CA: Corwin Press.
27. Hansen, H.F., 2005. Choosing evaluation models: a discussion on evaluation design. Evaluation, 11 (4), 447-462.
28. Holton, E., 1996. The flawed four-level evaluation model. Human resource development quarterly, 7 (1), 5-22.
29. House, E.R., 1978. Assumptions underlying evaluation models. Educational researcher, 7 (3), 4-12.
30. House, E.R., 1991. Evaluation and social justice: Where are we? In: M.W. McLaughlin and D.C. Phillips, eds. Evaluation and education: at quarter century. Chicago, IL: University of Chicago Press, 233-247.
31. Kennedy, A., 2005. Models of continuing professional development: frameworks for analysis. Journal of in-service education, 31 (2), 235-250.
32. Kirkpatrick, D., 1996. Invited reaction: reaction to Holton article. Human resource development quarterly, 7 (1), 23-25.
33. Kirkpatrick, D., 1998. Evaluating training programmes: the four levels. 2nd ed. San Francisco, CA: Berrett-Koehler.
34. Leithwood, K. and Levin, B., 2005. Assessing school leadership and leadership programme effects on pupil learning. Nottingham: Department for Education and Skills.
35. Maxwell, B., Coldwell, M., and Simkins, T., 2009. Possibilities of partnerships as sites for learning: leadership development in English 14-19 Diploma consortia. Paper presented at the Annual Conference of the British Educational Research Association, September, Manchester, UK.
36. Merton, R., 1968. Social theory and social structure. New York: Free Press.
37. Parlett, M. and Hamilton, D., 1976. Evaluation as illumination: a new approach to the study of innovative programmes. Edinburgh: Centre for Research in the Educational Sciences, Occasional Paper No. 9.
38. Patton, M.Q., 1997. Utilization-focused evaluation. 2nd ed. Beverly Hills, CA: Sage.
39. Pawson, R. and Tilley, N., 1997. Realistic evaluation. London: Sage.
40. Rogers, P., Hacsi, T., Petrosino, A., and Huebner, T.A., eds., 2000. Program theory in evaluation: challenges and opportunities. San Francisco, CA: Jossey-Bass.
41. Scriven, M., 1973. Goal-free evaluation. In: E. House, ed. School evaluation: the politics and process. Berkeley, CA: McCutchan, 319-328.
42. Simkins, T., 2005. Leadership in education: 'what works' or 'what makes sense'? Educational management administration and leadership, 33 (1), 9-26.
43. Simkins, T., 2009. Integrating work-based learning into large-scale national leadership development programmes in the UK. Educational review, 61 (4), 391-405.
44. Simkins, T., et al., 2006. Coaching as an in-school leadership development strategy: experiences from Leading from the Middle. Journal of in-service education, 32 (3), 321-340.
45. Simkins, T., Coldwell, M., and Close, P., 2009. Outcomes of in-school leadership development work: a study of three NCSL programmes. Educational management administration and leadership, 37 (1), 29-50.
46. Stake, R., 1967. The countenance of educational evaluation. Teachers college record, 68 (7), 523-540.
47. Stake, R., 1986. Evaluating educational programmes. In: D. Hopkins, ed. Inservice training and educational development. London: Croom Helm, 240-254.
48. Stufflebeam, D.L., 1983. The CIPP model for programme evaluation. In: G. Madaus, M.S. Scriven, and D.L. Stufflebeam, eds. Evaluation models: viewpoints on educational and human services evaluation. Boston, MA: Kluwer-Nijhoff, 117-141.
49. Stufflebeam, D.L. and Shinkfield, A., 2007. Evaluation: theory, models and applications. San Francisco, CA: Jossey-Bass.
50. Stufflebeam, D.L. and Webster, W.J., 1980. An analysis of alternative approaches to evaluation. Educational evaluation and policy analysis, 2 (3), 5-19.
51. Sullivan, H. and Stewart, M., 2006. Who owns the theory of change? Evaluation, 12 (2), 179-199.
52. Torres, R.T. and Preskill, H., 2001. Evaluation and organizational learning: past, present and future. American journal of evaluation, 22 (3), 387-395.
53. Training and Development Agency for Schools, 2007. Impact evaluation of CPD. London: TDA.
54. Tyler, R.W., 1942. General statement on evaluation. Journal of educational research, 35 (7), 492-501.
55. Wayne, A.J., et al., 2008. Experimenting with teacher professional development. Educational researcher, 37 (8), 469-479.
56. Webster-Wright, A., 2009. Reframing professional development through understanding authentic professional learning. Review of educational research, 79 (2), 702-739.