Evaluating the outcomes of plans: Theory, practice, and methodology

Environment and Planning B: Planning and Design

Volumn 37, Issue 4, 2010, Pages 740-757

  Laurian, Lucie ^a   Crawford, Jan ^b   Day, Maxine ^c   Kouwenhoven, Peter ^d   Mason, Greg ^e   Ericksen, Neil ^d   Beattie, Lee ^f  

^a UNIVERSITY OF IOWA   (United States)

^b Planning Consultants Ltd   (New Zealand)

^c The University of Waikato ^*  (New Zealand)

^d UNIVERSITY OF WAIKATO   (New Zealand)

^e Inform Planning Ltd   (New Zealand)

^f UNIVERSITY OF AUCKLAND   (New Zealand)

Author keywords

[No Author keywords available]

Indexed keywords

ENVIRONMENTAL PLANNING; LAND USE PLANNING; PLANNING METHOD; PLANNING PRACTICE;

NEW ZEALAND;

EID: 77954945217     PISSN: 02658135     EISSN: 14723417     Source Type: Journal    
DOI: 10.1068/b35051     Document Type: Article

References (67)

1. Alexander ER (Ed.), 2006 Evaluation in Planning: Evolution and Prospects (Ashgate, Aldershot, Hants)
2. Alexander ER, Faludi A, 1989, Planning and plan implementation: notes on evaluation criteria Environment and Planning B: Planning and Design 16 127-140
3. Alterman R, Hill M, 1978, Implementation of urban land use plans Journal of the American Institute of Planners 44 274 -285
4. Baehler K, 2003, Evaluation and the policy cycle, in Evaluating Policy and Practice: A New Zealand Reader Eds N Lunt, C Davidson, K McKegg (Pearson Prentice Hall, Auckland) Section 1.4
5. Baer W, 1997, General plan evaluation criteria: an approach to making better plans Journal of the American Planning Association 63 329-344
6. Baum H, 2001, How should we evaluate community initiatives? Journal of the American Planning Association 67 147 -158
7. Beattie L, To appear The Reality of Land Use Planning PhD thesis, School of Architecture and Planning, University of Auckland
8. Berke P, Manta M, 2001, Are we planning for sustainable development? An evaluation of 30 comprehensive plans Journal of The American Planning Association 66 21 - 34
9. Berke P, Crawford J, Dixon J, Ericksen N, 1999, Do cooperative environmental planning mandates produce good plans? Empirical results from the New Zealand experience Environment and Planning B: Planning and Design 26 643 - 664
10. Berke P, Backhurst M, Laurian L, Day M, Crawford J, Ericksen N, Dixon J, 2006, What makes plan implementation successful? An evaluation of local plans and implementation practices in New Zealand Environment and Planning B: Planning and Design 33 581-600
11. Bickman L, 1989, Barriers to the use of program theory Evaluation Practice 12 387-390
12. Blalock A, 1999, Evaluation research and the performance management movement: from estrangement to useful integration? Evaluation 5 117-149
13. Calkins H W, 1979, The planning monitor: an accountability theory of plan evaluation Environment and Planning A 11 745 - 758
14. Carmona M, 2007, Monitoring outcome quality in planning: challenges and possibilities Town and Country Planning Tomorrow Series number 8
15. Carmona M, Sieh L, 2004 Measuring Quality in Planning: Managing the Performance Process (Spon, London)
16. Carmona M, Sieh L, 2005, Performance measurement innovation in English planning authorities Planning Theory and Practice 6 303 - 333
17. Carmona M, Sieh L, 2008, Performance measurement in planning-towards a holistic view Environment and Planning C: Government and Policy 26 428 - 454
18. Chehmsky E, Shadish WR (Eds), 1997 Evaluation for the 21st Century: A Handbook (Sage, Thousand Oaks, CA)
19. Chen H, 1990 Theory-driven Evaluations (Sage, Newbury Park, CA)
20. Chen H, Rossi P, 1989, Issues of the theory-driven perspective Evaluation and Program Planning 12 299-306
21. Davidson C, 2003, The mix of methods: common research techniques used in evaluation, in Evaluating Policy and Practice: A New Zealand Reader Eds N Lunt, C Davidson, K McKegg (Pearson, Prentice Hall, Auckland) Section 3.2
22. Davidson J E, 2000, Ascertaining causality in theory-based evaluation, in Program Theory Evaluation: Challenges and Opportunities New Directions in Evaluation series, Eds P J Rogers, A J Petrosino, T Hacsi, T A Huebner (Jossey-Bass, San Francisco, CA) chapter 2
23. Day M, Crawford J, Kouwenhoven P, Laurian L, Mason G, Ericksen N, 2008, Achieving anticipated environmental outcomes: how effective is the District Plan? Report on a methodological pilot on the evaluation of plan outcomes with regard to water quality in Papakura District, PUCM RMA Report number 3, http://www.waikato.ac.nz/igci/pucm/ Publications-Phase3.htm
24. Doctors S, Wokutch R, 1980, Social program evaluation: six models, in Values, Ethics and Standards in Evaluation number 7, Eds R Perloff, E Perloff (Jossey-Bass, San Francisco, CA) pp 27-38
25. Duignan P, 2003, Approaches and terminology in programme and policy evaluation, in Evaluating Policy and Practice: A New Zealand Reader Eds N Lunt, C Davidson, K McKegg (Pearson, Prentice Hall, Auckland) Section 3.1
26. Ericksen N, Berke P, Crawford J, Dixon J, 2004 Plan-making for Sustainability: The New Zealand Experience (Ashgate, Aldershot, Hants)
27. Guba EG, Lincoln YS, 1989 Fourth Generation Evaluation (Sage, Newbury Park, CA)
28. Hendricks M, 1996, Performance monitoring: how to measure effectively the results of our efforts, paper presented at the American Evaluation Association Annual Conference, Atlanta, 6 November, http://www.eval.org/
29. Hoch C J, 2002, Evaluating plans pragmatically Planning Theory 1 53 - 75
30. Hockings M, Holton S, Dudley N, 2000 Evaluating Effectiveness: A Framework for Assessing the Management of Protected Areas Adrian Phillips Series (IUCN, Gland)
31. Hopkins L, 1974, Plan, projection, policy-mathematical programming and planning theory Environment and Planning A 6 419 - 430
32. Hopkins L, 1979, Quadratic versus linear models for land-use plan design Environment and Planning A 11 291 -298
33. Houghton M, 1997, Performance indicators in town planning: much ado about nothing? Local Government Studies 23(2)1-13
34. Kaiser E J, Godschalk DR, Chapin F S, 1995 Urban Land Use Planning 4th edition (University of Illinois Press, Urbana, IL)
35. Knaap G, Hopkins L, Donaghy K, 1998, Do plans matter? A framework for examining the logic and effects of land use planning Journal of Planning Education and Research 18 25 - 34
36. Kouwenhoven P, van der Werff ten Bosch J, 2004, RAP: the methodology and case study, in Proceedings of the 6th International Conference on Hydroinformatics Eds S-Y Liong, K-K Phoon, V Babovic (World Scientific Publishing, Hackensack, NJ) pp 1163 - 1170
37. Laurian L, Day M, Backhurst M, Berke P, Ericksen N, Crawford J, Dixon J, Chapman S, 2004a, What drives plan implementation? Plans, planning agencies and developers Journal of Environmental Planning and Management 47 555 - 577
38. Laurian L, Day M, Berke P, Ericksen N, Backhurst M, Crawford J, Dixon J, 2004b, Evaluating plan implementation: a conformance-based methodology Journal of the American Planning Association 70 471 -480
39. Lichfield N, 1996 Community Impact Evaluation (UCL Press, London)
40. Lipsey MW, Crosse S, Dunkle D, Pollard J, Stobart G, 1985, Evaluation: the state of the art and the sorry state of the science, in Utilizing Prior Research in Evaluation Planning: New Directions for Program Evaluation number 27, Ed. D S Cordray (Jossey-Bass, San Francisco, CA) pp 7 - 28
41. Lunt N, Davidson C, Mc Kegg K (Eds), 2003 Evaluating Policy and Practice: A New Zealand Reader (Pearson Prentice Hall, Auckland)
42. McCoy M, Hargie OD, 2001, Evaluating evaluation: implications for assessing quality International Journal of Health Care Quality Assurance 14 317 - 327
43. Mason G, 2008 Evaluating the Effectiveness of Conformance-based Plans: Attributing Built Heritage Outcomes to Plan Implementation Under New Zealand's Resource Management Act PhD thesis, University of Waikato, http://adt.waikato.ac.nz/public/adt-uow20080313.124057/index.html
44. Mastop H, Faludi A, 1997, Evaluation of strategic plans: the performance principle Environment and Planning B: Planning and Design 24 815 - 832
45. Mayne J, 2001, Addressing attribution through contribution analysis: using performance measures sensibly Canadian Journal of Program Evaluation 16 1 - 24
46. Morrison N, Pearce B, 2000, Developing indicators for evaluating the effectiveness of the UK land use planning system Town Planning Review 71 191 -211
47. Newcomer K, 1997, Using performance measurement to improve programs New Directions for Evaluation 75 5 -14
48. Patton M Q, 1989, A context and boundaries for a theory-driven approach to validity Evaluation and Program Planning 12 375 - 377
49. Patton M Q, 1997 Utilization-focused Evaluation 3rd edition (Sage, Beverly Hills, CA)
50. Pawson R, Tilley N, 1997 Realistic Evaluation (Sage, London)
51. Peled E, Spiro S, 1998, Goal-focused evaluation: lessons from a study of a shelter for homeless youth Evaluation 4 455-468
52. Pitkin S, 1992, Comprehensive plan format: a key to impacting decisionmaking Environmental and Urban Issues 19(4) 8 -10
53. Rogers PJ, Petrosino AJ, Hacsi T, Huebner TA, 2000, Program theory evaluation: practice, promise and problems, in Program Theory Evaluation: Challenges and Opportunities New Directions in Evaluation series Eds P J Petrosino, A J Hacsi, T A Huebner (Jossey-Bass, San Francisco, CA) pp 5 -14
54. Rossi P, Freeman H E, 1989 Evaluation: A Systematic Approach (Sage, Newbury Park, CA)
55. Scriven M, 1967, The methodology of evaluation, in Perspectives of Curriculum Evaluation Eds R W Tyler, R M Gagne, M Scriven (Rand McNally, Chicago, IL) pp 39 - 83
56. Scriven M, 1996, Types of evaluation and types of evaluator American Journal of Evaluation 17 151-161
57. Seasons M, 2003, Monitoring and evaluation in municipal planning Journal of the American Planning Association 69 431-440
58. Shadish WR, Cook TD, Levitzin LC, 1991 Foundations of Program Evaluation: Theories and Practice (Sage, Newbury Park, CA)
59. Snyder BL, Coglianese C, 2005, Measuring progress: program evaluation of environmental policies Environment 47(2) 22 - 39
60. Talen E, 1996, After the plans: methods to evaluate implementation success of plans Journal of Planning Education and Research 16 79-91
61. Talen E, Anselin L, 1998, Assessing spatial equity: an evaluation of measures of accessibility to public playgrounds Environment and Planning A 30 595 - 613
62. Tyler RW, 1942, General statement on evaluation Journal of Educational Research 35 492 - 501
63. Vedung E, 1997 Public Policy and Program Evaluation (Transaction Publishers, New Brunswick, NJ)
64. Verschuren P, Zsolnai L, 1998, Norms, goals, and stakeholders in program evaluation Human Systems Management 17 155 - 162
65. Weiss C, 1972 Evaluation Research: Methods of Assessing Program Effectiveness (John Hopkins University Press, Baltimore, MD)
66. Weiss C, 1997, How can theory-based evaluation make greater headway? Evaluation Review 21 501-524
67. Weiss C, 1998 Evaluation: Methods for Studying Programs and Policies 2nd edition (Prentice-Hall, Englewood Cliffs, NJ)