Evaluation of community-based injury prevention programmes: methodological issues and challenges

International Journal of Injury Control and Safety Promotion

Volumn 12, Issue 3, 2005, Pages 143-156

  Nilsen, Per ^a  

^a LINKÖPING UNIVERSITY   (Sweden)

Author keywords

Community based programmes; Evaluation methodology; Study design; Validity

Indexed keywords

ACCIDENT PREVENTION; ARTICLE; CONSTRUCT VALIDITY; EVALUATION STUDY; EXTERNAL VALIDITY; HUMAN; INCIDENCE; INTERNAL VALIDITY; OUTCOME ASSESSMENT; PRACTICE GUIDELINE; QUALITATIVE ANALYSIS; QUANTITATIVE ANALYSIS; QUASI EXPERIMENTAL STUDY; SYSTEMATIC REVIEW; CONSUMER; HEALTH CARE PLANNING; HEALTH CARE QUALITY; HEALTH PROMOTION; INJURY; METHODOLOGY; REPRODUCIBILITY; SOCIAL MARKETING;

COMMUNITY HEALTH PLANNING; CONSUMER PARTICIPATION; HEALTH PROMOTION; HUMANS; PROGRAM EVALUATION; REPRODUCIBILITY OF RESULTS; SOCIAL MARKETING; WOUNDS AND INJURIES;

EID: 27944474587     PISSN: 17457300     EISSN: 17457319     Source Type: Journal    
DOI: 10.1080/17457300512331339175     Document Type: Article

References (93)

1. Ader, M, Berensson, K, Carlsson, P, Granath, M and Urwitz, V. 2001. Quality indicators for health promotion programmes. Health Promotion International, 16: pp. 187 – 195
2. BakerEA BrownsonCA 1999 Defining characteristics of community-based health promotion programs In Community-Based Prevention, R.C. Brownson, E.A. Baker and L.F. Novick (Eds), (Gaithersburg: Aspen Publications)
3. Beattie, TF, Currie, CE, Williams, JM and Wright, P. 1998. Measures of injury severity in childhood: a critical overview. Injury Prevention, 4: pp. 228 – 231
4. Benson, A. 1995. The evaluation of community based injury prevention activity: the UK perspective. Injury Prevention, 1: pp. 116 – 118
5. Bjerre, B and Jonell, A-C. 1998. The community safety approach in Falun, Sweden. What makes it work?. International Journal for Consumer and Product Safety, 5: pp. 139 – 153
6. Bjerre, B and Sandberg, B-M. 1998. The effects of a community-based injury prevention study in Falun, Sweden–Outpatient and hospital-based injury records. International Journal for Consumer and Product Safety, 5: pp. 129 – 138
7. Bjerre, B and Schelp, L. 2000. The community safety approach in Falun, Sweden–is it possible to characterize the most effective prevention endeavours and how long-lasting are the results?. Accident Analysis and Prevention, 32: pp. 461 – 470
8. BrachtN (Ed.) 1990 Introduction In Health Promotion at the Community Level, (Newbury Park: Sage Publications)
9. Cart Project Team. 1996. Developing methodologies for evaluating community-wide health promotion. Health Promotion International, 11: pp. 227 – 236
10. Charter Jr, WW and Jones, JE. 1973. On the risk of appraising non-events in program evaluation. Educational Researcher, 2: pp. 5 – 7
11. ChristoffelT GallagherSS 1999 Injury Prevention and Public Health (Gaithersburg: Aspen Publishers)
12. Coggan, C, Patterson, P, Brewin, M, Hooper, R and Robinson, E. 2000. Evaluation of the Waitakere Community Injury Prevention Project. Injury Prevention, 6: pp. 130 – 134
13. ConnellJP KubischAC 1998 Applying a theory of change approach to the evaluation of comprehensive community initiatives: progress, prospects, and problems In New Approaches to Evaluating Community Initiatives Volume 2. Theory, Measurement, and Analysis, K. Fulbright-Anderson, A.C. Kubisch and J.P. Connell (Eds), (Washington DC: The Aspen Institute)
14. Cryer, C, Langley, JD, Stephenson, SCR, Jarvis, SN and Edwards, P. 2002. Measure for measure: the quest for valid indicators of non-fatal injury incidence. Public Health, 116: pp. 257 – 262
15. Cummings, P and Koepsell, TD. 2002. Statistical and design issues in studies of groups. Injury Prevention, 8: pp. 6 – 7
16. Davidson, LL, Durkin, MS, Kuhn, L, O'Connor, P, Barlow, B and Heagarty, MC. 1994. The impact of the safe kids/healthy neighborhoods injury prevention program in Harlem, 1988 through 1991. American Journal of Public Health, 84: pp. 580 – 586
17. Day, LM, Ozanne-Smith, J, Cassell, E and Li, L. 2001. Evaluation of the Latrobe Valley Better Health Injury Prevention Program. Injury Prevention, 7: pp. 66 – 69
18. Des Jarlais, DC, Lyles, C, Crepaz, N and the TREND Group. 2004. Improving the reporting quality of nonrandomized evaluations of behavioral and public health interventions: The TREND Statement. American Journal of Public Health, 94: pp. 361 – 366
19. Dusenbury, L, Brannigan, R, Falco, M and Hansen, WB. 2003. A review of research on fidelity of implementation: implications for drug abuse prevention in school settings. Health Education Research, 18: pp. 237 – 256
20. EkmanR LindqvistK MenckelE SchelpL SvanströmL 1999 Evaluation of safety interventions In Safety Promotion Research, L. Laflamme, L. Svanström and L. Schelp (Eds), (Stockholm: Karolinska Institutet)
21. Eriksson, C. 2000. Learning and knowledge-production for public health: a review of approaches to evidence-based public health. Scandinavian Journal of Public Health, 28: pp. 298 – 308
22. EvansD HeadD SpellerV 1994 Assuring Quality in Health Promotion: How to Develop Standards of Good Practice (London: Health Education)
23. FinneyJW MossRH 1986 Environmental assessment and evaluation research In Evaluation Studies Review Annual, D.S. Cordray and M.W. Lipsey (Eds), (Newbury Park: Sage Publications)
24. Frimodt-MöllerB 1994 Ulykker kan forebygges (Copenhagen: Komiteen For Sundhedsoplysning), (In Danish.)
25. GoodmanRM 1999 Principles and tools for evaluating community-based prevention and health promotion programs In Community-Based Prevention–Programs that Work, R.C. Brownson, E.A. Baker and L.F. Novick (Eds), (Gaithersburg: Aspen Publishers)
26. GoodstadtMS HyndmanB McQueenDV PotvinL RootmanI SpringettJ 2001 Evaluation in health promotion: synthesis and recommendations In Evaluation in Health Promotion, I. Rootman, M. Goodstadt, B. Hyndman, D.V. McQueen, L. Potvin, J. Springett and E. Ziglio (Eds), (Copenhagen: WHO)
27. GreenLW LewisFM 1986 Measurement and Evaluation in Health Education and Health Promotion (Palo Alto: Mayfield)
28. Guyer, B, Gallagher, SS, Chang, B-H, Azzara, CV, Cupples, LA and Colton, T. 1989. Prevention of childhood injuries: Evaluation of the Statewide Childhood Injury Prevention Program (SCIPP). American Journal of Public Health, 79: pp. 1521 – 1527
29. Harachi, TW, Abbott, RD, Catalano, RF, Haggerty, KP and Fleming, CB. 1999. Opening the black box: using process evaluation measures to assess implementation and theory building. American Journal of Community Psychology, 27: pp. 711 – 731
30. HarringtonC GallagherSS BurgessLL GuyerB 1988 Injury Prevention Programs in State Health Departments–A National Survey (Boston: Childhood Injury Prevention Resource Center, Harvard School of Public Health)
31. Hawe, P. 1994. Capturing the meaning of ‘community’ in community intervention evaluation: some contributions from community psychology. Health Promotion International, 9: pp. 199 – 210
32. HaweP DegelingD HallJ 1995 Evaluating Health Promotion (Sydney: MacLennan & Petty)
33. Heller, K. 1989. The return to community. American Journal of Community Psychology, 17: pp. 1 – 15
34. Hodge, M. 2002. Evaluating injury prevention interventions. Injury Prevention, 8: pp. 8 – 9
35. Jeffs, D, Booth, D and Calvert, D. 1993. Local injury information, community participation and injury reduction. Australian Journal of Public Health, 17: pp. 365 – 372
36. Judd, J, Frankish, CJ and Moulton, G. 2001. Setting standards in the evaluation of community-based health promotion programmes–a unifying approach. Health Promotion International, 16: pp. 367 – 380
37. Klassen, TP, MacKay, JM, Moher, D, Walker, A and Jones, AL. 2000. Community-based injury prevention interventions. The Future of Children, 10: pp. 83 – 110
38. KristiansenIS GosdenT 2002 Evaluating economic interventions: a role for non-randomised designs? In Evidence-based Health Economics, C. Donaldson, M. Mugford and L. Vale (Eds), (London: BMJ Books)
39. LaflammeL 1999 Questions and challenges ahead in safety promotion research In Safety Promotion Research, L. Laflamme, L. Svanström and L. Schelp (Eds) Stockholm: Karolinska Institutet)
40. Learmonth, A and Mackie, P. 2000. Evaluating effectiveness in health promotion: a case of re-inventing the millstone?. Health Education Journal, 59: pp. 267 – 280
41. Lindqvist, K and Brodin, H. 1996. One-year economic consequences of accidents in a Swedish municipality. Accident Analysis and Prevention, 28: pp. 209 – 219
42. Lindqvist, K and Lindholm, L. 2001. A cost-benefit analysis of the community-based injury prevention programme in Motala, Sweden–a WHO Safe Community. Public Health, 115: pp. 317 – 322
43. Lindqvist, K, Timpka, T and Schelp, L. 1996. Ten years of experiences from a participatory community-based injury prevention program in Motala, Sweden. Public Health, 110: pp. 339 – 346
44. Lindqvist, K, Timpka, T and Schelp, L. 2001a. Evaluation of an inter-organizational prevention program against injuries among the elderly in a WHO Safe Community. Public Health, 115: pp. 308 – 316
45. Lindqvist, K, Timpka, T and Schelp, L. 2001b. Evaluation of inter-organizational traffic injury prevention in a WHO safe community. Accident Analysis and Prevention, 33: pp. 599 – 607
46. Lindqvist, K, Timpka, T, Schelp, L and Åhlgren, M. 1998. The WHO safe community program for injury prevention: evaluation of the impact on injury severity. Public Health, 112: pp. 385 – 391
47. Lindqvist, K, Timpka, T, Schelp, L and Åhlgren, M. 1999. Evaluation of a home injury prevention program in a WHO Safe Community. International Journal for Consumer and Product Safety, 6: pp. 25 – 32
48. MenckelE 1999 Evaluation research–approaches, models and methods for evaluating safety promotion In Safety Promotion Research, L. Laflamme, L. Svanström and L. Schelp (Eds), (Stockholm: Karolinska Institutet)
49. NaidooJ WillsJ 2000 Health Promotion (Edinburgh: Baillière Tindall)
50. NilsenP 2004 What makes community-based injury prevention work?–In search of evidence of effectiveness (Submitted for publication)
51. NilsenP HudsonDG KullbergA TimpkaT EkmanR LindqvistK 2004 Making sense of safety–beyond injury prevention Injury Prevention (accepted for publication)
52. Nutbeam, D. 1998. Evaluating health promotion–progress, problems, and solutions. Health Promotion International, 13: pp. 27 – 44
53. Nutbeam, D. 1999. The challenge to provide ‘evidence’ in health promotion. Health Promotion International, 14: pp. 99 – 101
54. Oliver, S, Peersman, G, Harden, A and Oakley, A. 1999. Discrepancies in findings from effectiveness reviews: the case of health promotion for older people in accident and injury prevention. Health Education Journal, 58: pp. 66 – 77
55. Ozanne-Smith, J, Day, L, Stathakis, V and Sherrard, J. 2002. Controlled evaluation of a community based injury prevention program in Australia. Injury Prevention, 8: pp. 18 – 22
56. ParishR 2001 Health promotion: towards a quality assurance framework In Evaluation in Health Promotion, I. Rootman, M. Goodstadt, B. Hyndman, D.V. McQueen, L. Potvin, J. Springett and E. Ziglio (Eds), (Copenhagen: WHO)
57. PawsonR TilleyN 1997 Realistic Evaluation (London: Sage Publications)
58. Petridou, E, Tolma, E, Dessypris, N and Trichopoulos, D. 1997. A controlled evaluation of a community injury prevention project in two Greek Islands. International Journal of Epidemiology, 26: pp. 173 – 179
59. PiriePL 1990 Evaluating health promotion programs In Health Promotion at the Community Level, N. Bracht (Ed.), (Newbury Park: Sage Publications)
60. Pless, IB. 1996. Perspectives on evaluating community programmes. Injury Prevention, 2: pp. 81 – 83
61. PotvinL RichardL 2001 Evaluating community health promotion programmes In Evaluation in Health Promotion, I. Rootman, M. Goodstadt, B. Hyndman, D.V. McQueen, L. Potvin, J. Springett and E. Ziglio (Eds), (Copenhagen: WHO)
62. Rada, J, Ratima, M and Howden-Chapman, P. 1999. Evidence-based purchasing of health promotion: methodology for reviewing evidence. Health Promotion International, 14: pp. 177 – 187
63. Rissel, C, Finnegan, J and Bracht, N. 1995. Evaluating quality and sustainability: issues and insights from the Minnesota Heart Health Program. Health Promotion International, 10: pp. 199 – 207
64. Robertson, LS. 1986. Community injury control programs of the Indian Health Service: an early assessment. Public Health Studies, 101: pp. 632 – 637
65. Schelp, L. 1987. Community intervention and changes in accident pattern in a rural Swedish municipality. Health Promotion, 2: pp. 109 – 125
66. Schelp, L. 1988. The role of organizations in community participation–prevention of accidental injuries in a rural Swedish municipality. Social Science and Medicine, 26: pp. 1087 – 1093
67. Schwarz, DF, Grisso, JA, Miles, C, Holmes, JH and Sutton, LR. 1993. An injury prevention program in an urban African-American Community. American Journal of Public Health, 83: pp. 675 – 680
68. SechrestL WestSG PhillipsMA RednerR YeatonW 1979 Some neglected problems in evaluation research: Strength and integrity of treatments In Evaluation Studies Review Annual, L. Sechrest, S.G. West, M.A. Phillips, R. Redner and W. Yeaton (Eds), (Newbury Park: Sage Publications)
69. Shannon, HS, Robson, LS and Guastello, SJ. 1999. Methodological criteria for evaluating occupational safety intervention research. Safety Science, 31: pp. 161 – 179
70. Sim, F and Mackie, P. 2001. Evaluate Evaluate. Public Health, 115: p. 307
71. Simpson, JC, Morrison, LGL, Langley, JD and Memom, PA. 2003. The process and impact of implementing injury prevention projects in smaller communities in New Zealand. Health Promotion International, 18: pp. 237 – 245
72. Smart, H. 1999. Evaluating community development for health: a survey of evaluation activity across the Lothians. Health Education Journal, 58: pp. 355 – 364
73. SpellerV 1998 Quality assurance programmes: their development and contribution to improving effectiveness in health promotion In Evaluating Health Promotion, D. Scott and R. Weston (Eds), (Cheltenham: Stanley Thomas)
74. Steckler, A, McLeroy, KR and Goodman, RM. 1992. Towards integrating qualitative and quantitative methods: an introduction. Health Education Quarterly, 19: pp. 1 – 8
75. SvanströmL 2000 Evidence-based injury prevention and safety promotion: state-of-the-art In Injury Prevention and Control, D. Mohan and G. Tiwari (Eds), (London: Taylor & Francis)
76. Svanström, L, Ekman, R, Schelp, L and Lindström, Å. 1995. The Lidköping Accident Prevention Programme–a community approach to preventing childhood injuries in Sweden. Injury Prevention, 1: pp. 169 – 172
77. SvanströmL HaglundBJA 2000 Evidence-based Injury Prevention–An Introduction (Stockholm: Karolinska Institutet)
78. Svanström, L, Schelp, L, Ekman, R and Lindström, Å. 1996. Falköping, Sweden, ten years after: still a safe community?. International Journal for Consumer Safety, 3: pp. 1 – 7
79. Tellnes, G. 1985. An evaluation of an injury prevention campaign in general practice in Norway. Family Practice, 2: pp. 91 – 93
80. Timpka, T and Lindqvist, K. 2001. Evidence based prevention of acute injuries during physical exercise in a WHO safe community. British Journal of Sports Medicine, 35: pp. 20 – 27
81. Timpka, T, Lindqvist, K, Schelp, L and Åhlgren, M. 1999. Community-based injury prevention: effects on health care utilization. International Journal of Epidemiology, 28: pp. 502 – 508
82. TonesK GreenJ 2004 Health Promotion–Planning and Strategies (London: Sage Publications)
83. Victora, CG, Habicht, J-P and Bryce, J. 2004. Evidence-based public health: moving beyond randomized trials. American Journal of Public Health, 94: pp. 400 – 405
84. Walsh, SS, Jarvis, SN, Towner, EML and Aynsley-Green, A. 1996. Annual incidence of unintentional injury among 54,000 children. Injury Prevention, 2: pp. 16 – 20
85. WelanderG SvanströmL EkmanR 2000 Safety Promotion: An Introduction (Stockholm: Karolinska Institutet)
86. Wimbush, E and Watson, J. 2000. An evaluation framework for health promotion: theory, quality and effectiveness. Evaluation, 6: pp. 301 – 321
87. WHO Safe Community Collaborating Centre 2003 http://www.phs.ki.se/csp/safecom (accessed 20 October 2003)
88. Ytterstad, B. 1995. The Harstad injury prevention study: Hospital-based injury recording used for outcome evaluation of community-based prevention of bicyclist and pedestrian injury. Scandinavian Journal of Primary Health Care, 13: pp. 141 – 149
89. Ytterstad, B. 1996. The Harstad injury prevention study: community based prevention of fall-fractures in the elderly evaluated by means of a hospital based injury recording system in Norway. Epidemiology and Community Health, 50: pp. 551 – 558
90. Ytterstad, B. 2003. A decade of community-based traffic injury prevention with emphasis on children. Postal dissemination of local injury data can be effective. International Journal of Circumpolar Health, 62: pp. 61 – 74
91. Ytterstad, B, Smith, GS and Coggan, CA. 1998. Harstad injury prevention study: prevention of burns in young children by community based intervention. Injury Prevention, 4: pp. 176 – 180
92. Ytterstad, B and Wasmuth, HH. 1995. The Harstad injury prevention study: Evaluation of hospital-based injury recording and community-based intervention for traffic injury prevention. Accident Analysis and Prevention, 27: pp. 111 – 123
93. ZhaoZ SvanströmL 2002 Perspectives on the development of community safety promotion in China In Developing Safe Communities–Two Decades of Experiences, J.P. Cho and L. Svanström (Eds), (Suwon: Department of Emergency Medicine, Ajou University School of Medicine)