Capturing the complexity of evaluations of health promotion interventions: A scoping review

Canadian Journal of Program Evaluation

Volumn 27, Issue 1, 2013, Pages 65-91

  Kania, Ania ^a   Patel, Alka B ^a   Roy, Amrita ^a   Yelland, Gregory S ^b   Nguyen, Duyen Thi Kim ^a   Verhoef, Marja J ^a  

^a UNIVERSITY OF CALGARY   (Canada)

^b Yelland Evaluation Services   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84878602077     PISSN: 08341516     EISSN: 00077720     Source Type: Journal    
DOI: None     Document Type: Review

References (79)

1. *Abernathy, T. J. (1994). Compliance for kids: A community-based tobacco prevention project. Canadian Journal of Public Health, 85(2), 82-84.
2. *Abernathy, T. J., & Bertrand, L. D. (1992). Preventing cigarette smoking among children: Results of a four-year evaluation of the PAL program. Canadian Journal of Public Health, 83(3), 226-229.
3. *AFM Youth Services & AFM Research & Quality Monitoring. (2004). Evaluation report on the partnership between: River East Transcona School Division & the Addictions Foundation of Manitoba. Winnipeg, MB: River East Transcona School Division. Retrieved from http://www.afm.mb.ca/pdf/ RETSD%20Final%20Report%202004.pdf
4. *Allison, K. R., Silverman, G., & Dignam, C. (1990). Effects on students of teacher training in use of a drug education curriculum. Journal of Drug Education, 20(1), 31-46.
5. *Ambtman, R., Madak, P., Koss, D., & Strople, M. (1990). Evaluation of a comprehensive elementary school curriculum-based drug education program. Journal of Drug Education, 20(3), 199-225.
6. Arksey, H., & O'Malley, L. (2005). Scoping studies: Towards a methodological framework. International Journal of Social Research Methodology, 8(1), 19-32.
7. *Ashbury, F., Cameron, C., Finlan, C., Holmes, R., Villareal, E., Décoste, Y., ... Kralj, B. (2006). The impact of a quit smoking contest on smoking behaviour in Ontario. Chronic Diseases in Canada, 27(2), 77-84.
8. *Bains, N., Pickett, W., Laundry, B., & Mecredy, D. (2000). Predictors of smoking cessation in an incentive-based community intervention. Chronic Diseases in Canada, 21(2), 54-61.
9. *Barnett, T. A., Gauvin, L., Lambert, M., O'Loughlin J., Paradis, G., & McGrath, J. J. (2007). The influence of school smoking policies on student tobacco use. Archives of Pediatrics and Adolescent Medicine, 161(9), 842-848.
10. *Bernstein, S. M., & Stoduto, G. (1999). Adding a choice-based program for tobacco smoking to an abstinence-based addiction treatment program. Journal of Substance Abuse Treatment, 1(2), 167-173.
11. Brien, S. E., Lorenzetti, D. L., Lewis, S., Kennedy, J., & Ghali, W. A. (2010). Overview of a formal scoping review on health system report cards. Implementation Science, 5(2).
12. *Carpenter, C. (2006). Did Ontario's zero tolerance & graduated licensing law reduce youth drunk driving? Journal of Policy Analysis and Management, 25(1), 183-195.
13. *Carpenter, C. S., & Eisenberg, D. (2009). Effects of Sunday sales restrictions on overall and day-specific alcohol consumption: Evidence from Canada. Journal of Studies on Alcohol and Drugs, 70(1), 126-133.
14. *Chalmers, K., Bramadat, I. J., Cantin, B., Murnaghan, D., Shuttleworth, E., Scott-Findlay, S., & Tataryn, D. (2001). A smoking reduction and cessation program with registered nurses: Findings and implications for community health nursing. Journal of Community Health Nursing, 18(2), 115-134.
15. *Chouinard, M. C., & Robichaud-Ekstrand, S. (2005). The effectiveness of a nursing inpatient smoking cessation program in individuals with cardiovascular disease. Nursing Research, 54(4), 243-254.
16. Commission of the Social Determinants of Health [CSDH]. (2008). Closing the gap in a generation: Health equity through action on the social determinants of health. Final Report of the Commission on Social Determinants of Health. Geneva, Switzerland: World Health Organization. Retrieved from http://whqlibdoc.who.int/publications/2008/9789241563703-eng.pdf
17. Collins, D. J., & Lapsley, H. M. (2008). The costs of tobacco, alcohol, and illicit drug abuse to Australian society in 2004/05. Retrieved from http://www.health.gov.au/internet/drugstrategy/publishing.nsf/Content/34 F55AF632F67B70CA2573F60005D42B/$File/mono64.pdf
18. *Collins Management Consulting and Research Ltd. (2003). An evaluation of youth health centres in Nova Scotia: Phase III report. Halifax, NS: Youth Health Evaluation Steering Committee. Retrieved from http://www.gov.ns.ca/hpp/publications/Evaluation%20of%20 YHC%20in%20NS- Phase%20III%20Final%20Report.pdf
19. *Cookson, S., Heath, A., & Bertrand, L. (2000). The HeartSmart Family Fun Pack: An evaluation of family-based intervention for cardiovascular risk reduction in children. Canadian Journal of Public Health, 91(4), 256-259.
20. *Côté, F., Godin, G., & Gagné, C. (2006). Efficiency of an evidence-based intervention to promote and reinforce tobacco abstinence among elementary schoolchildren in a school transition period. Health Education & Behavior, 33(6), 747-759.
21. *Csiernick, R. C., & Troller, J. (2002). Evaluating the effectiveness of a relapse prevention group. Journal of Social Work Practice in the Addictions, 2(2), 29-37.
22. *DeWit, D. J., Steep, B., Silverman, G., Stevens-Lavigne, A., Ellis, K., Rye, B.J., ...Wood, E. (2000). Evaluating an in-school drug prevention program for at-risk youth. Alberta Journal of Education Research, 26(2), 117-133.
23. *Dubray, J., & Schwartz, R. (2010). Formative evaluation of the Smoke-Free Ontario act: Comprehensive report. Toronto, ON: Ontario Tobacco Research Unit. Retrieved from http://www.otru.org/pdf/special/special- SFOAcomp.pdf
24. *Dupuis, S. (2007). The impact of tobacco control policies on university students' smoking in Ontario. Kinesiology Abstracts, 19, 14.
25. Eoyang, G. H., & Berkas, T. H. (1999). Evaluating performance in a CAS. In M. R. Lissack & H. P. Gunz (Eds.), Managing complexity in organizations: A view in many directions (pp. 313-335). Westport, CT: Greenwood Publishing Group.
26. *Fiissel, D., Schwartz, R., Schnoll, J., & Garcia, J. (2008). Formative evaluation of the Youth Action Alliance program. Toronto, ON: Ontario Tobacco Research Unit.
27. *Flay, B. R., Koepke, D., Thomson, S. J., Santi, S., Best, J. A., & Brown, K. S. (1989). Six-year follow-up of the first Waterloo school smoking prevention trial. American Journal of Public Health, 79(10), 1371-1376.
28. *Gagne, L. (2007). The 2005 British Columbia smoking cessation mass media campaign and short-term changes in smoking. Journal of Public Health Management & Practice, 13(3), 296-306.
29. *Gliksman, L., Rylett, M., & Douglas, R. R. (2007). Aboriginal community alcohol harm reduction policy (ACAHRP) project: A vision for the future. Substance Use and Misuse, 42(12-13), 1851-1866.
30. *Gliksman, L., Douglas, R. R., Thomson, M., Moffatt, K., Smythe, C., & Caverson, R. (1990). Promoting municipal alcohol policies: An evaluation of a campaign. Contemporary Drug Problems, 17(3), 391-420.
31. *Gospodinov, N., & Irvine, I. J. (2004). Global health warnings on tobacco packaging: Evidence from the Canadian experiment. Topics in Economic Analysis & Policy, 4(1), article 30.
32. *Grant, K. A., Lane, P. L., Janus, G., & Okovita, L. (1995). An evaluation of a hospital-based drinking and driving prevention program. Canadian Journal of Public Health, 86(2), 91-94.
33. Green, L. W., Richard, L., & Potvin, L. (1996). Ecological foundations of health promotion. American Journal of Health Promotion, 10(4), 270-281.
34. *Grierson, T., van Dijk, M. W., Dozois, E., & Mascher, J. (2006). Using the internet to build community capacity for healthy public policy. Health Promotion Practice, 7(1), 13-22.
35. *Hammond, D., Fong, G. T., Borland, R., Cummings, M., McNeill, A., & Driezen P. (2007). Text and graphic warnings on cigarette packages: Findings from the international tobacco control four-country study. American Journal of Preventive Medicine, 32(3), 210-217.
36. *Hammond, D., McDonald, P. W., Fong, G. T., Brown, K. S., & Camerson, R. (2004). The impact of cigarette warning labels and smoke-free bylaws on smoking cessation: Evidence from former smokers. Canadian Journal of Public Health, 95(3), 201-204.
37. *Hayward, L. M., Campbell, H. S., & Sutherland-Brown, C. (2007). Aboriginal users of Canadian quitlines: An exploratory analysis. Tobacco Control, 16(Suppl 1), i60-i64.
38. *Health Canada. (2005). Quit4life - 12 month follow-up evaluation. Retrieved from http://hc-sc.gc.ca/hc-ps/pubs/tobac-tabac/quit-cesseranneval/ index-eng.php
39. Johnson, B., & Onwuegbuzie, A. J. (2004). Mixed methods research: A research paradigm whose time has come. Educational Researcher, 33(7), 14-26.
40. *Kishchuk, N., Peters, C., Towers, A. M., Sylvestre, M., Bourgault, C., & Richard, L. (1994). Formative and effectiveness evaluation of a worksite program promoting healthy alcohol consumption. American Journal of Health Promotion, 8(5), 353-362.
41. *Leinweber, C. E., Macdonald, J. M., & Campbell, H. S. (1994). Community smoking cessation contests: An effective public health strategy. Canadian Journal of Public Health, 85(2), 95-98.
42. Leykum, L. K., Pugh, J., Lawrence, V., Parchman, M., Noel, P. H., Cornell, J., & McDaniel Jr., R. R. (2007). Organizational interventions employing principles of complexity science have improved outcomes for patients with Type II Diabetes. Implementation Science, 2(28) (28 August 2007).
43. McDaniel, R. R., Lanham, H. J., & Anderson, R. A. (2009). Implications of complex adaptive systems theory for the design of research on health care organizations. Health Care Management Review, 34(2), 191-199.
44. McLaren, L., & Hawe, P. (2005). Ecological perspectives in health research. Journal of Epidemiology and Community Health, 59(1), 6-14.
45. *Meyer, M., & Estable, A. (2004). Evaluation of the Quit4Life youth cessation demonstration project. Retrieved from http://www.hc-sc.gc.ca/hc- ps/alt-formats/pdf/pubs/tobac-tabac/quit-cesser-progeval/quit-cesserprogeval- eng.pdf
46. *Millar, W. J., & Naegele, B. E. (1987). Time to Quit program: Community involvement in smoking cessation. Canadian Journal of Public Health, 78(2), 109-114.
47. *Morrison, W. (2004). Investigating a school-based approach to tobacco control: The Hampton High School Initiative. Retrieved from http://www.hc-sc.gc.ca/hc-ps/alt-formats/pdf/pubs/tobac-tabac/hampton/ hampton-eng.pdf
48. *Murray, R. P., Connett, J. E., Rand, C. S., Pan, W., & Anthonisen, N. R. (2002). Persistence of the effect of the Lung Health Study (LHS) smoking intervention over eleven years. Preventive Medicine, 35(4), 314-319.
49. *Niccols, A., & Sword, W. (2005). "New Choices" for substance-using mothers and their children: Preliminary evaluation. Journal of Substance Use, 10(4), 239-251.
50. *O'Connor, A. M., Davies, B. L., Dulberg, C. S., Buhler, P. L., Nadon, C., McBride, B. H., & Benzie, R. J. (1992). Effectiveness of a pregnancy smoking cessation program. Journal of Obstetric, Gynecologic, & Neonatal Nursing, 21(5), 385-392.
51. *O'Loughlin, J., Paradis, G., Renaud, L., Meshefedjian, G., & Barnett, T. (1997). The "Yes, I Quit" smoking cessation course: Does it help wom en in a low income community quit? Journal of Community Health, 22(6), 451-468.
52. *O'Loughlin, J. L., Lampron, G. P., & Sacks-Silver, G. E. (1990). Evaluation of a smoking cessation guide for low income, functionally illiterate women: A pilot study. Canadian Journal of Public Health, 81(6), 471-2.
53. Patton, M.Q. (1994). Developmental evaluation. Evaluation Practice, 15(3), 311-319.
54. Patton, M.Q. (2011). Developmental evaluation: Applying complexity concepts to enhance innovation and use. New York, NY: Guilford Press.
55. *Patton, D., & Lemaire, J. (2002). The Brandon Middle Years Pilot Project (BMYPP) program evaluation. Retrieved from http://www.afm.mb.ca/ pdf/Brandon%20Middle%20Years%20Project.pdf
56. Pawson, R., & Tilley, N. (1997). Realistic evaluation. London, UK: Sage.
57. Pawson, R., & Tilley, N. (2004). Realistic evaluation. Retrieved from http://www.communitymatters.com.au/RE-chapter.pdf
58. Plano Clark, V. L., & Creswell, J. W. (2011). Designing and conducting mixed methods research (2nd ed.). London, UK: Sage.
59. Plsek, P., & Greenhalgh, T. (2001). Complexity science: The challenge of complexity in health care. British Medical Journal, 323(7313), 625-628.
60. Poland, B., Krupa, G., & McCall, D. (2009). Settings for health promotion: An analytic framework to guide intervention design and implementation. Health Promotion Practice, 10(4), 505-516.
61. Powers, R. A. (2007). Alcohol and drugs abuse prevention. Psychiatric Annals, 37(5), 349-358.
62. *Prilleltensky, I., Nelson, G., & Valdes, L. S. (2000). A value-based approach to smoking prevention with immigrants from Latin America: Program evaluation. Journal of Ethnic and Cultural Diversity in Social Work, 9(1-2), 97-117.
63. Public Health Agency of Canada [PHAC]. (2003). What makes Canadians healthy or unhealthy? Retrieved from http://www.phac-aspc.gc.ca/ph-sp/ determinants/index-eng.php
64. *R. A. Malatest and Associates Ltd. (2005). Mass media tobacco strategy evaluation. Retrieved from http://pubs.aina.ucalgary.ca/health/62252. pdf
65. *Reid, R. D., Pipe, A. L., & Quinlan, B. (2006). Promoting smoking cessation during hospitalization for coronary artery disease. Canadian Journal of Cardiology, 22(9), 775-780.
66. Rogers, P. J. (2009). Matching impact evaluation design to the nature of the intervention and the purpose of the evaluation. Journal of Development Effectiveness, 1(3), 217-226.
67. *Ross, C., Richard, L., & Potvin, L. (1998). One year outcome evaluation of an alcohol and drug abuse prevention program in a Quebec high school. Canadian Journal of Public Health, 89(3), 166-170.
68. Rouse, W. (2008). Health care as a complex adaptive system: Implications for design and management. The Bridge, 38 (1), 17-25.
69. *Ryan, B., Coffin, K., Smillie, C., & Porter, K.(1990). Smoking cessation in Nova Scotia: Results of the Time to Quit program. Canadian Journal of Public Health, 81(2), 166-167.
70. *Saffer, H. (1991). Alcohol advertising bans and alcohol abuse: An international perspective. Journal of Health Economics, 10(1), 65-79.
71. *Santi, S. M., Cargo, M., Brown, K. S., Best, J. A., & Cameron, R. (1994). Dispositional risk-factors for smoking-stage transitions: A social influences program as an effect modifier. Addictive Behaviors, 19(3), 269-285.
72. *Smillie, C., Coffin, K., Porter, K., & Ryan, B. (1988). Primary health care through a community based smoking-cessation program. Journal of Community Health, 13(3), 156-170.
73. *Smith, P. M., Camerson, R., McDonald, P. W., Kawash, B., Madill, C., & Brown, K. S. (2004). Telephone counseling for population-based smoking cessation. American Journal of Health Behavior, 28(3), 231-241.
74. *Stephens, T., Pederson, L., Koval, J., & Macnab, J. (2001). Comprehensive tobacco control policies and the smoking behaviour of Canadian adults. Tobacco Control, 10(4), 317-322.
75. Thurston, W. E., Vollman, A.R., Wilson, D. R., MacKean, G., Felix, R., & Wright, M. (2003). Development and testing of a framework for assessing the effectiveness of health promotion. Social and Preventative Medicine, 48(5), 301-316.
76. Van Beurden, E. K., Kia, A. M., Zash, A., Dietrich, U., & Rose, L. (2011). Making sense in a complex landscape: How the Cynefin framework from Complex Adaptive Systems Theory can inform health promotion practice. Health Promotion International. doi:10.1093/heapro/dar089
77. Vollman, A., Anderson, E. T., & McFarlane, J. (2007). Canadian community as partner: Theory and multidisciplinary practice (2nd ed.). London, UK: Lippincott Williams & Wilkins.
78. *Wild, T. C., Roberts, A. B., Cunningham, J., Schopflocher, D., & Pazderka- Robinson, H. (2004). Alcohol problems and interest in self-help: A population study of Alberta adults. Canadian Journal of Public Health, 95(2), 127-132.
79. World Health Organization. (1986). Ottawa charter for health promotion. Retrieved from http://www.who.int/hpr/NPH /docs/ottawa-charter- hp.pdf