Program theory evaluation: Logic analysis

Evaluation and Program Planning

Volumn 34, Issue 1, 2011, Pages 69-78

  Brousselle, Astrid ^a   Champagne, François ^b  

^a UNIVERSITÉ DE SHERBROOKE   (Canada)

^b UNIVERSITÉ DE MONTRÉAL   (Canada)

Author keywords

Evaluation; Evaluation theory; Logic analysis; Program theory evaluation

Indexed keywords

CONCEPTUAL FRAMEWORK; THEORETICAL STUDY;

ARTICLE; HEALTH CARE QUALITY; HUMAN; LOGIC; METHODOLOGY; THEORETICAL MODEL;

HUMANS; LOGIC; MODELS, THEORETICAL; PROGRAM EVALUATION;

EID: 77956480905     PISSN: 01497189     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.evalprogplan.2010.04.001     Document Type: Article

References (106)

1. Ainsworth S., Sened I. The role of lobbyists: Entrepreneurs with two audiences. American Journal of Political Science 1993, 37:834-866.
2. Austen-Smith D. Information and influence: Lobbying for agendas and votes. American Journal of Political Science 1993, 37:799-833.
3. Baumgartner F.R., Leech B.L. Basic interests: The importance of groups in politics and in political science 1998, Princeton University Press, Princeton.
4. Berry J.M. The interest group society 1997, Longman, New York. 3rd ed.
5. Beyer J.M., Trice H.M. The utilization process: A conceptual framework and synthesis of empirical findings. Administrative Science Quarterly 1982, 27:591-622.
6. Bickman L. Editor's notes. Using program theory in evaluation. New directions for evaluation 1987, Vol. 33:1-3. Jossey-Bass Publishers, San Francisco.
7. Bickman L. Using program theory in evaluation. New directions for evaluation 1987, Vol. 33. Jossey-Bass Publishers, San Francisco.
8. Bickman L. Advances in program theory. New directions for evaluation 1990, Vol. 47. Jossey-Bass Publishers, San Francisco.
9. Birckmayer J.D., Weiss C.H. Theory-based evaluation in practice: What do we learn?. Evaluation Review 2000, 24:407-431.
10. Brisson P. Développement du champ québécois des toxicomanies au XXe siècle. L'usage des drogues et la toxicomanie 1988, Vol. 3:3-44. Gaëtan Morin, Montreal.
11. Brousselle A., Contandriopoulos D., Lemire M. How logic analysis can be used to evaluate knowledge transfer initiatives: The case of the Research Collective on the Organization of Primary Care Services. The International Journal of Theory, Research and Practice 2009, 15(2):165-183.
12. Brousselle A., Lamothe L., Mercier C., Perreault M. Beyond the limitations of best practices: How program theory analysis helped reinterpret dual diagnosis guidelines. Evaluation and Program Planning 2007, 30(1):94-104.
13. Brousselle, A., Lamothe, L., Sylvain, C., Foro, A., & Perreault, M. (accepted). Key enhancing factors for integrating services for patients with mental and substance use disorders. Mental Health and Substance Use: dual diagnosis.
14. Brousselle, A., Lamothe, L., Sylvain, C., Foro, A., & Perreault, M. (in press). Integrating services for patients with mental health and substance abuse disorders. What matters? Health Care Management Review, July-september.
15. Campbell D.T. Pattern matching as an essential in distal knowing. The psychology of Egon Brunswick 1966, 81-106. Holt, Rinehart & Winston, New York. K.R. Hammond (Ed.).
16. Carpenter D.P., Esterling K.M., Lazer D.M.J. The strength of weak ties in lobbying networks: Evidence from health-care politics in the United States. Journal of Theoretical Politics 1998, 10:417-444.
17. Carpenter D.P., Esterling K.M., Lazer D.M.J. The strength of strong ties: A model of contact-making in policy networks with evidence from U.S. health politics. Rationality and Society 2003, 15:411-440.
18. Carpenter D.P., Esterling K.M., Lazer D.M.J. Friends, brokers, and transitivity: Who informs whom in Washington politics?. Journal of Politics 2004, 66:224-246.
19. Champagne, F. (2002) The ability to manage change. Ottawa: Commission on the future of health care in Canada: the Romanow Commission, Health Canada, discussion paper n̊39.
20. Champagne F., Brousselle A., Contandriopoulos A.-P., Hartz Z. L'analyse logique. Concepts et méthodes d'évaluation des interventions. 2009, 103-112. Montreal: Les Presses de l'Université de Montréal. A. Brousselle, F. Champagne, A.-P. Contandriopoulos, Z. Hartz (Eds.).
21. Champagne F., Brousselle A., Hartz Z., Contandriopoulos A.-P. Modéliser les interventions. Concepts et méthodes d'évaluation des interventions 2009, 57-72. Montreal: Les Presses de l'Université de Montréal. A. Brousselle, F. Champagne, A.-P. Contandriopoulos, Z. Hartz (Eds.).
22. Champagne F., Leduc N., Bilodeau H., Blais R., Clapperton I., Lehoux P., et al. Évaluation de la programmation régionale de soins ambulatoires 2001, Groupe de Recherche Interdisciplinaire en Santé, Université de Montréal, Montreal.
23. Champagne F., Lemieux-Charles L., McGuire W. Introduction: Towards a broader understanding of the use of knowledge and evidence in health care. Multiple perspectives on evidence based decision-making in health care 2004, 3-17. University of Toronto Press, Toronto. L. Lemieux-Charles, F. Champagne, A. Langley (Eds.).
24. Chen H.T. Issues in constructing program theory. Advances in program theory. New directions for evaluation 1990, Vol. 47:7-18. Jossey-Bass Publishers, San Francisco.
25. Chen H.T. Theory-driven evaluations 1990, Sage Publications, Newbury Park, CA.
26. Chen H.-T. The roots of theory-driven evaluation. Current views and origins. Evaluation roots. Tracing theorists' views and influences 2004, 132-152. Sage Publications, Thousand Oaks, CA. M. Alkin (Ed.).
27. Chen H.T. Practical program evaluation: Assessing and improving planning, implementation and effectiveness 2005, Sage Publications, Thousand Oaks, CA.
28. Chen H.T., Rossi P.H. The theory-driven approach to validity. Evaluation and Program Planning 1987, 10:95-103.
29. CHSRF The theory and practice of knowledge brokering in Canada's health system 2003, Canadian Health Services Research Foundation/Fondation canadienne de la recherche sur les services de santé, Ottawa.
30. CHSRF Conceptualiser et regrouper les données probantes pour guider le système de santé 2005, Canadian Health Services Research Foundation/Fondation canadienne de la recherche sur les services de santé, Ottawa.
31. Conrad K.J., Miller T.Q. Measuring and testing program philosophy. Advances in program theory. New directions for evaluation 1987, Vol. 47:19-42. Jossey-Bass Publishers, San Francisco.
32. Conrad D.A., Shortell S.M. Integrated health systems: Promise and performance. Frontiers of Health Services Management 1996, 13(1):3-40.
33. Contandriopoulos A.-P., Denis J.-L. Intégration des soins: Concepts et mise en œuvre 2001, Groupe de recherche interdisciplinaire en santé, Université de Montréal, Montreal.
34. Contandriopoulos A.-P., Champagne F., Denis J.-L., Avargues M.C. L'évaluation dans le domaine de la santé: Concepts et méthodes. Revue d'épidémiologie et santé publique 2000, 48:517-539.
35. Contandriopoulos D., Brousselle A., Kêdoté N.M. Evaluating interventions aimed at promoting information utilization in organizations and systems. Healthcare Policy 2008, 4(1):89-107.
36. Cook T.D. The false choice between theory-based evaluation and experimentation. Program theory in evaluation: Challenges and opportunities. New directions for evaluation 2000, Vol. 87:27-34. Jossey-Bass Publishers, San Francisco.
37. Davidson E.J. Ascertaining causality in theory-based evaluation. Program theory in evaluation: Challenges and opportunities. New directions for evaluation 2000, Vol. 87:17-26. Jossey-Bass Publishers, San Francisco.
38. Davis P. The limits of realist evaluation: Surfacing and exploring assumptions in assessing the best value performance regime. Evaluation 2005, 11(3):275-295.
39. Davis P., Howden-Chapman P. Translating research findings into health policy. Social Science & Medicine 1996, 43:865-872.
40. Denis J.-L., Lomas J. Convergent evolution: The academic and policy roots of collaborative research. Journal of Health Services Research & Policy 2003, 8(Suppl. 2):1-6.
41. Donaldson S.I. Theory-driven program evaluation in the new millennium. Evaluating social programs and problems: Visions for the new millennium 2003, 109-141. Lawrence Erlbaum Associates, Mahwah, NJ. S.I. Donaldson, M. Scriven (Eds.).
42. Donaldson S.I. Program theory-driven evaluation science: Strategies and applications 2007, Taylor and Francis Group, New York.
43. Feldman P.H., Gold M., Chu K. State health policy information: What worked?. Health Affairs 1997, 16:207-210.
44. Fitzpatrick J. Dialogue with Stewart Donaldson. American Journal of Evaluation 2002, 23(3):347-365.
45. Fleury M.-J. Émergence des réseaux intégrés de services comme modèle d'organisation et de transformation du système sociosanitaire. Santé mentale au Québec 2002, 27(2):7-15.
46. Frenk J. Balancing relevance and excellence: Organizational responses to link research with decision making. Social Science & Medicine 1992, 35:397-404.
47. Glouberman S., Mintzberg H. Managing the care of health and the cure of disease. Part II. Integration. Health Care Management Review 2001, 26(1):70-84.
48. Greenhalgh T., Kristjansson E., Robinson V. Realist review to understand the efficacy of school feeding programmes. British Medical Journal 2007, 335:858-861.
49. Hacsi T.A. Using program theory to replicate successful programs. Program theory in evaluation: Challenges and opportunities. New directions for evaluation 2000, Vol. 87:17-26. Jossey-Bass Publishers, San Francisco.
50. Jordan G. The commercial lobbyists: Politics for profit in Britain 1991, Aberdeen University Press, Aberdeen, UK.
51. Kêdoté M., Brousselle A., Champagne F. Use of health care services by patients with co-occurring severe mental illness and substance use disorders. Mental Health and Substance Use: dual diagnosis 2008, 1(3):216-227.
52. Kingdon J.W. Agendas, alternatives, and public policies 1995, Longman, New York.
53. Lamarche P., Lamothe L., Bégin C., Léger M., Vallières-Joly M. L'intégration des services: Enjeux structurels et organisationnels ou humains et cliniques?. Ruptures 2002, 8(2):70-91.
54. Lamothe L. La reconfiguration des hôpitaux: Un défi d'ordre professionnel. Ruptures 1999, 6(2):132-148.
55. Lamothe, L., Brousselle, A., Sylvain, C., Foro, A., & Perreault, M. (submitted) Integrating Mental Health and Addiction Services to Treat People with Co-occurring Disorders: Challenges and Processes. Psychiatric Services.
56. Lavis J., Roberston D., Woodside J.M., McLeod C.B., Abelson J. How can research organizations more effectively transfer research knowledge to decision-makers?. The Milbank Quarterly 2003, 81:221-248.
57. Lindblom C.E. The science of "muddling through" Public Administration Review 1959, 19:79-88.
58. Lipsey M.W. Driving toward theory in program evaluation: More models to choose from. Evaluation and Program Planning 1989, 12:317-328.
59. Lipsey M.W. Theory as method: Small theories of treatment. Understanding causes and generalizing about them. New directions for program evaluation 1993, Vol. 57:5-38. Jossey-Bass Publishers, San Francisco.
60. Lomas J. Using research to inform healthcare managers' and policy makers' questions: From summative to interpretive synthesis. Healthcare Policy 2005, 1:55-71.
61. Mark M.M. From program theory to tests of program theory. Advances in program theory. New directions for evaluation 1990, Vol. 47:37-52. Jossey-Bass Publishers, San Francisco.
62. Markham B., Lomas J. Review of the multi-hospital arrangements literature: Benefits, disadvantages and lessons for implementation. Health Management Forum 1995, 8(3):24-35.
63. Marquart J.M. A pattern-matching approach to link program theory and evaluation data. Advances in program theory. New directions for evaluation 1990, Vol. 47:93-108. Jossey-Bass Publishers, San Francisco.
64. Mercier C., Beaucage B. Toxicomanie et problèmes sévères de santé mentale: Recension des écrits et état de situation pour le Québec 1997, Government of Quebec, Comité permanent de lutte à la toxicomanie, Quebec.
65. Mercille G. A realist approach to the systematic review. Health promotion evaluation practices in the americas. Values and research 2008, 81-100. Springer, New York. L. Potvin, D. McQueen (Eds.).
66. Milbrath L.M. Lobbying as a communication process. Public Opinion Quarterly 1960, 24:33-53.
67. Milbrath L.M. The Washington lobbyist 1963, Rand McNally, Chicago.
68. Mitton C., Adair C.E., McKenzie E., Patten S.B., Waye Perry B. Knowledge transfer and exchange: Review and synthesis of the literature. The Milbank Quarterly 2007, 85(4):729-768.
69. Mueser K.T., Noordsy D.L., Drake R.E., Fox L. Integrated treatment for dual disorders: A guide to effective practice 2003, The Guilford Press, New York.
70. Page S. "Virtual" health care organizations and the challenges of improving quality. Health Care Management Review 2003, 28(1):79-92.
71. Page M., Parker S.H., Renger R. How using a logic model refined our program to ensure success. Health Promotion Practice 2007, 10(1):76-82.
72. Paramahams, R. (2009). Blind men and an elephant, accessed April 10, 2009. http://en.wikipedia.org/wiki/Blind_Men_and_an_Elephant.
73. Patton M.Q. The evaluator's responsibility for utilization. Evaluation Practice 1988, 9:5-24.
74. Patton M.Q. Utilization-focused evaluation: The new century text 1997, Sage Publications, Thousand Oaks, CA. 3rd ed.
75. Pawson R., Tilley N. Realistic evaluation 1997, Sage Publications, London, UK.
76. Pawson R., Tilley N. Realistic evaluation. Encyclopedia of evaluation 2005, 362-367. Sage Publications, Thousand Oaks, CA. S. Mathison (Ed.).
77. Pawson R., Greenhalgh T., Harvey G., Walshe K. Realist review - a new method of systematic review designed for complex policy interventions. Journal of Health Services Research and Policy 2005, 10(Suppl. 1):S1-21.
78. Pineault R., Tousignant P., Roberge D., Lamarche P., Reinharz D., Larouche D., et al. The research collective: A tool for producing timely, context-linked research syntheses. Healthcare Policy 2006, 1(4):58-75.
79. Pineault R., Tousignant P., Roberge D., Lamarche P., Reinharz D., Larouche D., et al. Involving decision-makers in producing syntheses: the case of the research collective on primary healthcare in Québec. Healthcare Policy 2007, 2(4):2-17.
80. Renger R., Hurley C. From theory to practice: Lessons learned in the application of the ATM approach to developing logic models. Evaluation and Program Planning 2006, 29:106-119.
81. Renger R., Titcomb A. A three-step approach to teaching logic models. American Journal of Evaluation 2002, 23(4):493-503.
82. Rogers P.J. Theory-based evaluation: Reflections ten years on. Enduring issues in evaluation: The 20th anniversary of the collaboration between NDE and AEA. New directions for evaluation 2007, Vol. 114:63-67. Jossey-Bass Publishers and the American Evaluation Association, San Francisco.
83. Rogers P.J., Hacsi T.A., Petrosino A., Huebner T.A. Program theory evaluation: Practice, promise, and problems. Program theory in evaluation: Challenges and opportunities. New directions for evaluation 2000, Vol. 87:5-14. Jossey-Bass Publishers, San Francisco.
84. Rogers P.J., Hacsi T.A., Petrosino A., Huebner T.A. Program theory in evaluation: Challenges and opportunities. New directions for evaluation 2000, Vol. 87. Jossey-Bass Publishers, San Francisco.
85. Roos N.P., Shapiro E. From research to policy: What have we learned?. Medical Care 1999, 37(Suppl.):291-305.
86. Rossi P.H., Lipsey M.W., Freeman H.E. Evaluation: A systematic approach 2004, Sage Publications, Thousand Oaks, CA. 7th ed.
87. Sabatier P.A., Jenkins-Smith H.C. The advocacy coalition framework: An assessment. Theories of the policy process: Theoretical lenses on public policy 1999, 117-166. Westview Press, Boulder, CO. P.A. Sabatier (Ed.).
88. SAMHSA Strategies for developing treatment programs for people with co-occurring substance abuse and mental disorders 2003, Department of Health and Human Services; Substance Abuse and Mental Health Services Administration, Washington, US.
89. Scheirer M.A. Program theory and implementation theory: Implications for evaluators. Using program theory in evaluation. New directions for evaluation 1987, Vol. 33:59-76. Jossey-Bass Publishers, San Francisco.
90. Shadish W.R. Program micro- and macrotheories: A guide for social change. Using program theory in evaluation. New directions for evaluation 1987, Vol. 33:93-110. Jossey-Bass Publishers, San Francisco.
91. Shortell S.M., Gillies R.R., Anderson D.A., Erickson K.M., Mitchell J.B. Remaking health care in America: Building organized delivery systems 1996, Jossey-Bass Publishers, San Fransisco.
92. Sicotte C., Lehoux P., Champagne F., Gamache M. Analyse de l'implantation d'un réseau interhospitalier de soins pédiatriques: Le réseau mère-enfant 2001, Groupe de recherche interdisciplinaire en santé. Université de Montréal, Montreal.
93. Smith N.L. Using path analysis to develop and evaluate program theory and impact. Advances in program theory. New directions for evaluation 1990, Vol. 47:53-60. Jossey-Bass Publishers, San Francisco.
94. Suchman E.A. Evaluative research: Principles and practice in public service and social action programs 1967, Russell Sage Foundation, New York.
95. Torrey W.C., Drake R.E., Cohen M., Fox L.B., Lynde D., Gorman P., et al. The challenge of implementing and sustaining integrated dual disorders treatment programs. Community Mental Health Journal 2002, 38:507-521.
96. Touati N., Contandriopoulos A.-P., Denis J.-L., Rodríguez R., Sicotte C., Nguyen H. Une expérience d'intégration des soins dans une zone rurale: Les enjeux de la mise en œuvre. Ruptures 2001, 8(2):93-108.
97. Trevisan M.S. Evaluability assessment from 1986 to 2006. American Journal of Evaluation 2007, 28(3):290-303.
98. Weiss C.H. Evaluation research. Methods for assessing program effectiveness 1972, Prentice-Hall, Englewood Cliffs, NJ.
99. Weiss C.H. Research for policy's sake: The enlightenment function of social research. Policy Analysis 1977, 3:531-545.
100. Weiss C.H. How can theory-based evaluation make greater headway?. Evaluation Review 1997, 21:501-524.
101. Weiss C.H. Evaluation 1998, Prentice Hall, Upper Saddle River, NJ.
102. Weiss C.H. Which links in which theories shall we evaluate?. Program theory in evaluation: Challenges and opportunities. New directions for evaluation 2000, Vol. 87:35-45. Jossey-Bass Publishers, San Francisco.
103. Weiss C.H. Theory-based evaluation: Past, present and future. Enduring issues in evaluation: The 20th anniversary of the collaboration between NDE and AEA. New directions for evaluation 2007, Vol. 114:68-81. Jossey-Bass and the American Evaluation Association.
104. Weitzman B.C., Silver D., Dillman K.-N. Integrating a comparison group design into a theory of change evaluation: The case of the urban health initiative. American Journal of Evaluation 2002, 23(4):371-385.
105. Yin R.K. Case study research. Design and methods. Applied social research method series 2002, Vol. 5. Sage Publications, Thousand Oaks, CA. 3rd ed.
106. Ziedonis D.M., Smelson D., Rosenthal R.N., Batki S., Green A.I., Henry R.J., et al. Improving the care of individuals with schizophrenia and substance use disorders: Consensus recommendations. Journal of Psychiatric Practice 2005, 11(5):315-339.