Managing Tensions Between Evaluation and Research: Illustrative Cases of Developmental Evaluation in the Context of Research

American Journal of Evaluation

Volumn 35, Issue 1, 2014, Pages 45-60

  Rey, Lynda ^a,b   Tremblay, Marie Claude ^a,b   Brousselle, Astrid ^b  

^a UNIVERSITÉ DE MONTRÉAL   (Canada)

^b UNIVERSITÉ DE SHERBROOKE   (Canada)

Author keywords

challenges; complex intervention; developmental evaluation; research

Indexed keywords

EID: 84893658437     PISSN: 10982140     EISSN: 15570878     Source Type: Journal    
DOI: 10.1177/1098214013503698     Document Type: Article

References (68)

1. Alkin M. C.,Christie C. A.Theorists' models in action. San Francisco, CA: Jossey-Bass; 2005:.
2. Alkin M. C.,Vo A. T.,Hansen M.Using logic models to facilitate comparisons of evaluation theory.Evaluation and Program Planning. 2012;38:1-88.
3. Alvesson M.Methodology for close up studies-Struggling with closeness and closure.Higher Education. 2003;46:167-193.
4. Arendt H.La crise de la culture: huit exercices de pensée politique. Paris, France: Gallimard; 1972:.
5. Beywl W.The evolutive role of evaluation: Just another choice or a unique stance?.Evaluation and Program Planning. 2012;35:219-221.
6. Brousselle A.,Champagne F.,Contandriopoulos A.-P.,Hartz Z.L'évaluation: concepts et méthodes. 2011). L'évaluation: concepts et méthodes (2nd ed.). Montreal, Canada: Presses de l'Université de Montréal.Montreal, Canada: Presses de l'Université de Montréal; 2011:.
7. Campbell M.,Patton M. Q.,Patrizi P.Changing stakeholder needs and changing evaluator roles: The Central Valley Partnership of the James Irvine Foundation.Evaluation and Program Planning. 2003;26:459-469.
8. Cartland J.,Ruch-Ross H. S.,Mason M.,Donohue W.American Journal of Evaluation. 2008:.
9. Champagne F.,Contandriopoulos A.-P.,Tanon A.L'évaluation: Concepts et méthodes. 2011). Utiliser L'évaluation. In BrousselleA.ChampagneF.ContandriopoulosA.-P.HartzZ. (Eds.), L'évaluation: Concepts et méthodes (2nd ed., pp. 277-308). Montreal, Canada: Presses de l'Université de Montréal.Brousselle A.Champagne F.Contandriopoulos A.-P.Hartz Z., ed. Montreal, Canada: Presses de l'Université de Montréal; 2011:277-308.
10. Cherniss C.,Fishman D. B.The Mesquite "MicroSociety" school: Identifying organizational factors that facilitate successful adoption of an innovative program.Evaluation and Program Planning. 2004;27:79-88.
11. Cloutier J.Qu'est-ce que l'innovation sociale?. Montréal, Canada: Centre de recherches des innovations sociales (CRISES; 2003:.
12. Coghlan D.Insider action research doctorates: Generating actionable knowledge.Higher Education. 2007;54:293-306.
13. Contandriopoulos A.-P.,Rey L.,Brousselle A.,Champagne F.Évaluer une intervention complexe: enjeux conceptuels, méthodologiques, et opérationnels.Canadian Journal of Program Evaluation. 2012;26:1-16.
14. Cook T.Collaborative action research within developmental evaluation.Evaluation. 2006;12:418-436.
15. Denis J.-L.,Lomas J.Convergent evolution: The academic and policy roots of collaborative research.Journal of Health Services Research & Policy. 2003;8:1-6.
16. Dickens L.,Watkins K.Action research: Rethinking Lewin.Management Learning. 1999;30:127-140.
17. Dozois E.,Langlois M.,Blanchet-Cohen N.DE 201: Guide du praticien de l'évaluation évolutive. Montreal, Canada: J. W. McConnell Family Foundation, International Institute for Child Rights and Development, University of Victoria; 2010:.
18. Dubois N.,Lloyd S.,Houle J.,Mercier C.,Brousselle A.,Rey L.Practice-based evaluation as a response to address intervention complexity.Canadian Journal of Program Evaluation. 2011;26:105-115.
19. Elliott J.Encyclopedia of evaluation. Mathison S., ed. Thousand Oaks, CA: Sage; 2005:8-10.
20. Fagen M. C.,Redman S. D.,Stacks J.,Barrett V.,Thullen B.,Altenor S.,Neiger B. L.Developmental evaluation: Building innovations in complex environments.Health Promotion Practice. 2011;12:645-650.
21. Fassin D.Comment faire de la santé publique avec des mots. Une rhétorique à l'œuvre.Ruptures. 2000;7:58-78.
22. Fournier D. M.Encyclopedia of evaluation. Mathison S., ed. Thousand Oaks, CA: Sage; 2004:139-140.
23. Gamble J. A.A developmental evaluation primer. Montreal, Canada: The J. W. McConnell Family Foundation; 2008:.
24. Glasgow R. E.,Emmons K. M.How can we increase translation of research into practice? Types of evidence needed.Annual Review of Public Health. 2007;28:413-433.
25. Glasgow R. E.,Lichtenstein E.,Marcus A.Why don't we see more translation of health promotion research to practice? Rethinking the efficacy-to-effectiveness transition.American Journal of Public Health. 2003;93:1261-1267.
26. Greene J. C.Logic and evaluation theory.Evaluation and Program Planning. 2013;38:71-73.
27. Gröne O.,Jorgensen S. J.,Garcia-Barbero M.Standards for health promotion in hospitals. Self-assessment tool for pilot implementation. Copenhagen, Denmark: WHO Regional Office for Europe; 2004:.
28. Hartz Z.Creating a dialogue between the concepts of complexity paradigms and the pragmatic approaches proposed for evaluating complex interventions.Canadian Journal of Program Evaluation. 2011;26:115-119.
29. Huberman M.Steps toward an integrated model of research utilization.Knowledge: Creation Diffusion Utilization. 1987;8:586-611.
30. Hugon M. A.,Siebel C.Recherches impliquées-Recherche-action: le cas de l'éducation. Brussels, Belgium: De Boeck-Wesmail; 1988:.
31. Jacob S.Dictionnaire des politiques publiques. Boussaguet L.Jacquot S.Ravinet P., ed. Paris, France: Les Presses de Sciences Po; 2010:201-208.
32. Levin-Rozalis M.Evaluation and research: Differences and similarities.Canadian Journal of Program Evaluation. 2003;18:1-31.
33. Macaulay A. C.,Commanda L. E.,Freeman W. L.,Gibson N.,McCabe M. L.,Robbins C. M.,Twohig P. L.Participatory research maximises community and lay involvement. North American primary care research group.British Medical Journal. 1999;319:774-778.
34. Mason R.,Boutilier M.The challenge of genuine power sharing in participatory research: The gap between theory and practice.Canadian Journal of Community Mental Health. 1996;15:145-152.
35. Miller R. L.Logic models: A useful way to study theories of evaluation practice?.Evaluation and Program Planning. 2012;38:77-80.
36. Nutbeam D.Evaluating health promotion.British Medical Journal, 318. 1999;404A:.
37. O'Neill M.,Stirling A.Promotion de la santé au Canada et au Québec. Perspectives critiques. O'Neill M.Dupéré S. A.Rootman I., ed. Quebec, Canada: Presses de l'Université Laval; 2006:42-61.
38. Patton M. Q.Developmental evaluation.American Journal of Evaluation. 1994;15:311-319.
39. Patton M. Q.A world larger than formative and summative.American Journal of Evaluation. 1996a;17:131-144.
40. Patton M. Q.Utilization-focused evaluation: The new century text. 1996b). Utilization-focused evaluation: The new century text (3rd ed.). Thousand Oaks, CA: Sage.Thousand Oaks, CA: Sage; 1996b:.
41. Patton M. Q.Organizational development and evaluation.The Canadian Journal of Program Evaluation, Special Issue. 1999;:93-114.
42. Patton M. Q.Qualitative research and evaluation methods. 2002). Qualitative research and evaluation methods (3rd ed.). Thousand Oaks, CA: Sage.Thousand Oaks, CA: Sage; 2002:.
43. Patton M. Q.Evaluation for the way we work.The Non-Profit Quarterly. 2006;13:28-33.
44. Patton M. Q.Utilization-focused evaluation. 2008). Utilization-focused evaluation (4th ed.). San Francisco, CA: Sage.San Francisco, CA: Sage; 2008:.
45. Patton M. Q.Developmental evaluation: Applying complexity concepts to enhance innovation and use. New York, NY: Guilford; 2011:.
46. Pelikan J.,Krajic K.,Dietscher C.The Health Promoting Hospital (HPH): Concept and development.Patient Education and Counseling. 2001;45:239-243.
47. Poth C.,Pei J.,Pinto D.Proceedings of global learn. Barton S. M.Hedberg J.Suzuki K., ed. Chesapeake, VA: Association for the Advancement of Computing in Education; 2011:p 778.
48. Poth C. A.,Pinto D.,Howery K.Addressing the challenges encountered during a developmental evaluation: Implications for evaluation practice.Canadian Journal of Program Evaluation. 2011;26:39-48.
49. Potter C.,Naidoo G.Evaluating large-scale interactive radio programmes.Distance Education. 2009;30:117-141.
50. Potvin L.,Bilodeau A.,Gendron S.Trois defis pour l'evaluation en promotion de la sante.Promotion & Education. 2008;15:17-21.
51. Potvin L.,Bilodeau A.,Gendron S.Trois conceptions de la nature des programmes: implications pour l'évaluation de programmes complexes en santé publique.Canadian Journal of Program Evaluation. 2011;26:91-104.
52. Potvin L.,Goldberg C.Promotion de la santé au Canada et au Québec, perspectives critiques. O'Neill M.Dupéré S.Pederson A.Rootman I., ed. Quebec, Canada: Presses de l'Université Laval; 2006:457-473.
53. PotvinP. (2007). De la recherche à la pratique, de la pratique à la recherche. Mini-colloque, Maîtrise en psychoéducation, Trois-Rivières, Quebec, Canada, April 19, 2007. Retrieved May 30, 2013, fromhttp://www.pierrepotvin.com/6.%20Publications/Conf%20ma%C3%AEtrise-19%20avril-07.pdf.
54. Preskill H.,Russ- EftBuilding evaluation capacity: 72 activites for teaching and training. Thousand Oaks: CA: Sage; 2005:.
55. Rey L.,Brousselle A.,Dedobbeleer N.Logic analysis: Testing program theory to better evaluate complex interventions.Canadian Journal of Program Evaluation. 2012;26:61-89.
56. Robson C.Real world research: A resource for social scientists and practitioner-researchers. 2002). Real world research: A resource for social scientists and practitioner-researchers (2nd ed.). Oxford, England: Blackwell.Oxford, England: Blackwell; 2002:.
57. Rootman I.,Goodstadt M.,Hyndman B.,McQueen D. V.,Potvin L.,Springett J.,Ziglio E.Evaluation in health promotion, principles and perspectives. Copenhagen, Denmark: World Health Organization; 2001:.
58. Rossi P. H.Evaluation roots: A wider perspective of theorists' views and influences. 2013). My views of evaluation and their origins. In AlkinM. C. (Ed.), Evaluation roots: A wider perspective of theorists' views and influences (2nd ed., pp 106-112). Thousand Oaks, CA: Sage.Alkin M. C., ed. Thousand Oaks, CA: Sage; 2013:106-112.
59. Saari E.,Kallio K.Developmental impact evaluation for facilitating learning in innovation networks.American Journal of Evaluation. 2011;32:227-245.
60. Schwandt T. A.The centrality of practice to evaluation.American Journal of Evaluation. 2005;26:95-105.
61. Scriven M.Evaluation studies review annual. Glass G. V., ed. Beverly Hills, CA: Sage; 1976:101-118.
62. Scriven M.Types of evaluation and types of evaluator.Evaluation Practice. 1996;17:151-161.
63. Thiebaut G.-C.,Brousselle A.,Contandriopoulos A.-P.,Champagne F.,Hartz Z.L'évaluation: concepts et méthodes. 2011). Positionner l'évaluateur face aux enjeux de l'évaluation. In BrousselleA.ChampagneF.ContandriopoulosA.-P.HartzZ. (Eds.), L'évaluation: concepts et méthodes (2nd ed., pp. 11-23). Montreal, Canada: Presses de l'Université de Montréal.Brousselle A.Champagne F.Contandriopoulos A.-P.Hartz Z., ed. Montreal, Canada: Presses de l'Université de Montréal; 2011:11-23.
64. Torvatn H.Book review: Logic modeling methods in program evaluation, J.A. Frechtling. Wiley, Inc., Jossey-Bass, San Francisco (2007).Evaluation and Program Planning. 2008;31:219-221.
65. TremblayM. C.RichardL. (2011). Complexity: A potential paradigm for a health promotion discipline. Health Promotion International. Retrieved from:http://heapro.oxfordjournals.org/content/early/2011/09/07/heapro.dar054.short. doi:10.1093/heapro/dar054.
66. Weiss C. H.Evaluating action programs: Readings in social action and education. Boston, MA: Allyn & Bacon; 1972:.
67. Weiss C. H.The many meanings of research utilization.Public Administration Review. 1979;39:426-431.
68. ZimmermanB. J.DuboisN.HouleJ.LloydS.MercierC.BrousselleA.ReyL. (2011). How does complexity impact evaluation? An introduction to the special issue. Canadian Journal of Program Evaluation, 26, V-XX. Retrieved fromhttp://www.medsp.umontreal.ca/IRSPUM_DB/pdf/26691.pdf.