The bottom-up approach to integrative validity: A new perspective for program evaluation

Evaluation and Program Planning

Volumn 33, Issue 3, 2010, Pages 205-214

  Chen, Huey T ^a  

^a NATIONAL CENTER FOR ENVIRONMENTAL HEALTH   (United States)

Author keywords

Bottom up approach; Credible evidence; External validity; Integrative validity model; Internal validity; Top down approach; Viability evaluation; Viable validity

Indexed keywords

BOTTOM-UP APPROACH; MODEL VALIDATION; MODELING; STAKEHOLDER; TOP-DOWN APPROACH;

ARTICLE; HEALTH CARE QUALITY; HEALTH PROMOTION; METHODOLOGY; THEORETICAL MODEL; VALIDATION STUDY;

HEALTH PROMOTION; MODELS, THEORETICAL; PROGRAM EVALUATION; VALIDATION STUDIES AS TOPIC;

EID: 77953819073     PISSN: 01497189     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.evalprogplan.2009.10.002     Document Type: Article

References (80)

1. Aber J.L., Brown J.L., Chaudry N., Jones S.M., Samples F. The evaluation of the resolving conflict creatively program: An overview. American Journal of Preventive Medicine 1996, 12(5 Suppl.):82-90.
2. Evaluation roots: Tracing theorists' views and influences 2004, Sage, Thousand Oaks, CA. M. Alkin (Ed.).
3. Altschuld J. Planning and conducting needs assessment: A practical guide 1995, Sage, Thousand Oaks, CA.
4. Atkins D., Fink K., Slutsky J. Better information for better health care: The evidence-based practice center program and the agency for healthcare research and quality. Annals of Internal Medicine 2005, 142(12 Pt. 2):1035-1041.
5. Bamberger M., Rugh J., Mabry L. Realworld evaluation: Working under time, data, and political constraints 2006, Sage, Thousand Oaks, CA.
6. Bluthenthal R.N., Kral A.H., Erringer E.A., Edlin B.R. Use of an illegal syringe exchange and injection-related risk behaviors among street-recruited injection drug users in Oakland, California, 1992 to 1995. Journal of Acquired Immune Deficiency Syndromes Human Retrovirology 1998, 18(5):505-511.
7. Campbell D.T., Stanley J. Experimental and quasi-experimental designs for research 1963, Rand McNally, Chicago.
8. CDC Framework for program evaluation in public health. MMWR 1999, 48(RR-11):1-40.
9. Chen H.T. Validity in evaluation research: A critical assessment of current issues. Policy and Politics 1988, 16(1):1-16.
10. Chen H.T. Theory-driven evaluations 1990, Sage, Thousand Oak, CA.
11. Chen H.T. Practical program evaluation: Assessing and improving planning, implementation, and effectiveness 2005, Sage, Thousand Oak, CA.
12. Chen H.T., Yip F., Iqbal S., Garbe P. Evaluating a Carbon Monoxide Ordinance: Using Program Theory to Enhance External Validity. Manuscript presented at American Evaluation Association Annual Meetings, November 10-14, 2009, Orlando, Florida 2009.
13. Chen H.T. A Theory-Driven Evaluation Perspective on Mixed Methods Research. Research in the Schools 2006, 13(1):75-83.
14. Chen H.T., Rossi P.H. The theory-driven approach to validity. Evaluation and Program Planning 1983, 10:95-103.
15. Chinman M., Hannah G., Wandersman A., Ebener P., Hunter S.B., Imm P., et al. Developing a community science research agenda for building community capacity for effective preventive interventions. American Journal of Community Psychology 2005, 35(3/4):143-157.
16. Cook T.D., Campbell D.T. Quasi-experimentation: Design and analysis issues for field settings 1979, Rand McNally, Chicago.
17. Cronbach L.J. Designing evaluations of educational and social programs 1982, Jossey-Bass, San Francisco.
18. Cross J.E., Saunders C.M., Bartelli D. The effectiveness of educational and needle exchange programs: A meta-analysis of HIV preventional strategies for injection drug users. Quality & Quantity 1998, 32:165-180.
19. Cunningham-Sabo L., Carpenter W.R., Peterson J.C., Anderson L.A., Helfrich C.D., Davis S.M. Utilization of prevention research: Searching for evidence. American Journal of Preventive Medicine 2007, 33(1 Suppl.):S9-S20.
20. Des Jarlais D.C., Friedman S.R. Fifteen years of research on preventing HIV infection among injecting drug users: What we have learned, what we have not learned, what we have done, what we have not done. Public Health Reports 1998, 113(Suppl. 1):182-188.
21. Des Jarlais D.C., Marmor M., Paone D., Titus S., Shi Q., Perlis T., et al. HIV incidence among injecting drug users in New York City syringe-exchange programmes. The Lancet 1996, 348(9033):987-991.
22. Donaldson S.L. Program theory-driven evaluation science: Strategies and applications 2007, Lawrence Erlbaum, New York.
23. Donaldson S.L., Christie C.A., Mark M.M.E. What counts as credible evidence in applied and evaluation practice? 2008, Sage, Newbury Park, CA.
24. Eggert L.L., Thompson E.A., Herting J.R., Nicholas L.J., Dicker B.G. Preventing adolescent drug abuse and high school dropout through an intensive school-based social network development program. American Journal of Health Promotion 1994, 8(3):202-215.
25. FDA Guideline for the clinical evaluation of analgesic drugs 1992, Food & Drug Administration, Rockville, MD.
26. Flay B.R. Efficacy and effectiveness trials (and other phases of research) in the development of health promotion programs. Preventive Medicine 1986, 15(5):451-474.
27. Flay B.R., Biglan A., Boruch R.F., Castro F.G., Gottfredson D., Kellam S., et al. Standards of evidence: Criteria for efficacy, effectiveness and dissemination. Prevention Science 2005, 6(3):151-175.
28. Gibbon M., Labonte R., Laverack G. Evaluating community capacity. Health & Social Care in Community 2002, 10(6):485-491.
29. Glasgow R.E., Lichtenstein E., Marcus A.C. Why don't we see more translation of health promotion research to practice? Rethinking the efficacy-to-effectiveness transition. American Journal of Public Health 2003, 93(8):1261-1267.
30. Glasgow R.E., Green L.W., Klesges L.M., Abrams D.B., Fisher E.B., Goldstein M.G., et al. External validity: We need to do more. Annals of Behavioral Medicine 2006, 31(2):105-108.
31. Green L.W., Glasgow R.E. Evaluating the relevance, generalization, and applicability of research: Issues in external validation and translation methodology. Evaluation & The Health Professions 2006, 29(1):126-153.
32. Advanced in mixed-method evaluation: The challenge and benefits of integrating diverse paradigm 1997, 74. Jossey-Bass, San Francisco.
33. Greenwald P., Cullen J.W. The scientific approach to cancer control. CA: A Cancer Journal for Clinicians 1984, 34(6):328-332.
34. Guba E.G., Lincoln Y.S. Fourth generation evaluation 1989, Sage, Newbury Park, CA.
35. Hagan H.C.J.D., Friedman S.R., Purchase D., Alter M.J. Reduced risk of hepatitis B and hepatitis C among injection drug users in the Tacoma syringe exchange program. American Journal of Public Health 1995, 85(11):1531-1537.
36. Hallfors D., Cho H., Sanchez V., Khatapoush S., Kim H.M., Bauer D. Efficacy vs effectiveness trial results of an indicated " model" substance abuse program: Implications for public health. American Journal of Public Health 2006, 96(12):2254-2259.
37. Haynes B. Can it work? Does it work? Is it worth it? The testing of healthcare interventions is evolving. BMJ 1999, 319(7211):652-653.
38. Critical issues in STEM evaluation 2006, Jossey-Bass, San Francisco. D. Huffman, F. Lawrenz (Eds.).
39. Kellam S.G., Langevin D.J. A framework for understanding " evidence" in prevention research and programs. Prevention Science 2003, 4(3):137-153.
40. Klesges L.M., Dzewaltowski D.A., Glasgow R.E. Review of external validity reporting in childhood obesity prevention research. American Journal of Preventive Medicine 2008, 34(3):216-223.
41. Kohatsu N.D., Robinson J.G., Torner J.C. Evidence-based public health: An evolving concept. American Journal of Preventive Medicine 2004, 27(5):417-421.
42. Ksobiech K. A meta-analysis of needle sharing, lending, and borrowing behaviors of needle exchange program attenders. AIDS Education and Prevention 2003, 15(3):257-268.
43. Lurie P. Invited commentary: Le mystere de Montreal. American Journal of Epidemiology 1997, 146(12):1003-1006.
44. Masson C.L., Sorensen J.L., Perlman D.C., Shopshire M.S., Delucchi K.L., Chen T., et al. Hospital- versus community-based syringe exchange: A randomized controlled trial. AIDS Education and Prevention 2007, 19(2):97-110.
45. McGinnis J.M., Foege W. Guide to community preventive services: Harnessing the science. American Journal of Preventive Medicine 2000, 18(1 Suppl.):1-2.
46. Miller R.L., Shinn M. Learning from communities: Overcoming difficulties in dissemination of prevention and promotion efforts. American Journal of Community Psychology 2005, 35(3/4):169-183.
47. Moher D., Schulz K.F., Altman D.G. The CONSORT statement: Revised recommendations for improving the quality of reports of parallel-group randomised trials. The Lancet 2001, 357(9263):1191-1194.
48. Mrazek P.J., Haggerty R.J. Reducing risks for mental disorders: Frontiers for preventive intervention research 1994, National Academy Press, Washington, DC.
49. Nutbeam D. Evaluating health promotion. BMJ 1999, 318(7180):404A.
50. Patrick K., Scutchfield F.D., Woolf S.H. External validity reporting in prevention research. American Journal of Preventive Medicine 2008, 34(3):260-262.
51. Patton M.Q. Utilization-focused evaluation 1997, Thousand Oaks, CA. 3rd ed.
52. Persaud N., Mamdani M.M. External validity: The neglected dimension in evidence ranking. Journal of Evaluation in Clinical Practice 2006, 12(4):450-453.
53. Posavac E.J., Carey R.G. Program evaluation: Methods and case studies 2007, Pearson Prentice Hall, Upper Saddle River, NJ.
54. Rogers E.M. Diffusion of innovations 2003, Free Press, New York. 5th ed.
55. Rossi P.H., Lipsey M.W., Freeman H.E. Evaluation: A systematic approach 2004, Sage, Thousand Oaks, CA.
56. Rotheram-Borus M.J., Duan N. Next generation of preventive interventions. Journal of American Academy of Child and Adolescent Psychiatry 2003, 42(5):518-526.
57. Sackett D.L., Rosenber W.M.C., Gray J.A.M., Hayes R., Richardson W.S. Evidence-based medicine: What is and what it isn't. BMJ 1996, 312:71-72.
58. Sanders J., Evaluation J.C.o.S.f.E. The program evaluation standards 1994, Sage, Thousand Oaks, CA. 2nd ed.
59. Sandler I., Balk D., Jordan J., Kennedy C., Nadeau J., Shapiro E. Bridging the gap between research and practice in bereavement: Report from the Center for the Advancement of Health. Death Studies 2005, 29(2):93-122.
60. Shadish W.R., Luellen J.K. Donald Campbell: The accidental evaluator. Evaluation roots: Tracing theorists' views and influences 2004, 80-87. Sage, Thousand Oaks, CA. M.C. Alkin (Ed.).
61. Shadish W.R., Cook T.D., Leviton L.C. Foundation of program evaluation: Theories of practice 1991, Sage, Newbury Park, CA.
62. Shadish W.R., Cook T.D., Campbell D.T. Experimental and quasi-experimental designs for generalized causal inference 2002, Houghton Mifflin, Boston.
63. Speller V., Learmonth A., Harrison D. The search for evidence of effective health promotion. BMJ 1997, 315(7104):361-363.
64. Spoth R.L., Greenberg M.T. Toward a comprehensive strategy for effective practitioner-scientist partnerships and larger-scale community health and well-being. American Journal of Community Psychology 2005, 35(3/4):107-126.
65. Steckler A., McLeroy K.R. The importance of external validity. American Journal of Public Health 2008, 98(1):9-10.
66. Stephenson J., Imrie J. Why do we need randomised controlled trials to assess behavioural interventions?. BMJ 1998, 316(7131):611-613.
67. Stimson G.V. Has the United Kingdom averted an epidemic of HIV-1 infection among drug injectors?. Addiction 1996, 91(8):1085-1088.
68. Suchman E. Evaluation research 1967, Russell Sage, New York.
69. Sussman S., Valente T.W., Rohrbach L.A., Skara S., Pentz M.A. Translation in the health professions: Converting science into action. Evaluation & Health Professions 2006, 29(1):7-32.
70. Handbook of mixed methods in social and behavioral research 2003, Sage, Thousand Oaks, CA. A. Tashakkori, C. Teddlie (Eds.).
71. Tilford S. Evidence-based health promotion. Health Education Research 2000, 15(6):659-663.
72. Van den Hoek J.A., van Haastrecht H.J., Coutinho R.A. Risk reduction among intravenous drug users in Amsterdam under the influence of AIDS. American Journal of Public Health 1989, 79(10):1355-1357.
73. Vlahov D., Junge B., Brookmeyer R., Cohn S., Riley E., Armenian H., et al. Reductions in high-risk drug use behaviors among participants in the Baltimore needle exchange program. Journal of Acquired Immune Deficiency Syndrome Human Retrovirology 1997, 16(5):400-406.
74. Wandersman A. Community science: Bridging the gap between science and practice with community-centered models. American Journal of Community Psychology 2003, 31(3/4):227-242.
75. Wandersman A., Duffy J., Flaspohler P., Noonan R., Lubell K., Stillman L., et al. Bridging the gap between prevention research and practice: The interactive systems framework for dissemination and implementation. American Journal of Community Psychology 2008, 41(3/4):171-181.
76. Weiner B.J., Helfrich C.D., Savitz L.A., Swiger K.D. Adoption and implementation of strategies for diabetes management in primary care practices. American Journal of Preventive Medicine 2007, 33(1 Suppl.):S35-S44. quiz S45-S39.
77. Weiss C. Where politics and evaluation research meet. American Journal of Evaluation 1973/1993, 14(1):93-106.
78. Weiss C. Evaluation 1998, Prentice Hall, Englewood Cliffs, NJ. 2nd ed.
79. Wholey J.S. Evaluability assessment: Developing program theory. Using program theory inn evaluation 1987, 33:77-92. Jossey-Bass, San Francisco.
80. Zaltman G., Duncan R. Strategies for planned change 1977, Wiley, New York.