Multilevel evaluation alignment: An explication of a four-step model

American Journal of Evaluation

Volumn 25, Issue 4, 2004, Pages 493-507

  Yang, Huilan ^a   Shen, Jianping ^b   Cao, Honggao ^b   Warfield, Charles ^b  

^a W K KELLOGG FOUNDATION   (United States)

^b NONE

Author keywords

[No Author keywords available]

Indexed keywords

EID: 10244242462     PISSN: 10982140     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ameval.2004.09.001     Document Type: Article

References (29)

1. T.F. Babor K.L. Steinberg B. Mcree J. Vendetti K.M. Carroll Treating marijuana dependence in adults: A multisite, randomized clinical trial In: J.M. Herrell R.B. Straw (Eds.), Conducting multiple site evaluations in real-world settings. New directions for evaluation, no. 94 2002 Jossey-Bass San Francisco 17-30
2. S. Banks G.J. McHugo V. Williams R.E. Drake M. Shinn A perspective meta-analytic approach in a multisite study of homeless prevention In: J.M. Herrell R.B. Straw (Eds.), Conducting multiple site evaluations in real-world settings. New directions for evaluation, no. 94 2002 Jossey-Bass San Francisco 45-60
3. A.S. Bryk S. Raudenbush Hierarchical linear models: Applications and data analysis 1992 Sage Newbury Park, CA
4. H.T. Chen Development of a national evaluation system to evaluate CDC-funded health department HIV prevention programs American Journal of Evaluation 22 2001 55-77
5. J.A. Cook M.A. Carey L.A. Razzano J. Burke C.R. Blyler The pioneer: The employment intervention demonstration program In: J.M. Herrell R.B. Straw (Eds.), Conducting multiple site evaluations in real-world settings. New directions for evaluation, no. 94 2002 Jossey-Bass San Francisco 31-44
6. Dehejia, R. (1999). Evaluation in multi-site programs. Working paper, Columbia University and NBER (retrieved May 20th, 2004, from http://emlab.berkeley.edu/symposia/nsf99/papers/dehejia.pdf).
7. L.S. Hamilton D.F. McCaffrey B.M. Stecher S.P. Klein A. Robyn D. Bugliari Studying large-scale reforms of instructional practice: An example from mathematics and science Educational Evaluation and Policy Analysis 25 1 2003 1-29
8. Hanssen, C. E. (2004). Structural equation modeling as a tool for multisite evaluation. Unpublished doctoral dissertation, Western Michigan University, Kalamazoo.
9. E.A. Hanushek The economics of schooling: Production and efficiency in public schools Journal of Economic Literature 24 1986 1141-1177
10. Herrell, J. M., & Straw, R. B. (2002). Conducting multiple site evaluations in real-world settings. New directions for evaluation, no. 94. San Francisco: Jossey-Bass.
11. Howard, B. C., McGee, S., Shia, R., & Hong, N. S. (2001). Computer-based science inquiry: How components of metacognitive self-regulation affect problem-solving. Paper presented at the annual meeting of the American Educational Research Association, Seattle, WA (retrieved May 20th, 2004, from http://www.cet.edu/research/papers/inquiry/AERA2001BHcbsi.pdf).
12. Kalaian, S. A. (2003). Meta-analysis methods for synthesizing treatment effects in multisite studies: Hierarchical linear modeling (HLM) perspective. Practical Assessment, Research and Evaluation, 8(15) (retrieved May 20th, 2004, from http://pareonline.net/ getvn.asp?v=8%26n=15).
13. Kellogg Foundation, W. K. (2001). Logic model development guide. Battle Creek, MI: Kellogg Foundation (retrieved May 20th, 2004, from http://www.wkkf.org/Pubs/Tools/Evaluation/Pub3669.pdf).
14. Kellogg Foundation, W. K. (2003a). Philanthropy and volunteerism: Unleashing resources for the common good. Battle Creek, MI: Kellogg Foundation (retrieved May 20th, 2004, from http://www.wkkf.org/Pubs/PhilVol/Pub644.pdf).
15. Kellogg Foundation, W. K. (2003b). Evaluation guidebook for the unleashing resources initiative, phase II. Battle Creek, MI: WS & Associates.
16. A. Konu T. Lintonen V. Autio Evaluation of well-being in schools: A multilevel analysis of general subjective well-being School Effectiveness and School Improvement 13 2002 187-200
17. F. Lawrenz D. Huffman How can multi-site evaluation be participatory? American Journal of Evaluation 24 2003 471-482
18. D. Livert D. Rindskopf L. Saxe M. Stirratt Using multilevel modeling in the evaluation of community-based treatment programs Multivariate Behavior Research 36 2000 155-184
19. D. McDonald Developing guidelines to enhance the evaluation of overseas development projects Evaluation and Program Planning 22 1999 163-174
20. M. Patton Utilization-focused evaluation 1997 Sage Thousand Oaks, CA
21. S.W. Raudenbush X. Liu Statistical power and optimal design for multisite randomized trials Psychological Methods 5 2000 199-213
22. D.J. Rog F.L. Randolph A multisite evaluation of supported housing: Lessons learned from cross-site collaboration In: J.M. Herrell R.B. Straw (Eds.), Conducting multiple site evaluations in real-world settings. New directions for evaluation, no. 94 2002 Jossey-Bass San Francisco 61-72
23. J.R. Sanders Cluster evaluation In: E. Chelimsky W.R. Shadish (Eds.), Evaluation for the 21th century: A handbook 1997 Sage Thousand Oaks, CA 396-404
24. Schlenger, W., Karuntzos, G., Bray, J., & Ringwalt, C. (1999). Workplace managed care multisite evaluation design. Research Triangle Park, NC: Research Triangle Institute (retrieved May 20th, 2004, from http://workplace.samhsa.gov/WPResearch/CrossSites/multisiteeval.pdf).
25. M.J. Schwerin P.G. Michael D.N. Galser K.L. Farrar A cluster evaluation of Navy quality of life programs Evaluation and Program Planning 25 2002 303-312
26. J. Shen C. Warfield A proposal to conduct the initiative-level evaluation for the unleashing resources for the common good initiative 2003 W.K. Kellogg Foundation, Philanthropy and Volunteerism Program Area Battle Creek, MI
27. R.B. Straw J.M. Herrell A framework for understanding and improving multisite evaluations In: J.M. Herrell R.B. Straw (Eds.), Conducting multiple site evaluations in real-world settings. New directions for evaluation, no. 94 2002 Jossey-Bass San Francisco 5-16
28. Wagner, M., Iida, E., & Spiker, D. (2001). The multisite evaluation of the parents as teachers home visiting program: Three-year findings from one community (SRI Project P07283). Menlo Park, CA: SRI International (retrieved May 20th, 2004, from http://www.sri.com/policy/cehs/publications/humpub/patdel.pdf).
29. Winick, C., & Larson, M. J. (1997). 75 community action programs. In J. H. Lowinson, P. Ruiz, R. B. Millman, & J. G. Langrod (Eds.), Substance abuse: A comprehensive textbook (3rd ed., pp. 755-764). Philadelphia, PA: Williams and Wilkins.