Evaluations of after-school of programs: A meta-evaluation of methodologies and narrative synthesis of findings

American Journal of Evaluation

Volumn 23, Issue 4, 2002, Pages 387-419

  Scott Little, Catherine ^a   Hamann, Mary Sue ^a   Jurs, Stephen G ^a  

^a Regional Educational Laboratory at SERVE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0036891063     PISSN: 10982140     EISSN: None     Source Type: Journal    
DOI: 10.1016/S1098-2140(02)00234-5     Document Type: Article

References (62)

1. Acosta-Tello, E. (1998). A study of quality dimensions within selected school-age care programs in Southern California. Unpublished doctoral dissertation submitted to the University of California, Irvine and the University of California, Los Angeles.
2. Barker, N. C. (1998). Can specialized after-school programs impact delinquent behavior among African-American youth? Child welfare and juvenile justice. In Proceedings of the annual research conference, a system of care for children's mental health: Expanding the research base (Vol. 10, pp. 2-7, February 23-26, 1997). Tampa, FL.
3. Beck, E. L. (1999). Prevention and intervention programming: Lessons learned from an after-school program. The Urban Review, 31, 107-124.
4. Beuhring, T., Blum, R. W., & Rinehart, P. M. (2000). Protecting teens: Beyond race, income, and family structure. Minneapolis, MN: Center for Adolescent Health.
5. Boruch, R. F. (1997). Randomized experiments for planning and evaluation: A practical guide. Thousand Oaks, CA: Sage.
6. Boruch, R. F. (1998). Randomized controlled experiments for evaluation and planning. Handbook of applied social research methods. Thousand Oaks, CA: Sage.
7. Campbell, D. T., & Stanley, J. C. (1966). Experimental and quasi-experimental designs for research. Chicago: Rand McNally.
8. Catalano, R. F., Berglund, M. L., Ryan, J. A. M., Lonczak, H. S., & Hawkins, J. D. (1998). Positive youth development in the United States: Research findings on evaluations of positive youth development programs. Retrieved May 24, 2001, from http://aspe.os.dhhs.gov/hsp/PostivieYouthDev99/index.htm.
9. Cook, T. D., & Campbell, D. T. (1979). Quasi-experimentation: Design & analysis issues for field settings. Boston: Houghton Mifflin.
10. Cook, T. D., & Shadish, W. R. (1994). Social experiments: Some developments over the past fifteen years. Annual Review of Psychology, 45, 545-581.
11. Cooper, H. (1998). Synthesizing research: A guide for literature reviews (3rd ed.). Thousand Oaks, CA: Sage.
12. Cooper, H., & Hedges, L. V. (Eds.). (1994). The handbook of research synthesis. New York: Russell Sage Foundation.
13. Corrin, W. J., & Cook, T. D. (1998). Design elements of quasi-experiments. Advances in educational productivity: Vol. 7. Evaluation research for educational productivity. Greenwich, CT: JAI Press.
14. Dryfoos, J. G. (1998). A look at community schools in 1998: Occasional paper #2 (ED423034). New York: National Center for Schools and Communities.
15. Engman, R. (1992). On a roll: A successful after-school tutoring program at Patrick Henry School, Alexandria, Virginia. Principal, 71, 24-25.
16. Fashola, O. S. (1998). Review of extended-day and after-school programs and their effectiveness (Report No. 24). Baltimore, MD: Center for Research on the Education of Students Placed at Risk.
17. Fashola, O. S. (1999). The child first authority after-school program: A descriptive evaluation (Report No. 38). Baltimore, MD: Center for Research on the Education of Students Placed at Risk.
18. Fleming-McCormick, T., & Tushnet, N. C. (1996). 4-H after-school activity program. Los Alamitos, CA: Southwest Regional Laboratory.
19. Gaynor, F. K., & Horowitz, J. E. (1998). Evaluation of the 4-H after-school activity program (ASAP) 1997-1998. San Francisco, CA: WestED.
20. Halpern, R., Spielberger, J., & Robb, S. (2001). Evaluation of the MOST (Making the most of after-school time) initiative: Final report and summary of findings. Chicago, IL: Chapin Hall Center for Children at the University of Chicago.
21. Halpern, R. (2000). The promise of after-school programs for low-income children. Early Childhood Research Quarterly, 15, 185-214.
22. Hamilton, L. S., & Klein, S. P. (1998). Achievement test score gains among participants in the foundations school-age enrichment program. Rand Project Memorandum, PM-858-EDU.
23. Harvard Family Research Project. (2001). The Exchange, 7, 2. Available: http://www.gse.harvard.edu/.
24. Harvard Family Research Project After-School Initiative. (2001). Retrieved October 1, 2001, from http://www.gse.harvard.edu/hfrp/projects/afterschool.
25. Heinsman, D. T., & Shadish, W. R. (1996). Assignment methods in experimentation: When do nonrandomized experiments approximate answers from randomized experiments? Psychological Methods, 1, 154-169.
26. Henderson, D. (1990). Expanding the curriculum with after-school classes. Oak Park Valley Union Elementary School District, Tulare, California. Thrust, 1, 32-33.
27. Huang, D., Gribbons, B., Kyung, S. K., Lee, C., & Baker, E.V. (2000). A decade of results: The impact of LA's BEST after-school enrichment program on subsequent student achievement and performance. Los Angeles: UCLA Center for the Study of Evaluation.
28. Hudley, C. (1999). Problem behaviors in middle childhood: Understanding risk status and protective factors. Paper presented at the Annual Meeting of The American Educational Research Association in Montreal, Canada.
29. Joint Committee on Standards for Educational Evaluation. (1994). The Program Evaluation Standards (2nd ed.). Thousand Oaks, CA: Sage.
30. King, R. D., Jr., Lipsey, M. W., Shayne, M. W., & Hoskins, A. (1998). Final report on a formative evaluation of the first year of the project for neighborhood aftercare (PNA): A school-based after-school program. Nashville, TN: Vanderbilt Institute for Public Studies.
31. Kulik, J. A., & Kulik, C. C. (1989). Meta-analysis in education. International Journal of Education Research, 31, 221-340.
32. Lamare, J. (1997). Sacramento START: An evaluation report. Sacramento, CA: Sacramento California Neighborhoods Planning and Development Services Department.
33. LoSciuto, L., & Hilbert, S. (1999). A two-year evaluation of the Woodstock youth development project. Journal of Early Adolescence, 19, 488-518.
34. Marshall, N. L., Coll, C. G., Marx, F., McCartney, K., Keife, N., & Ruh, J. (1997). After-school time and children's behavioral adjustment. Merrill-Palmer Quarterly, 43, 497-514.
35. Mathematica Policy Research Inc. (2000). Enhancing the 21st Century Community Learning Centers evaluation: A concept paper. MPR Reference No. 8658-400. Available: http://www.mathematicampr.com/.
36. Mathematica Policy Research Inc. (2001). A broader view: The national evaluation of the 21st Century Community Learning Centers Program. Design Report: Vols. 1 and 2. MPR Reference No. 8658-400. Available: http://www.mathematica-mpr.com/.
37. Mercure, M. (1993). Project achievement: An after-school success story. Principal, 73, 48-50.
38. Miller, B. M. (1995). Out-of-school time: Effects on learning in the primary grades. Wellesley, MA: Center for Research on Women, National Institute on Out-of-School Time.
39. O'Donnell, J., & Michalak, E. A. (1997). Inner-city youths helping children: After-school programs to promote bonding and reduce risk. Social Work in Education, 19, 231-442.
40. Pettit, G. S., Laird, R. D., Bates, J. E., & Dodge, K. A. (1997). Patterns of after-school care in middle childhood: Risk factors and developmental outcomes. Merrill-Palmer Quarterly, 43, 515-538.
41. Phillips, R. S. (1999). Intervention with siblings of children with developmental disabilities from economically disadvantaged families. Families in Society: The Journal of Contemporary Services, 80, 569-577.
42. Pierce, K. M., Hamm, J. V., & Vandell, D. L. (1999). Experiences in after-school programs and children's adjustment in first-grade classrooms. Child Development, 70, 756-767.
43. Pigott, T. D. (1994). Methods for handling missing data in research synthesis. In H. Cooper & L. V. Hedges (Eds.), The handbook of research synthesis. New York: Russell Sage Foundation.
44. Posner, J. K., & Vandell, D. L. (1994). Low-income children's after-school care: Are there beneficial effects of after-school programs? Child Development, 65, 440-456.
45. Reisner, E. R., White, R. N., Brimingham, J., & Welsh, M. (2001). Building quality and supporting expansion of after-school projects: Evaluation results from the TASC after-school program's second year. Washington, DC: Policy Studies Associates Inc.
46. Roth, J., Brooks-Gunn, J., Murray, L., & Foster, W. (1998). Promoting healthy adolescents: Synthesis of youth development program evaluations. Journal of Research on Adolescence, 8, 423-459.
47. Scales, A. M., Morris, G. A., & George, A. W. (1998). A church operated after-school tutorial and enrichment program. The Negro Educational Review, 49, 153-164.
48. Schinke, S., Cole, K. C., & Poulin, S. R. (1998). Evaluation of boys' and girls' club of America's educational enhancement program. Atlanta, GA: Author.
49. Schorr, L. B. (1997). Common purpose: Strengthening families and neighborhoods to rebuild America. New York: Doubleday.
50. Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Boston: Houghton-Mifflin.
51. Shadish, W. R., & Ragsdale, K. (1996). Random versus nonrandom assignment in controlled experiments: Do you get the same answer? Journal of Consulting & Clinical Psychology, 64, 1290-1305.
52. Stufflebeam, D. L. (2001). The meta-evaluation imperative. American Journal of Evaluations, 22, 183-209.
53. Surr, W. B. (2000). Measuring what matters: Meeting the high-stakes accountability challenge on our own terms. After-school issues. Wellesley, MA: National Institute on Out-of-School Time.
54. Torre, A. A. N. (1997). Influencing Latino education. Education and Urban Society, 30, 20-40.
55. University of Nevada, Reno Cooperative Extension Service. (1999). Reducing delinquent behavior and improving academic achievement in after-school programs. Retrieved March 2, 2001, from http://www.cyfernet.org.
56. Urban School Initiative. (1999). Urban School Initiative school age care project: 1998-1999 school year evaluation report. Columbus, OH: Ohio Departments of Human Services and Education.
57. Walker, K. E., Grossman, J. B., Raley, R., Fellerath, V., & Holton, G. I. (2000). Extended service schools: Putting programming in place. Philadelphia, PA: Public/Private Ventures and Manpower Demonstration Research Corporation.
58. Warren, C., Brown, P., & Freudenberg, N. (1999). Evaluation of the New York City beacons: Phase I findings. New York: Academy for Educational Development.
59. Weinbaum, A. (1996). Participatory assessment in after-school programs. New York: Academy for Educational Development.
60. Woodworth, G. (1994). Managing meta-analytic databases. In H. Cooper & L. V. Hedges (Eds.), The handbook of research synthesis. New York: Russell Sage Foundation.
61. Wortman, P. M. (1994). Judging research quality. In H. Cooper & L. V. Hedges (Eds.), The handbook of research synthesis. New York: Russell Sage Foundation.
62. Wortman, P. M., & Bryant, F. B. (1985). School desegregation and black achievement: An integrative review. Sociological Methods and Research, 13(3), 289-324.