Randomizing groups to evaluate place-based programs

Learning More from Social Experiments: Evolving Analytic Approaches

Volumn , Issue , 2006, Pages 115-172

  Bloom, Howard S ^a  

^a MDRC ^*  (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84903037207     PISSN: None     EISSN: None     Source Type: Book    
DOI: None     Document Type: Chapter

References (82)

1. Blalock, Hubert M., Jr. 1972. Social Statistics. New York: McGraw-Hill.
2. Blank, Rolf K., Diana Nunnaley, Andrew Porter, John Smithson, and Eric Osthoff. 2002. Experimental Design to Measure Effects of Assisting Teachers in Using Data on Enacted Curriculum to Improve Effectiveness of Instruction in Mathematics and Science Education. Washington, D.C.: National Science Foundation.
3. Bloom, Howard S. 1995. "Minimum Detectable Effects: A Simple Way to Report the Statistical Power of Experimental Designs." Evaluation Review 19(5): 547-56.
4. Bloom, Howard S., Johannes M. Bos, and Suk-Won Lee. 1999. "Using Cluster Random Assignment to Measure Program Impacts: Statistical Implications for the Evaluation of Education Programs." Evaluation Review 23(4): 445-69.
5. Bloom, Howard S., and James A. Riccio. 2002. Using Place-Based Random Assignment and Comparative Interrupted Time-Series Analysis to Evaluate the Jobs-Plus Employment Program for Public Housing Residents. New York: MDRC.
6. Bloom, Howard S., James A. Riccio, and Nandita Verma. Forthcoming. Promoting Work in Public Housing: The Effectiveness of Jobs-Plus. New York: MDRC.
7. Bloom, Howard S., JoAnn Rock, Sandra Ham, Laura Melton, and Julieanne O'Brien. 2001. Evaluating the Accelerated Schools Approach: A Look at Early Implementation and Impacts on Student Achievement in Eight Elementary Schools. New York: MDRC.
8. Bogatz, Gerry Ann, and Samuel Ball. 1971. The Second Year of Sesame Street: A Continuing Evaluation. Princeton, N.J.: Educational Testing Service.
9. Boruch, Robert F., and Ellen Foley. 2000. "The Honestly Experimental Society: Sites and Other Entities as the Units of Allocation and Analysis in Randomized Trials." In Validity and Social Experimentation: Donald Campbell's Legacy, edited by Leonard Bickman. Volume 1. Thousand Oaks, Calif.: Sage Publications.
10. Branson, William H. 1972. Macroeconomic Theory and Policy. New York: Harper & Row.
11. Brooks-Gunn, Jeanne, Greg J. Duncan, and J. Lawrence Aber, eds. 1997. Neighborhood Poverty: Context and Consequences for Children. New York: Russell Sage Foundation.
12. Bryk, Anthony S., and Stephen W. Raudenbush. 1988. "Heterogeneity of Variance in Experimental Studies: A Challenge to Conventional Interpretations." Psychological Bulletin 104(3): 396-404.
13. Campbell, Marion K., Jeremy M. Grimshaw, and I. N. Steen. 2000. "Sample Size Calculations for Group Randomised Trials." Journal of Health Services and Policy Research 5: 12-16.
14. Campbell, Marion K., Jill Mollison, and Jeremy M. Grimshaw. 2001. "Group Trials in Implementation Research: Estimation of Intragroup Correlation Coefficients and Sample Size." Statistics in Medicine 20: 391-99.
15. Chen, Hueytsyh, and Peter H. Rossi. 1983. "Evaluating with Sense: The Theory-Driven Approach." Evaluation Review 7(3): 283-302.
16. Cohen, Jacob. 1977/1988. Statistical Power Analysis for the Behavioral Sciences. New York: Academic Press.
17. Connell, James P., and Anne C. Kubisch. 1998. "Applying a Theory of Change Approach to the Evaluation of Comprehensive Community Initiatives: Progress, Prospects, and Problems." In New Approaches to Evaluating Community Initiatives, Volume 2: Theory, Measurement, and Analysis, edited by Karen Fulbright-Anderson, Anne C. Kubisch, and James P. Connell. Washington, D.C.: Aspen Institute.
18. Cook, Thomas H., David Hunt, and Robert F. Murphy. 2000. "Comer's School Development Program in Chicago: A Theory-Based Evaluation." American Educational Research Journal (Summer).
19. Cornfield, Jerome. 1978. "Randomization by Group: A Formal Analysis." American Journal of Epidemiology 108(2): 100-102.
20. Cox, David R. 1958. Planning of Experiments. New York: John Wiley.
21. Donner, Allan, and Neil Klar. 2000. Design and Analysis of Group Randomization Trials in Health Research. London: Arnold.
22. Eccles, Martin P., I. Nick Steen, Jeremy M. Grimshaw, Lois Thomas, Paul McNamee, Jennifer Souter, John Wilsdon, Lloyd Matowe, Gillian Needham, Fiona Gilbert, and Senga Bond. 2001. "Effect of Audit and Feedback and Reminder Messages on Primary-Care Referrals: A Randomized Trial." The Lancet 357: 1406-9.
23. Fisher, Ronald A. 1925. Statistical Methods for Research Workers. Edinburgh: Oliver & Boyd.
24. -. 1926. "The Arrangement of Field Experiments." Journal of Agriculture 33: 503-13.
25. -. 1937/1947. The Design of Experiments. Edinburgh: Oliver & Boyd.
26. Flay, Brian R. 2000. "Approaches to Substance Use Prevention Utilizing School Curriculum Plus Social Environment Change." Addictive Behaviors 25(6): 861-85.
27. Flay, Brian R., Katherine B. Ryan, J. Allan Best, Stephen Brown, Mary W. Kersell, Josie R. d'Avernas and Mark P. Zanna. 1985. "Are Social-Psychological Smoking Prevention Programs Effective? The Waterloo Study." Journal of Behavioral Medicine 8(1): 37-59.
28. Gail, Mitchell H., Steven D. Mark, Raymond J. Carroll, Sylvan B. Green, and David Pee. 1996. "On Design Considerations and Randomization-Based Inference for Community Intervention Trials." Statistics in Medicine 15: 1069-92.
29. Galster, George C., Roberto G. Quercia, and Alvaro Cortes. 2000. "Identifying Neighborhood Thresholds: An Empirical Exploration." Housing Policy Debate 11(3): 701-32.
30. Garfinkel, Irwin, Charles F. Manski, and Charles Michalopoulos. 1992. "Micro Experiments and Macro Effects." In Evaluating Welfare and Training Programs, edited by Charles F. Manski and Irwin Garfinkel. Cambridge, Mass.: Harvard University Press.
31. Gladwell, Malcolm. 2000. The Tipping Point: How Little Things Can Make a Big Difference. Boston: Little, Brown.
32. Gosnell, Harold F. 1927. Getting Out the Vote: An Experiment in the Stimulation of Voting. Chicago: University of Chicago Press.
33. Gosset, William Sealy ["Student," pseud.]. 1908. "The Probable Error of a Mean." Biometrika 6: 1-25.
34. Granovetter, Mark. 1973. "The Strength of Weak Ties." American Journal of Sociology 78(6): 1360-80.
35. -. 1978. "Threshold Models of Collective Behavior." American Journal of Sociology 83(6): 1420-43.
36. Grimshaw, Jeremy M., Ruth E. Thomas, Graeme MacLennan, Cynthia Fraser, Craig Ramsay, Luke Vale, Paula Whitty, Martin P. Eccles, Lloyd Matowe, L. Shirran, Michel Wensing, Rob Dijkstra, and C. Donaldson. 2004. "Effectiveness and Efficiency of Guideline Dissemination and Implementation Strategies." Health Technology Assessment.
37. Gueron, Judith M. 1984. Lessons from a Job Guarantee: The Youth Incentive Entitlement Pilot Projects. New York: MDRC.
38. Hacking, Ian. 1988. "Telepathy: Origins of Randomization in Experimental Design." Isis 79: 427-51.
39. Hedges, Larry V., and Ingram Olkin. 1985. Statistical Methods for Meta-Analysis. Boston: Academic Press.
40. Hsieh, Chang-Tai, and Miguel Urquiola. 2003. "When Schools Compete, How Do They Compete? An Assessment of Chile's Nationwide School Voucher Program." Working paper w10008. Washington: National Bureau of Economic Research. Available at: www.nber.org/papers/w10008 (accessed January 5, 2005).
41. Jencks, Christopher, and Susan E. Mayer. 1990. "The Social Consequences of Growing Up in a Poor Neighborhood." In Inner-City Poverty in the United States, edited by Laurence E. Lynn, Jr., and M. McGeary. Washington, D.C.: National Academy Press.
42. Kane, Thomas J. 2004. "The Impact of After-School Programs: Interpreting the Results of Four Recent Evaluations." New York: W. T. Grant Foundation.
43. Kellert, Stephen H. 1993. In the Wake of Chaos: Unpredictable Order in Dynamical Systems. Chicago: University of Chicago Press.
44. Kelling, George, A. M. Pate, D. Dieckman, and C. Brown. 1974. The Kansas City Preventative Patrol Experiment: Technical Report. Washington, D.C.: Police Foundation.
45. Kennedy, Stephen D. 1988. "Direct Cash Low-Income Housing Assistance," in Lessons From Selected Program and Policy Areas, edited by Howard S. Bloom, David S. Cordray, and Richard J. Light. San Francisco: Jossey-Bass.
46. Kish, Leslie. 1965. Survey Sampling. New York: John Wiley.
47. Kling, Jeffrey R., Jens Ludwig, and Lawrence F. Katz. 2005. "Neighborhood Effects on Crime for Female and Male Youth: Evidence from a Randomized Housing Voucher Experiment." Quarterly Journal of Economics 120(1): n.p.
48. Kmenta, Jan. 1971. Elements of Econometrics. New York: Macmillan.
49. Ladd, Helen F., and Edward B. Fiske. 2000. When Schools Compete: A Cautionary Tale. Washington, D.C.: Brookings Institution Press.
50. Leviton, Laura C., Robert L. Goldenberger, C. Suzanne Baker, and M. C. Freda. 1999. "Randomized Controlled Trial of Methods to Encourage the Use of Antenatal Corticosteroid Therapy for Fetal Maturation." Journal of the American Medical Association 281(1): 46-52.
51. Lindquist, Everet Franklin. 1953. Design and Analysis of Experiments in Psychology and Education. Boston: Houghton Mifflin.
52. Lipsey, Mark W. 1990. Design Sensitivity: Statistical Power for Experimental Research. Newbury Park, Calif.: Sage.
53. Liu, Xiaofeng. 2003. "Statistical Power and Optimum Sample Allocation Ratio for Treatment and Control Having Unequal Costs per Unit of Randomization." Journal of Educational and Behavioral Statistics 28(3): 231-48.
54. Martin, Donald C., Paula Diehr, Edward B. Perrin, and Thomas D. Koepsell. 1993. "The Effect of Matching on the Power of Randomized Community Intervention Studies." Statistics in Medicine 12: 329-38.
55. Miller, Cynthia, and Howard Bloom. 2002. "Random Assignment in Cleveland - Round One." Internal memorandum. New York: MDRC.
56. Murray, David M. 1998. Design and Analysis of Group-Randomized Trials. New York: Oxford University Press.
57. Murray, David M., Peter J. Hannan, David R. Jacobs, Paul J. McGovern, Linda Schmid, William L. Baker, and Clifton Gray. 1994. "Assessing Intervention Effects in the Minnesota Heart Health Program." American Journal of Epidemiology 139(1): 91-103.
58. Murray, David M., Brenda L. Rooney, Peter J. Hannan, Arthur V. Peterson, Dennis V. Ary, Anthony Biglan, Gilbert J. Botvin, Richard I. Evans, Brian R. Flay, Robert Futterman, J. Greg Getz, Pat M. Marek, Mario Orlandi, MaryAnn Pentz, Cheryl L. Perry, and Steven P. Schinke. 1994. "Intraclass Correlation Among Common Measures of Adolescent Smoking: Estimates, Correlates and Applications in Smoking Prevention Studies."" American Journal of Epidemiology 140(11): 1038-50.
59. Murray, David M., and Brian Short. 1995. "Intraclass Correlation Among Measures Related to Alcohol Use by Young Adults: Estimates, Correlates and Applications in Intervention Studies."" Journal of Studies on Alcohol 56(6): 681-94.
60. Musgrave, Richard A. 1959. The Theory of Public Finance. New York: McGraw-Hill.
61. Musgrave, Richard A., and Peggy B. Musgrave. 1973. Public Finance in Theory and Practice. New York: McGraw-Hill.
62. Myrdal, Gunnar. 1944. An American Dilemma. New York: Harper & Row.
63. National Center for Educational Statistics. 1997. "Reading and Mathematics Achievement Growth in High School." Issue brief 98-038. Washington: U.S. Department of Education.
64. Nye, Barbara, Larry V. Hedges, and Spyros Konstantopoulos. 1999. "The Long-Term Effects of Small Classes: A Five-Year Follow-up of the Tennessee Class Size Experiment." Educational Evaluation and Policy Analysis 21(2):127-42.
65. Peirce, Charles S., and Joseph Jastrow. 1885. "On Small Differences of Sensation." Memoirs of the National Academy of Sciences for 1884 3: 75-83.
66. Peterson, Paul E., Patrick J. Wolf, William G. Howell, and David E. Campbell. 2002. "School Vouchers: Results from Randomized Experiments." Unpublished paper. Kennedy School of Government, Harvard University.
67. Raudenbush, Stephen W. 1997. "Statistical Analysis and Optimal Design for Group Randomized Trials." Psychological Methods 2(2): 173-85.
68. Rossi, Peter H., Mark W. Lipsey, and Howard W. Freeman. 2004. Evaluation: A Systematic Approach. 7th edition. Thousand Oaks, Calif.: Sage Publications.
69. Rubin, Donald B. 1980. "Discussion of 'Randomization Analysis of Experimental Data: The Fisher Randomization Test Comment,' by D. Basu." Journal of the American Statistical Association 75(371): 591-93.
70. Schelling, Thomas. 1971. "Dynamic Models of Segregation." Journal of Mathematical Sociology 1: 143-86.
71. Shadish, William R., Thomas D. Cook, and Donald T. Campbell. 2002. Experimental and Quasi-Experimental Designs for Generalized Causal Inference. Boston: Houghton Mifflin.
72. Sherman, Lawrence W., and David Weisburd. 1995. "General Deterrent Effects of Police Patrol in Crime 'Hot Spots': A Randomized Controlled Trial." Justice Quarterly 12(4): 625-48.
73. Siddiqui, Ohidul, Donald Hedeker, Brian R. Flay, and Frank B. Hu. 1996. "Intra-Class Correlation Estimates in a School-based Smoking Prevention Study: Outcome and Mediating Variables by Gender and Ethnicity."" American Journal of Epidemiology 144(4): 425-33.
74. Sikkema, Kathleen J., Jeffrey A. Kelly, Richard A. Winett, Laura J. Solomon, V. A. Cargill, R. A. Roffman, T. L. McAuliffe, T. G. Heckman, E. A. Anderson, D. A. Wagstaff, A. D. Norman, M. J. Perry, D. A. Crumble, and M. B. Mercer. 2000. "Outcomes of a Randomized Community-Level HIV Prevention Intervention for Women Living in 18 Low-Income Housing Developments." American Journal of Public Health 90(1): 57-63.
75. Slavin, Robert E. 2002. "Evidence-Based Education Policies: Transforming Educational Practice and Research." Educational Researcher 31(7): 15-21.
76. Smith, Herbert L., Tu Ping, M. Giovanna Merli, and Mark Hereward. 1997. "Implementation of a Demographic and Contraceptive Surveillance System in Four Counties in North China." Population Research and Policy Review 16(4): 289-314.
77. Teruel, Graciela M., and Benjamin Davis. 2000. Final Report: An Evaluation of the Impact of PROGRESA Cash Payments on Private Inter-Household Transfers. Washington, D.C.: International Food Policy Research Institute.
78. Tienda, Marta. 1991. "Poor People and Poor Places: Deciphering Neighborhood Effects on Poverty Outcomes." In Macro-Micro Linkages in Sociology, edited by Joan Huber. Newbury Park, Calif.: Sage Publications.
79. Ukoumunne, Obioha C., Martin C. Gulliford, Susan Chinn, Jonathan A. C. Sterne, and Peter G. J. Burney. 1999. "Methods for Evaluating Area-Wide and Organisation-Based Interventions in Health and Health Care: A Systematic Review." Health Technology Assessment 3(5): entire issue.
80. U.S. Department of Education. 2003. Early Childhood Longitudinal Study, Kinder-garten Class of 1998-99 (ECLS-K). Washington: National Center for Education Statistics. Available at: nces.ed.gov/ecls (accessed January 5, 2005).
81. Verma, Nandita. 2003. Staying or Leaving: Lessons from Jobs-Plus About the Mobility of Public Housing Residents and the Implications for Place-Based Initiatives. New York: MDRC.
82. Wilson, William Julius. 1996. When Work Disappears: The World of the New Urban Poor. New York: Alfred A. Knopf.