Assignment Procedure Biases in Randomised Policy Experiments

Economic Journal

Volumn 127, Issue 602, 2017, Pages 873-895

  Aldashev, Gani ^a   Kirchsteiger, Georg ^b,c   Sebald, Alexander ^d  

^a UNIVERSITÉ DE CERGY PONTOISE   (France)

^b UNIVERSITÉ LIBRE DE BRUXELLES   (Belgium)

^c UNIVERSITY OF VIENNA   (Austria)

^d UNIVERSITY OF COPENHAGEN   (Denmark)

Author keywords

[No Author keywords available]

Indexed keywords

ECONOMIC POLICY; POLICY MAKING; PREDICTION;

EID: 84994149392     PISSN: 00130133     EISSN: 14680297     Source Type: Journal    
DOI: 10.1111/ecoj.12321     Document Type: Article

References (47)

1. Abbring, J. and Heckman, J. (2007). ‘Econometric evaluation of social programs, part III: distributional treatment effects, dynamic treatment effects, dynamic discrete choice, and general equilibrium policy evaluation’, in (J. Heckman, and E. Leamer, eds.), Handbook of Econometrics, vol. 6, pp. 5145–5303, Amsterdam: Elsevier.
2. Angelucci, M. and De Giorgi, G. (2009). ‘Indirect effects of an aid program: how do cash transfers affect ineligibles' consumption?’, American Economic Review, vol. 99(1), pp. 486–508.
3. Angrist, J., Bettinger, E., Bloom, E., King, E. and Kremer, M. (2002). ‘Vouchers for private schooling in Colombia: evidence from a randomized natural experiment’, American Economic Review, vol. 92(5), pp. 1535–58.
4. Angrist, J., Bettinger, E. and Kremer, M. (2006). ‘Long-term educational consequences of secondary school vouchers: evidence from administrative records in Colombia’, American Economic Review, vol. 96(3), pp. 847–62.
5. Banerjee, A., Cole, S., Duflo, E. and Linden, L. (2007). ‘Remedying education: evidence from two randomized experiments in India’, Quarterly Journal of Economics, vol. 122(3), pp. 1235–64.
6. Banerjee, A., Duflo, E., Glennerster, R. and Kinnan, C. (2010). ‘The miracle of microfinance: evidence from a randomized evaluation’, Working Paper, Department of Economics, MIT.
7. Battigalli, P. and Dufwenberg, M. (2007). ‘Guilt in games’, American Economic Review, Papers and Proceedings, vol. 97(2), pp. 170–6.
8. Battigalli, P. and Dufwenberg, M. (2009). ‘Dynamic psychological games’, Journal of Economic Theory, vol. 144(1), pp. 1–35.
9. Behrman, J. and Todd, P. (1999). Randomness in the Experimental Sample of Progresa (Education, Health, and Nutrition Program), Washington, DC: International Food Policy Research Institute.
10. Bruhn, M. and McKenzie, D. (2009). ‘In pursuit of balance: randomization in practice in development field experiments’, American Economic Journal: Applied Economics, vol. 1(4), pp. 200–32.
11. Bulte, E., Beekman, G., Di Falco, S., Hella, J. and Lei, P. (2014). ‘Behavioral responses and the impact of new agricultural technologies: evidence from a double-blind experiment in Tanzania’, American Journal of Agricultural Economics, vol. 96(3), pp. 813–30.
12. Card, D. and Hyslop, D. (2005). ‘Estimating the effects of a time-limited earnings subsidy for welfare-leavers’, Econometrica, vol. 73(6), pp. 1723–70.
13. Card, D. and Robins, P. (2005). ‘How important are “entry effects" in financial incentive programs for welfare recipients? Experimental evidence from the self-sufficiency project’, Journal of Econometrics, vol. 125(1–2), pp. 113–39.
14. Charness, G. and Dufwenberg, M. (2006). ‘Promises and partnership’, Econometrica, vol. 74(6), pp. 1579–601.
15. Chassang, S., Padró-i-Miquel, G. and Snowberg, E. (2012). ‘Selective trials: a principal-agent approach to randomized controlled experiments’, American Economic Review, vol. 102(4), pp. 1279–309.
16. Cook, T. and Campbell, D. (1979). Quasi-experimentation: Design and Analysis Issues for Field Settings, Boston, MA: Houghton Mifflin.
17. De Mel, S., McKenzie, D. and Woodruff, C. (2008). ‘Returns to capital in microenterprises: evidence from a field experiment’, Quarterly Journal of Economics, vol. 123(4), pp. 1329–72.
18. Duflo, E. (2004). ‘Scaling Up and Evaluation’, Annual World Bank Conference on Development Economics, Washington, DC: The World Bank.
19. Duflo, E., Gale, W., Liebman, J., Orszag, P. and Saez, E. (2006). ‘Saving incentives for low- and middle-income families: evidence from a field experiment with H & R block’, Quarterly Journal of Economics, vol. 121(4), pp. 1311–46.
20. Duflo, E., Glennerster, R. and Kremer, M. (2008). ‘Using randomization in development economics research: a toolkit’, In (T.P. Schultz and J.A. Strauss, eds.) Handbook of Development Economics, vol. 4, pp. 3895–962. Amsterdam: Elsevier.
21. Dufwenberg, M. and Kirchsteiger, G. (2004). ‘A theory of sequential reciprocity’, Games and Economic Behavior, vol. 47(2), pp. 268–98.
22. Ferraz, C. and Finan, F. (2008). ‘Exposing corrupt politicians: the effects of Brazil's publicly released audits on electoral outcomes’, Quarterly Journal of Economics, vol. 123(2), pp. 703–45.
23. Fetterman, D. (1982). ‘Ibsen's baths: reactivity and insensitivity (a misapplication of the treatment-control design in a national evaluation)’, Educational Evaluation and Policy Analysis, vol. 4(3), pp. 261–79.
24. Friedlander, D., Hoetz, G., Long, D. and Quint, J. (1985). Maryland: Final Report on the Employment Initiatives Evaluation, New York, NY: MDRC.
25. Geanakoplos, J., Pearce, D. and Stacchetti, E. (1989). ‘Psychological games and sequential rationality’, Games and Economic Behavior, vol. 1(1), pp. 60–79.
26. Gertler, P. (2004). ‘Do conditional cash transfers improve child health? Evidence from PROGRESA's controlled randomized experiment’, American Economic Review, vol. 94(2), pp. 336–41.
27. Harris, J. (1985). ‘Macroexperiments versus microexperiments for health policy’, in(J. Hausmann, and D. Wise, eds.), Social Experimentation, pp. 145–185, Chicago, IL: University of Chicago Press.
28. Heckman, J. (1991) ‘Randomization and social policy evaluation’, Working Paper 107, National Bureau of Economic Research Technical.
29. Heckman, J. and Vytlacil, E. (2007a), ‘Econometric evaluation of social programs, part I: causal models, structural models and econometric policy evaluation’, in(J. Heckman, and E. Leamer eds.), Handbook of Econometrics, vol. 6, pp. 4779–4874, Amsterdam: Elsevier.
30. Heckman, J. and Vytlacil, E. (2007b), ‘Econometric evaluation of social programs, part II: using the marginal treatment effects to organize alternative econometric estimators to evaluate social programs, and to forecast their effects in new environments’, in (J. Heckman, and E. Leamer, eds.), Handbook of Econometrics, vol. 6, pp. 4875–5143, Amsterdam: Elsevier.
31. Hoorens, V. (1993). ‘Self-enhancement and superiority biases in social comparison’, European Review of Social Psychology, vol. 4(1), pp. 113–39.
32. Imbens, G. and Wooldridge, J. (2009). ‘Recent developments in the econometrics of program evaluation’, Journal of Economic Literature, vol. 47(1), pp. 5–86.
33. Krueger, A. (1999). ‘Experimental estimates of education production functions’, Quarterly Journal of Economics, vol. 114(2), pp. 497–532.
34. Levitt, S. and List, J. (2009). ‘Field experiments in economics: the past, the present, and the future’, European Economic Review, vol. 53(1), pp. 1–18.
35. Levitt, S. and List, J. (2011). ‘Was there really a Hawthorne effect at the Hawthorne plant? An analysis of the original illumination experiments’, American Economic Journal: Applied Economics, vol. 3(1), pp. 224–38.
36. Levy, S. (2006). Progress against Poverty: Sustaining Mexico's Progresa-Oportunidades Program, Washington, DC: Brookings Institution Press.
37. Malani, A. (2006). ‘Identifying placebo effects with data from clinical trials’, Journal of Political Economy, vol. 114(2), pp. 236–56.
38. Michalopoulos, C., Robins, P. and Card, D. (2005). ‘When financial work incentives pay for themselves: evidence from a randomized social experiment for welfare recipients’, Journal of Public Economics, vol. 89(1), pp. 5–29.
39. Ongena, S. (2009). ‘Resentful demoralization’, in (B. Everitt and D. Howel, eds), Encyclopedia of Statistics in Behavioral Science, vol. 4, pp. 1744–1746, Chichester, UK: Wiley.
40. Parker, S., Rubalcava, L. and Teruel, G. (2008). ‘Evaluating conditional schooling and health programs’, in (T.P. Schultz and J. Strauss eds.), Handbook of Development Economics, vol. 4, pp. 3963–4035, North-Holland: Elsevier.
41. Philipson, T. and Hedges, L. (1998). ‘Subject evaluation in social experiments’, Econometrica, vol. 66(2), pp. 381–408.
42. Rabin, M. (1993). ‘Incorporating fairness into game theory and economics’, American Economic Review, vol. 83(4), pp. 1281–302.
43. Ruffle, B. (1999). ‘Gift giving with emotions’, Journal of Economic Behavior & Organization, vol. 39(4), pp. 399–420.
44. Schultz, T.P. (2004). ‘School subsidies for the poor: evaluating the Mexican Progresa poverty program’, Journal of Development Economics, vol. 74(1), pp. 199–250.
45. Schumacher, J., Milby, J., Raczynski, J., Engle, M., Caldwell, E. and Carr, J. (1994). ‘Demoralization and threats to validity in Birmingham's Homeless Project’, in (K. Conrad ed.), Critically Evaluating the Role of Experiments, pp. 41–44, San Francisco, CA: Jossey-Bass.
46. Sebald, A. (2010). ‘Attribution and reciprocity’, Games and Economic Behavior, vol. 68(1), pp. 339–52.
47. Sobel, J. (2005). ‘Interdependent preferences and reciprocity’, Journal of Economic Literature, vol. 43(2), pp. 392–436.