The effectiveness of public-sponsored training revisited: The importance of data and methodological choices

Journal of Labor Economics

Volumn 32, Issue 4, 2014, Pages 837-897

  Biewen, Martin ^a   Fitzenberger, Bernd ^b   Osikominu, Aderonke ^c   Paul, Marie ^d  

^a UNIVERSITY OF TÜBINGEN   (Germany)

^b UNIVERSITY OF FREIBURG   (Germany)

^c UNIVERSITY OF HOHENHEIM   (Germany)

^d UNIVERSITY OF DUISBURG ESSEN   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84938421135     PISSN: 0734306X     EISSN: None     Source Type: Journal    
DOI: 10.1086/677233     Document Type: Article

References (83)

1. Abadie, Alberto, and Guido Imbens. 2006. Large sample properties of matching estimators for average treatment effects. Econometrica 74:235–67.
2. Abadie, Alberto, and Guido Imbens. 2011. Bias-corrected matching estimators for average treatment effects. Journal of Business and Economic Statistics 29:1–11.
3. Barnow, Burt S. 1987. The impact of CETA programs on earnings: A review of the literature. Journal of Human Resources 22:157–93.
4. Bender, Stefan, Martin Biewen, Bernd Fitzenberger, Michael Lechner, Sonja Lischke, Ruth Miquel, Aderonke Osikominu, Tobias Wenzel, and Conny Wunsch. 2004. Die Beschäftigungswirkung der FbW-Maßnahmen 2000–2002 auf individueller Ebene: Eine Evaluation auf Basis der prozessproduzierten Daten des IAB–Vorläufiger Zwischenbericht Oktober 2004. Department of Economics, Goethe University Frankfurt, and SIAW, University of St. Gallen.
5. Bender, Stefan, Martin Biewen, Bernd Fitzenberger, Michael Lechner, Ruth Miquel, Aderonke Osikominu, Marie Waller, and Conny Wunsch. 2005. Die Beschäftigungswirkung der FbW-Maßnahmen 2000–2002 auf individueller Ebene: Eine Evaluation auf Basis der prozessproduzierten Daten des IAB–Zwischenbericht Oktober 2005. Department of Economics, Goethe University Frankfurt, and SIAW, University of St. Gallen.
6. Bender, Stefan, Annette Haas, and Christoph Klose. 2000. The IAB Employment Subsample, 1975–1995. Schmollers Jahrbuch 120:649–62.
7. Bergemann, Annette, Bernd Fitzenberger, and Stefan Speckesser. 2009. Evaluating the dynamic employment effects of training programs in East Germany using conditional differences-in-differences. Journal of Applied Econometrics 24:797–823.
8. Bergemann, Annette, and Gerard J. van den Berg. 2008. Active labor market policy effects for women in Europe: A survey. Annales d’Economie et de Statistique 91–92:385–408.
9. Biewen, Martin, Bernd Fitzenberger, Aderonke Osikominu, and Marie Waller. 2007. Which program for whom: Evidence on the comparative effectiveness of public sponsored training programs in Germany. IZA Discussion Paper no. 2885, Institute for the Study of Labor, Bonn.
10. Blaschke, Dieter, and Hans-Eberhard Plath. 2000. Möglichkeiten und Grenzen des Erkenntnisgewinns durch Evaluation aktiver Arbeitsmarkt-politik. Mitteilungen aus der Arbeitsmarkt- und Berufsforschung (MittAB) 33:462–82.
11. Bloom, Howard S., Larry L. Orr, Stephen H. Bell, George Cave, Fred Doolittle, Winston Lin, and Johannes M. Bos. 1997. The benefits and costs of JTPA Title II-A programs. Journal of Human Resources 32:549– 76.
12. Blundell, Richard, Monica Costa Dias, Costas Meghir, and John van Reenen. 2004. Evaluating the employment impact of a mandatory job search program. Journal of the European Economic Association 2:569–606.
13. Bundesagentur für Arbeit. 2001, 2002a, 2003a, 2004a, 2005a. Daten zu den Eingliederungsbilanzen 2000, 2001, 2002, 2003, 2004,Nürnberg (various issues).
14. Bundesagentur für Arbeit. 2002b, 2003b, 2004b, 2005b. Arbeitsmarkt, 2001, 2002, 2003, 2004. Nürnberg (various issues).
15. Bundesagentur für Arbeit. 2005c. Geschäftsbericht, 2004. Nürnberg.
16. Busso, Matias, John DiNardo, and Justin McCrary. 2009. Finite sample properties of semiparametric estimators of average treatment effects. Unpublished manuscript, Department of Economics, University of California, Berkeley.
17. Bundesagentur für Arbeit. 2011. New evidence on the finite sample properties of propensity score matching and reweighting estimators. Unpublished manuscript, Department of Economics, University of California, Berkeley.
18. Calmfors, Lars. 1994. Active labour market policy and unemployment: A framework for the analysis of crucial design features. OECD Economic Studies 22:7–47.
19. Carcillo, Stéphane, and David Grubb. 2006. From inactivity to work: The role of active labour market policies.. OECD Social Employment and Migration Working Papers no. 36, Organization for Economic Cooperation and Development, Paris.
20. Card, David, Jochen Kluve, and Andrea Weber. 2010. Active labour market policy evaluations: A meta-analysis. Economic Journal 120:F452–F477.
21. Card, David, and Daniel Sullivan. 1988. Measuring the effect of subsidized training programs on movements in and out of employment. Econometrica 56:497–530.
22. Crépon, Bruno, Muriel Dejemeppe, and Marc Gurgand. 2005. Counseling the unemployed: Does it lower unemployment duration and recurrence IZA Discussion Paper no. 1796, Institute for the Study of Labor, Bonn.
23. Crépon, Bruno, Marc Ferracci, Grégory Jolivet, and Gerard J. van den Berg. 2009. Active labor market policy effects in a dynamic setting. Journal of the European Economic Association 7:595–605.
24. de Luna, Xavier, and Per Johansson. 2010. Nonparametric inference for the effect of a treatment on survival times with application in the health and social sciences. Journal of Statistical Planning and Inference 140:2122–37.
25. Dolton, Peter, and Jeffrey Smith. 2011. The impact of the UK New Deal for Lone Parents on benefit receipt. IZA Discussion Paper no. 5491, Institute for the Study of Labor, Bonn.
26. Dorsett, Richard. 2006. The New Deal for Young People: Effect on the labour market status of young men. Labour Economics 13:405–22.
27. Dyke, Andrew, Carolyn J. Heinrich, Peter R. Mueser, Kenneth R. Troske, and Kyung-Seong Jeon. 2006. The effects of welfare-to-work program activities on labor market outcomes. Journal of Labor Economics 24: 567–607.
28. Fitzenberger, Bernd, Olga Orlanski, Aderonke Osikominu, and Marie Paul. 2013. Déjà vu Short-term training in Germany, 1980–1992 and 2000–2003. Empirical Economics 44:289–328.
29. Fitzenberger, Bernd, Aderonke Osikominu, and Robert Völter. 2006. Imputation rules to improve the education variable in the IAB Employment Subsample. Journal of Applied Social Science Studies 126: 405–36.
30. Fitzenberger, Bernd, Aderonke Osikominu, and Robert Völter. 2008. Get training or wait Long-run employment effects of training programs for the unemployed in West Germany. Annales d’Economie et de Statistique 91–92:321–55.
31. Fitzenberger, Bernd, and Stefan Speckesser. 2007. Employment effects of the provision of specific professional skills and techniques in Germany. Empirical Economics 32:529–73.
32. Fitzenberger, Bernd, and Robert Völter. 2007. Long run effects of training programs for the unemployed in East Germany. Labour Economics 14: 730–55.
33. Fougère, Denis, Jacqueline Pradel, and Muriel Roger. 2005. Does job search assistance affect search effort and outcomes IZA Discussion Paper no. 1825, Institute for the Study of Labor, Bonn.
34. Fredriksson, Peter, and Per Johansson. 2008. Dynamic treatment assignment: The consequences for evaluations using observational data. Journal of Business and Economic Statistics 26:435–45.
35. Frölich, Markus. 2004. Finite-sample properties of propensity-score matching and weighting estimators. Review of Economics and Statistics 86:77–90.
36. Frölich, Markus. 2008. Statistical treatment choice: An application to active labour market programmes. Journal of American Statistical Association 103:547–58.
37. Galdo, Jose, Jeffrey Smith, and Dan A. Black. 2008. Bandwidth selection and the estimation of treatment effects with unbalanced data. Annales d’Economie et Statistique 91–92:189–216.
38. Gerfin, Michael, and Michael Lechner. 2002. Microeconometric evaluation of the active labor market policy in Switzerland. Economic Journal 112:854–93.
39. Hardoy, Inés. 2005. Impact of multiple labour market programmes on multiple outcomes: The case of Norwegian youth programmes. LABOUR 19:425–67.
40. Heckman, James J., and V. Joseph Hotz. 1989. Choosing among alternative nonexperimental methods for estimating the impact of social programs: The case of manpower training. Journal of the American Statistical Association 84:862–74.
41. Heckman, James J., Hidehiko Ichimura, Jeffrey A. Smith, and Petra Todd. 1998. Characterizing selection bias using experimental data. Econometrica 65:1017–98.
42. Heckman, James J., Hidehiko Ichimura, and Petra Todd. 1997. Matching as an econometric evaluation estimator: Evidence from evaluating a job training programme. Review of Economic Studies 64:605–54.
43. Heckman, James J., Robert J. LaLonde, and Jeffrey A. Smith. 1999. The economics and econometrics of active labor market programs. In Hand-book of labor economics, vol. 3A, ed. Orley Ashenfelter and David Card, 1865–2097. Amsterdam: North Holland.
44. Heckman, James J., and Jeffrey Smith. 1999. The pre-programme earnings dip and the determinants of participation in a social programme: Implications for simple programme evaluation strategies. Economic Journal 109:313–48.
45. Heinrich, Carolyn J., Peter R. Mueser, Kenneth Troske, Kyung-Seong Jeon, and Daver C. Kahvecioglu. 2010. New estimates of public em-ployment and training program net impacts: A nonexperimental evaluation of the Workforce Investment Act program. Working Paper no. 1003, Department of Economics, University of Missouri.
46. Hotz, V. Joseph, Guido Imbens, and Jacob A. Klerman. 2006. Evaluating the differential effects of alternative welfare-to-work training compo-nents: A reanalysis of the California GAIN program. Journal of Labor Economics 24:521–66.
47. Huber, Martin, Michael Lechner, and Conny Wunsch. 2010. How to control for many covariates Reliable estimators based on the propensity score. IZA Discussion Paper no. 5268, Institute for the Study of Labor, Bonn.
48. Hui, Shek-wai, and Jeffrey Smith. 2003a. Issues in the design of Canada’s Adult Education and Training Survey. Research Report, Statistics Canada.
49. Hui, Shek-wai, and Jeffrey Smith.2003b The labour market impacts of adult education and training in Canada. Research report, Statistics Canada.
50. Hujer, Reinhard, Stephan L. Thomsen, and Christopher Zeiss. 2006. The effects of short-term training measures on the individual unemployment duration in West Germany. ZEW Discussion Paper no. 06-065, Centre for European Economic Research, Mannheim.
51. Human Resources and Skills Development Canada (HRSDC). 2004. Summative evaluation of employment benefits and support measures under the terms of the Canada/British Columbia Labour Market Development Agreement. Final report. Document no. SP-AH-666-04-04E.
52. Imbens, Guido. 2000. The role of the propensity score in estimating dose-response functions. Biometrika 87:706–10.
53. Jacobebbinghaus, Peter, and Stefan Seth. 2007. The German Integrated Employment Biographies Sample (IEBS). Journal of Applied Social Science Studies 127:335–42.
54. Jespersen, Svend T., Jakob R. Munch, and Lars Skipper. 2008. Costs and benefits of Danish active labour market programmes. Labour Economics 15:859–84.
55. Kluve, Jochen, and Claus M. Schmidt. 2002. Can training and employment subsidies combat European unemployment Economic Policy 35:409–48.
56. Kurtz, Beate. 2003. Trainingsmaßnahmen: Was verbirgt sich dahinter IAB Werkstattbericht Nr. 8, Institute for Employment Research, Nürnberg.
57. Larsson, Laura. 2003. Evaluation of Swedish youth labor market pro-grams. Journal of Human Resources 38:891–927.
58. Lechner, Michael. 1999. Earnings and employment effects of continuous off-the-job training in East Germany after unification. Journal of Business and Economic Statistics 17:74–90.
59. Lechner, Michael. 2001. Identification and estimation of causal effects of multiple treatments under the conditional independence assumption. In Econometric evaluation of active labor market politics in Europe, ed. Michael Lechner and Friedhelm Pfeiffer, 45–58. Heidelberg: Physica-Verlag.
60. Lechner, Michael. 2002. Program heterogeneity and propensity score matching: An application to the evaluation of active labor market policies. Review of Economics and Statistics 84:205–20.
61. Lechner, Michael, Ruth Miquel, and Conny Wunsch. 2007. The curse and blessing of training the unemployed in a changing economy: The case of East Germany after unification. German Economic Review 8:468–507.
62. Lechner, Michael, Ruth Miquel, and Conny Wunsch. 2011. Long-run effects of public sector sponsored training in West Germany. Journal of the European Economic Association 9:742–84.
63. Lechner, Michael, and Stephan Wiehler. 2011. Kids or courses Gender differences in the effects of active labor market policies. Journal of Pop-ulation Economics 24:783–812.
64. Lechner, Michael, and Conny Wunsch. 2009. Active labour market policy in East Germany: Waiting for the economy to take off. Economics of Transition 4:661–702.
65. Lechner, Michael, Ruth Miquel, and Conny Wunsch. 2011. Sensitivity of matching-based program evaluations to the availability of control variables. IZA Discussion Paper no. 5553, Institute for the Study of Labor, Bonn.
66. Lee, Wang-Sheng. 2013. Propensity score matching and variations on the balancing test. Empirical Economics 44:47–80.
67. Martin, John P. 2000. What works among active labour market policies: Evidence from OECD countries’ experiences. OECD Economic Studies no. 30, 79–113.
68. Martin, John P., and David Grubb. 2001. What works for whom: A review of OECD countries’ experiences with active labour market policies. Swedish Economic Policy Review 8:9–56.
69. Mueser, Peter R., Kenneth R. Troske, and Alexey Gorislavsky. 2007. Using state administrative data to measure program performance. Review of Economics and Statistics 89:761–83.
70. OECD (Organization for Economic Cooperation and Development). 2005. Labour market programmes and activation strategies: Evaluating the impacts. In OECD Employment Outlook, chap. 4. Paris: OECD.
71. Osikominu, Aderonke. 2013. Quick job entry or long-term human capital development The dynamic effects of alternative training schemes. Re-view of Economic Studies 80:313–42.
72. Park, Norm, Bob Power, W. Craig Riddell, and Ging Wong. 1996. An assessment of the impact of government-sponsored training. Canadian Journal of Economics 29:S93–S98.
73. Rosenbaum, Paul R., and Donald B. Rubin. 1983. The central role of the propensity score in observational studies for causal effects. Biometrika 70:41–55.
74. Roy, Andrew D. 1951. Some thoughts on the distribution of earnings. Oxford Economic Papers 3:135–46.
75. Rubin, Donald B. 1974. Estimating causal effects of treatments in ran-domized and nonrandomized studies. Journal of Educational Psychol-ogy 66:688–701.
76. Schneider, Hilmar, Karl Brenke, Lutz Kaiser, Jakob Steinwedel, Birgit Jesske, and Arne Uhlendorff. 2006. Evaluation der Maßnahmen zur Umsetzung der Vorschläge der Hartz-Kommission; Modul 1b: För-derung beruflicher Weiterbildung und Transferleistungen. IZA Research Report no. 7, Institute for the Study of Labor, Bonn.
77. Sianesi, Barbara. 2004. An evaluation of the Swedish system of active labor market programs in the 1990s. Review of Economics and Statistics 86: 133–55.
78. Sianesi, Barbara. 2008. Differential effects of Swedish active labour market programmes for unemployed adults in the 1990s. Labour Economics 15: 370–99.
79. Splawa-Neyman, Jerzy (edited and translated by Dorota M. Dabrowska and Terrence P. Speed). 1923/1990. On the application of probability theory to agricultural experiments: Essay on principles, section 9. Statistical Science 5, no. 4:465–72.
80. van den Berg, Gerard J., and Bas van der Klaauw. 2006. Counseling and monitoring of unemployed workers: Theory and evidence from a con-trolled social experiment. International Economic Review 47:895–936.
81. Waller, Marie. 2008. On the importance of correcting reported end dates of labor market programs. Journal of Applied Social Science Studies 128: 213–36.
82. Weber, Andrea, and Helmut Hofer. 2004. Employment effects of early interventions on job search programs. IZA Discussion Paper no. 1076, Institute for the Study of Labor, Bonn.
83. Wunsch, Conny, and Michael Lechner. 2008. What did all the money do On the general ineffectiveness of recent West German labour market programmes. Kyklos 61:134–74.