Causal inference and omitted variable bias in financial aid research: Assessing solutions

Review of Higher Education

Volumn 31, Issue 3, 2008, Pages 329-354

  Cellini, Stephanie Riegg ^a  

^a GEORGE WASHINGTON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 41849129903     PISSN: 01625748     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Review

References (93)

1. Alon, S. (2005). Model mis-specification in assessing the impact of financial aid on academic outcomes. Research in Higher Education, 46(1), 109-125.
2. Angrist, J. D. (1998). Estimating the labor market impact of voluntary military service using social security data on military applicants. Econometrica, 66(2), 249-288.
3. Angrist, J. D., Imbens, G. W., & Rubin, D. B. (1996). Identification of causal effects using instrumental variables. Journal of the American Statistical Association, 91(434), 444-455.
4. Angrist, J. D., & Krueger, A. B. (1991). Does compulsory school attendance affect schooling and earnings? Quarterly Journal of Economics, 106(4), 979-1014.
5. Angrist, J. D., & Krueger, A. B. (1999). Empirical strategies in labor economics. In O. Ashenfelter & D. Card (Eds.), Handbook of Labor Economics (Vol. 3, pp. 1277-1366). London: Elsevier Science.
6. Angrist, J. D., & Krueger, A. B. (2001). Instrumental variables and the search for identification: From supply and demand to natural experiments. Journal of Economic Perspectives, 15(4), 69-85.
7. Athey, S., & Imbens, G. (2006). Identification and inference in non-linear difference-in-differences models. Econometrica, 74(20), 431-497.
8. Becker, G. S. (1964). Human capital: A theoretical and empirical analysis with special reference to education. New York: Columbia University Press.
9. Becker, W. E. (2003, October 3). Omitted variables and sample selection problems in studies of college-going decisions. Conference paper presented at the Mini-Conference on Evaluation Methods and Practices Appropriate for Faith-Based and Other Providers of Social Services, Bloomington, IN.
10. Berliner, D. C. (2002). Educational research: The hardest science of all. Educational Researcher, 31(8), 18-20.
11. Bertrand, M., Duflo, E., & Mullainathan, S. (2004). How much should we trust differences-in-differences estimates? Quarterly Journal of Economics, 91(1), 249-275.
12. Bettinger, E. (2004). How financial aid affects persistence. National Bureau of Economic Research, Working Paper No. 10242. Cambridge, MA: National Bureau of Economic Research.
13. Black, S. E. (2002). Do better schools matter? Parental valuation of elementary education. Quarterly Journal of economics, 114(2), 577-599.
14. Bound, J., Jaeger, D. A., & Baker, R. M. (1995). Problems with instrumental variables estimation when the correlation between the instruments and exogenous explanatory variable is weak. Journal of the American Statistical Association, 90(430), 443-450.
15. Card, D. (1999). The causal effect of education on earnings. In O. Ashenfelter & D. Card (Eds.), Handbook of Labor Economics (Vol. 3, pp. 1801-1863). London: Elsevier Science.
16. Card, D., & Lemieux, T. (2000). Dropout and enrollment trends in the post-war period: What went wrong in the 1970s? National Bureau of Economic Research, Working Paper 7658. Cambridge, MA: National Bureau of Economic Research.
17. Cellini, S. R. (2006). Smoothing the transition to college? The effect of tech-prep programs on educational attainment. Economics of Education Review, 25(4), 394-411.
18. Chamberlain, G. (1980). Analysis of covariance with qualitative data. Review of Economic Studies, 47(1), 225-238.
19. Chamberlain, G. (1984). Panel Data. In Z. Griliches & M. Intriligator (Eds.), Handbook of Econometrics, Vol. 2 (pp. 1247-1318). Amersterdam: North Holland.
20. Chatterji, M. (2005). Evidence on "what works": An argument for extended-term mixed-method (ETMM) evaluation designs. Educational Researcher, 34(5), 14-24.
21. Cohen, D. K., Raudenbush, S. W., & Ball, D. L. (2003). Resources, instruction, and research. Educator Evaluation and Policy Analysis, 25(2), 119-142.
22. Cook, T. D. (2002). Randomized experiments in educational policy research: A critical examination of the reasons the educational evaluation community has offered for not doing them. Educational Evaluation and Policy Analysis, 24(3), 175-199.
23. Conley, T., & Taber, C. (2005). Inference with "difference in differences" with a small number of policy changes. National Bureau of Economic Research, Technical Working Paper No. 312. Cambridge, MA: National Bureau of Economic Research.
24. Cornwell, C., Mustard, D. B., & Sridhar, D. J. (2006). The enrollment effects of meritbased financial aid. Journal of Labor Economics, 24(4), 761-786.
25. Cronbach, L. J., & Associates. (1980). Toward reform in program evaluation. San Francisco: Jossey-Bass.
26. Currie, J., & Thomas, D. (1995). Does Head Start make a difference? American Economic Review, 83(5), 341-364.
27. Curs, B., & Singell, L. D., Jr. (2002). An analysis of the application and enrollment processes for in-state and out-of-state students at a large public university. Economics of Education Review, 21, 111-124.
28. DesJardins, S. J., Ahlburg, D., & McCall, B. P. (2006). An integrated model of application, admission, enrollment, and financial aid. The Journal of Higher Education, 77(3), 381-429.
29. Dowd, A. C. (Forthcoming). Dynamic interactions and intersubjectivity: Challenges to causal modeling in studies of college student debt. Review of Education Research.
30. Dowd, A. C. (2004). Income and financial aid effects on persistence and degree attainment in public colleges. Education Policy Analysis Archives, 12(21). Retrieved on July 15, 2007, from http://epaa.asu.edu/epaa/ v12n21.
31. Dowd, A. C., & Coury, T. (2006). The effect of loans on the persistence and attainment of community college students. Research in Higher Education, 47(1), 33-61.
32. Dowd, A. C., & Tong, V. P. (2007). Accountability, assessment, and the scholarship of "best practice." In J. C. Smart (Ed.), Higher education: Handbook of theory and research (Vol. 22, pp. 57-119). New York: Agathon Press.
33. Dynarski, S. (2000). Hope for whom? Financial aid for the middle class and its impact on college attendance. National Tax Journal, 53(3), 629-661.
34. Dynarski, S. (2003). Does aid matter? Measuring the effect of student aid on college attendance and completion. American Economic Review, 93(1), 279-288.
35. Ehrenberg, R. G., Zhang, L., & Levin, J. (2006). Crafting a class: The tradeoff between merit scholarships and enrolling lower-income students. The Review of Higher Education, 29(2), 195-211.
36. Erickson, F., & Gutierrez, K. (2002). Culture, rigor, and science in educational research. Educational Researcher, 31(8), 21-24.
37. Feuer, M. J., Towne, L., & Shavelson, R. J. (2002a). Scientific culture and educational research. Educational Researcher, 31(8), 4-14.
38. Feuer, M. J, Towne, L., & Shavelson, R. J. (2002b). Reply. Educational Researcher, 31(8), 28-29.
39. Fuller, W. C., Manski, C. F., & Wise, D. A. (1982). New evidence on the economic determinants of postsecondary schooling choices. Journal of Human Resources, 17(4), 488-498.
40. Greene, W. H. (2000). Econometric analysis. Upper Saddle River, NJ: Prentice-Hall.
41. Heller, D. E. (1999). The effects of tuition and state financial aid on public college enrollment. The Review of Higher Education, 23(1), 65-89.
42. Hossler, D., Braxton, J., & Coopersmith, G. (1989). Understanding student college choice. In J. C. Smart (Ed.), Higher education: Handbook of theory and research (Vol. 5, pp. 231-288). New York: Agathon Press.
43. Hossler, D., & Gallagher, K. S. (1987). Studying student college choice: A three-phase model and the implications for policymakers. College and University, 62, 207-221.
44. Howell, W. G., Wolf, P. J., Campbell, D. E., & Peterson, P. E. (2002). School vouchers and academic performance: Results from three randomized field trials. Journal of Policy Analysis and Management, 21(2), 191-217.
45. Hahn, A., Leavitt, T., & Aaron, P. (1994). Evaluation of the Quantum Opportunities Program: Did the program work? A report on the postsecondary outcomes and cost-effectiveness of the QOP, 1989-1973. Waltham, MA: Brandeis University Heller Graduate School.
46. Imbens, G., & Lemieux, T. (2007). Regression discontinuity designs: A guide to practice. National Bureau of Economic Research, Working Paper No. 13039. Cambridge, MA: National Bureau of Economic Research.
47. Jackson, G. A. (1978). Financial aid and student enrollment. The Journal of Higher Education, 49(6), 548-574.
48. Jackson, G. A. (1990). Financial aid, college entry, and affirmative action. American Journal of Education, 98(4), 523-550.
49. Kane, T. J. (1994). College entry by Blacks since 1970: The role of college costs, family background, and the returns to education. Journal of Political Economy, 102(5), 878-911.
50. Kane, T. J. (1995). Rising public college tuition and college entry: How well do public subsidies promote access to college? National Bureau of Economic Research, Working Paper No. 5164. Cambridge, MA: National Bureau of Economic Research.
51. Kane, T. J. (2003). A quasi-experimental estimate of the impact of financial aid on college-going. National Bureau of Economic Research, Working Paper No. 9703. Cambridge, MA: National Bureau of Economic Research.
52. Kane, T. J. (2004). Evaluating the impact of the D.C. tuition assistance grant program. National Bureau of Economic Research, Working Paper No. 10658. Cambridge, MA: National Bureau of Economic Research.
53. Kane, T. J., Riegg, S. K., & Staiger, D. O. (2006) School quality, neighborhoods, and housing prices. American Law and Economics Review, 8(2), 183-212.
54. Kohn, M. G., Marski, C. F., &c Mundel, D. S. (1976). An empirical investigation of factors which influence college-going behavior. Annals of Economic and Social Measurement, 5(4), 391-419.
55. Krueger, A. B. (1999). Experimental estimates of education production functions. Quarterly Journal of Economics, 114(2), 497-532.
56. Krueger, A. B., & Zhu, P. (2004). Another look at the New York City school voucher experiment. American Behavioral Scientist, 47(5), 658-698.
57. Lee, D. S., & Card, D. (2006). Regression discontinuity inference with specification error. National Bureau for Economic Research, Technical Working Paper No. 322. Cambridge, MA: National Bureau of Economic Research.
58. Lee, M., & Kang, C. (2006). Identification for differences-in- differences with cross-section and panel data. Economic Letters, 92, 270-276.
59. Lisenmeier, D., Rosen, H., & Rouse, C. (2003). Financial aid packages and college enrollment decisions: An econometric case study. National Bureau of Economic Research, Working Paper No. 9228. Cambridge, MA: National Bureau of Economic Research.
60. Manski, C., & Wise, D. (1983). College Choice in America. Cambridge: MA, Harvard University Press.
61. Mayer, D. P., Peterson, P. E., Myers, D. E., Tuttle, C. C., & Howell, W. G. (2002). School choice in New York City after three years: An evaluation of the school choice scholarships program. Final report. Washington, DC: Mathematica Policy Resarch. Retrieved November 10, 2006, from http://www.mathematica-mpr.com/PDFs/nycfull.
62. Meyer, B. D. (1995). Natural and quasi-experimental designs in economics. Journal of Business and Economic Statistics, 13(2), 151-161.
63. Mincer, J. (1958). Investment in human capital and personal income distribution. Journal of Political Economy, 66(4): 281-302.
64. Moore, R. L., Studenmund, A. H., & Slobko, T. (1991). The effect of the financial aid package on the choice of a selective college. Economics of Education Review, 10(4), 311-321.
65. Myers, D., Olsen, R., Seftor, N., Young, J., & Tuttle, C. (2004). The impacts of regular Upward Bound: Results from the third follow-up data collection. Washington, DC: Mathematica Policy Research. Retrieved on May 20, 2006, from http://www.mathematica-mpr.com/publications/PDFs/upboundimpact. pdf.
66. Myers, D., & Dynarski, M. (2003). Random assignment in program evaluation and intervention research: Questions and answers. Washington, DC: U.S. Department of Education, Institute of Education Sciences. Retrieved on May 20, 2006, from http://www.mathematica-mpr.com/PDFs/randomassign.pdf.
67. Myers, D. E., & Mayer, D. P. (2003). Comments on "Another look at the New York City Voucher experiment." Washington, DC: Mathematica Policy Research. Retrieved November 10, 2006, from http://www.mathematica-mpr. com/PDFs/anotherlook.
68. Myers, D., & Schirm, A. (1999). The impacts of Upward Bound: Final report on Phase I of the national evaluation. Report submitted to the U.S. Department of Education. Washington, DC: Mathematica Policy Research. Retrieved on May 20, 6006, from http://www.ed.gov/offices/OUS/PES/higher/upward.pdf.
69. Neumark, D., & Rothstein, D. (2003). School-to-career programs and transitions to employment and higher education. National Bureau of Economic Research, Working Paper No. 10060. Cambridge, MA: National Bureau of Economic Research.
70. Powers, D. E., & Swinton, S. S. (1984). Effects of self-study for coachable test item types. Journal of Educational Psychology, 76(2), 266-278.
71. Purnell, R., & Blank, S. (2004). Support success: Services that may help low-income students succeed in community college. New York: MDRC. Retrieved on November 8, 2006, from http://www.mdrc.org/publications/399/full.pdf.
72. Raudenbush, S. W. (1997). Statistical analysis and optimal design for cluster randomized trials. Psychological Methods, 2(2), 173-185.
73. Raudenbush, S. W. (2005). Learning from attempts to improve schooling: The contribution of methodological diversity. Educational Researcher, 34(5), 1333-1350.
74. Raudenbush, S. W., Martinez, A., & Spybrook, J. (2007). Strategies for improving precision in group-randomized experiments. Educational Evaluation and Policy Analysis, 29(1), 5-29.
75. Rothstein, J. (2006). Good principals or good peers? Parental valuations of school characteristics, tiebout equilibrium, and the incentive effects of competition among jurisdictions. American Economic Review, 96(4), 1333-1350.
76. Rouse, C. E. (1998). Private school vouchers and student achievement: An evaluation of the Milwaukee parental choice program. Quarterly Journal of Economics, 113(2), 553-602.
77. Seneca, J. J., & Taussig, M. K. (1987). Educational quality, access, and tuition policy at state universities. The Journal of Higher Education, 58(1), 25-37.
78. Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. N.p.: Houghton-Mifflin.
79. Stahlecker, P., & Trenkler, G. (1993). Some further results on the use of proxy variables in prediction. The Review of Economics and Statistics, 75(4), 707-711.
80. Staiger, D., & Stock, J. H. 1997. Instrumental variables regression with weak instruments. Econometrica, 65(3), 97-106.
81. St. John, E. P. (1990). Price response in persistence decisions: An analysis of the High School and Beyond senior cohort, Research in Higher Education, 31(4), 387-403.
82. St. John, E. P. (1999). Evaluating state student grant programs: A case study of Washington's grant program. Research in Higher Education, 40(2), 149-169.
83. St. John, E. P., Musoba, G. D., & Simmons, A. B. (2003). Keeping the promise: The impact of Indiana's twenty-first century scholars program. Review of Higher Education, 27(1), 103-123.
84. St. Pierre, E. A. "Science" rejects postmodernism. Educational Researcher, 31(8), 25-27.
85. Thistlewaite, D., & Campbell, D. (1960). Regression-discontinuity analysis: An alternative to the ex-post facto experiment. Journal of Educational Psychology, 51, 309-317.
86. U.S. Department of Education. (2003). Identifying and implementing educational practices supported by rigorous evidence: A user-friendly guide. Washington, DC: U.S. Department of Education, Institute of Education Sciences.
87. U.S. Department of Education. (2006a). Digest of education statistics, 2005. Washington, DC: National Center for Education Statistics.
88. U.S. Department of Education. (2006b). 2004-2005 federal Pell Grant program endof-year report. Washington, DC: Office of Postsecondary Education.
89. Van der Klaauw, W. (2002). Estimating the effect of financial aid offers on college enrollment: A regression-discontinuity approach. International Economic Review, 43(4), 1249-1287.
90. Weiler, W. C. (1990). Transition from consideration of a college to the decision to apply. Research in Higher Education, 35(6), 631-646.
91. Welki, A. M., & Navratil, F. J. (1987). The role of applicants' perceptions in the choice of college, College and University, 62, 147-160.
92. Wooldridge, J. M. (2002). Econometric analysis of cross section and panel data. Cambridge, MA: MIT Press.
93. Wooldridge, J. M. (2005). Fixed-effects and related estimators for correlated random coefficient and treatment-effect panel data models. The Review of Economics and Statistics, 87(2), 385-390.