Using Instrumental Variables to Account for Selection Effects in Research on First-Year Programs

Research in Higher Education

Volumn 52, Issue 2, 2011, Pages 194-214

  Pike, Gary R ^a   Hansen, Michele J ^a   Lin, Ching Hui ^b  

^a INDIANA UNIVERSITY   (United States)

^b INDIANA UNIVERSITY   (United States)

Author keywords

First year programs; Grades; Instrumental variables; Learning communities; Self selection

Indexed keywords

EID: 78651474021     PISSN: 03610365     EISSN: None     Source Type: Journal    
DOI: 10.1007/s11162-010-9188-x     Document Type: Article

References (78)

1. Angrist, J. D., Imbens, G. W., & Rubin, D. B. (1996). Identification of causal effects using instrumental variables. Journal of the American Statistical Association, 91, 444-455.
2. Angrist, J. D., & Pischke, J. (2009). Mostly harmless econometrics: An empiricist's companion. Princeton, NJ: Princeton University Press.
3. Baird, L. L. (1985). Do grades and tests predict adult accomplishment? Research in Higher Education, 21, 261-278.
4. Baker, S., & Pomerantz, N. (2000). Impact of learning communities on retention at a metropolitan university. Journal of College Student Retention, 2, 115-126.
5. Beckett, A. K., & Rosser, V. J. (2007, November). Relationship between learning community participation and degree attainment. Paper presented at the annual meeting of the Association for the Study of Higher Education, Louisville, KY.
6. Bound, J., Jaeger, D. A., & Baker, R. M. (1995). Problems with instrumental variables estimation when the correlation between the instruments and the endogenous explanatory variable is weak. Journal of the American Statistical Association, 90, 443-450.
7. Breusch, T. S., & Pagan, A. R. (1979). A simple test for heteroscedasticity and random coefficient variation. Econometrica, 47, 1287-1294.
8. Cellini, S. R. (2008). Causal inference and omitted variable bias in financial aid research: Assessing solutions. Review of Higher Education, 31, 329-354.
9. Chism, L. P. & Hansen, M. J. (2007, July). Proving and improving: Purposeful themed learning communities assessment. Paper presented at the International Conference on First-Year Year Experience, Honolulu, HI.
10. Chism, L. P., Baker, S. S., Hansen, M. J., & Williams, G. (2008). Implementation of first-year seminars, the summer academy bridge program, and themed learning communities. Metropolitan Universities, 19(2), 8-17.
11. Cook, T. D., & Campbell, D. T. (1979). Quasi-experimentation: Design and analysis issues for field settings. Boston, MA: Houghton Mifflin Company.
12. Cook, T. D., & Shadish, W. R. (1994). Social experiments: Some developments over the past fifteen years. Annual Review of Psychology, 45, 545-580.
13. Cook, R. D., & Weisberg, S. (1983). Diagnostics for heteroscedasticity in regression. Biometrika, 70, 1-10.
14. Davidson, R., & MacKinnon, J. G. (1993). Estimation and inference in econometrics. New York: Oxford University Press.
15. DesJardins, S. L., McCall, B. P., Ahlburg, D. A., & Moye, M. J. (2002). Adding a timing light to the "Tool Box". Research in Higher Education, 43, 83-114.
16. Eimers, M. T., & Pike, G. R. (1997). Minority and nonminority adjustment to college: Differences or similarities? Research in Higher Education, 38, 77-97.
17. Finney, S. J., & DiStefano, C. (2006). Non-normal and categorical data in structural equation modeling. In G. R. Hancock & R. O. Mueller (Eds.), Structural equation modeling: A second course (pp. 269-314). Greenwich, CT: IAP.
18. Fishman, J. A. (1957). Supplement to College Board scores, no. 2. New York: College Entrance Examination Board.
19. Hahn, J., Todd, P., & van der Klaauw, W. (2001). Identification and estimation of treatment effects with a regression-discontinuity design. Econometrica, 69, 201-209.
20. Hansen, M. J., & Williams, G. A. (2005). Assessing learning communities at Indiana University-Purdue University in Indianapolis: Comprehensive approaches, leveraging results, lessons learned, and remaining challenges. Metropolitan Universities Journal, 16, 69-90.
21. Heckman, J. J. (2008). Econometric Causality (Working Paper No. 13934). Cambridge, MA: National Bureau of Economic Research. http://www. nber. org/papers/w13934. Accessed 3 July 2009.
22. stCentury Scholars. http://www. learnmoreindiana. org/college/paying/TwentyFirstCenturyScholars. Accessed 29 July 2009.
23. Inkelas, K. K., Brower, A. M., Crawford, S., Hummel, M., Pope, D., & Zeller, W. J. (2004, November). National Study of Living-Learning Programs: 2004 report of findings. College Park, MD: University of Maryland & Association of College and University Housing Officers International. http://www. livelearnstudy. net/additionalresources/reports. html. Retrieved 15 Aug 2008.
24. Inkelas, K. K., Daver, Z. E., Vogt, K. E., & Leonard, J. B. (2007). Living-learning programs and first-generation college students' academic and social transition to college. Research in Higher Education, 48, 403-434.
25. Inkelas, K. K., & Weisman, J. L. (2003). Different by design: An examination of student outcomes among participants in three types of living-learning programs. Journal of College Student Development, 44, 335-368.
26. Institute of Education Sciences (no date). About IES. http://www. ies. ed. gov/director. Accessed 7 July 2009.
27. Ishitani, T. T. (2003). A longitudinal approach to assessing attrition behavior among first-generation students: Time-varying effects of pre-college characteristics. Research in Higher Education, 44, 433-449.
28. Johnson, J. L., & Romanoff, S. J. (1999). Higher education residential learning communities: What are the implications for student success? College Student Journal, 33, 385-399.
29. Knight, W. E. (2003). Learning communities and first-year programs: Lessons for planners. Planning for Higher Education, 31(4), 5-12.
30. Kuh, G. D. (2008). High-impact educational practices: What they are who has access to them, and why they matter. Washington, DC: Association of American Colleges and Universities.
31. Kuh, G. D., Kinzie, J., Schuh, J. H., Whitt, E. J., & Associates. (2005). Student success in college: Creating conditions that matter. San Francisco: Jossey-Bass.
32. Malin, J. T., Bray, J. H., Dougherty, T. W., & Skinner, W. K. (1980). Factors affecting the performance and satisfaction of adult men and women attending college. Research in Higher Education, 13, 115-130.
33. Manpower Demonstration Research Corporation (2009). Project page: Learning communities demonstration. New York: Author. http://www. mdrc. org/project_31_76. html. Accessed 28 Aug 2009.
34. Mathiasen, R. L. (1984). Predicting college academic achievement: A research review. College Student Journal, 18, 380-386.
35. Matthews, D. B. (1991). The effects of learning style on grades of first-year college students. Research in Higher Education, 32, 253-268.
36. Mouw, J., & Khanna, R. (1993). Prediction of academic success: A review of the literature and some recommendations. College Student Journal, 27, 328-336.
37. National Center for Postsecondary Research (2009). Learning communities. New York: NCPR, Teachers College, Columbia University. http://www. postsecondaryresearch. org/index. html?Id=Research& Info=Learning+Communities. Accessed 3 Sept 2009.
38. National Survey of Student Engagement. (2007). Experiences that matter: Enhancing student learning and success. Bloomington, IN: Indiana University Center for Postsecondary Research.
39. Noble, J., & Sawyer, R. (1987). Predicting grades in specific college freshman courses from ACT test scores and self-reported high school grades. ACT Research Report Series, 87-20. Iowa City, IA: American College Testing Program.
40. Noble, J., & Sawyer, R. (1997). Alternative methods for validating admission and course placement criteria. AIR Professional File, no. 63, 1-9.
41. Odell, C. W. (1927). Attempt at predicting success in freshman year at college. School and Society, 25, 702-706.
42. Pascarella, E. T., & Terenzini, P. T. (1991). How college affects students: Findings and insights from twenty years of research. San Francisco: Jossey-Bass.
43. Pascarella, E. T., & Terenzini, P. T. (2005). How college affects students: A third decade of research (Vol. 2). San Francisco: Jossey-Bass.
44. Pasque, P. A., & Murphy, R. (2005). The intersections of living-learning programs and social identity as factors of academic achievement and intellectual engagement. Journal of College Student Development, 46, 429-441.
45. Pike, G. R. (1999). The effects of residential learning communities and traditional residential living arrangements on educational gains during the first year of college. Journal of College Student Development, 40, 269-284.
46. Pike, G. R. (2002). The differential effects of on- and off-campus living arrangements on students' openness to diversity. NASPA Journal, 39, 283-299.
47. Pike, G. R. (2009, March). An analysis of first-time freshmen dismissed from University College after Fall 2008. Unpublished research report, Office of Information Management and Institutional Research, Indiana University-Purdue University-Indianapolis, Indianapolis, IN.
48. Pike, G. R., & Saupe, J. L. (2002). Does high school matter? An analysis of three methods of predicting first-year grades. Research in Higher Education, 43, 187-207.
49. Pike, G. R., Schroeder, C. C., & Berry, T. R. (1997). Enhancing the educational impact of residence halls: The relationship between residential learning communities and first-year college experiences and persistence. Journal of College Student Development, 38, 609-621.
50. Purdie, J. R. II, & Rosser, V. J. (2007, November). Examining the academic performance and retention of four-year students in academic themed floors, freshman interest groups and first-year experience courses. Paper presented at the annual meeting of the Association for the Study of Higher Education, Louisville, KY.
51. Ramsey, J. B. (1969). Tests of specification errors in classical linear least-squares regression analysis. Journal of the Royal Statistical Society. Series B, Statistical Methodology, 31, 350-371.
52. Reynolds, C. L., & DesJardins, S. L. (2009). The use of matching methods in higher education research: Answering whether attendance at a 2-year institution results in differences in educational attainment. In J. C. Smart (Ed.), Higher education: Handbook of theory and research (Vol. XXIV, pp. 47-104). Dordrecht, The Netherlands: Springer.
53. Saupe, J. L. (1992). A technique for producing a double-entry expectancy nomograph from observed proportions without distributional assumptions. Research in Higher Education, 33, 85-98.
54. Saupe, J. L., & Eimers, M. T. (2010, June). Correcting correlations when predicting success in college. Paper presented at the annual meeting of the Association for Institutional Research, Chicago, IL.
55. Schneider, B., Carnoy, M., Kilpatrick, J., Schmidt, W. H., & Shavelson, R. J. (2007). Estimating causal effects using experimental and observational designs. Washington, D. C.: American Educational Research Association.
56. Sedlacek, W. E. (2004). Beyond the big test: Noncognitive assessment in higher education. San Francisco: Jossey-Bass.
57. Segal, D. (1934). Prediction of success in college (Bulletin No. 15, U. S. Office of Education). Washington, D. C.: U. S. Government Printing Office.
58. Slavin, R. E. (2002). Evidence-based education policies: Transforming educational practice and research. Educational Researcher, 31(7), 15-21.
59. Starke, M. C., Harth, M., & Sirianni, F. (2001). Retention, bonding, and academic achievement: Success of a first-year seminar. Journal of the First-Year Experience & Students in Transition, 13, 7-35.
60. Stassen, M. L. A. (2003). Student outcomes: The impact of varying living-learning community models. Research in Higher Education, 44, 581-613.
61. Stata Corp, L. P. (2007). Stata users guide: Release 10. College Station, TX: Author.
62. Stock, J. H., & Yogo, M. (2005). Testing for weak instruments in linear IV regression. In D. W. K. Andrews & J. H. Stock (Eds.), Identification and inference for econometric models: Essays in honor of Thomas Rothenberg. Cambridge, UK: Cambridge University Press.
63. Szelényi, K., Inkelas, K. K., Drechsler, M. J., & Kim, Y. C. (2007, November). Exploring social capital in the transition to college of students in living-learning programs from differing socioeconomic backgrounds. Paper presented at the annual meeting of the Association for the Study of Higher Education, Louisville, KY.
64. Terenzini, P. T., Rendon, L. I., Upcraft, M. L., Millar, S. B., Allison, K. W., Gregg, P. L., et al. (1994). The transition to college: Diverse students, diverse stories. Research in Higher Education, 35, 57-73.
65. Terenzini, P. T., Springer, L., Yaeger, P. M., Pascarella, E. T., & Nora, A. (1996). First-generation college students: Characteristics, experiences, and cognitive development. Research in Higher Education, 37, 1-22.
66. Thistlewaite, D. L., & Campbell, D. T. (1960). Regression-discontinuity analysis: An alternative to the ex post factor experiment. Journal of Educational Psychology, 51, 309-317.
67. Thomas, L. L., Kuncel, N. R., & Credé, M. (2007). Noncognitive variables in college admissions: The case of the Non-Cognitive Questionnaire. Educational and Psychological Measurement, 67, 635-657.
68. Tinto, V. (1975). Dropout from higher education: A theoretical synthesis of recent research. Review of Educational Research, 45, 89-125.
69. Titus, M. A. (2006). Detecting selection bias, using propensity score matching, and estimating treatment effects: An application to the private returns to a Master's degree. Research in Higher Education, 48, 487-521.
70. Travers, R. M. W. (1949). Significant research on the prediction of academic success. In W. T. Donahue, C. H. Coomb, & R. M. W. Travers (Eds.), The measurement of student adjustment and achievement (pp. 147-190). Ann Arbor, MI: University of Michigan Press.
71. United States Department of Education. (2005). Scientifically based evaluation methods. Federal Register, 70(15), 3586-3589.
72. Upcraft, M. L., Gardner, J. N., & Barefoot, B. O. (2005). Challenging and supporting the first-year student: A handbook for improving the first year of college. San Francisco: Jossey-Bass.
73. Walpole, M. (2008). Emerging from the pipeline: African American students, socioeconomic status, and college experiences and outcomes. Research in Higher Education, 49, 237-255.
74. Williams, G., Chism, L. P., & Hansen, M. J. (2009, May). Linking a summer bridge program to themed learning communities. Paper presented at the annual meeting of the Educational Policy Institute Retention Conference, New Orleans, LA.
75. Williford, L. E. (1996). The freshman year: How do personal factors influence academic success and persistence? 1996 SAIR annual report: Charting the course in a changing environment. Mobile, AL: Southern Association for Institutional Research.
76. Willingham, W. (1985). Success in college: The role of personal qualities and academic ability. New York: College Entrance Examination Board.
77. Wooldridge, J. M. (1995). Score diagnostics for linear models estimated by two stage least squares. In G. S. Maddala, P. C. B. Phillips, & T. N. Srinivasan (Eds.), Advances in econometrics and quantitative economics: Essays in honor of Professor C R. Rao. Cambridge, MA: Blackwell.
78. Zhao, C., & Kuh, G. D. (2004). Adding value: Learning communities and student engagement. Research in Higher Education, 45, 115-138.