Using weighting adjustments to compensate for survey nonresponse

Research in Higher Education

Volumn 49, Issue 2, 2008, Pages 153-171

  Pike, Gary R ^a  

^a INDIANA UNIVERSITY   (United States)

Author keywords

Assessment; Bias; Nonresponse; Precision; Surveys; Weighting

Indexed keywords

EID: 38349180078     PISSN: 03610365     EISSN: None     Source Type: Journal    
DOI: 10.1007/s11162-007-9069-0     Document Type: Article

References (47)

1. Bethlehem, J. G. (2002). Weighting nonresponse adjustments based on auxiliary information. In R. M. Groves, D. A. Dillman, J. L. Eltinge, & R. J. A. Little (Eds.), Survey nonresponse (pp. 275-287). New York: Wiley.
2. Carini, R. M., Hayek, J. H., Kuh, G. D., Kennedy, J. M., & Ouimet, J. A. (2003). College student responses to web and paper surveys: Does mode matter? Research in Higher Education, 44, 1-19.
3. Chapman, D. W. (1976). A survey of nonresponse imputation procedures. Proceedings of the Social Statistics Section, American Statistical Association, 1976(1), 245-251.
4. Curtin, R., Presser, S., & Singer, E. (2000). The effects of response rate changes on the index of consumer sentiment. Public Opinion Quarterly, 64, 413-428.
5. de Leeuw, E., & de Heer, W. (2002). Trends in household survey nonresponse: A longitudinal and international comparison. In R. M. Groves, D. A. Dillman, J. L. Eltinge, & R. J. A. Little (Eds.), Survey nonresponse (pp. 41-54). New York: Wiley.
6. Dey, E. L. (1997). Working with low survey response rates: The efficacy of weighting adjustments. Research in Higher Education, 38, 215-227.
7. Dey, E. L., Hurtado, S., Rhee, B., Inkelas, K. K., Wimsatt, L. A., & Guan, F. (1997). Improving research on postsecondary student outcomes: A review of the strengths and limitations of national data resources. Stanford, CA: National Center for Postsecondary Improvement.
8. Dillman, D. A. (2000). Mail and internet surveys: The tailored design method (2d ed.). New York: Wiley.
9. Dillman, D. A., Eltinge, J. L., Groves, R. M., & Little, R. J. A. (2002). Survey nonresponse in design, data collection, and analysis. In R. M. Groves, D. A. Dillman, J. L. Eltinge, & R. J. A. Little (Eds.), Survey nonresponse (pp. 3-26). New York: Wiley.
10. Du Mouchel, W. H., & Duncan, G. J. (1983). Using survey weights in multiple regression analyses of stratified samples. Journal of the American Statistical Association, 78, 535-543.
11. Gelman, A., & Carlin, J. B. (2002). Poststratification and weighting adjustments. In R. M. Groves, D. A. Dillman, J. L. Eltinge, & R. J. A. Little (Eds.), Survey nonresponse (pp. 289-302). New York: Wiley.
12. Goyder, J., Warriner, K., & Miller, S. (2002). Evaluating socio-economic status (SES) bias in survey nonresponse. Journal of Official Statistics, 18, 1-11.
13. Groves, R. M. (1989). Survey errors and survey costs. New York: Wiley.
14. Groves, R. M., Cialdini, R. B., & Couper, M. P. (1992). Understanding the decision to participate in a survey. Public Opinion Quarterly, 56, 475-495.
15. Groves, R. M., & Couper, M. P. (1998). Nonresponse in household interview surveys. New York: Wiley.
16. Groves, R. M., Presser, S., & Dipko, S. (2004). The role of topic interest in survey participation decisions. Public Opinion Quarterly, 68, 2-31.
17. Groves, R. M., Singer, E., & Corning, A. (2000). Leverage-salience theory of survey participation: Description and an illustration. Public Opinion Quarterly, 64, 299-308.
18. Hahs-Vaughn, D. L. (2006, Fall). Weighting omissions and best practices when using large-scale data in educational research. (Air Professional File No. 101). Tallahassee, FL: Association for Institutional Research.
19. Holt, D., & Smith, T. M. F. (1979). Post stratification. Journal of the Royal Statistical Society, Series A (General), 142(1), 33-46.
20. Hutchinson, J., Tollefson, N., & Wigington, H. (1987). Response bias in college freshmen's responses to mail surveys. Research in Higher Education, 26, 99-106.
21. Jones, J. (1996). The effects of non-response on statistical inference. Journal of Health and Social Policy, 8, 49-62.
22. Kalton, G. (1983a). Compensating for missing survey data. Ann Arbor: University of Michigan Institute for Social Research.
23. Kalton, G. (1983b). Introduction to survey sampling (Sage University Paper series on Quantitative Applications in the Social Sciences, 07-035). Beverly Hills, CA: Sage.
24. Kalton, G., & Kasprzyk, D. (1986). The treatment of missing survey data. Survey Methodology, 12, 1-16.
25. Keeter, S., Miller, C., Kohut, A., Groves, R. M., & Presser, S. (2000). Consequences of reducing nonresponse in a national telephone survey. Public Opinion Quarterly, 64, 125-148.
26. Kish, L. (1965). Survey sampling. New York: Wiley.
27. Kuh, G. D. (2001). The national survey of student engagement: Conceptual framework and overview of psychometric properties. Bloomington, IN: Indiana University Center for Postsecondary Research. Retrieved February 24, 2006 from the national Survey of Student Engagement Web site: http://www.nsse.iub.edu/ html/psychometric_framework_2002.cfm
28. Kuh, G. D., Hayek, J. C., Carini, R. M., Ouimet, J. A., Gonyea, R. M., & Kennedy, J. (2001). NSSE technical and norms report. Bloomington, IN: Indiana University Center for Postsecondary Research.
29. Kuh, G. D. Kinzie, J., Cruce, T., Shoup, R., & Gonyea, R. M. (2007, January). Connecting the dots: Multi-faceted analyses of the relationships between student engagement results from the NSSE, and the institutional practices and conditions that foster student success. (Revised final report prepared for the Lumina Foundation for Education grant #2518). Bloomington, IN: Indiana University Center for Postsecondary Research.
30. Little, R. J. A. (1993). Post-stratification: A modeler's perspective. Journal of the American Statistical Association, 88, 1001-1012.
31. Mandell, L. (1974). When to weight: Nonresponse bias in survey data. Public Opinion Quarterly, 38, 247-252.
32. Merkle, D. M., & Edelman, M. (2002). Nonresponse in exit polls: A comprehensive analysis. In R. M. Groves, D. A. Dillman, J. L. Eltinge, & R. J. A. Little (Eds.), Survey nonresponse (pp. 243-257). New York: Wiley.
33. Moore, D. L., & Tarnai, J. (2002). Evaluating nonresponse error in mail surveys. In R. M. Groves, D. A. Dillman, J. L. Eltinge, & R. J. A. Little (Eds.), Survey nonresponse (pp. 197-211). New York: Wiley.
34. National Center for Education Statistics. (2002). Statistical standards. Retrieved January 3, 2006 from the NCES Web site: http://www.nces.ed.gov/ statprog/2002/stdintro.asp
35. National Survey of Student Engagement (2004). Student engagement: Pathways to collegiate success. Bloomington, IN: Indiana University Center for Postsecondary Research. Retrieved November 20, 2006 from http://www.nsse.iub. edu/html/report-2004.cfm
36. Oh, H. L., & Scheuren, F. (1983). Weighting and adjustment for unit nonresponse. In W. G. Madow, I. Olkin, & D. B. Rubin (Eds.), Incomplete data in sample surveys, volume 2, theory and bibliographies (pp. 143-184). New York: Academic Press.
37. Peterson, M. W., Einarson, M. K., Augustine, C. H., & Vaughan, D. S. (1999). Institutional support for student assessment: Methodology and results of a national survey. Stanford, CA: National Center for Postsecondary Improvement.
38. Pike, G. R. (2004). Measuring quality: A comparison of U. S. News rankings and NSSE benchmarks. Research in Higher Education, 45, 193-208.
39. Pike, G. R. (2007). Adjusting for nonresponse in surveys. In J. C. Smart (Ed.), Higher education: Handbook of theory and research (Vol. XXII, pp. 411-449). Dordrecht, The Netherlands: Springer.
40. Porter, S. R., & Umbach, P. D. (2006). Student survey response rates across institutions: Why do they vary? Research in Higher Education, 47, 229-247.
41. Porter, S. R., & Whitcomb, M. E. (2003). The impact of lottery incentives on student survey response rates. Research in Higher Education, 44, 389-407.
42. Porter, S. R., & Whitcomb, M. E. (2005). Non-response in student surveys: The role of demographics, engagement, and personality. Research in Higher Education, 46, 127-152.
43. Thomas, S. L. (2006). Sampling: Rationale and rigor in choosing what to observe. In C. F. Conrad &R. C. Serlin (Eds.), The SAGE handbook for research in education: Engaging ideas and enriching inquiry (pp. 393-404). Thousand Oaks, CA: Sage.
44. Thomsen, I. (1973). A note on the efficiency of weighting subclass means to reduce the effects of non-response when analyzing survey data. Statistisk Tidskrift, 11, 278-283.
45. Tremblay, V. (1986). Practical criteria for definition of weighting classes. Survey Methodology, 12, 85-97.
46. Vartivarian, S. L. (2004). On the formation of weighting class adjustments for unit nonresponse in sample surveys. (Doctoral dissertation, University of Michigan, 2004). Ann Arbor, MI: ProQuest. (UMI No. 3137952).
47. Warwick, D. P., & Lininger, C. A. (1975). The sample survey: Theory and practice. New York: McGraw-Hill.