Non-response in student surveys: The role of demographics, engagement and personality

Research in Higher Education

Volumn 46, Issue 2, 2005, Pages 127-152

  Porter, Stephen R ^a   Whitcomb, Michael E ^a  

^a WESLEYAN UNIVERSITY   (United States)

Author keywords

Holland personality type; Ordered logit; Student engagement; Survey methodology; Survey non response

Indexed keywords

EID: 13844281869     PISSN: 03610365     EISSN: None     Source Type: Journal    
DOI: 10.1007/s11162-004-1597-2     Document Type: Review

References (70)

1. Adams, L. L. M., and Gale, D. (1982). Solving the quandry between questionnaire length and response rate in educational research. Research in Higher Education 17(3): 231-240.
2. American Association for Public Opinion Research (2004). Standard definitions: Final dispositions of case codes and outcome rates for surveys, Lenexa, KS.
3. Aviv, A. L., Zelenski, J. M., Rallo, L., and Larsen, R. J. (2002). Who comes when: Personality differences in early and later participation in a university subject pool. Personality and Individual Differences 33: 487-496.
4. Barrick, M. R., Mount, M. K., and Gupta, R. (2003). Meta-analysis of the relationship between the Five-Factor Model of personality and Holland's Occupational types. Personal Psychology 56: 46-74.
5. Bradburn, N. M. (1978). Respondent burden. Paper presented at the The American Statistical Association, Proceedings of the Survey Research Methods Section.
6. Brennan, M., and Hoek, J. (1992). The behavior of respondents, nonrespondents, and refusers across mail surveys. Public Opinion Quarterly 56(4): 530-535.
7. Cooper, H., Baumgardner, A. H., and Strathman, A. (1991). Do students with different characteristics take part in psychology experiments at different times of the semester? Journal of Personality 59: 109-127.
8. Couper, M. P. (1997). Survey introductions and data quality. Public Opinion Quarterly 61(2): 317-338.
9. Couper, M. P., Traugott, M. W., and Lamias, M. J. (2001). Web survey design and administration. Public Opinion Quarterly 65: 250-253.
10. Crawford, S. D., Couper, M. P., and Lamias, M. J. (2001). Web surveys: Perceptions of burden. Social Science Computer Review 19(2): 146-162.
11. Curtin, R., Presser, S., and Singer, E. (2000). The effects of response rate changes on the index of consumer sentiment. Public Opinion Quarterly 64: 413-428.
12. De Leeuw, E., and Heer, W. (2002). Trends in household survey nonresponse: A longitudinal and international comparison. In: Groves, R. M., Dillman, D. A., Eltinge, J. L., and Little, R. J. A. (eds.), Survey Nonresponse, John Wiley & Sons, New York.
13. Dey, E. (1997). Working with low survey response rates: The efficacy of weighting adjustments. Research in Higher Education 38(2): 215-227.
14. Dommeyer, C. J., and Moriarty, E. (2000). Comparing two forms of an email survey: Embedded vs. attached. International Journal of Market Research 42(1): 39-50.
15. Evans, R., and Donnerstein, E. (1974). Some implications for psychological research of early versus late term participation by college students. Journal of Research in Personality 8: 102-109.
16. Goyder, J. (1982). Further evidence on factors affecting response rates to mailed questionnaires. American Sociological Review 47(4): 550-553.
17. Goyder, J. (1986). Surveys on surveys: Limitations and potentialities. Public Opinion Quarterly 50(1): 27-41.
18. Goyder, J. (1987). The Silent Minority: Nonrespondents in Sample Surveys, Westview Press, Boulder.
19. Goyder, J., Warriner, K., and Milller, S. (2002). Evaluating socio-economic status (SES) bias in survey nonresponse. Journal of Official Statistics 18(1): 1-11.
20. Greene, W. H. (1997). Econometric Analysis, Prentice Hall, Upper Saddle River, NJ.
21. Groves, R. M., Cialdini, R. B., and Couper, M. P. (1992). Understanding the decision to participate in a survey. Public Opinion Quarterly 56: 475-495.
22. Groves, R. M., and Couper, M. P. (1996). Contact-level influences on cooperation in face-to-face surveys. Journal of Official Statistics 12(1): 63-83.
23. Groves, R. M., Singer, E., and Corning, A. (2000). Leverage-saliency theory of survey participation. Public Opinion Quarterly 64: 299-308.
24. Heberlein, T. A., and Baumgartner, R. (1978). Factors affecting response rates to mailed questionnaires: A quantitative analysis of the published literature. American Sociological Review 43(4): 447-462.
25. Holland, J. L. (1966). The Psychology of Vocational Choice, Blaisdell, Waltham, MA.
26. Holland, J. L. (1985). Making Vocational Choices, Prentice-Hall, Englewood Cliffs, NJ.
27. Hutchinson, J., Tollefson, N., and Wigington, H. (1987). Response bias in college freshman's response to mail surveys. Research in Higher Education 26(1): 99-106.
28. Johnson, J. S., and Mowrer, R. R. (2000). Mail surveys among college students:Do initial responders score differently from nonresponders on the 16PF? Psychological Reports 86: 901-908.
29. Kaldenberg, D. O., Koenig, H. F., and Becker, B. W. (1994). Mail survey response rate patterns in a population of the elderly: Does response deteriorate with age? Public Opinion Quarterly 58(1): 68-76.
30. Kandel, D., and Raveis, J. L. (1983). Sex differences in the characteristics of members lost to a longitudinal panel: A speculative research note. Public Opinion Quarterly 47(4): 567-575.
31. Kojetin, B. A., Borgida, E., and Snyder, M. (1993). Survey Topic Involvement and Nonresponse Bias. Paper presented at the Proceeding of the Section on Survey Research Method, Volume II, American Statistical Association.
32. Kuh, G. D. (2003). The National Survey of Student Engagement: Conceptual Framework and Overview of Psychometric Properties, Indiana University Center for Postsecondary Research, Bloomington, IN.
33. Kwak, N., and Radler, B. (2002). A comparison between mail and web surveys: Response pattern, respondent profile, and data quality. Journal of Official Statistics 18(2): 257-273.
34. Lahaut, V. M. H. C. J., Jansen, H. A. M., van de Mheen, D., Garretsen, H. F. L., Verdurmen, J. E. E., and van Dijk, A. (2003). Estimating non-response bias in a survey on alcohol consumption: Comparison of response waves. Alcohol and Alcoholism 38: 128-134.
35. Larson, L. M., Rottingham, P. J., and Borgen, F. (2002). Meta-analysis of big six interests and big five personality factors. Journal of Vocational Behavior 61: 217-239.
36. Laurie, H., Smith, R., and Scott, L. (1999). Strategies for reducing nonresponse in a longitudinal panel survey. Journal of Official Statistics 15(2): 269-282.
37. Liberty, H. J. (1993). The relationship between extraversion and time of data collection. Personality and Individual Differences 14: 835-836.
38. Lin, I.-F., and Schaeffer, N. C. (1995). Using survey participants to estimate the impact of nonparticipation. Public Opinion Quarterly 59: 236-258.
39. Long, J. S. (1997). Regression Models for Categorical and Limited Dependent Variables, Sage Publications, Thousand Oaks, CA.
40. Lowe, F., and McCormick, T. C. (1955). Some Survey Sampling Biases. Public Opinion Quarterly 19: 303-315.
41. McCrae, R. R., and Costa, P. T. J. (1996). Toward a new generation of personality theories: Theoretical contexts for the five-factor model. In: Wiggins, J. S. (ed.), The Five-Factor Model of Personality: Theoretical Perspectives, Guilford, New York, pp. 51-87.
42. McDaniel, S. W., Madden, C. S., and Verille, P. (1987). Do topic differences affect survey non-response? Journal of the Market Research Society 29: 55-66.
43. Moore, D. L., and Tarnai, J. (2002). Evaluating nonresponse error in mail surveys. In: Groves, R. M., Dillman, D. A., Eltinge, J. L., and Little, R. J. A. (eds.), Survey Nonresponse, John Wiley & Sons, New York, pp. 197-211.
44. Mount, M. K., Barrick, M. A., Scullen, S. M., and Rounds, J. (2004, April 2004). Higher Order Dimensions of Personality Traits and Interests. Paper presented at the Annual meeting of the Society for Industrial and Organizational Psychology, Chicago.
45. National Center for Education Statistics (2002). National Postsecondary Student Aid Study 1999-2000 (NPSAS:2000), CATI Nonresponse Bias Analysis Report (No. 2002-03), Washington, DC.
46. National Survey of Student Engagement (2003). The College Student Report: 2003 Overview.
47. Pealer, L. N., Weiler, R. M., Pigg, R. M. Jr., Miller, D., and Dorman, S. M. (2001). The feasibility of a web-based surveillance system to collect health risk data from college students. Health Education & Behavior 28(5): 547-559.
48. Porter, S. R., and Umbach, P. D. (2002). College Major Choice: An Analysis of Person-Environment Fit. Paper presented at the Association for Institutional Research, Toronto, Canada.
49. Porter, S. R., and Umbach, P. D. (2004). What works best? Collecting alumni data with multiple technologies. AIR Professional File 90: 1-10.
50. Porter, S. R., and Whitcomb, M. E. (2003a). The impact of contact type on web survey response rates. Public Opinion Quarterly 67(4): 579-588.
51. Porter, S. R., and Whitcomb, M. E. (2003b). The impact of lottery incentives on student survey response rates. Research in Higher Education 44(4): 389-407.
52. Porter, S. R., Whitcomb, M. E., and Weitzer, W. H. (2004). Multiple surveys of students and survey fatigue. In: Porter, S. R. (ed.), Overcoming Survey Research Problems, New Directions for Institutional Research (Vol. 121), Jossey-Bass, San Francisco.
53. Roman, R. J., Moskowitz, G. B., Stein, M. I., and Eisenberg, R. F. (1995). Individual differences in experiment participation: Structure, autonomy, and the time of semester. Journal of Personality 63: 113-138.
54. Sax, L. J., Gilmartin, S. K., and Bryant, A. N. (2003). Assessing response rates and nonresponse bias in web and paper surveys. Research in Higher Education 44(4): 409-432.
55. Sax, L. J., Lindholm, J. A., Astin, A. W., Korn, W. S., and Mahoney, K. M. (2001). The American Freshman:National Norms for Fall 2001, Higher Education Research Institute, UCLA, Los Angeles, CA.
56. Singer, E., Groves, R. M., and Corning, A. D. (1999). Differential incentives:Beliefs about practices, perceptions of equity, and effects on survey participation. Public Opinion Quarterly 63: 251-260.
57. Singer, E., van Hoewyk, J., and Maher, M. P. (2000). Experiments with incentives in telephone surveys. Public Opinion Quarterly 64: 171-188.
58. Smart, J. C., Feldman, K. A., and Ethington, C. A. (2000). Academic Disciplines:Holland's Theory and the Study of College Students and Faculty, Vanderbilt University Press, Nashville.
59. Smith, T. W. (1995). Trends in nonresponse rates. International Journal of Public Opinion Research 7: 157-171.
60. Smith, K., and Bers, T. (1987). Improving alumni survey response rates: An experiment and cost-benefit analysis. Research in Higher Education 27 (3): 218-226.
61. Steeh, C. G. (1981). Trends in nonresponse rates, 1952-1979. Public Opinion Quarterly 59: 66-77.
62. Stevens, C. D., and Ash, R. A. (2001). The conscientiousness of students in subject pools: Implications for "laboratory" research. Journal of Research in Personality 35: 91-97.
63. Stinchcombe, A. L., Jones, C., and Sheatsley, P. (1981). Nonresponse bias for attitude questions. Public Opinion Quarterly 45(3): 359-375.
64. Tuckel, P., and O'Neill, H. (2002). The vanishing respondent in telephone surveys. Journal of Advertising Research 26-48.
65. Umbach, P. D., and Porter, S. R. (2002). How do academic departments impact student satisfaction? Understanding the contextual effects of departments. Research in Higher Education 23(2): 209-233.
66. Van Kenhove, P., Wijnen, K., and De Wulf, K. (2002). The influence of topic involvement on mail-survey response behavior. Psychology & Marketing 19: 293-301.
67. Voigt, L. F., Koepsell, T. D., and Daling, J. R. (2003). Characteristics of telephone survey respondents according to willingness to participate. American Journal of Epidemiology 157: 66-73.
68. Whitcomb, M. E., and Porter, S. R. (2004). Email contacts: A test of complex graphical designs. Social Science Computer Review 22(3): 370-376.
69. Zelenski, J. M., Rusting, C. L., and Larsen, R. J. (2000). Personality Differences and Consistency in the Time of Experiment Participation. Paper presented at the Poster presented at The Annual Meeting of the Society for Personality and Social Psychology, Nashville, TN.
70. Zusman, B. J., and Duby, P. (1987). An evaluation of the use of monetary incentives in postsecondary survey research. Journal of Research and Development in Education 20(4): 73-78.