Evaluating survey quality in health services research: A decision framework for assessing nonresponse bias

Health Services Research

Volumn 48, Issue 3, 2013, Pages 913-930

  Halbesleben, Jonathon R B ^a   Whitman, Marilyn V ^a  

^a UNIVERSITY OF ALABAMA   (United States)

Author keywords

Nonresponse bias; response rate; survey quality

Indexed keywords

DATA COLLECTION METHOD; HEALTH CARE QUALITY; HEALTH SERVICES RESEARCH; HEALTH SURVEY; HUMAN; NONRESPONSE BIAS; REVIEW;

BIAS (EPIDEMIOLOGY); DATA COLLECTION; DATA INTERPRETATION, STATISTICAL; HEALTH SERVICES RESEARCH; HUMANS; QUESTIONNAIRES; RESEARCH DESIGN;

EID: 84877607923     PISSN: 00179124     EISSN: 14756773     Source Type: Journal    
DOI: 10.1111/1475-6773.12002     Document Type: Review

References (41)

1. Armstrong, J. S., and, T. Overton,. 1977. Estimating Nonresponse Bias in Mail Surveys. Journal of Marketing 14: 396-402.
2. Asch, D. S., M. K. Jedrziewski, and, N. A. Christakis,. 1997. " Response Rates to Surveys Published in Medical Journals." Journal of Clinical Epidemiology 50 (10): 1129-36.
3. Baines, A. D., M. R. Partin, M. Davern, and, T. H. Rockwood,. 2007. " Mixed-Mode Administration Reduced Bias and Enhanced Poststratification Adjustments in a Health Behavior Survey." Journal of Clinical Epidemiology 60: 1246-55.
4. Beebe, T. J., G. R. Locke, S. A. Barnes, M. E. Davern, and, K. J. Anderson,. 2007. " Mixing Web and Mail Methods in a Survey of Physicians." Health Services Research 42 (3): 1219-34.
5. Beebe, T. J., S. M. Jenkins, K. J. Anderson, and, M. E. Davern,. 2008. " Survey-Related Experiential and Attitudinal Correlates of Future Health Survey Participation: Results of a Statewide Survey." Mayo Clinic Proceedings 83 (12): 1358-63.
6. Beebe, T. J., J. Y. Ziegenfuss, J. L. St Sauver, S. M. Jenkins, L. Haas, M. E. Davern, and, N. J. Talley,. 2011. " Health Insurance Portability and Accountability Act (HIPAA) Authorization and Survey Nonresponse." Medical Care 49 (4): 365-70.
7. Cummings, S. M., L. A. Savitz, and, T. R. Konrad,. 2001. " Reported Response Rates to Mailed Physician Questionnaires." Health Services Research 35 (6): 213-26.
8. Davern, M., D. McAlpine, T. J. Beebe, J. Ziegenfuss, T. Rockwood, and, K. T. Call,. 2010. " Are Lower Response Rates Hazardous to Your Health Survey? An Analysis of Three State Telephone Health Surveys." Health Services Research 45: 1324-44.
9. Deehan, A., L. Templeton, C. Taylor, C. Drummond, and, J. Strange,. 1997. " The Effect of Cash and Other Financial Inducements on the Response Rate of General Practitioners in a National Postal Survey." British Journal of General Practice 47: 87-90.
10. Ellis, R. A., C. M. Endo, and, J. M. Armer,. 1970. " The Use of Potential Nonrespondents for Studying Nonresponse Bias." Pacific Sociological Review 13: 103-9.
11. Filion, F. L., 1976. " Exploring and Correcting for Nonresponse Bias Using Follow-ups of Nonrespondents." Pacific Sociological Review 19: 401-8.
12. Fitzgerald, R., and, L. Fuller,. 1982. " I Hear You Knocking But You Can't Come In: The Effects of Reluctant Respondents and Refusers on Sample Survey Estimates." Sociological Methods and Research 11: 3-32.
13. Fowler, F. J., P. M. Gallagher, V. L. Stringfellow, A. M. Zaslavsky, J. W. Thompson, and, P. D. Cleary,. 2002. " Using Telephone Interviews to Reduce Nonresponse Bias to Mail Surveys of Health Plan Members." Medical Care 40 (3): 190-200.
14. Gliksman, L., C. Smythe, and, R. C. Engs,. 1992. " Responders vs. Non-Responders to a Mail Survey: Are They Different? " The Canadian Journal of Program Evaluation 7: 131-7.
15. Groves, R. M., 2006. " Nonresponse Rates and Nonresponse Bias in Household Surveys." Public Opinion Quarterly 70 (5): 646-75.
16. Groves, R. M., R. B. Cialdini, and, M. P. Couper,. 1992. " Understanding the Decision to Participate in a Survey." Public Opinion Quarterly 56: 475-95.
17. Groves, R. M., and, E. Peytcheva,. 2008. " The Impact of Nonresponse Rates on Nonresponse Bias: A Meta-analysis." Public Opinion Quarterly 72 (2): 167-89.
18. Groves, R. M., S. Presser, and, S. Dipko,. 2000. " The Role of Topic Interest in Survey Participation Decisions." Public Opinion Quarterly 68: 2-31.
19. Groves, R. M., E. Singer, and, A. Corning,. 2000. " Leverage-Saliency Theory of Survey Participation: Description and an Illustration." Public Opinion Quarterly 64: 299-308.
20. Halpern, S. D., P. A. Ubel, J. A. Berlin, and, D. A. Asch,. 2002. " Randomized Trial of 5 Dollars versus 10 Dollars Monetary Incentives, Envelope Size, and Candy to Increase Physician Response Rates to Mailed Questionnaires." Medical Care 40 (9): 834-9.
21. Halpern, S. D., R. Kohn, A. Dornbrand-Lo, T. Metkus, D. A. Asch, and, K. G. Volpp,. 2011. " Lottery-based versus Fixed Incentives to Increase Clinicians' Response to Surveys." Health Services Research 46 (5): 1663-74.
22. Kaner, E. F. S., C. A. Haighton, and, B. R. Mcavoy,. 1998. " 'So Much Post, So Busy with Practice-So, No Time!': A Telephone Survey of General Practitioners Reasons for Not Participating in Postal Questionnaire Surveys." British Journal of General Practice 48: 1067-9.
23. Lillard, L. A., and, M. M. Farmer,. 1997. " Linking Medicare and National Survey Data." Annuals of Internal Medicine 127: 691-5.
24. Lin, I., and, N. Schaeffer,. 1995. " Using Survey Participants to Estimate the Impact of Non-participation." Public Opinion Quarterly 59: 236-58.
25. Little, R. J., and, D. B. Rubin,. 2002. Statistical Analysis with Missing Data. New York: John Wiley and Sons.
26. Ma, C., M. E. Samuels, and, J. W. Alexander,. 2003. " Factors that Influence Nurses' Job Satisfaction." Journal of Nursing Administration 33 (5): 293-9.
27. Mazor, K. M., B. E. Clauser, T. Field, R. A. Yood, and, J. H. Gurwitz,. 2002. " A Demonstration of the Impact of Response Bias on the Results of Patient Satisfaction Surveys." Health Services Research 37 (5): 1403-17.
28. McLeod, T. G., B. A. Costello, R. C. Colligan, R. A. Dierkhising, T. J. Beebe, K. P. Offord, and, G. R. Locke III,. 2009. " Personality Characteristics of Health Care Satisfaction Survey Non-Respondents." International Journal of Health Care Quality Assurance 22 (2): 145-56.
29. Nicholls, K., K. Chapman, T. Shaw, A. Perkins, M. M. Sullivan, S. Crutchfield, and, E. Reed,. 2011. " Enhancing Response Rates in Physician Surveys: The Limited Utility of Electronic Options." Health Services Research 46 (5): 1675-82.
30. Peiperl, M. A., and, Y. Baruch,. 1997. " Models of Careers: Back to Square Zero." Organizational Dynamics 35 (4): 7-22.
31. Rivara, F. P., T. D. Koepsell, J. Wang, D. Durbin, K. M. Jaffe, M. Vavilala, A. Dorsch, M. Roper-Caldback, E. Houseknecht, and, N. Temkin,. 2011. " Comparison of Telephone with World Wide Web-Based Responses by Parents and Teens to a Follow-Up Survey after Injury." Health Services Research 46 (3): 964-81.
32. Rogelberg, S. G., and, J. M. Stanton,. 2007. " Introduction: Understanding and Dealing with Survey Nonresponse." Organizational Research Methods 10 (2): 195-209.
33. Rogelberg, S. G., A. Luong, M. E. Sederburg, and, D. S. Cristol,. 2000. " Employee Attitude Surveys: Examining the Attitudes of Noncompliant Employees." Journal of Applied Psychology 85: 284-93.
34. Rogelberg, S. G., G. G. Fisher, D. Maynard, M. D. Hakel, and, M. Horvath,. 2001. " Attitudes toward Surveys: Development of a Measure and Its Relationship to Respondent Behavior." Organizational Research Methods 4: 3-25.
35. Rogelberg, S. G., J. M. Conway, M. E. Sederburg, C. Spizmuller, S. Aziz, and, W. E. Knight,. 2003. " Profiling Active and Passive Nonrespondents to an Organizational Survey." Journal of Applied Psychology 88 (6): 1104-14.
36. Roth, P. L., 1994. " Missing Data: A Conceptual Review for Applied Psychologists." Personnel Psychology 47: 537-60.
37. Sitzia, J., and, N. Wood,. 1998. " Response Rate in Patient Satisfaction Research: An Analysis of 210 Published Studies." International Journal for Quality in Health Care 10 (4): 311-7.
38. Sosdian, C. P., and, L. M. Sharp,. 1980. " Nonresponse in Mail Surveys: Access Failure or Response Resistance." Public Opinion Quarterly 44: 396-402.
39. Taris, T. W., and, P. J. G. Schreurs,. 2007. " How May Nonresponse Affect Findings in Organizational Surveys? The Tendency-to-the-Positive Effect." International Journal of Stress Management 14 (3): 249-59.
40. Willis, G., T. DeMaio, and, B. Harris-Kojetin,. 1999. " Is the Bandwagon Headed to the Methodological Promised Land? Evaluation of the Validity of Cognitive Interviewing Techniques." In Cognition and Survey Research, edited by, M. Sirken, D. Herrmann, S. Schechter, N. Schwarz, J. Tanur, and, R. Tourangeau, pp. 133-43. New York: Wiley.
41. Yessis, J., and, C. Rathert,. 2006. " Initial versus Prompted Responders to Patient Satisfaction Surveys: Implications for Interpretation and Patient Feedback." Journal of Applied Management and Entrepreneurship 11 (4): 49-64.