Enhancing Surveys of Health Care Professionals: A Meta-Analysis of Techniques to Improve Response

Evaluation and the Health Professions

Volumn 36, Issue 3, 2013, Pages 382-407

  Cho, Young Ik ^a   Johnson, Timothy P ^b   VanGeest, Jonathan B ^c  

^a UNIVERSITY OF WISCONSIN MILWAUKEE   (United States)

^b UNIVERSITY OF ILLINOIS AT CHICAGO   (United States)

^c KENT STATE UNIVERSITY   (United States)

Author keywords

health professionals; meta analysis; research methods; response rates; survey

Indexed keywords

ARTICLE; HEALTH CARE PERSONNEL; HEALTH CARE SURVEY; HEALTH PROFESSIONALS; HUMAN; META ANALYSIS; METHODOLOGY; MOTIVATION; REGRESSION ANALYSIS; RESEARCH; RESEARCH METHODS; RESPONSE RATES; STATISTICS; SURVEY;

HEALTH PROFESSIONALS; META-ANALYSIS; RESEARCH METHODS; RESPONSE RATES; SURVEY;

HEALTH CARE SURVEYS; HEALTH PERSONNEL; HUMANS; MOTIVATION; REGRESSION ANALYSIS; RESEARCH;

EID: 84882961122     PISSN: 01632787     EISSN: 15523918     Source Type: Journal    
DOI: 10.1177/0163278713496425     Document Type: Article

References (75)

1. Akl E. A.,Maroun N.,Klocke R. A.,Montori V.,Schunemann H. J.Electronic mail was not better than postal mail for surveying residents and faculty.Journal of Clinical Epidemiology. 2005;58:425-429.
2. Asch D. A.Use of a coded postcard to maintain anonymity in a highly sensitive mail survey: Cost, response rates, and bias.Epidemiology. 1996;7:550-551.
3. Asch D. A.,Christakis N. A.Different response rates in a trial of two envelop styles in mail survey research.Epidemiology. 1994;5:364-365.
4. Asch D. A.,Christakis N. A.,Ubel P. A.Conducting physician mail surveys on a limited budget: A randomized trial comparing $2 bill versus $5 bill incentives.Medical Care. 1998;36:95-99.
5. Asch D. A.,Jedrziewski M. K.,Christakis N. A.Response rates to mail surveys published in medical journals.Journal of Clinical Epidemiology. 1997;50:1129-1136.
6. Barriball K. L.,While A. E.Non-response in survey research: A methodological discussion and development of an explanatory model.Journal of Advanced Nursing. 1999;30:677-686.
7. Becker H.,Cookston J.,Kulberg V.Mailed survey follow-ups-Are postcard reminders more cost-effective than second questionnaires?.Western Journal of Nursing Research. 2000;22:642-647.
8. Beebe T. J.,Locke R.,Barnes S. A.,Davern M. E.,Anderson K. J.Mixing web and mail methods in a survey of physicians.Health Services Research. 2007;42:1219-1234.
9. Berk M. L.Interviewing physicians: The effect of improved response rate.American Journal of Public Health. 1985;75:1338-1340.
10. Berry S. H.,Kanouse D. E.Physician response to a mailed survey: An experiment in timing of payment.Public Opinion Quarterly. 1987;51:102-114.
11. Bhandari M.,Devereaux P. J.,Swiontkowski M. F.,Schemitsch E. H.,Shankardass K.,Sprague S.,Guyatt G. H.A randomized trial of opinion leader endorsement in a survey of orthopaedic surgeons: Effect on primary response rate.International Journal of Epidemiology. 2003;32:634-636.
12. Bonevski B.,Magin P.,Horton G.,Foster M.,Girgis A.Response rates in GP surveys: Trialling two recruitment strategies.Australian Family Physician. 2011;40:427-430.
13. Bostick R. M.,Pirie P.,Luepker R. V.,Kofron P. M.Using physician caller follow-ups to improve the response rate to a physician telephone survey: Its impact and implications.Evaluation and the Health Professions. 1992;15:420-433.
14. Burns K. E. A.,Duffett M.,Kho M. E.,Meade M. O.,Adhikari N. K. J.,Sinuff T.,Cook D. J.A guide for the design and conduct of self-administered surveys of clinicians.Canadian Medical Association Journal. 2008;179:245-252.
15. Camuňas C.,Alward R. R.,Vecchione E.Survey response rates to a professional association mail questionnaire.Journal of the New York State Nurses Association. 1990;21:7-9.
16. Cartwright A.,Ward A. W.Variations in general practitioners' response to postal questionnaires.British Journal of Preventive and Social Medicine. 1968;22:199-205.
17. Cook J. V.,Dickinson H. O.,Eccles M. P.Response rates in postal surveys of healthcare professionals between 1996 and 2005: An observational study.BMC Health Services Research. 2009;9:160.
18. Cull W. L.,O'Connor K. G.,Sharp S.,Tang S. S.Response rates and response bias for 50 surveys of pediatricians.Health Services Research. 2005;40:213-226.
19. Cummings S. M.,Savitz L. A.,Konrad T. R.Reported response rates to mailed physician questionnaires.Health Services Research. 2001;35:1347-1355.
20. Curtis E. A.,Redmond R. A.Survey postal questionnaire: Optimising response and dealing with non-response.Nursing Research. 2009;16:76-88.
21. del Valle M.,Morgenstern H.,Rogstad T. L.,Albright C.,Vickrey B. G.A randomized trial of the impact of certified mail on response rate to a physician survey, and a cost-effectiveness analysis.Evaluation and the Health Professions. 1997;20:389-406.
22. Dillman D. A.,Smyth J. D.,Christian L. M.Internet, mail and mixed-mode surveys. The tailored design method. Hoboken, NJ: John Wiley; 2009:.
23. Donaldson G. W.,Moinpour C. M.,Bush N. E.,Chapko M.,Jocom J.,Siadak M.,Sullivan K. M.Physician participation in research surveys: A randomized study of inducements to return mailed research questionnaires.Evaluation and the Health Professions. 1999;22:427-441.
24. Dykema J.,Stevenson J.,Day B.,Sellers S. L.,Bonham V. L.Effects of incentives and prenotification on response rates and costs in a national web survey of physicians.Evaluation and the Health Professions. 2011;34:434-447.
25. Everett S. A.,Price J. H.,Bedell A. W.,Telljohann S. K.The effect of a monetary incentive in increasing the return rate of a survey to family physicians.Evaluation and the Health Professions. 1997;20:207-214.
26. Field T. S.,Cadoret C. A.,Brown M. L.,Ford M.,Greene S. M.,Hill D.,Zapka J. M.Surveying physicians: Do components of the "Total Design Approach" to optimizing survey response rates apply to physicians?.Medical Care. 2002;40:596-606.
27. Ford R.,Bammer G.A research routine to assess bias introduced by low response rates in postal surveys.Nurse Researcher. 2009;17:44-53.
28. Gattellari M.,Ward J. E.Will donations to their learned college increase surgeons' participation in surveys? A randomized trial.Journal of Clinical Epidemiology. 2001;54:645-650.
29. Gore-Felton C.,Koopman C.,Bridges E.,Thoresen C.,Spiegel D.An example of maximizing survey return rates: Methodological issues for health professionals.Evaluation and the Health Professions. 2002;25:152-168.
30. Grava-Gubins I.,Scott S.Effects of various methodologic strategies: Survey response rates among Canadian physicians and physicians-in-training.Canadian Family Physician. 2008;54:1424-1430.
31. Guise V.,Chambers M.,Valimaki M.,Makkonen P.A mixed-mode approach to data collection: Combining web and paper questionnaires to examine nurses' attitudes to mental illness.Journal of Advanced Nursing. 2010;66:1623-1632.
32. Halpern S. D.,Kohn R.,Dornbrand-Lo A.,Metkus T.,Asch D. A.,Volpp K. G.Lottery-based versus fixed incentives to increase clinicians' response to surveys.Health Services Research. 2011;46:1663-1674.
33. Halpern S. D.,Ubel P. A.,Berlin J. A.,Asch D. A.Randomized trial of $5 versus $10 monetary incentives, envelope size, and candy to increase physician response rates to mailed questionnaires.Medical Care. 2002;40:834-839.
34. Hart A. M.,Brennan C. W.,Sym D.,Larson E.The impact of personalized prenotification on response rates to an electronic survey.Western Journal of Nursing Research. 2009;31:17-23.
35. Hawley K. M.,Cook J. R.,Jensen-Doss A.Do noncontingent incentives increase survey response rates among mental health providers? A randomized trail comparison. Administration and Policy in Mental Health. 2009;36:343-348.
36. Heywood A.,Mudge P.,Ring I.,Sanson-Fisher R.Reducing systematic bias in studies of general practitioners: The use of a medical peer in the recruitment of general practitioners in research.Family Practice. 1995;12:227-231.
37. Hill C. A.,Fahrney K.,Wheeless S. C.,Carson C. P.Survey response inducements for registered nurses.Western Journal of Nursing Research. 2006;28:322-334.
38. James K. M.,Ziegenfuss J. Y.,Tilburt J. C.,Harris A. M.,Beebe T. J.Getting physicians to respond: The impact of incentive type and timing on physician survey response rates.Health Services Research. 2011;46:232-242.
39. Johnson T. P.,Wislar J. S.Response rates and nonresponse errors in surveys.Journal of the American Medical Association. 2012;307:1805-1806.
40. Kanaan R. A. A.,Wessely S. C.,Armstrong D.Differential effects of pre and post-payment on neurologists' response rates to a postal survey.BMC Neurology. 2010;10:100.
41. Keating N. L.,Zaslavsky A. M.,Goldstein J.,West D. W.,Ayanian J. Z.Randomized trial of $20 versus $50 incentives to increase physician survey response rates.Medical Care. 2008;46:878-881.
42. Kellerman S. E.,Herold J.Physician response to surveys: A review of the literature.American Journal of Preventive Medicine. 2001;20:61-67.
43. Kephart W. M.,Bressler M.Increasing the responses to mail questionnaires.Public Opinion Quarterly. 1958;22:123-132.
44. Klabunde C. N.,Willis G. B.,McLeod C. C.,Dillman D. A.,Johnson T. P.,Greene S. M.,Brown M. L.Improving the quality of surveys of physicians and medical groups: A research agenda.Evaluation and the Health Professions. 2012;35:477-506.
45. Lusk C.,Delclos G. L.,Burau K.,Drawhorn D. D.,Aday L. A.Mail versus internet surveys: Determinants of method of response preferences among health professionals.Evaluation and the Health Professions. 2007;30:186-201.
46. Malin J. L.,Rideout J.,Ganz P. A.Tracking managed care: The importance of a cash incentive for medical director response to a survey.American Journal of Managed Care. 2000;6:1209-1214.
47. Martins Y.,Lederman R. I.,Lowenstein C. I.,Joffe S.,Neville B. A.,Hastings B. T.,Abel G. A.Increasing response rates from physicians in oncology research: A structured literature review and data from a recent physician survey.British Journal of Cancer. 2012;106:1021-1026.
48. Matteson K. A.,Anderson B. L.,Pinto S. B.,Lopes V.,Schulkin J.,Clark M. A.Surveying ourselves: Examining the use of a web-based approach for a physician survey.Evaluation and the Health Professions. 2011;34:448-463.
49. McLaren B.,Shelley J.Response rates of Victorian general practitioners to a mailed survey on miscarriage: Randomised trial of a prize and two forms of introduction to the research.Australian and New Zealand Journal of Public Health. 2000;24:360-364.
50. McLeod C. C.,Klabunde C. N.,Willis G. B.,Stark D.Health care provider surveys in the United States, 2000-2010: A review.Evaluation and the Health Professions. 2013;36:106-126.
51. McFarlane E.,Olmsted M. G.,Murphy J.,Hill C. A.Nonresponse bias in a mail survey of physicians. Montreal, Canada: Paper presented at the Annual Conference of the American Association for Public Opinion Research; 2006:.
52. Myerson S.Improving the response rates in primary care research. Some methods used in a survey on stress in general practice since the new contract (1990).Family Practice. 1993;10:342-346.
53. Nicholls K.,Chapman K.,Shaw T.,Perkins A.,Sullivan M. M.,Crutchfield S.,Reed E.Increasing response rates in physician surveys: The limited utility of electronic options.Health Services Research. 2011;46:1675-1682.
54. Olson K.Survey participation, nonresponse bias, measurement error bias, and total bias.Public Opinion Quarterly. 2006;70:737-758.
55. Olson L.,Schneiderman M.,Armstrong R. V.Increasing physician survey response rates without biasing survey results. Alexandria, VA:; 1993:1036-1041.
56. Parsons J. A.,Warnecke R. B.,Czaja R. F.,Barnsley J.,Kaluzny A.Factors associated with response rates in a national survey of primary care physicians.Evaluation Review. 1994;18:756-766.
57. Paul C. L.,Walsh R. A.,Tzelepis F.A monetary incentive increases postal survey response rates for pharmacists.Journal of Epidemiology and Community Health. 2005;59:1099-1101.
58. Puleo E.,Zapka J.,White M. J.,Mouchawar J.,Somkin C.,Taplin S.Caffeine, cajoling, and other strategies to maximize clinician survey response rates.Evaluation and the Health Professions. 2002;25:169-184.
59. Raudenbush S. W.,Bryk A. S.Hierarchical linear models. 2002). Hierarchical linear models (2nd ed.). Thousand Oaks, CA: Sage.Thousand Oaks, CA: Sage; 2002:.
60. Raudenbush S. W.,Bryk A. S.,Cheong A. S.,Fai Y. F.,Congdon R. T.,du Toit M.HLM 7: Hierarchical linear and nonlinear modeling. Lincolnwood, IL: Scientific Software International; 2011:.
61. Recklitis C. J.,Campbell E. G.,Kutner J. S.,Bober S. L.Money talks: Non-monetary incentive and Internet administration fail to increase response rates to a physician survey.Journal of Clinical Epidemiology. 2009;62:224-226.
62. Scott A.,Jeon S. H.,Joyce C. M.,Humphreys J. S.,Kalb G.,Witt J.,Leahy A.A randomised trial and economic evaluation of the effect of response mode on response rate, response bias, and item non-response in a survey of doctors.BMC Medical Research Methodology. 2011;11:26.
63. Singer E.,Couper M. P.Do incentives exert undue influence on survey participation? Experimental evidence.Journal of Empirical Research on Human Research Ethics. 2008;3:49-56.
64. Temple-Smith M.,Mulvey G.,Doyle W.Maximizing response rates in a survey of general practitioners: Lessons from a Victorian survey on sexually transmissible diseases.Australian Family Physician. 1998;27:S15-S18.
65. Templeton L.,Deehan A.,Taylor C.,Drummond C.,Strang J.Surveying general practitioners: Does a low response rate matter?.British Journal of General Practice. 1997;47:91-94.
66. Thorpe C.,Ryan B.,McLean S. L.,Burt A.,Stewart M.,Brown J. B.,Reid G. J.,Harris S.How to obtain excellent response rates when surveying physicians.Family Practice. 2008;26:65-68.
67. Ulrich C. M.,Danis M.,Koziol D.,Garrett-Mayer E.,Hubbard R.,Grady C.Does it pay to play? A randomized trial of prepaid financial incentives and lottery incentives in surveys of nonphysician healthcare professionals.Nursing Research. 2005;54:178-183.
68. Ulrich C. M.,Grady C.Financial incentives and response rates in nursing research.Nursing Research. 2004;53:73-74.
69. VanGeest J. B.,Johnson T. P.Surveying nurses: Identifying strategies to improve participation.Evaluation and the Health Professions. 2011;34:487-511.
70. VanGeest J. B.,Johnson T. P.,Welch V. L.Methodologies for improving response rates in surveys of physicians: A systematic review.Evaluation and the Health Professions. 2007;30:303-321.
71. VanGeest J. B.,Wynia M. K.,Cummins D. S.,Wilson I. B.Effects of different monetary incentives on the return rate of a national survey of physicians.Medical Care. 2001;39:197-201.
72. Viera A. J.,Edwards T.Does an offer for a free on-line continuing medical education (CME) activity increase physician survey response rate? A randomized trial.BMC Research Notes. 2012;5:129.
73. VonRiesen R. D.Postcard reminders versus replacement questionnaires and mail survey response rates from a professional population.Journal of Business Research. 1979;7:1-7.
74. Wilson P. M.,Petticrew M.,Calnan M.,Nazareth I.Effects of a financial incentive on health researchers' response to an online survey: A randomized controlled trial.Journal of Medical Internet Research. 2010;12:e13.
75. Ziegenfuss J. Y.,Burmeister K.,James K. M.,Haas L.,Tilburt J. C.,Beebe T. J.Getting physicians to open the survey: Little evidence that an envelope teaser increases response rates.BMC Medical Research Methodology. 2012;12:41.