The Use and Effects of Incentives in Surveys

Annals of the American Academy of Political and Social Science

Volumn 645, Issue 1, 2013, Pages 112-141

  Singer, Eleanor ^a   Ye, Cong ^b  

^a UNIVERSITY OF MICHIGAN   (United States)

^b UNIVERSITY OF MARYLAND   (United States)

Author keywords

incentives; nonresponse; nonresponse bias; response rates

Indexed keywords

EID: 84870199016     PISSN: 00027162     EISSN: 15523349     Source Type: Journal    
DOI: 10.1177/0002716212458082     Document Type: Article

References (109)

1. Abraham Katherine G.,Helms Sara,Presser Stanley.How social processes distort measurement: The impact of survey nonresponse on estimates of volunteer work in the United States.American Journal of Sociology. 2009;114 (4): 1129-65.
2. Ajzen Icek,Fishbein MartinUnderstanding attitudes and predicting social behavior. Englewood Cliffs, NJ: Prentice Hall; 1980:.
3. Bates Nancy,Dahlhamer James,Singer Eleanor.Privacy concerns, too busy, or just not interested: Using doorstep concerns to predict survey nonresponse.Journal of Official Statistics. 2008;24 (4): 591-612.
4. Battaglia Michael P.,Khare Meena,Frankel Martin R.,Murray Mary Cay,Buckley Paul,Peritz SaralynAdvances in telephone survey methodology. Lepkowski James L.Tucker ClydeBrick J. MichaeldeLeeuw Edith D.Japec LilliLavrakas Paul J.Link Michael W.Sangster Roberta L., ed. Hoboken, NJ: John Wiley; 2008:529-60.
5. Baumgartner Robert,Rathbun Pamela.Prepaid monetary incentives and mail survey response rates. Paper presented at the annual conference of the American Association for Public Opinion Research; 1997Norfolk, VA; 1997.
6. Berlin Martha,Mohadjer Leyla,Waksberg Joseph,Kolstad Andrew,Kirsch Irwin,Rock D.,Yamamoto KentaroJSM proceedings. Alexandria, VA: American Statistical Association; 1992:393-98.
7. Beydoun Hind,Saftlas Audrey F.,Harland Kari,Triche Elizabeth.Combining conditional and unconditional recruitment incentives could facilitate telephone tracing in surveys of postpartum women.Journal of Clinical Epidemiology. 2006;59 (7): 732-38.
8. Birnholtz Jeremy P.,Horn Daniel B.,Finholt Thomas A.,Bae Sung Joo.The effects of cash, electronic, and paper gift certificates as respondent incentives for a Web-based survey of technologically sophisticated respondents.Social Science Computer Review. 2004;22 (3): 355-62.
9. Bosnjak Michael,Tuten Tracy L.Prepaid and promised incentives in Web surveys.Social Science Computer Review. 2003;21 (2): 208-17.
10. Brehm John.Stubbing our toes for a foot in the door? Prior contact, incentives and survey response.International Journal of Public Opinion Research. 1994;6 (1): 45-63.
11. Brick J. Michael,Brick Pat,Dipko Sarah,Presser Stanley,Tucker Clyde,Yuan Yangyang.Cell phone survey feasibility in the U.S.: Sampling and calling cell numbers versus landline numbers.Public Opinion Quarterly. 2007;71 (1): 23-39.
12. Brick J. Michael,Montaquila Jill,Hagedorn Mary Collins,Roth Shelley Brock,Chapman Christopher.Implications for RDD design from an incentive experiment.Journal of Official Statistics. 2005;21 (4): 571-89.
13. Brick J. Michael,Williams Douglas.Explaining rising nonresponse rates in cross-sectional surveys.The Annals of the American Academy of Political and Social Science. 2013;:.
14. Cantor David,O'Hare Barbara,O'Connor KathleenAdvances in telephone survey methodology. Lepkowski James M.Tucker ClydeBrick J. Michaelde Leeuw EdithJapec LilliLavrakas Paul J.Link Michael W.Sangster Roberta L., ed. New York, NY: Wiley; 2008:471-98.
15. Cantor David,Wang Kevin,Abi-Habib NatalieJSM proceedings. Alexandria, VA: American Statistical Association; 2003:37-48.
16. Church Allan H.Estimating the effect of incentives on mail survey response rates: A meta-analysis.Public Opinion Quarterly. 1993;57 (1): 62-79.
17. Cobanoglu Cihan,Cobanoglu Nesrin.The effect of incentives in Web surveys: Application and ethical considerations.International Journal of Market Research. 2003;45 (4): 475-88.
18. Cockayne Sarah,Torgerson David J.A randomised controlled trial to assess the effectiveness of offering study results as an incentive to increase response rates to postal questionnaires.BMC Medical Research Methodology. 2005;5:34-38.
19. Coogan Patricia F.,Rosenberg Lynn.Impact of a financial incentive on case and control participation in a telephone interview.American Journal of Epidemiology. 2004;160 (3): 295-98.
20. Couper Mick P.,Singer Eleanor,Conrad Frederick G.,Groves Robert M.Risk of disclosure, perceptions of risk, and concerns about privacy and confidentiality as factors in survey participation.Journal of Official Statistics. 2008;24 (2): 255-75.
21. Couper Mick P.,Singer Eleanor,Conrad Frederick G.,Groves Robert M.Experimental studies of disclosure risk, disclosure harm, topic sensitivity, and survey participation.Journal of Official Statistics. 2010;26 (2): 287-300.
22. Creighton Kathleen P.,King Karen E.,Martin Elizabeth A.The use of monetary incentives in Census Bureau longitudinal surveys. Washington, DC: U.S. Census Bureau; 2007:.
23. Curtin Richard,Presser Stanley,Singer Eleanor.Changes in telephone survey nonresponse over the past quarter century.Public Opinion Quarterly. 2005;69 (1): 87-98.
24. Curtin Richard,Singer Eleanor,Presser Stanley.Incentives in random digit dial telephone surveys: A replication and extension.Journal of Official Statistics. 2007;23 (1): 91-105.
25. Davern Michael,Rockwood Todd H.,Sherrod Randy,Campbell Stephen.Prepaid monetary incentives and data quality in face-to-face interviews: Data from the 1996 Survey of Income and Program Participation Incentive Experiment.Public Opinion Quarterly. 2003;67 (1): 139-47.
26. de Leeuw Edith D.,de Heer WimGroves Robert M.,Dillman Don A.,Eltinge John L.Survey nonresponse. New York, NY: John Wiley; 2002:41-54.
27. Deutskens Elisabeth,de Ruyter Ko,Wetzels Martin,Oosterveld Paul.Response rate and response quality of internet-based surveys: An experimental study.Marketing Letters. 2004;15 (1): 21-36.
28. Dillman Don A.,Smyth Jolene D.,Christian Leah M.Internet, mail and mixed-mode surveys: The tailored design method. 2009. Internet, mail and mixed-mode surveys: The tailored design method. 3rd ed.New York, NY: Wiley.New York, NY: Wiley; 2009:.
29. Dirmaier Jörg,Harfst Timo,Koch Uwe,Schulz Holger.Incentives increased return rates but did not influence partial nonresponse or treatment outcome in a randomized trial.Journal of Clinical Epidemiology. 2007;60 (12): 1263-70.
30. Doody Michele M.,Sigurdson Alice S.,Kampa Diane,Chimes Kathleen,Alexander Bruce H.,Ron Elaine,Tarone Robert E.,Linet Martha S.Randomized trial of financial incentives and delivery methods for improving response to a mailed questionnaire.American Journal of Epidemiology. 2003;157 (7): 643-51.
31. Downes-Le GuinTheoJanowitzPaulStoneRobKhorramShahrokh2002. Use of pre-incentives in an Internet survey. Journal of Online Research. Available from http://www.websm.org/uploadi/editor/use_of_pre-incentives_in_an_internet_survey.pdf.
32. Edwards Phil,Roberts Ian,Clarke Mike,DiGuiseppi Carolyn,Pratap Sarah,Wentz Reinhard,Kwan Irene.Increasing response rates to postal questionnaires: Systematic review.British Journal of Medicine. 2002;324 (7347): 1183-91.
33. Finsen Vilhjalmur,Storeheier Andreas H.Scratch lottery tickets are a poor incentive to respond to mailed questionnaires.BMC Medical Research Methodology. 2006;6:19-23.
34. Fishbein Martin,Ajzen IcekBelief, attitude, intention and behavior: An introduction to theory and research. Reading, MA: Addison-Wesley; 1975:.
35. Gelman Andrew,Stevens Matt,Chan Valerie.Regression modeling and meta-analysis for decision making: A cost-benefit analysis of incentives in telephone surveys.Journal of Business & Economic Statistics. 2002;21 (2): 213-25.
36. Goldenberg Karen L.,David McGrath,Lucilla TanJSM proceedings. Alexandria, VA: American Statistical Association; 2009:5985-99.
37. Göritz Anja S.The impact of material incentives on response quantity, response quality, sample composition, survey outcome, and cost in online access panels.International Journal of Market Research. 2004a;46 (3): 327-45.
38. Göritz Anja S.Recruitment for online access panels.International Journal of Market Research. 2004b;46 (4): 411-25.
39. Göritz Anja S.Cash lotteries as incentives in online panels.Social Science Computer Review. 2006a;24 (4): 445-59.
40. Göritz Anja S.Incentives in Web studies: Methodological issues and a review.International Journal of Internet Science. 2006b;1 (1): 58-70.
41. Göritz Anja S.The long-term effect of material incentives on participation in online panels.Field Methods. 2008;20 (3): 211-25.
42. Göritz Anja S.Advanced methods for conducting online behavioral research. Gosling Samuel D.Johnson John A., ed. Washington, DC: American Psychological Association; 2010:.
43. Gouldner Alvin W.The norm of reciprocity: A preliminary statement.American Sociological Review. 1960;25 (2): 161-78.
44. Groves Robert M.Nonresponse rates and nonresponse bias in household surveys.Public Opinion Quarterly. 2006;70 (5): 646-75.
45. Groves Robert M.,Couper Mick P.,Presser Stanley,Singer Eleanor,Tourangeau Roger,Acosta Giorgina P.,Nelson Lindsay.Experiments in producing nonresponse bias.Public Opinion Quarterly. 2006;70 (5): 720-36.
46. Groves Robert M.,Peytcheva Emilia.The impact of nonresponse rates on nonresponse bias.Public Opinion Quarterly. 2008;72 (2): 167-89.
47. Groves Robert M.,Presser Stanley,Dipko Sarah.The role of topic interest in survey participation decisions.Public Opinion Quarterly. 2004;68 (1): 2-31.
48. Groves Robert M.,Singer Eleanor,Corning Amy D.Leverage-salience theory of survey participation: Description and an illustration.Public Opinion Quarterly. 2000;64 (3): 299-308.
49. Halpern Scott D.,Karlawish Jason H. T.,Casarett David,Berlin Jesse A.,Asch David A.Empirical assessment of whether moderate payments are undue or unjust inducements for participation in clinical trials.Archives of Internal Medicine. 2004;164 (7): 801-3.
50. Halpern Scott D.,Ubel Peter A.,Berlin Jesse A.,Asch David A.Randomized trial of $5 versus $10 monetary incentives, envelope size, and candy to increase physician response rates to mailed questionnaires.Medical Care. 2002;40 (9): 834-39.
51. Harris Ian A.,Khoo Oliver K.,Young Jane M.,Solomon Michael J.,Rae Hamish.Lottery incentives did not improve response rate to a mailed survey: A randomized controlled trial.Journal of Clinical Epidemiology. 2008;61 (6): 609-10.
52. Holbrook Allyson,Krosnick Jon A.,Pfent AlisonAdvances in telephone survey methodology. Lepkowski James M.Tucker ClydeBrick J. Michaelde Leeuw EdithJapec LilliLavrakas Paul J.Link Michael W.Sangster Roberta L., ed. New York, NY: Wiley; 2008:499-528.
53. Homans George C.The human group. New York, NY: Harcourt, Brace and Company; 1950:.
54. Hox Joop.The influence of interviewers' attitudes and behavior on household survey nonresponse: An international comparison. Paper presented at the International Conference on Survey Nonresponse; 1999Portland, OR; 1999.
55. Hyman Herbert H.Interviewing in social research. Chicago, IL: University of Chicago Press; 1954:.
56. Jäckle Annette,Lynn Peter.Respondent incentives in a multi-mode panel survey: Cumulative effects on nonresponse and bias.Survey Methodology. 2008;34 (1): 105-17.
57. James Jeannine M.,Richard Bolstein.The effect of monetary incentives and follow-up mailings on the response rate and response quality in mail surveys.Public Opinion Quarterly. 1990;54 (3): 346-61.
58. Juster F. Thomas,Suzman Richard.An overview of the Health and Retirement Study.Journal of Human Resources. 1995;30 (5): S7-S56.
59. Keating Nancy L.,Zaslavsky Alan M.,Goldstein Judy,West Dee W.,Ayanian John Z.Randomized trial of $20 versus $50 incentives to increase physician survey response rates.Medical Care. 2008;46 (8): 878-81.
60. Kenyon Sara,Pike Katie,Jones David,Taylor David,Salt Alison,Marlow Neil,Brocklehurst Peter.The effect of a monetary incentive on return of a postal health and development questionnaire: A randomised trial.BMC Health Services Research. 2005;5:55-58.
61. Kerachsky Stuart J.,Mallar Charles D.JSM proceedings. Alexandria, VA: American Statistical Association; 1981:258-63.
62. Kropf Martha,Blair Johnny.Testing theories of survey cooperation: Incentives, self-interest and norms of cooperation.Evaluation Review. 2005;29 (6): 559-75.
63. Laurie Heather,Lynn PeterMethodology of longitudinal surveys. Lynn Peter, ed. London: John Wiley; 2009:.
64. Lengacher Jennie E.,Sullivan Colleen M.,Couper Mick P.,Groves Robert M.JSM proceedings. Alexandria, VA: American Statistical Association; 1995:1029-34.
65. Leung Gabriel M.,Ho Lai Ming,Chan Moon Fai,Johnston Janice M.,Wong Fung Kam.The effects of cash and lottery incentives on mailed surveys to physicians: A randomized trial.Journal of Clinical Epidemiology. 2002;55 (8): 801-7.
66. Leung Gabriel M.,Johnston Janice M.,Saing Hnin,Tin Keith Y. K.,Wong Irene O. L.,Ho Lai-Ming.Prepayment was superior to postpayment cash incentives in a randomized postal survey among physicians.Journal of Clinical Epidemiology. 2004;57 (8): 777-84.
67. Lynn Peter.The impact of incentives on response rates to personal interview surveys: Role and perceptions of interviewers.International Journal of Public Opinion Research. 2001;13 (3): 326-36.
68. Mack Stephen,Huggins Vicki,Keathley Donald,Sundukchi MahdiJSM proceedings. Alexandria, VA: American Statistical Association; 1998:529-34.
69. Mann Sue L.,Lynn Diana J.,Peterson Arthur V.The "downstream" effect of token prepaid cash incentives to parents on their young adult children's survey participation.Public Opinion Quarterly. 2008;72 (3): 487-501.
70. Marcus Bernd,Bosnjak Michael,Lindner Steffen,Pilischenko Stanislav,Schütz Astrid.Compensating for low topic interest and long surveys: A field experiment on nonresponse in Web surveys.Social Science Computer Review. 2007;25 (3): 372-83.
71. Martin Elizabeth,Abreu Denise,Winters Franklin.Money and motive: Effects of incentives on panel attrition in the Survey of Income and Program Participation.Journal of Official Statistics. 2001;17 (2): 267-84.
72. Martinez-Ebers Valerie.Using monetary incentives with hard-to-reach populations in panel surveys.International Journal of Public Opinion Research. 1997;9 (1): 77-86.
73. McConaghy Mark,Beerten Roeland.Influencing response on the Family Resources Survey by using incentives.Social Survey Methodology Bulletin. 2003;51 (1): 27-35.
74. McGrath David E.JSM proceedings. Alexandria, VA: American Statistical Association; 2006:3411-18.
75. Medway Rebecca.Satisficing in telephone surveys: Do prepaid cash incentives make a difference?. Paper presented at the Annual Conference of the American Association of Public Opinion Research; 2012Orlando, FL; 2012.
76. Merkle Daniel,Edelman Murray,Dykeman Kathy,Brogan Chris.An experimental study of ways to increase exit poll response rates and reduce survey error. Paper presented at the Annual Conference of the American Association of Public Opinion Research; 1998St. Louis, MO; 1998.
77. Moses Sharon H.,Clark T. Justin.Effect of prize draw incentive on the response rate to a postal survey of obstetricians and gynaecologists: A randomised controlled trial.BMC Health Services Research. 2004;4:14-16.
78. Petrolia Daniel R.,Bhattacharjee Sanjoy.Revisiting incentive effects: Evidence from a random sample mail survey on consumer preferences for fuel ethanol.Public Opinion Quarterly. 2009;73 (3): 537-50.
79. Porst Rolf,Briel Christa vonZUMA-Arbeitsbericht. Mannheim, Germany:; 1995:.
80. Porter Stephen R.,Whitcomb Michael E.The impact of lottery incentives on student survey response rates.Research in Higher Education. 2003;44 (4): 389-407.
81. Presser Stanley. Remarks made at a seminar on respondent incentives sponsored by the Council for Professional Associations on Federal Statistics; 2008Washington, DC; 2008.
82. Presser Stanley,McCulloch Susan.The growth of survey research in the United States: Government-sponsored surveys 1984 to 2004.Social Science Research. 2011;40:1019-24.
83. Rao Kumar,Kaminska Olena,McCutcheon Allan L.Recruiting probability samples for a multi-mode research panel with internet and mail components.Public Opinion Quarterly. 2010;74 (1): 68-84.
84. Roberts Lesley M.,Wilson Sue,Roalfe Andrea,Bridge Peter.A randomized controlled trial to determine the effect on response of including a lottery incentive in health surveys.BMC Health Services Research. 2004;4:30-37.
85. Ryu Erica,Couper Mick P.,Marans Robert W.Survey incentives: Cash vs. in-kind; face-to-face vs. mail; response rate vs. nonresponse error.International Journal of Public Opinion Research. 2006;18 (1): 89-106.
86. Schoeni Robert F.,Stafford Frank,McGonagle Katherine A.,Andreski Patricia.Response rates in national panel surveys.The Annals of the American Academy of Political and Social Science. 2013;:.
87. Schwarz Norbert,Clore Gerald L.Social psychology: Handbook of basic principles. Higgins E. ToryKruglanski Arie W., ed. New York, NY: Guilford; 1996:.
88. Sharp Linda,Cochran Claire,Cotton Seonaidh C.,Gray Nicola M.,Gallagher Marie E.Enclosing a pen with a postal questionnaire can significantly increase the response rate.Journal of Clinical Epidemiology. 2006;59 (7): 747-54.
89. Shettle Carolyn,Mooney Geraldine.Monetary incentives in U.S. government surveys.Journal of Official Statistics. 1999;15 (2): 231-50.
90. Singer EleanorGroves Robert M.,Dillman Don A.,Eltinge John L.,Little Roderick J. A.Survey nonresponse. New York, NY: Wiley; 2002:163-78.
91. Singer Eleanor.Exploring the meaning of consent: Participation in research and beliefs about risks and benefits.Journal of Official Statistics. 2003;19 (3): 273-85.
92. Singer EleanorCollege Park, MD:; 2010:.
93. Singer Eleanor,Couper Mick P.Do incentives exert undue influence on survey participation? Experimental evidence.Journal of Empirical Research on Human Research Ethics. 2008;3 (3): 49-56.
94. Singer Eleanor,Frankel Martin R.,Glassman Marc B.The effect of interviewer characteristics and expectations on response.Public Opinion Quarterly. 1983;47 (1): 68-83.
95. Singer Eleanor,Gebler Nancy,Raghunathan Trivellore,Hoewyk John Van,McGonagle Katherine.The effect of incentives in interviewer-mediated surveys.Journal of Official Statistics. 1999;15 (2): 217-30.
96. Singer Eleanor,Groves Robert M.,Corning Amy D.Differential incentives: Beliefs about practices, perceptions of equity, and effects on survey participation.Public Opinion Quarterly. 1999;63 (2): 251-60.
97. Singer Eleanor,Kohnke-Aguirre Luane.Interviewer expectation effects: A replication and extension.Public Opinion Quarterly. 1979;43 (2): 245-60.
98. Singer Eleanor,Kulka Richard A.Studies of welfare populations: Data collection and research issues. Ploeg Michele VerMoffitt Robert A.Citro Constance F., ed. Washington, DC: National Academy Press; 2002:105-28.
99. Singer Eleanor,Presser StanleyAdvances in telephone survey methodology. Lepkowski James M.Tucker ClydeBrick J. Michaelde Leeuw EdithJapec LilliLavrakas Paul J.Link Michael W.Sangster Roberta L., ed. New York, NY: Wiley; 2008:449-70.
100. Singer Eleanor,Van Hoewyk John,Maher Mary P.Does the payment of incentives create expectation effects?.Public Opinion Quarterly. 1998;62:152-64.
101. Singer Eleanor,Hoewyk John Van,Maher Mary P.Experiments with incentives in telephone surveys.Public Opinion Quarterly. 2000;64 (2): 171-88.
102. Smith Tom W.Trends in nonresponse rate.International Journal of Public Opinion Research. 1995;7 (2): 157-71.
103. Sudman Seymour,Bradburn Norman M.,Blair Ed,Stocking Carol.Modest expectations: The effects of interviewers' prior expectations on responses.Sociological Methods and Research. 1977;6 (2): 171-82.
104. Teisl Mario F.,Brian Roe,Mike Vayda.Incentive effects on response rates, data quality, and survey administration costs.International Journal of Public Opinion Research. 2005;18 (3): 364-73.
105. Tuten Tracy L.,Galesic Mirta,Bosnjak Michael.Effects of immediate versus delayed notification of prize draw results on response behavior in Web surveys: An experiment.Social Science Computer Review. 2004;22 (3): 377-84.
106. Ulrich Connie M.,Danis Marion,Koziol Deloris,Garrett-Mayer Elizabeth,Hubbard Ryan,Grady Christine.Does it pay to pay? A randomized trial of prepaid financial incentives and lottery incentives in surveys of nonphysician healthcare professionals.Nursing Research. 2005;54 (3): 178-83.
107. Wetzels Willem,Schmeets Hans,van den Brakel Jan,Feskens Remco.Impact of prepaid incentives in face-to-face surveys: A large-scale experiment with postage stamps.International Journal of Public Opinion Research. 2008;20 (4): 507-16.
108. Yu Julie,Cooper Harris.A quantitative review of research design effects on response rates to questionnaires.Journal of Marketing Research. 1983;20 (1): 36-44.
109. Zagorsky Jay L.,Rhoton Patricia.The effects of promised monetary incentives on attrition in a long-term panel survey.Public Opinion Quarterly. 2008;72 (3): 502-13.