National surveys via RDD telephone interviewing versus the internet: Comparing sample representativeness and response quality

Public Opinion Quarterly

Volumn 73, Issue 4, 2009, Pages 641-678

  Chang, Linchiat ^a   Krosnick, Jon A ^b  

^a Stanford University ^*

^b STANFORD UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 72749103443     PISSN: 0033362X     EISSN: 15375331     Source Type: Journal    
DOI: 10.1093/poq/nfp075     Document Type: Review

References (61)

1. Acree, Michael, Maria Ekstrand, Thomas J. Coates, and Ron Stall. 1999. "Mode Effects in Surveys of GayMen:AWithin-Individual Comparison of Responses by Mail and by Telephone." Journal of Sex Research 36:67-75.
2. Aronson, Elliot, Phoebe C. Ellsworth, J. Merrill Carlsmith, and Marti Hope Gonzales. 1990. Methods of Research in Social Psychology. New York: McGraw-Hill.
3. Berrens, Robert P., Alok K. Bohara, Hank Jenkins-Smith, Carol Silva, and David L. Weimer. 2003. "The Advent of Internet Surveys for Political Research: A Comparison of Telephone and Internet Samples." Political Analysis 11:1-22.
4. Best, Samuel J., Brian Krueger, Clark Hubbard, and Andrew Smith. 2001. "An Assessment of the Generalizability of Internet Surveys." Social Science Computer Review 19:131-145
5. Bracht, Glenn H., and Gene V. Glass. 1968. "The External Validity of Experiments" American Educational Research Journal 5:437-474
6. Bridge, R. Gary, Leo G. Reeder, David Kanouse, Donald R. Kinder, Vivian T. Nagy, and Charles Judd. 1977. "Interviewing Changes Attitudes-Sometimes. " Public Opinion Quarterly 41:57-64.
7. Cannell, Charles F., Peter V. Miller, and Lois Oksenberg. 1981. "Research on Interviewing Techniques." Sociological Methodology 12:389-437.
8. Chang, LinChiat. 2001. A Comparison of Samples and Response Quality Obtained from RDD Telephone Survey Methodology and Internet Survey Methodology. Doctoral Dissertation, Ohio State University.
9. Chartrand, Tanya L., and John A. Bargh. 1999. "The Chameleon Effect: The Perception-Behavior Link and Social Interaction." Journal of Personality and Social Psychology 76:893-910.
10. Clausen, Aage R. 1968. "Response Validity: Vote Report." Public Opinion Quarterly 32:588-606.
11. Clinton, Joshua D. 2001. Panel Bias from Attrition and Conditioning: A Case Study of the Knowledge Networks Panel. Unpublished manuscript, Stanford University.
12. Cordell, Warren N., and Henry A. Rahmel. 1962. "Are Nielsen Ratings Affected by Noncooperation, Conditioning, or Response Error?" Journal of Advertising Research 2:45-49.
13. Couper, Mick P. 2000. "Web Surveys: A Review of Issues and Approaches." Public Opinion Quarterly 64:464-494
14. Curtin, Richard, Stanley Presser, and Eleanor Singer. 2000. "The Effects of Response Rate Changes on the Index of Consumer Sentiment." Public Opinion Quarterly 64:413-428
15. De Leeuw, Edith D., and Martin Collins. 1997. "Data Collection Methods and Survey Quality An Overview." In Survey Measurement and Process Quality, eds. Lars E. Lyberg, Paul Biemer, Martin Collins, Edith de Leeuw, Cathryn Dippo, Norbert Schwarz, and Dennis Trewin. New York: Wiley.
16. Dillman, Don A. 1978. Mail and Telephone Surveys: The Total Design Method. New York:Wiley.
17. Dillman, Don A. 2000. Mail and Internet Surveys: The Tailored DesignMethod. New York:Wiley.
18. Donovan, John J., and David J. Radosevich. 1999. "A Meta-Analytic Review of the Distribution of Practice Effect: Now You See It, Now You Don't." Journal of Applied Psychology 84:795-805.
19. Falaris, Evangelos M., and H. Elizabeth Peters. 1998. "Survey Attrition and Schooling Choices." The Journal of Human Resources 33:531-554
20. Fitzgerald, John, Peter Gottschalk, and Robert Moffitt. 1998a. "An Analysis of Sample Attrition in Panel Data: The Michigan Panel Study of Income Dynamics." NBER Technical Working Papers, National Bureau of Economic Research, Inc.
21. ---. 1998b. "An Analysis of the Impact of Sample Attrition on the Second Generation of Respondents in the Michigan Panel Study of Income Dynamics." The Journal of Human Resources 33:300-344.
22. Fitzsimons, Gavan J., and Vicki Morwitz. 1996. "The Effect of Measuring Intent on Brand Level Purchase Behavior." Journal of Consumer Research 23:1-11.
23. Flemming, Greg, and Molly Sonner. 1999. "Can Internet Polling Work? Strategies for Conducting Public Opinion Surveys Online." Paper presented at the annual meeting of the American Association for Public Opinion Research, St. Petersburg Beach, FL, USA.
24. Fowler, Floyd Jackson, Anthony M. Roman, and Zhu Xiao Di. 1998. "Mode Effects in a Survey of Medicare Prostate Surgery Patients." Public Opinion Quarterly 62:29-46.
25. Granberg, Donald, and Soren Holmberg. 1991. "Self-Reported Turnout and Voter Validation." American Journal of Political Science 35:448-459
26. Greenwald, Anthony G., Catherine G. Carnot, Rebecca Beach, and Barbara Young. 1987. "Increasing Voting Behavior by Asking People if They Expect to Vote." Journal of Applied Psychology 72:315-318
27. Groves, Robert M., and Robert L. Kahn. 1979. Surveys by Telephone: A National Comparison with Personal Interviews. New York: Academic.
28. Groves, R. M., E. Singer, and A. D. Corning. 2000. "Leverage- Saliency Theory of Survey Participation: Description and an Illustration." Public Opinion Quarterly 64:299-308.
29. Himmelfarb, Samuel, and Fran H. Norris. 1987. "An Examination of Testing Effects in a Panel Study of Older Persons." Personality and Social Psychology Bulletin 13:188-209.
30. Holbrook, Allyson L., Melanie C. Green, and Jon A. Krosnick. 2003. "Telephone versus Faceto- Face Interviewing of National Probability Samples with Long Questionnaires: Comparisons of Respondent Satisficing and Social Desirability Response Bias." Public Opinion Quarterly 67:79-125.
31. Holbrook, Allyson L., Jon A. Krosnick, and Alison M. Pfent. 2007. "Response Rates in Surveys by the News Media and Government Contractor Survey Research Firms." In Telephone Survey Methodology, eds. J. Lepkowski, B. Harris-Kojetin, P. J. Lavrakas, C. Tucker, E. de Leeuw, M. Link, M. Brick, L. Japec, and R. Sangster. New York: Wiley.
32. Jagodzinski, Wolfgang, Steffen M. Kuhnel, and Peter Schmidt. 1987. "Is There a "Socratic Effect" in Nonexperimental Panel Studies? Consistency of an Attitude toward Guestworkers." Sociological Methods and Research 15:259-302.
33. Keeter, Scott, Carolyn Miller, Andrew Kohut, Robert M. Goves, and Stanley Presser. 2000. "Consequences of ReducingNonresponse in a National Telephone Survey." Public OpinionQuarterly 64:125-148
34. Kenny, David A. 1979. Correlation and Causality. New York: Wiley.
35. Kiecker, Pamela, and James E. Nelson. 1996. "Do Interviewers Follow Telephone Survey Instructions?" Journal of the Market Research Society 38:161-176
36. Krosnick, Jon A. 1991. "Response Strategies for Coping with the Cognitive Demands of Attitude Measures in Surveys." Applied Cognitive Psychology 5:213-236
37. ---. 1999. "Survey Methodology." Annual Review of Psychology 50:537-567
38. Lavrakas, Paul J. 1993. Telephone Survey Methods: Sampling, Selection, and Supervision. Thousand Oaks, CA: Sage.
39. ---. 1997. "Methods for Sampling and Interviewing in Telephone Surveys." In Handbook of Applied Social Research Methods, eds. Bickman Leonard, and Debra J. Rog. Thousand Oaks, CA: Sage.
40. Leary, Mark R. 1995. Behavioral Research Methods. Pacific Grove, CA: Brooks/Cole.
41. Lerner, Jennifer S., Julie H. Goldberg, and Philip E. Tetlock. 1998. "Sober Second Thought: The Effects of Accountability, Anger, and Authoritarianism on Attributions of Responsibility." Personality and Social Psychology Bulletin 24:563-574
42. Lerner, Jennifer S., and Philip E. Tetlock. 1999. "Accounting for the Effects of Accountability." Psychological Bulletin 125:255-275
43. Lubin, Bernard, Eugene E. Levitt, and Marvin Zuckerman. 1962. "Some Personality Differences between Responders and Nonresponders to a Survey Questionnaire." Journal of Consulting Psychology 26:192.
44. Lyberg, Lars, and Daniel Kasprzyk. 1991. "Data Collection Methods and Measurement Error: An Overview." In Measurement Errors in Surveys, eds. Paul Biemer, Robert M. Groves, Lars E. Lyberg, Nancy Mathiowetz, and Seymour Sudman. New York: Wiley.
45. Mann, Christopher B. 2005. "Unintentional Voter Mobilization: Does Participation in Pre-election Surveys Increase Voter Turnout?" Annals of the American Academy of Political and Social Science 601:155-168
46. Menard, Scott. 1991. Longitudinal Research. Newbury Park, CA: Sage.
47. Miller, Jane S., and Shelly Haas 2003. Council for Marketing and Opinion Research 2003 Respondent Cooperation and Industry Image Survey. Cincinnati, OH: CMOR.
48. Mulligan, Ken, Jon A. Krosnick, Wendy Smith, Melanie Green, and George Bizer. 2001. Nondifferentiation on Attitude Rating Scales: A Test of Survey Satisficing Theory. Unpublished Manuscript, Stanford University.
49. Neumann, Roland, and Fritz Strack. 2000. "Mood Contagion: The Automatic Transfer of Mood Between Persons." Journal of Personality and Social Psychology 79:211-223
50. Novotny, Janet A.,William V. Rumpler, Joseph T. Judd, Howard Riddick, Donna Rhodes, Margaret McDowell, and Ronette Briefel. 2001. "Diet Interviews of Subject Pairs: How Different Persons Recall Eating the Same Foods." Journal of the American Dietetic Association 101:1189-1193
51. Price, Kenneth H. 1987. "Decision Responsibility, Task Responsibility, Identifiability, and Social Loafing." Organizational Behavior and Human Decision Processes 40:330-345
52. Rohde, Gregory L., and Robert Shapiro. 2000. Falling Through the Net: Toward Digital Inclusion. Washington, DC: U.S. Department of Commerce, Economics and Statistics Administration and National Telecommunications and Information Administration.
53. Rossi, Peter H., James D. Wright, and Andy B. Anderson. 1983. Handbook of Survey Research. Orlando, FL: Academic.
54. Sherman, Steven J. 1980. "On the Self-Erasing Nature of Errors of Prediction." Journal of Personality and Social Psychology 39:211-221
55. Smith, Eliot R., Nyla Branscombe, and Carol Bormann. 1988. "Generality of the Effects of Practice on Social Judgement Tasks." Journal of Personality and Social Psychology 54:385-395
56. Sobol, Marion G. 1959. "Panel Mortality and Panel Bias." Journal of the American Statistical Association 54(285):52-68.
57. Tourangeau, Roger, and Tom W. Smith. 1996. "Asking Sensitive Questions: The Impact of Data Collection Mode, Question Format, and Question Context." Public Opinion Quarterly 60:275-304.
58. Van Der Zouwen, Johannes, Wil Dijkstra, and Johannes H. Smit. 1991. "Studying Respondent- Interviewer Interaction: The Relationship between Interviewing Style, Interviewer Behavior, and Response Behavior." In Measurement Errors in Surveys, eds. Paul Biemer, Robert M. Groves, Lars E. Lyberg, Nancy Mathiowetz, and Seymour Sudman. New York: Wiley.
59. Willson,Victor L., and Richard R. Putnam. 1982. "A Meta-Analysis of Pretest Sensitization Effects in Experimental Design." American Educational Research Journal 19:249-258
60. Wright, Debra L.,William S. Aquilino, and Andrew J. Supple. 1998. "A Comparison of Computer- Assisted Paper-and-Pencil Self-Administered Questionnaires in a Survey on Smoking, Alcohol, and Drug Use." Public Opinion Quarterly 62:331-353
61. Zagorsky, Jay, and Pat Rhoton. 1999. Attrition and the National Longitudinal Survey's Women Cohorts. Columbus, OH: Center for Human Resource Research, Ohio State University.