Survey research and societal change

Annual Review of Psychology

Volumn 55, Issue , 2004, Pages 775-801

  Tourangeau, Roger ^a,b  

^a UNIVERSITY OF MARYLAND   (United States)

^b UNIVERSITY OF MICHIGAN   (United States)

Author keywords

Modes of data collection; Response rates; Telephone sampling; Web surveys

Indexed keywords

HUMAN; METHODOLOGY; PSYCHOLOGY; QUESTIONNAIRE; REVIEW; SOCIAL CHANGE;

HUMANS; PSYCHOLOGY; QUESTIONNAIRES; SOCIAL CHANGE;

EID: 1842590320     PISSN: 00664308     EISSN: None     Source Type: Book Series    
DOI: 10.1146/annurev.psych.55.090902.142040     Document Type: Article

References (121)

1. Am. Stat. Assoc. 1999. More about telephone surveys. Alexandria, VA: Sect. Surv. Res. Methods, Am. Stat. Assoc.
2. Appel MV, Tortora RD, Sigman R. 1992. Direct data entry using Touch-Tone and voice recognition technology for the M3 survey. Res. Rep. Ser. No. RR-92/01, Bur. Census, Stat. Res. Div.
3. Aquilino WS. 1994. Interview mode effects in surveys of drug and alcohol use. Public Opin. Q. 58:210-40
4. Atrostic BK, Bates N, Burt G, Silberstein A. 2001. Nonresponse in U.S. government household surveys: consistent measures, recent trends, and new insights. J. Off. Stat. 17: 209-26
5. Baker RP, Bradburn NM, Johnson R. 1995. Computer-assisted personal interviewing: an experimental evaluation of data quality and survey costs. J. Off. Stat. 11:415-34
6. Baumgartner RM. 1990. Telephone answering machines and completion rates for telephone surveys. Presented at Ann. Meet. Am. Assoc. Public Opin. Res., May 17-20, Lancaster, PA
7. Bergman LR, Kristiansson KE, Olofsson A, Säfström M. 1994. Decentralised CATI versus paper and pencil interviewing: effects on the results of the Swedish labor force surveys. J. Off. Stat. 10:181-95
8. Blakely EJ, Snyder MG. 1997. Fortress America: Gated Communities in the United States. Washington, DC: Brookings Inst. Press
9. Blom E, Lyberg L. 1998. Scanning and optical character recognition in survey organizations. In Computer Assisted Survey Information Collection, ed. MP Couper, RP Baker, J Bethlehem, CZ Clark, J Martin, et al., pp. 499-520. New York: Wiley
10. Blyth WG. 1997. Developing a speech recognition application for survey research. In Survey Measurement and Process Quality, ed. L Lyberg, P Biemer, M Collins, E de Leeuw, C Dippo, et al., pp. 249-66. New York: Wiley
11. Brick JM, Waksberg J, Kulp D, Starer A. 1995. Bias in list-assisted telephone surveys. Public Opin. Q. 59:218-35
12. Casady RJ, Lepkowski JM. 1993. Stratified telephone survey designs. Surv. Method. 19: 103-13
13. Catlin O, Ingram S. 1988. The effects of CATI on costs and data quality: a comparison of CATI and paper methods in centralized interviewing. See Groves et al. 1988, pp. 437-50
14. Chaiken S. 1980. Heuristic versus systematic information processing and the use of source versus message cues in persuasion. J. Personal. Soc. Psychol. 39:752-66
15. Church AH. 1993. Estimating the effects of incentives on mail survey response rates: a meta-analysis. Public Opin. Q. 57:62-79
16. Cialdini RB. 1984. Influence: The New Psychology of Modem Persuasion. New York: Quill
17. Conrad FG, Schober MF. 2000. Clarifying question meaning in a household telephone survey. Public Opin. Q. 64:1-28
18. Cooley PC, Miller HG, Gribble IN, Turner CF. 2000. Automating telephone surveys: using T-ACASI to obtain data on sensitive topics. Comput. Hum. Behav. 16:1-11
19. Couper MP. 2001. Web surveys: a review of issues and approaches. Public Opin. Q. 64:464-94
20. Couper MP, Blair J, Triplett T. 1999. A comparison of mail and e-mail for a survey of employees in federal statistical agencies. J. Off. Stat. 15:39-56
21. Couper MP, Nicholls W II. 1998. The history and development of computer-assisted survey information collection methods. In Computer-Assisted Survey Information Collection, ed. MP Couper, RP Baker, J Bethlehem, CZ Clark, J Martin, et al., pp. 1-22. New York: Wiley
22. Curtin R, Presser S, Singer E. 2000. The effects of response rate changes on the Index of Consumer Sentiment. Public Opin. Q. 64:413-28
23. Cynamon M, Camburn D. 1992. Employing a new technique to ask questions on sensitive topics. Presented at Ann. Meet. Natl. Field Dir. Conf., May 17-20, Ft. Lauderdale, FL
24. Daves R. 1990. You know what to do at the beep, but do survey researchers? Presented at Midwest Assoc. Public Opin. Res., Chicago IL
25. de Leeuw E, de Heer W. 2002. Trends in house-hold survey nonresponse: a longitudinal and international comparison. See Groves et al. 2002, pp. 41-54
26. de Leeuw E, van der Zouwen J. 1988. Data quality in telephone and face to face surveys: a comparative meta-analysis. See Groves et al. 1988, pp. 283-99
27. Dennis JM. 2001. Response timing and coverage of non-Internet households: data quality in an Internet-enabled panel. Presented at Ann. Meet. Am. Assoc. Public Opin. Res., May 17-20, Montreal
28. Dillman DA. 1978. Mail and Telephone Surveys. New York: Wiley
29. Dillman DA. 1991. The design and administration of mail surveys. Annu. Rev. Social. 17: 225-49
30. Dillman DA. 2000. Mail and Internet Surveys: The Tailored Design Method. New York: Wiley
31. Dillman DA, Gallegos JG, Frey JH. 1976. Reducing refusal rates for telephone interviews. Public Opin. Q. 40:66-78
32. Dillman DA, Tortora RD, Conradt J, Bowker D. 1998. Influence of plain vs. fancy design on response rates for web surveys. Presented at Jt. Stat. Meet., Aug. 9-13, Dallas
33. Downes-Le Guin T, Soo Hoo B. 1994. Disk-by-mail data collection for professional populations. Presented at Annu. Meet. Am. Assoc. Public Opin., May 12-15, Danvers, MA
34. Epstein JF, Barker PR, Kroutil LA. 2001. Mode effects in self-reported mental health data. Public Opin. Q. 65:529-49
35. Fink JC. 1983. CATI's first decade: the Chilton experience. Soc. Methods Res. 12:153-68
36. Fogg BJ, Nass C. 1997. Silicon sycophants: The effects of computers that flatter. Int. J. Hum. Comput. Stud. 46:551-61
37. Fowler FJ, Mangione TW. 1990. Standardized Survey Interviewing: Minimizing Interviewer Error. Newbury Park, CA: Sage
38. Fox RJ, Crask MR, Kim J. 1988. Mail survey response rates: a meta-analysis of selected techniques for inducing response. Public Opin. Q. 52:467-91
39. Frankovic KA. 1994. Interactive polling and Americans' comfort level with technology. Presented at Annu. Meet. Am. Assoc. Public Opin., May 12-15, Danvers, MA
40. Goyder J. 1987. The Silent Majority: Nonrespondents on Sample Surveys. Boulder, CO: Westview
41. Gribble JN, Miller HG, Cooley PC, Catania JA, Pollack L, et al. 2000. The impact of T-ACASI interviewing on reporting drug use among men who have sex with men. Subst. Use Misuse 80:869-90
42. Groves RM. 1989. Survey Costs and Survey Errors. New York: Wiley
43. Groves RM. 1990. Theories and methods of telephone surveys. Annu. Rev. Sociol. 16: 221-40
44. Groves RM, Biemer P, Lyberg L, Massey J, Nicholls W, Waksberg J, eds. 1988. Telephone Survey Methodology. New York: Wiley
45. Groves RM, Couper MP. 1998. Nonresponse in Household Surveys. New York: Wiley
46. Groves RM, Dillman DA, Eltinge JL, Little RJA, eds. 2002. Survey Nonresponse. New York: Wiley
47. Groves RM, Mathiowetz N. 1984. Computer assisted telephone interviewing: effects on interviewers and respondents. Public Opin. Q. 48:356-69
48. Groves RM, McGonagle K. 2001. A theory-guided interviewer training protocol regarding survey participation. J. Off. Stat. 17:249-66
49. Groves RM, Singer E, Corning A. 2000. Leverage-salience theory of survey participation: description and an illustration. Public Opin. Q. 64:299-308
50. Hartell L, Clayton R. 1991. A voice recognition technology in survey data collection: results of the first field tests. Presented at Natl. Field Technol. Conf., May 11-16, San Diego
51. Heberlein TA, Baumgartner R. 1978. Factors affecting response rates to mailed questionnaires: a quantitative analysis of the published literature. Am. Social. Rev. 43:447-62
52. Hochstim J. 1967. A critical comparison of three strategies of collecting data from house-holds. J. Am. Stat. Assoc. 62:976-89
53. Holbrook AL, Green MC, Krosnick JA. 2003. Telephone versus face-to-face interviewing of national probability samples with long questionnaires: comparisons of respondent satisficing and social desirability response bias. Public Opin. Q. 6:79-125
54. Int, Telecommun. Union. 2001. ITU Yearbook of Statistics. Geneva
55. James JM, Bolstein R. 1992. Large monetary incentives and their effect on mail survey response rates. Public Opin. Q. 56:442-53
56. Johnson T, Hougland J, Clayton R. 1989. Obtaining reports of sensitive behaviors: a comparison of substance use reports from telephone and face-to-face interviews. Soc. Sci. Q. 70:174-83
57. Johnston J, Walton C. 1995. Reducing response effects for sensitive questions: a computer-assisted self interview with audio. Soc. Sci. Comput. Rev. 13:304-19
58. Keeter S, Kohut A, Miller C, Groves R, Presser S. 2000. Consequences of reducing nonresponse in a large national telephone survey. Public Opin. Q. 64:125-48
59. Kiesler S, Sproull L. 1986. Response effects in the electronic survey. Public Opin. Q. 50:402-13
60. Krosnick JA. 1991. Response strategies for coping with the cognitive demands of attitude measures in surveys. Appl. Cogn. Psychol. 5:213-36
61. Krosnick JA. 1999. Survey research. Annu. Rev. Psychol. 50:537-67
62. Lepkowski JM. 1988. Telephone sampling methods in the United States. See Groves et al. 1988, pp. 73-98
63. Lessler JT, Caspar RA, Penne MA, Barker PR. 2000. Developing computer-assisted interviewing (CAI) for the National Household Survey on Drug Abuse. J. Drug Issues 30:19-34
64. Lessler JT, Kalsbeek W. 1992. Nonsampling Error in Surveys. New York: Wiley
65. Lessler JT, O'Reilly JM. 1997. Mode of interview and reporting of sensitive issues: design and implementation of audio computer-assisted self-interviewing. In The Validity of Self-Reported Drug Use: Improving the Accuracy of Survey Estimates, ed. L Harrison, A Hughes, pp. 366-82. Rockville, MD: Natl. Inst. Drug Abuse
66. Lessler JJ, Weeks MF, O'Reilly JM. 1994. Results from the National Survey of Family Growth Cycle V Pretest. In 1994 Proc. Sect. Surv. Methods Res., pp. 64-70. Alexandria, VA: Am. Stat. Assoc.
67. Link MW, Oldendick RW. 1999. Call screening: Is it really a problem for survey research? Public Opin. Q. 63:577-89
68. Martin J, O'Muircheartaigh C, Curtice J. 1993. The use of CAPI for attitude surveys: an experimental comparison with traditional methods. J. Off. Stat. 9:641-61
69. Maynard DW, Schaeffer NC. 2002. Standardization and its discontents: standardization, interaction, and the survey interview. In Standardization and Tacit Knowledge: Interaction and Practice in the Survey Interview, ed. DW Maynard, H Houtkoop-Steenstra, NC Schaeffer, J van der Zouwen, pp. 3-47. New York: Wiley
70. McQueen DV. 1989. Comparison of results of personal interview and telephone surveys of behavior related to risk of AIDS: advantages of telephone techniques. In Conf. Proc.: Health Surv. Res. Methods, pp. 247-52. Washington, DC: Dep. Health Hum. Serv. Publ. No. (PHS) 89-3447
71. Merkle D, Edelman M. 2002. Nonresponse in exit polls: a comprehensive analysis. See Groves et al. 2002, pp. 243-58
72. Moon Y. 1998. Impression management in computer-based interviews: the effects of input modality, output modality, and distance. Public Opin. Q. 62:610-22
73. Morton-Williams J. 1993. Interviewer Approaches. Aldershot: Dartmouth
74. Mott F. 1985. Evaluation of fertility data and preliminary analytic results from the 1983 survey of the National Longitudinal Surveys of Work Experience of Youth. Rep. Natl. Inst. Child Health Hum. Dev. Cent. Hum. Resourc. Res.
75. Nass C, Fogg BJ, Moon Y. 1996. Can computers be teammates? Int. J. Hum.-Comput. Stud. 45:669-78
76. Natl. Telecommun. Inf. Adm. 2000. Falling Through the Net: Toward Digital Inclusion. Washington, DC: US Dep. Commer.
77. Newman JC, Des Jarlais DC, Turner CF, Gribble J, Cooley P, Paone D. 2002. The differential effects of face-to-face and computer interview modes. Am. J. Public Health 92:294-97
78. Norman KL, Friedman Z, Norman K, Stevenson R. 2001. Navigational issues in the design of online self-administered questionnaires. Behav. Inf. Technol. 20:37-45
79. Oldendick RW, Link MW. 1994. The answering machine generation. Public Opin. Q. 58:264-73
80. Olson L, Schneiderman M. 1995. Physicians' participation in a disk-by-mail survey. Presented at Ann. Meet. Am. Assoc. Public Opin. Res., May 18-21, Ft. Lauderdale, FL
81. O'Reilly J, Hubbard M, Lessler J, Biemer P, Turner C. 1994. Audio and video computer assisted self-interviewing: preliminary tests of new technology for data collection. J. Off. Stat. 10:197-214
82. Petty RE, Cacioppo JT. 1984. The effects of involvement on responses to argument quality and quantity: central and peripheral routes to persuasion. J. Personal. Soc. Psychol. 46:69-81
83. Phipps P, Tupek A. 1990. Assessing measurement errors in a touchtone recognition survey. Presented at Int. Conf. Meas. Errors Surv., Nov., Tucson, AZ
84. Presser S, Schaeffer NC. 2003. The science of asking questions. Annu. Rev. Social. 29:65-88
85. Presser S, Stinson L. 1998. Data collection mode and social desirability bias in self-reported religious attendance. Am. Social. Rev. 63:137-45
86. Putnam RD. 1995. Bowling Alone: The Collapse and Revival of American Community. New York: Simon & Schuster
87. Redline CD, Dillman DA. 2002. The influence of alternative visual designs on respondents' performance with branching instructions in self-administered questionnaires. See Groves et al. 2002, pp. 179-93
88. Reeves B, Nass C. 1996. The Media Equation: How People Treat Computers, Television, and New Media Like Real People and Places. Cambridge, MA: CSLI/Cambridge Univ. Press
89. Robinson JP, Godbey G. 1997. Time for Life: The Surprising Ways Americans Use their Time. University Park: Penn. State Univ. Press
90. Saris W, Pijper M. 1986. Computer assisted interviewing using home computers. Eur. Res. 14:144-50
91. Schaefer DR, Dillman DA. 1998. Development of a standard e-mail methodology: results of an experiment. Public Opin. Q. 62:378-97
92. Schaeffer NC, Maynard DW. 1996. From paradigm to prototype and back again: interactive aspects of "cognitive processing" in survey interviews. In Answering Questions: Methodology for Determining Cognitive and Communicative Processes in Survey Research, ed. N Schwarz, S Sudman, pp. 65-88. San Francisco: Jossey-Bass
93. Schober MF, Conrad FG. 1997. Does conversational interviewing reduce survey measurement error? Public Opin. Q. 60:576-602
94. Schwarz N. 1996. Cognition and Communication: Judgmental Biases, Research Methods, and the Logic of Conversation. Mahwah, NJ: Erlbaum
95. Singer E. 2002. The use of incentives to reduce nonresponse in household surveys. See Groves et al. 2002, pp. 163-78
96. Singer E. 2003. Exploring the meaning of consent: participation in research and beliefs about risks and benefits. J. Off. Stat. In press
97. Singer E, Mathiowetz N, Couper M. 1993. The impact of privacy and confidentiality concerns on survey participation: the case of the 1990 U.S. Census. Public Opin. Q. 57:465-82
98. Singer E, Van Hoewyk J, Gebler N. 1999. The effect of incentives on response rates in interviewer-mediated surveys. J. Off. Stat. 15:217-30
99. Smith TW. 1992. Discrepancies between men and women in reporting number of sexual partners: a summary from four countries. Soc. Biol. 39:203-11
100. Steeh C, Kirgis N, Cannon B, DeWitt J. 2001. Are they really as bad as they seem? Nonresponse rates at the end of the twentieth century. J. Off. Stat. 17:227-47
101. Suchman L, Jordan B. 1990. Interactional troubles in face-to-face survey interviews. J. Am. Stat. Assoc. 85:232-41
102. Thornberry O, Massey J. 1988. Trends in United States telephone coverage across time and subgroups. See Groves et al. 1988, pp. 41-54
103. Tourangeau R, Couper MP, Steiger DM. 2003. Humanizing self-administered surveys: experiments on social presence in Web and IVR surveys. Comput. Hum. Behav. 19:1-24
104. Tourangeau R, Rasinski K, Jobe J, Smith TW, Pratt W. 1997. Sources of error in a survey of sexual behavior. J. Off Stat. 13:341-65
105. Tourangeau R, Rips LJ, Rasinski K. 2001. The Psychology of Survey Response. New York: Cambridge Univ. Press
106. Tourangeau R, Steiger DM, Wilson D. 2002. Self-administered questions by telephone: evaluating interactive voice response. Public Opin. Q. 66:265-78
107. Tourangeau R, Smith TW. 1996. Asking sensitive questions: the impact of data collection mode, question format, and question context. Public Opin. Q. 60:275-304
108. Tuckel P, O'Neill H. 1995. A profile of telephone answering machine owners and screeners. 1995 Proc. Sect. Surv. Res. Methods, pp. 1157-62. Alexandria, VA: Am. Stat. Assoc.
109. Tuckel P, O'Neill H. 1996. New technology and nonresponse bias in RDD surveys. 1996 Proc. Sect. Surv. Res. Methods, pp. 889-94. Alexandria, VA: Am. Stat. Assoc.
110. Tuckel P, Schulman M. 2000. The impact of leaving different answering machine messages on nonresponse rates in a nationwide RDD survey. 2000 Proc. Sect. Surv. Res. Methods, pp. 901-6. Alexandria, VA: Am. Stat. Assoc.
111. Turner CF, Ku L, Rogers SM, Lindberg LD, Plec JH, Sonenstein FL. 1998. Adolescent sexual behavior, drug use, and violence: increased reporting with computer survey technology. Science 280:867-73
112. Turner CF, Miller HG, Smith TK, Cooley PC, Rogers SM. 1996. Telephone audio computer-assisted self-interviewing (T-ACASI) and survey measurement of sensitive behaviors: preliminary results. In Survey and Statistical Computing 1996, ed. R Banks, J Fairgrieve, L Gerrard, T Orchard, C Payne, A Westlake, pp. 121-30. Chesham, Bucks, UK: Assoc. Stat. Comput.
113. van Leeuwen R, de Leeuw E. 1999. I'm not selling anything: experiments in telephone introductions. Presented at Int. Conf. Surv. Nonresponse, Oct. 28-31, Portland, OR
114. Waksberg J. 1978. Sampling methods for random digit dialing. J. Am. Stat. Assoc. 73:40-46
115. Walker J, Sproull L, Subramani R. 1994. Using a human face in an interface. In Proc. Conf. Hum. Factors Comput., pp. 85-99. Boston: ACM
116. Warriner K, Goyder J, Gjertsen H, Hohner P, McSpurren K. 1996. Charities, no, lotteries, no, cash, yes: main effects and interactions in a Canadian incentives experiment. Presented at 4th Int. Soc. Sci. Methodol. Conf., Univ. Essex, Colchester, UK
117. Weeks MF, Jones BL, Folsom RE, Benrud CH. 1980. Optimal times to contact sample households. Public Opin. Q. 44:101-14
118. Weeks MF, Kulka RA, Pierson SA. 1987. Optimal call scheduling for a telephone survey. Public Opin. Q. 51:540-49
119. Werking G, Tupek A, Clayton R. 1988. CATI and touchtone self-response applications for establishment surveys. J. Off. Stat. 4:349-62
120. Xu M, Bates BJ, Schweitzer JC. 1993. The impact of messages on survey participation in answering machine households. Public Opin. Q. 57:232-37
121. Yu J, Cooper H. 1983. A quantitative review of research design effects on response rates to aquestionnaires. J. Mark. Res. 20:36-44