Framing effects in surveys: How respondents make sense of the questions we ask

Perspectives on Framing

Volumn , Issue , 2011, Pages 303-324

  de Bruin, Wändi Bruine ^a  

^a CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 79953017623     PISSN: None     EISSN: None     Source Type: Book    
DOI: None     Document Type: Chapter

References (103)

1. Blair, J., Ackermann, A., Piccinino, L., & Levenstein, R. (2007). Using behavior coding to validate cognitive interview findings. Proceedings of the American Statistical Association: Survey Research Methods Section, pp. 3896-3900.
2. Blake, D. R., Weber, B. M., & Fletcher, K. E. (2004). Adolescent and young adult women's misunderstanding of the term pap smear. Archives of Pediatrics and Adolescent Medicine, 158, 966-970.
3. Bostrom, A., Morgan, G. M., Fischhoff, B., & Read, D. (1994). What do people know about global climate change? 1. Mental models. Risk Analysis, 14, 959-970.
4. Bradburn, N. (1982). Question-wording effects in surveys. In R. M., Hogarth (Ed.), Question framing and response consistency (pp. 65-76). San Francisco, CA: Jossey-Bass.
5. Bruine de Bruin, W. (2005). Save the last dance for me: Unwanted serial position effects on jury evaluations. Acta Psychologica, 118, 245-260.
6. Bruine de Bruin, W., & Fischhoff, B. (2000). The effect of question format on measured HIV/AIDS knowledge in detention center teens, high school students, and adults. AIDS Education and Prevention, 12, 187-198.
7. Bruine de Bruin, W., & Keren, G. (2003). Order effects in sequentially judged options due to the direction of comparison. Organizational Behavior and Human Decision Processes, 92, 91-101.
8. Bruine de Bruin, W., Parker, A. M., & Fischhoff, B. (2007a). Can teens predict significant life events? Journal of Adolescent Health, 41, 208-210.
9. Bruine de Bruin, W., Parker, A. M., & Fischhoff, B. (2007b). Individual differences in adult decision-making competence. Journal of Personality and Social Psychology, 92, 938-956.
10. Bruine de Bruin, W., VanderKlaauw, W., Downs, J. S., Topa, G., & Armantier, O. (2009). The effect of question wording on reported inflation expectations. Paper presented at the conference on Subjective Probability and Utility in Decision Making (SPUDM), Rovereto, Italy.
11. Converse, J. M., & Presser, S. (1986). Survey questions. Handcrafting the standardized questionnaire. Thousand Oaks, CA: Sage.
12. Couper, M. P., Tourangeau, R., Conrad, F. G., & Crawford, S. D. (2004). What they see is what we get: Response options for web surveys. Social Science Computer Review, 22, 111-127.
13. Cronbach, L. J. (1941). An experimental comparison of the multiple true-false and multiple multiple-choice tests. Journal of Educational Psychology, 32, 533-543.
14. Curtin, R. (2006). Inflation expectations: Theoretical models and empirical tests. Paper presented at the National Bank of Poland Workshop on The Role of Inflation Expectations in Modelling and Monitary Policy Making, Warsaw.
15. Dillman, D. A., Smyth, J. D., & Christian, L. M. (2009). Internet, mail, and mixed-mode surveys. The tailored design method. Hoboken, NJ: Wiley.
16. Fischhoff, B. (1991). Value elicitation: Is there anything in there? American Psychologist, 46, 835-847.
17. Fischhoff, B. (1993). Transaction analysis: A framework and an application to insurance decisions. Journal of Risk and Uncertainty, 7, 53-69.
18. Fischhoff, B. (2005). Cognitive processes in stated preference methods. In K-G. Mäler & J. Vincent (Eds.), Handbook of environmental economics (pp. 937-968). Amsterdam: Elsevier.
19. Fischhoff, B., & Bruine de Bruin, W. (1999). Fifty-fifty = 50%? Journal of Behavioral Decision Making, 12, 149-163.
20. Fischhoff, B., Parker, A. M., Bruine de Bruin, W., Downs, J. S., Palmgren, C., Dawes, R., et al. (2000). Teen expectations for significant life events. Public Opinion Quarterly, 64, 189-205.
21. Fischhoff, B., Slovic, P., & Lichtenstein, S. (1980). Knowing what you want: Measuring labile values. In T. Wallsten (Ed.), Cognitive processes in choice and decision behavior (pp. 117-141). Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
22. Fleishman, L., Bruine de Bruin, W., & Morgan, M. G. (in press). Public perceptions of carbon capture and sequestration and other carbon-reducing technologies: Risk analysis.
23. Frisch, D. (1993). Reasons for framing effects. Organizational Behavior and Human Decision Processes, 54, 399-429.
24. Gigerenzer, G., Todd, P. M., & the ABC Group (2000). Simple heuristics that make us smart. Cary, NC: Oxford University Press.
25. Glejser, H., & Heyndels, B. (2001). Efficiency and inefficiency in the ranking in competitions: The case of the Queen Elisabeth Music Contest. Journal of Cultural Economics, 25, 109-129.
26. Gourville, J. T. (1998). Pennies-a-day: The effect of temporal reframing on transaction evaluation. Journal of Consumer Research, 24, 395-403.
27. Grice, H. P. (1975). Logic and conversation. In P. Cole & J. L. Morgan (Eds.), Syntax and semantics. Volume 3: Speech acts (pp. 41-58). New York: Academic Press.
28. Haan, M., Dijkstra, S., & Dijkstra, P. (2003). Expert judgment versus public opinion -evidence from the Eurovision Song Contest. Journal of Cultural Economics, 29, 59-78.
29. Haladyna, T. M., Downing, S. M., & Rodriguez, M. C. (2002). A review of multiple-choice item-writing guidelines for classroom assessment. Applied Measurement in Education, 15, 309-334.
30. Hershey, J. R., & Schoemaker, P. J. H. (1980). Risk taking and problem context in the domain of losses: An expected utility analysis. Journal of Risk and Insurance, 47, 111-132.
31. Hippler, H. J., & Schwarz, N. (1986). Not forbidding isn't allowing: The cognitive basis of the forbid-allow asymmetry. Public Opinion Quarterly, 50, 87-96.
32. Hogarth, R. M. (1982). Question framing and response consistency. San Francisco, CA: Jossey-Bass.
33. Hogarth, R. M., & Einhorn, H. J. (1992). Order effects in belief updating: The belief-adjustment model. Cognitive Psychology, 24, 1-55.
34. Holleman, B. (2006). The meanings of "yes" and "no". An explanation of the forbid/allow asymmetry. Quality and Quantity, 40, 1-38.
35. Holleman, B. (1999a). The nature of the forbid/allow asymmetry: Two correlational studies. Sociological Methods Research, 28, 209-244.
36. Holleman, B. (1999b). Wording effects in survey research: Using meta-analysis to explain the forbid/allow asymmetry. Journal of Quantitative Linguistics, 6, 29-40.
37. Hsee, C. K. (1996). The evaluability hypothesis: An explanation for preference reversals between joint and separate evaluations of alternatives. Organizational Behavior and Human Decision Processes, 67, 247-257.
38. Hsee, C. K., Abelson, R. P., & Salovey, P. (1991). The relative weighting of position and velocity in satisfaction. Psychological Science, 2, 263-266.
39. Huber, J., Payne, J. W., & Puto, C. (1982). Adding asymmetrically dominated alternatives: Violations of regularity and the similarity hypothesis. Journal of Consumer Research, 9, 90-98.
40. Hunter, J. (2005). Report on cognitive testing of cohabitation questions. Washington, DC: Statistical Research Division. U.S. Bureau of the Census.
41. Hurd, M. D. (2009). Subjective probabilities in household surveys. Annual Review of Economics, 1, 543-564.
42. Johnson, E. J., Bellman, S., & Lohse, G. L. (2002). Defaults, framing, and privacy: Why opting in-opting out. Marketing letters, 13, 5-15.
43. Johnson, E. J., & Goldstein, D. (2003). Do defaults save lives? Science, 302, 1338-1339.
44. Johnson, E. J., Häubl, G., & Keinan, A. (2007). Aspects of endowment: A query theory of value construction. Journal of Experimental Psychology, 33, 461-474.
45. Johnson, E. J., Hershey, J., Meszaros, J., & Kunreuther, H. (1993). Framing, probability distortions, and insurance decisions. Journal of Risk and Uncertainty, 7, 35-53.
46. Kahneman, D., & Tversky, A. (1979). Prospect theory: An analysis of decision under risk. Econometrica, 47, 263-291.
47. Keren, G., & Willemsen, M. C. (2009). Decision anomalies, experimenter assumptions, and participants' comprehension: Reevaluating the uncertainty effect. Journal of Behavioral Decision Making, 22, 301-317.
48. Kincaid, J. P., Fishburne, R. P., Rogers, R. L., & Chissom, B. S. (1975). Derivation of new readability formulas (automated readability index, fog count, and Flesch reading ease formula) for Navy enlisted personnel. Research branch report 8-75. Memphis: Naval Air Station.
49. Klein, G. (1999). Sources of power: How people make decisions. Cambridge, MA: MIT Press.
50. Koriat, A., Lichtenstein, S., & Fischhoff, B. (1980). Reasons for confidence. Journal of Experimental Psychology: Human Learning and Memory, 6, 107-118.
51. Krosnick, J. A. (1991). Response strategies for coping with the cognitive demands of attitude measures in surveys. Applied Cognitive Psychology, 5, 213-236.
52. Kühberger, A. (1995). Framing effects: A new look at old problems. Organizational Behavior and Human Decision Processes, 62, 230-240.
53. Kühberger, A. (1998). The influence of framing on risky decisions: A meta-analysis. Organizational Behavior and Human Decision Processes, 75 23-55.
54. LeBoeuf, R. A., & Shafir, E. (2003). Deep thoughts and shallow frames: On the susceptibility to framing effects. Journal of Behavioral Decision Making, 16, 77-92.
55. Leiser, D., & Drori, S. (2004). Naive understanding of inflation. Journal of Socio-Economics, 34, 179-198.
56. Lerner, E. B., Jehle, D. V. K., & Janicke, R. M. (2000). Medical communication: Do our patients understand? American Journal of Emergency Medicine, 18, 764-766.
57. Levin, I. P. (1999). Why do you and I make different decisions? Tracking individual differences in decision making. Presidential address to the Society for Judgment and Decision Making, Los Angeles, CA.
58. Levin, I. P., & Gaeth, G. J. (1988). Framing of attribute information before and after consuming the product. Journal of Consumer Research, 15, 374-378.
59. Levin, I. P., Gaeth, G. J., Schreiber, J., & Lauriola, M. (2002). A new look at framing effects: Distribution of effect sizes, individual differences, and independence of types of effects. Organizational Behavior and Human Decision Processes, 88, 411-429.
60. Levin, I. P., Schneider, S. L., & Gaeth, G. J. (1998). All frames are not created equal: A typology and critical analysis of framing effects. Organizational Behavior and Human Decision Processes, 76, 149-188.
61. Levin, I. P., Schnittjer, S. K., & Thee, S. L. (1988). Information framing effects in social and personal decisions. Journal of Experimental Social Psychology, 24, 520-529.
62. Li, Y., & Epley, N. (2009). When the best appears to be saved for last: Serial position effects on choice. Journal of Behavioral Decision Making, 22, 378-389.
63. Linville, P. W., Fischer, G. W., & Fischhoff, B. (1993). AIDS risk perceptions and decision biases. In J. B. Pryor & G. D. Reeder (Eds.), The social psychology of HIV infection (pp. 5-38). Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
64. Loewenstein, G., & Prelec, D. (1993). Preferences for sequences of outcomes. Psychological Review, 100, 91-108.
65. Loftus, E. F., & Palmer, J. C. (1974). Reconstruction of automobile destruction: An example of the interaction between language and memory. Journal of Verbal Learning and Verbal Behavior, 13, 585-589.
66. Madrian, B. C., & Shea, D. F. (2001). The power of suggestion: Inertia in 401 (k) participation and savings behavior. Quarterly Journal of Economics, 116, 1149-1187.
67. Mandel, D. R. (2001). Gain-loss framing and choice: Separating outcome formulations from descriptor formulations. Organizational Behavior and Human Decision Processes, 85, 56-76.
68. McDaniel, M. A., Anderson, J. L., Derbish, M. H., & Morisette, N. (2007). Testing the testing effect in the classroom. European Journal of Cognitive Psychology, 19, 494-513.
69. McKenney, N. R., & Bennett, C. E. (1994). Issues regarding data on race and ethnicity: The Census Bureau experience. Public Health Reports, 109, 16-25.
70. McKenzie, C. R. M. (2004). Framing effects in inference tasks - and why they are normatively defensible. Memory and Cognition, 32, 874-885.
71. McKenzie, C. R. M., Liersch, M. J., & Finkelstein, S. R. (2006). Recommendations implicit in policy defaults. Psychological Science, 17, 414-420.
72. McKenzie, C. R. M., & Nelson, J. D. (2003). What a speaker's choice of frame reveals: Reference points, frame selection, and framing effects. Psychological Bulletin and Review, 10, 596-602.
73. Menon, G., Raghubir, P., & Schwarz, N. (1995). Behavioral frequency judgments: An accessibility-diagnosticity framework. Journal of Consumer Research, 22, 212-228.
74. Paasche-Orlow, M. K., Taylor, H. A., & Brancati, F. L. (2003). Readability standards for informed-consent forms as compared with actual readability. New England Journal of Medicine, 348, 721-726.
75. Parker, A. M., & Fischhoff, B. (2005). Decision-making competence: External validation through an individual-differences approach. Journal of Behavioral Decision Making, 18, 1-27.
76. Presser, S., Couper, M.P., Lessler, J. T., Martin, E., Martin, J., Rothgeb, J. M., et al. (2004). Methods for testing and evaluating survey questions. Public Opinion Quarterly, 68, 109-130.
77. Ranyard, R., Del Missier, F., Bonini, N., Duxbury, D., & Summers, B. (2008). Perceptions and expectations of price changes and inflation: A review and conceptual framework. Journal of Economic Psychology, 29, 378-400.
78. Reyna, V F., & Brainerd, C. J. (1991). Fuzzy-trace theory and framing effects in choice: Gist extraction, truncation, and conversion. Journal of Behavioral Decision Making, 4, 249-262.
79. Roediger, H. L., & Marsh, E. J. (2005). The positive and negative consequences of multiple-choice testing. Journal of Experimental Psychology: Learning, Memory, and Cognition, 31, 1155-1159.
80. Rugg, D. (1941). Experiments in wording questions: II. Public Opinion Quarterly, 5, 91-92.
81. Scheer, J. K. (1973). Effect of placement in the order of competition on scores of Nebraska high school students. Research Quarterly, 44, 79-85.
82. Schuman, H., & Presser, S. (1981). Questions and answers in attitude surveys. New York: Wiley.
83. Schuster, M. A., Bell, R. M., & Kanouse, D. E. (1996). The sexual practices of adolescent virgins: Genital sexual activities of low-risk adolescents who have never had vaginal intercourse. American Journal of Public Health, 86, 1570-1576.
84. Schwarz, N. (1996). Cognition and communication: Judgmental biases, research methods, and the logic of conversation. Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
85. Schwarz, N. (1999). Self reports. How the questions shape the answers. American Psychologist, 54, 93-105.
86. Schwarz, N., Hippler, H. J., Deutsch, B., & Strack, F. (1985). Response categories: Effects on behavioral reports and comparative judgments. Public Opinion Quarterly, 49, 388-395.
87. Schwarz, N., & Scheuring, B. (1988). Judgments of relationship satisfaction: Inter- and intra-individual comparison strategies as a function of questionnaire structure. European Journal of Social Psychology, 18, 485-496.
88. Schwarz, N., Strack, F., & Mai, H. P. (1991). Assimilation and contrast effects in part-whole question sequences: A conversational logic analysis. Public Opinion Quarterly, 55, 3-23.
89. Schwarz, N., Strack, F., Müller, G., & Chassein, B. (1988). The range of response alternatives may determine the meaning of the question: Further advice on informative functions of response alternatives. Social Cognition, 6, 107-117.
90. Shafir, E., Simonson, I., & Tversky, A. (1993). Reason-based choice. Cognition, 49, 11-36.
91. Simonson, I. (1989). Choice based on reasons: The case of attraction and compromise effects. Journal of Consumer Research, 16, 158-174.
92. Simonson, I., & Tversky, A. (1992). Choice in context: Tradeoff contrast and extremeness aversion. Journal of Marketing Research, 29, 281-295.
93. Stanovich, K. E., & West, R. F. (1998). Individual differences in rational thought. Journal of Experimental Psychology: General, 127, 161-188.
94. Stanovich, K. E., & West, R. F. (2000). Individual differences in reasoning: Implications for the rationality debate? Behavioral and Brain Sciences, 23, 645-726.
95. Sudman, S., & Bradburn, N. (1982). Asking questions. A practical guide to questionnaire design. San Francisco, CA: Jossey-Bass.
96. Svenson, O., & Nilsson, G. (1986). Mental economics: Subjective representations of factors related to expected inflation. Journal of Economic Psychology, 7, 327-349.
97. Toppino, T. C., & Brochin, H. A. (1989). Learning from tests: The case of true-false examinations. Journal of Educational Research, 83, 119-124.
98. Tourangeau, R., Rasinski, K. A., & Bradburn, N. (1991). Measuring happiness in surveys: A test of the subtraction hypothesis. Public Opinion Quarterly, 55, 255-266.
99. Tourangeau, R., & Smith, T. W. (1996). Asking sensitive questions: The impact of data collection mode, question format, and question context. Public Opinion Quarterly, 60, 275-304.
100. Tversky, A., & Kahneman, D. (1981). The framing of decisions and the psychology of choice. Science, 211, 453-458.
101. Tversky, A., & Kahneman, D. (1991). Loss aversion in riskless choice: A referencedependent model. Quarterly Journal of Economics, 106, 1039-1061.
102. Varey, C. A., & Kahneman, D. (1992). Experiences extended across time: Evaluation of moments and episodes. Journal of Behavioral Decision Making, 5, 169-185.
103. Wilson, V. E. (1977). Objectivity and effect of order of appearance in judging of synchronized swimming meets. Perceptual and Motor Skills, 44, 295-298.