Questionnaire Design Effects in Climate Change Surveys: Implications for the Partisan Divide

Annals of the American Academy of Political and Social Science

Volumn 658, Issue 1, 2015, Pages 67-85

  Schuldt, Jonathon P ^a   Roh, Sungjong ^a   Schwarz, Norbert ^b  

^a Department of Obstetrics Gynecology   (United States)

^b UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

Author keywords

climate change; framing effects; global warming; partisan differences; question wording; scientific consensus; survey experiments

Indexed keywords

EID: 84922814039     PISSN: 00027162     EISSN: 15523349     Source Type: Journal    
DOI: 10.1177/0002716214555066     Document Type: Article

References (49)

1. ABC News, Stanford University, and TIME. 2006. National poll, March 9–14. Storrs, CT: The Roper Center for Public Opinion Research, University of Connecticut. Available from http://www.ropercenter.uconn.edu/data_access/ipoll/ipoll.html.
2. Bernauer Thomas.Climate change politics.Annual Review of Political Science. 2013;16:421-48
3. Bless Herbert,Schwarz Norbert.Mental construal and the emergence of assimilation and contrast effects: The inclusion/exclusion model.Advances in Experimental Social Psychology. 2010;42:319-73
4. Boykoff Maxwell T.,Boykoff Jules M.Balance as bias: Global warming and the U.S. prestige press.Global Environmental Change. 2004;14 (2): 125-36
5. Brossard Dominique,Nisbet Matthew C.Deference to scientific authority among a low information public: Understanding U.S. opinion on agricultural biotechnology.International Journal of Public Opinion Research. 2007;19 (1): 24-52
6. BurkemanOliver. 3March2003. Memo exposes Bush’s new green strategy. The Guardian. Available from http://www.theguardian.com.
7. Chong Dennis,Druckman James N.Framing theory.Annual Review of Political Science. 2007;10:103-26
8. Ding Ding,Maibach Edward W.,Zhao Xiaoquan,Roser-Renouf Connie,Leiserowitz Anthony.Support for climate policy and societal action are linked to perceptions about scientific agreement.Nature Climate Change. 2011;1 (9): 462-66
9. Druckman James N.The implications of framing effects for citizen competence.Political Behavior. 2001;23 (3): 225-56
10. Druckman James N.,Lupia Arthur.Experimenting with politics.Science. 2012;335 (6073): 1177-79
11. Dunlap Riley E.,McCright Aaron M.A widening gap: Republican and Democratic views on climate change.Environment: Science and Policy for Sustainable Development. 2008;50 (5): 26-35
12. Entman Robert M.Framing: Toward clarification of a fractured paradigm.Journal of Communication. 1993;43 (4): 51-58
13. Environmental Protection Agency (EPA). 2014. Climate change: Basic information. Available from http://www.epa.gov/climatechange/basics/.
14. Feldman Lauren,Maibach Edward W.,Roser-Renouf Connie,Leiserowitz Anthony.Climate on cable: The nature and impact of global warming coverage on Fox News, CNN, and MSNBC.International Journal of Press/Politics. 2011;17 (1): 3-31
15. Fiske Susan T.,Taylor Shelley E.Social cognition. 1991. Social cognition. 2nd ed.New York, NY: McGraw-Hill.New York, NY: McGraw-Hill; 1991:
16. Greenhill Murni,Leviston Zoe,Leonard Rosemary,Walker Iain.Assessing climate change beliefs: Response effects of question wording and response alternatives.Public Understanding of Science. 2013;:
17. Hamilton Lawrence C.Education, politics and opinions about climate change evidence for interaction effects.Climatic Change. 2010;104 (2): 231-42
18. Hoffman Andrew J.Talking past each other? Cultural framing of skeptical and convinced logics in the climate change debate.Organization & Environment. 2011;24 (1): 3-33
19. Jaskulsky Larissa,Besel Richard.Words that (don’t) matter: An exploratory study of four climate change names in environmental discourse.Applied Environmental Education & Communication. 2013;12 (1): 38-45
20. Krosnick Jon A.,Holbrook Allyson L.,Lowe Laura,Visser Penny S.The origins and consequences of democratic citizens’ policy agendas: A study of popular concern about global warming.Climatic Change. 2006;77 (1–2): 743
21. Lakoff George.Why it matters how we frame the environment.Environmental Communication. 2010;4 (1): 70-81
22. Lewandowsky Stephan,Gignac Gilles E.,Vaughan Samuel.The pivotal role of perceived scientific consensus in acceptance of science.Nature Climate Change. 2013;3 (4): 399-404
23. Lorenzoni Irene,Leiserowitz Anthony,de Franca Doria Miguel,Poortinga Wouter,Pidgeon Nick F.Cross national comparisons of image associations with “global warming” and “climate change” among laypeople in the United States of America and Great Britain.Journal of Risk Research. 2006;9 (3): 265-81
24. Marshall Christa.Big partisan gap on climate change is widened by Tea Partiers.The New York Times. 2010;:
25. McCright Aaron M.The effects of gender on climate change knowledge and concern in the American public.Population and Environment. 2010;32 (1): 66-87
26. McCright Aaron M.,Dunlap Riley E.The politicization of climate change and polarization in the American public’s views of global warming, 2001–2010.Sociological Quarterly. 2011;52 (2): 155-94
27. McCright Aaron M.,Dunlap Riley E.,Xiao Chenyang.Perceived scientific agreement and support for government action on climate change in the USA.Climatic Change. 2013;119 (2): 511-18
28. McFarland Sam G.Effects of question order on survey responses.Public Opinion Quarterly. 1981;45 (2): 208-15
29. Myers Teresa A.,Nisbet Matthew C.,Maibach Edward W.,Leiserowitz Anthony A.A public health frame arouses hopeful emotions about climate change.Climatic Change. 2012;113 (3–4): 1105-12
30. NewportFrank. 2010. Americans’ global warming concerns continue to drop. Gallup. Available from http://www.gallup.com.
31. Nisbet Matthew C.Communicating climate change: Why frames matter for public engagement.Environment: Science and Policy for Sustainable Development. 2009;51 (2): 12-23
32. Nisbet Matthew C.,Myers Teresa.The polls—trends: Twenty years of public opinion about global warming.Public Opinion Quarterly. 2007;71 (3): 444-70
33. Oreskes Naomi,Conway Erik M.Merchants of doubt: How a handful of scientists obscured the truth on issues from tobacco smoke to global warming. New York, NY: Bloomsbury Publishing; 2010:
34. Pew Research Center for the People & the Press. 2010. Wide partisan divide over global warming. Press release. Available from http://www.pewresearch.org/2010/10/27/wide-partisan-divide-over-global-warming/.
35. Reser Joseph P.,Swim Janet K.Adapting to and coping with the threat and impacts of climate change.American Psychologist. 2011;66 (4): 277-89
36. Rolfe-ReddingJustinMaibachEdward W.FeldmanLaurenLeiserowitzAnthony. 2011. Republicans and climate change: An audience analysis of predictors for belief and policy preferences. Available from papers.ssrn.com.
37. Schlichting Inga.Strategic framing of climate change by industry actors: A meta-analysis.Environmental Communication. 2013;7 (4): 493-511
38. Schuldt Jonathon P.,Konrath Sara H.,Schwarz Norbert.“Global warming” or “climate change”? Whether the planet is warming depends on question wording.Public Opinion Quarterly. 2011;75 (1): 115-24
39. Schuldt Jonathon P.,Roh Sungjong.Of accessibility and applicability: How heat-related cues affect belief in “global warming” versus “climate change.”.Social Cognition. 2014;32 (3): 217-38
40. Schuman Howard,Presser StanleyQuestions and answers in attitude surveys: Experiments on question form, wording, and context. New York, NY: Academic Press; 1981:
41. Schwarz Norbert.Self-reports: How the questions shape the answers.American Psychologist. 1999;54 (2): 93-105
42. Sherman David A.,Nelson Leif D.,Steele Claude M.Do messages about health risks threaten the self? Increasing the acceptance of threatening health messages via self-affirmation.Personality and Social Psychology Bulletin. 2000;26 (9): 1046-58
43. Stern Paul C.Psychological dimensions of global environmental change.Annual Review of Psychology. 1992;43 (1): 269-302
44. Strack FritzContext effects in social and psychological research. Schwarz NorbertSudman Seymour, ed. New York, NY: Springer; 1992:23-34.
45. Sudman Seymour,Bradburn Norman M.,Schwarz NorbertThinking about answers: The application of cognitive processes to survey methodology. San Francisco, CA: Jossey-Bass; 1996:
46. Tourangeau Roger,Rasinski Kenneth A.Cognitive processes underlying context effects in attitude measurement.Psychological Bulletin. 1988;103 (3): 299-314
47. Villar Ana,Krosnick Jon A.Global warming vs. climate change, taxes vs. prices: Does word choice matter?.Climatic Change. 2011;105 (1–2): 1-12
48. Washington Post, and ABC News. 2010. Washington Post-ABC News Poll. Available from http://www.washingtonpost.com/politics/polling.
49. Whitmarsh Lorraine.What’s in a name? Commonalities and differences in public understanding of “climate change” and “global warming.”.Public Understanding of Science. 2009;18 (4): 401-20