An Empirical Validation Study of Popular Survey Methodologies for Sensitive Questions

American Journal of Political Science

Volumn 60, Issue 3, 2016, Pages 783-802

  Rosenfeld, Bryn ^a   Imai, Kosuke ^a   Shapiro, Jacob N ^b  

^a PRINCETON UNIVERSITY   (United States)

^b PRINCETON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84939227939     PISSN: 00925853     EISSN: 15405907     Source Type: Journal    
DOI: 10.1111/ajps.12205     Document Type: Article

References (55)

1. Anderson, D. A., A. M. Simmons, S. M. Milnes, and M. Earleywine. 2007. “Effect of Response Format on Endorsement of Eating Disordered Attitudes and Behaviors.” International Journal of Eating Disorders 40: 90–93.
2. Belli, R. F., M. W. Traugott, and M. N. Beckmann. 2001. “What Leads to Voting Overreports? Contrasts of Overreporters to Validated Votes and Admitted Nonvoters in the American National Election Studies.” Journal of Official Statistics 17: 479–98.
3. Blair, Graeme. 2014. “Why Do Civilians Hold Bargaining Power in State Revenue Conflicts? Evidence from Nigeria.” Working Paper, Department of Politics, Princeton University.
4. Blair, Graeme, Christine Fair, Neil Malhotra, and Jacob Shapiro. 2013. “Poverty and Support for Militant Politics: Evidence from Pakistan.” American Journal of Political Science 57: 30–48.
5. Blair, Graeme, and Kosuke Imai. 2012. “Statistical Analysis of List Experiments.” Political Analysis 20: 47–77.
6. Blair, Graeme, Kosuke Imai, and Bethany Park. 2014. “List: Statistical Methods for the Item Count Technique and List Experiment.” Available at the Comprehensive R Archive Network, http://CRAN.R-project.org/package=list.
7. Blair, Graeme, Kosuke Imai, and Jason Lyall. 2014. “Comparing and Combining List and Endorsement Experiments: Evidence from Afghanistan.” American Journal of Political Science 58: 1043–63.
8. Blair, Graeme, Kosuke Imai, and Yang-Yang Zhou. 2015. “Design and Analysis of Randomized Response Technique.” Journal of the American Statistical Association. Forthcoming.
9. Blair, Graeme, Yang-Yang Zhou, and Kosuke Imai. 2015. “rr: Statistical Methods for the Randomized Response.” Available at the Comprehensive R Archive Network, http://CRAN.R-project.org/package=rr.
10. Buchman, Thomas A., and John A. Tracy. 1982. “Obtaining Responses to Sensitive Questions: Conventional Questionnaire versus Randomized Response Technique.” Journal of Accounting Research 20: 263–71.
11. Bullock, Will, Kosuke Imai, and Jacob N. Shapiro. 2011. “Statistical Analysis of Endorsement Experiments: Measuring Support for Militant Groups in Pakistan.” Political Analysis 19: 363–84.
12. Bursztyn, Leonardo, Michael Callen, Bruno Ferman, Syed Ali Hasanain, and Noam Yuchtman. 2014. “A Revealed Preference Approach to the Elicitation of Political Attitudes: Experimental Evidence on Anti-Americanism in Pakistan.” NBER Working Paper No. 20153.
13. Chaiken, Shelly. 1980. “Heuristic versus Systematic Information Processing and the Use of Source versus Message Cues in Persuasion.” Journal of Personality and Social Psychology 39: 752–66.
14. Cialdini, Robert B. 1993. Influence: The Psychology of Persuasion. New York: HarperCollins.
15. Corstange, Daniel. 2009. “Sensitive Questions, Truthful Answers? Modeling the List Experiment with LISTIT.” Political Analysis 17: 45–63.
16. Coutts, Elisabeth, and Ben Jann. 2011. “Sensitive Questions in Online Surveys: Experimental Results for the Randomized Response Technique (RRT) and the Unmatched Count Technique (UCT).” Sociological Methods & Research 40: 169–93.
17. Dalton, D. R., J. C. Wimbush, and C. M. Daily. 1994. “Using the Unmatched Count Technique (UCT) to Estimate Base-Rates for Sensitive Behavior.” Personnel Psychology 47: 817–28.
18. Elffers, Henk, Henry S. I. Robben, and Dick I. Hessing. 1992. “On Measuring Tax Evasion.” Journal of Economic Psychology 13: 545–67.
19. Fair, C. Christine, Rebecca Littman, Neil Malhotra, and Jacob N. Shapiro. 2014. “Relative Poverty, Perceived Violence, and Support for Militant Politics: Evidence from Pakistan.” Working paper, Princeton University.
20. Folsom, Ralph E. 1974. “A Randomized Response Validation Study: Comparison of Direct and Randomized Reporting of DUI Arrests.” Report No. 255–807. Research Triangle Institute, Chapel Hill, NC.
21. Gelman, Andrew, Aleks Jakulin, Maria Grazia Pittau, and Yu-Sung Su. 2008. “A Weakly Informative Prior Distribution for Logistic and Other Regression Models.” Annals of Applied Statistics 2: 1360–83.
22. Gingerich, Daniel W. 2010. “Understanding Off-the-Books Politics: Conducting Inference on the Determinants of Sensitive Behavior with Randomized Response Surveys.” Political Analysis 18: 349–80.
23. Glynn, Adam N. 2013. “What Can We Learn with Statistical Truth Serum? Design and Analysis of the List Experiment.” Public Opinion Quarterly 77: 159–72.
24. Gonzalez-Ocantos, Ezequiel,Chad Kiewiet de Jonge, Carlos Meléndez, Javier Osorio, and David W. Nickerson. 2012. “Vote Buying and Social Desirability Bias: Experimental Evidence from Nicaragua.” American Journal of Political Science 56: 202–17.
25. Hessing, Dick J., Henk Elffers, and Russell H. Weigel. 1988. “Exploring the Limits of Self-Reports and Reasoned Action: An Investigation of the Psychology of Tax Evasion Behavior.” Journal of Personality and Social Psychology 54: 405–13.
26. Holbrook, Allyson L., and Jon A. Krosnick. 2010a. “Measuring Voter Turnout by Using the Randomized Response Technique: Evidence Calling into Question the Method's Validity.” Public Opinion Quarterly 74: 328–43.
27. Holbrook, Allyson L., and Jon A. Krosnick. 2010b. “Social Desirability Bias in Voter Turnout Reports: Tests Using the Item Count Technique.” Public Opinion Quarterly 74: 37–67.
28. Horvitz, Daniel G., B. V. Shah, and Walt R. Simmons. 1967. “The Unrelated Question Randomized Response Model.” Proceedings of the American Statistical Association: Social Statistics Section. 64(326): 520–539.
29. Imai, Kosuke. 2011. “Multivariate Regression Analysis for the Item Count Technique.” Journal of the American Statistical Association 106: 407–16.
30. Imai, Kosuke, Bethany Park, and Kenneth F. Greene. 2015. “Using the Predicted Responses from List Experiments as Explanatory Variables in Regression Models.” Political Analysis. 23(2): 180–196.
31. Junger, Marianne. 1989. “Discrepancies between Police and Self-Report Data for Dutch Racial Minorities.” British Journal of Criminology 29: 273–83.
32. Krumpal, Ivar. 2012. “Estimating the Prevalence of Xenophobia and Anti-Semitism in Germany: A Comparison of Randomized Response and Direct Questioning.” Social Science Research 41: 1387–1403.
33. Kuklinski, James H., Michael D. Cobb, and Martin Gilens. 1997. “Racial Attitudes and the “New South” Journal of Politics 59: 323–49.
34. LaBrie, Joseph W., and Mitchell Earleywine. 2000. “Sexual Risk Behaviors and Alcohol: Higher Base Rates Revealed Using the Unmatched-Count Technique.” Journal of Sex Research 37: 321–26.
35. Lamb, Charles W., and Donald E. Stem. 1978. “An Empirical Validation of the Randomized Response Technique.” Journal of Marketing Research 15: 616–21.
36. Lara, Diana, Jennifer Strickler, Claudia Diaz Olavarrieta, and Charlotte Ellertson. 2004. “Measuring Induced Abortion in Mexico: A Comparison of Four Methodologies.” Sociological Methods and Research 32: 529–58.
37. Lensvelt-Mulders, G.J.L.M., J. Hox, P.G.M. van der Heijden, and C.J.M. Maas. 2005. “Meta-Analysis of Randomized Response Research.” Sociological Methods and Research 33: 319–48.
38. Locander, W. B., S. Sudman and N. M. Bradburn. 1976. “An Investigation of Interview Method, Threat, and Response Distortion.” Journal of the American Statistical Association 71: 269–75.
39. Lyall, Jason, Graeme Blair, and Kosuke Imai. 2013. “Explaining Support for Combatants during Wartime: A Survey Experiment in Afghanistan.” American Political Science Review 107: 679–705.
40. O'Keefe, Daniel J. 1990. Persuasion: Theory and Research. Sage: Newbury Park, CA.
41. Ostapczuk, Martin, Jochen Musch, and Morten Moshagen. 2009. “A Randomized-Response Investigation of the Education Effect in Attitudes towards Foreigners.” European Journal of Social Psychology 39: 920–31.
42. Petty, Richard E., and Duane T. Wegener. 1998. “Attitude Change: Multiple Roles for Persuasion Variables.” In The Handbook of Social Psychology: Volume One, ed. Daniel T. Gilbert, Susan T. Fiske, and Gardner Lindzey. 4th ed. New York: McGraw-Hill. 323–390.
43. Petty, Richard E., and John T. Cacioppo. 1986. Communication and Persuasion: Central and Peripheral Routes to Attitude Change. New York: Springer-Verlag.
44. Petty, Richard E., John T. Cacioppo, and David Schumann. 1983. “Central and Peripheral Routes to Advertising Effectiveness: The Moderating Role of Involvement.” Journal of Consumer Research 10: 135–46.
45. Public Policy Polling. 2011. “Toss Up on Mississippi ‘Personhood’ Amendment. Technical Report.” Public Policy Polling.
46. Shiraito, Yuki, and Kosuke Imai. 2012. “Endorse: R Package for Analyzing Endorsement Experiments.” Available at the Comprehensive R Archive Network. http://CRAN.R-project.org/package=endorse.
47. Tourangeau, Roger, and Ting Yan. 2007. “Sensitive Questions in Surveys.” Psychological Bulletin 133: 859–83.
48. Tracy, Paul E., and James Alan Fox. 1981. “The Validity of Randomized Response for Sensitive Measurements.” American Sociological Review 46: 187–200.
49. Tsuchiya, Takahiro, Yoko Hirai, and Shigeru Ono. 2007. “A Study of the Properties of the Item Count Technique.” Public Opinon Quarterly 71: 253–72.
50. van den Hout, Ardo, Peter G. M. van der Heijden, and Robert Gilchrist. 2007. “The Logistic Regression Model with Response Variables Subject to Randomized Response.” Computational Statistics & Data Analysis 51: 6060–69.
51. van der Heijden, Peter G. M., Ger van Gils, Jan Bouts, and Joop J. Hox. 2000. “A Comparison of Randomized Response, Computer-Assisted Self-Interview, and Face-to-Face Direct Questioning: Eliciting Sensitive Information in the Context of Welfare and Unemployment Benefit.” Sociological Methods & Research 28: 505–37.
52. Warner, Stanley L. 1965. “Randomized Response: A Survey Technique for Eliminating Evasive Answer Bias.” Journal of the American Statistical Association 60: 63–69.
53. Warner, Stanley L. 1971. “The Linear Randomized Response Model.” Journal of the American Statistical Association 66: 884–88.
54. Wolter, Felix, and Peter Preisendorfer. 2013. “Asking Sensitive Questions: An Evaluation of the Randomized Response Technique versus Direct Questioning Using Individual Validation Data.” Sociological Methods & Research 42: 321–53.
55. Wood, Wendy, and Carl A. Kallgren. 1988. “Communicator Attributes and Persuasion: Recipients' Access to Attitude-Relevant Information in Memory.” Personality and Social Psychology Bulletin 14: 172–82.