Respondent Screening and Revealed Preference Axioms: Testing Quarantining Methods for Enhanced Data Quality in Web Panel Surveys

Public Opinion Quarterly

Volumn 79, Issue 3, 2015, Pages 687-709

  Jones, Michael S ^a   House, Lisa A ^b   Gao, Zhifeng ^b  

^a NORTH CAROLINA STATE UNIVERSITY   (United States)

^b UNIVERSITY OF FLORIDA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84941278225     PISSN: 0033362X     EISSN: 15375331     Source Type: Journal    
DOI: 10.1093/poq/nfv015     Document Type: Review

References (35)

1. Andreoni, James, and John Miller. 2002. "Giving According to GARP: An Experimental Test of the Consistency of Preferences for Altruism." Econometrica 70:737-53.
2. Baker, Reg, Stephen J. Blumberg, J. Michael Brick, Mick P. Couper, Melanie Courtright, J. Michael Dennis, Don Dillman, Martin R. Frankel, Philip Garland, Robert M. Groves, Courtney Kennedy, Jon Krosnick, Paul J. Lavrakas, Sunghee Lee, Michael Link, Linda Piekarski, Kumar Rao, Randall K. Thomas, and Dan Zahs. 2010. "Research Synthesis: AAPOR Report on Online Panels." Public Opinion Quarterly 74:711-81.
3. Carson, Richard T., Jordan J. Louviere, Donald A. Anderson, Phipps Arabie, David S. Bunch, David A. Hensher, Richard M. Johnson, Warren F. Kuhfeld, Dan Steinberg, Joffre Swait, Harry Timmermans, and James B. Wiley. 1994. "Experimental Analysis of Choice." Marketing Letters 5:351-68.
4. Chang, Linchiat, and Jon A. Krosnick. 2010. "Comparing Oral Interviewing with Self-Administered Computerized Questionnaires: An Experiment." Public Opinion Quarterly 74:154-67.
5. Cojuharenco, Irina, Garriy Shteynberg, Michele Gelfand, and Marshall Schminke. 2012. "Self-Construal and Unethical Behavior." Journal of Business Ethics 109:447-61.
6. Dillman, Don A., Jolene D. Smyth, and Leah M. Christian. 2009. Internet, Mail, and Mixed-Mode Surveys: The Tailored Design Method. Hoboken, NJ: Wiley & Sons.
7. Downes-Le Guin, Theo. 2005. "Satisficing Behavior in Online Panels." Presentation at the MRA Annual Conference & Symposium, Chicago, IL, USA. http://www.sigmavalidation.com/tips/05-06-02-Online-Panelists.pdf.
8. Downes-Le Guin, Theo, Reg Baker, Joanne Mechling, and Erica Ruylea. 2012. "Myths and Realities of Respondent Engagement in Online Surveys." International Journal of Market Research 54:613-33.
9. Gao, Zhifeng, Lisa House, and Xiang Bi. 2013. "Data Quality of Online Surveys and Its Impact on Willingness-to-Pay Estimates." Working Paper.
10. Gao, Zhifeng, Lisa House, and Jing Xie. Forthcoming. "Online Survey Data Quality and Its Implication for Willingness-to-Pay: A Cross-Country Comparison." Canadian Journal of Agricultural Economics.
11. Houthakker, Hendrik. 1950. "Revealed Preference and the Utility Function." Economica 17:159-74.
12. Hougaard, Jens L., Tue Tjur, and Lars P. Osterdal. 2012. "On the Meaningfulness of Testing Preferences Axioms in Stated Preference Discrete Choice Experiments." European Journal of Health Economics 13:409-17.
13. Johnson, Russell E., and Robert G. Lord. 2010. "Implicit Effects of Justice on Self-Identity." Journal of Applied Psychology 95:681-95.
14. Johnson, Russell E., Christopher Selenta, and Robert G. Lord. 2006. "When Organizational Justice and the Self-Concept Meet." Organizational Behavior and Human Decision Processes 99:175-201.
15. Johnson, W. Russell, Nicholas A. Sieveking, and Earl S. Clanton. 1974. "Effects of Alternative Positioning of Open-Ended Questions in Multiple-Choice Questionnaires." Journal of Applied Psychology 59:776-78.
16. Kashima, Yoshihisa, Susumu Yamaguchi, Uichol Kim, Sang-Chin Choi, Michele J. Gelfand, and Masaki Yuki. 1995. "Culture, Gender, and Self: A Perspective from Individualism-Collectivism Research." Journal of Personality and Social Psychology 69:925-37.
17. Kraut, Allen I., Alan D. Wolfson, and Alan Rothenburg. 1975. "Some Effects of Position on Opinion Survey Items." Journal of Applied Psychology 60:774-76.
18. Krosnick, Jon. 1991. "Response Strategies for Coping with Cognitive Demands of Attitude Measures in Surveys." Applied Cognitive Psychology 5:213-36.
19. Lancsar, Emily, and Jordan Louviere. 2006. "Deleting 'Irrational' Responses from Discrete Choice Experiments: A Case of Investigating or Imposing Preferences?" Health Economics 15:797-811.
20. Lusk, Jayson. 2003. "Effects of Cheap Talk on Consumer Willingness-to-Pay for Golden Rice." American Journal of Agricultural Economics 85:840-56.
21. Lusk, Jayson, and Ted C. Schroeder. 2004. "Are Choice Experiments Incentive Compatible? A Test with Quality Differentiated Beef Steaks." American Journal of Agricultural Economics 86:467-82.
22. Mas-Colell, Andreu, Michael D. Whinston, and Jerry R. Green. 1995. Microeconomic Theory. Oxford, UK: Oxford University Press.
23. McIntosh, Emma, and Mandy Ryan. 2002. "Using Discrete Choice Experiments to Derive Welfare Estimates for the Provision of Elective Surgery: Implications of Discontinuous Preferences." Journal of Economic Psychology 23:367-82.
24. Miller, Jeff. 2006. "Research Reveals Alarming Incidence of 'Undesirable' Online Panelists." Research Conference Report, RFL Communications, Skokie, IL, USA (synthesized from Presentation at Research Industry Summit: Improving Respondent Cooperation, Chicago, IL, USA). Available at http://www.burke.com/Library/Articles/Jeff%20Miller%20RCR%20PDF.pdf.
25. Miller, Jeff, and Jamie Baker-Prewitt. 2009. "Beyond 'Trapping' the Undesirable Panelist: The Use of Red Herrings to Reduce Satisficing." Paper presented at the CASRO Panel Quality Conference, New Orleans, LA, USA [Burke Pub. No. CP51]. Available at http://www.burke.com/library/conference/beyond%20trapping%20the%20undesirable%20panelist-final.pdf.
26. Ryan, Mandy, and Angela Bate. 2001. "Testing the Assumptions of Rationality, Continuity, and Symmetry When Applying Discrete Choice Experiments in Health Care." Applied Economics Letters 8:59-63.
27. Samuelson, Paul. 1938. "A Note on the Pure Theory of Consumer Behavior." Economica 5:61-71.
28. Sedikides, Constantine, and Marilynn B. Brewer. 2001. Individual Self, Relational Self, Collective Self. Philadelphia: Psychology Press.
29. Selenta, Christopher, and Robert G. Lord. 2005. "Development of the Levels of Self-Concept Scale: Measuring the Individual, Relational, and Collective Levels." Unpublished manuscript.
30. Simon, Herbert. 1957. Models of Man: Social and Rational. Oxford, UK: Wiley.
31. Smith, Renee, and Holland Hofma-Brown. 2005. "Assessing the Quality of Data from Online Panels: Moving Forward with Confidence." White Paper, Harris Interactive.
32. -. 2006. "Comparing Metrics and Assessing Claims." Proceedings from the ESOMAR World Research Conference, Panel Research 317:9-21.
33. Tourangeau, Roger, and Kenneth A. Rasinski. 1988. "Cognitive Processes Underlying Context Effects in Attitude Measurement." Psychological Bulletin 103:299-314.
34. USDA. 2013. Agricultural Marketing Service Database. "Weekly Advertised Fruit & Vegetable Retail Prices." https://www.marketnews.usda.gov/mnp/fv-report-retail?repType=&run=&port al=fv&locChoose=&commodityClass=&startIndex=1&type=retail&class=FRUITS&commod ity=BLUEBERRIES®ion=ALL&organic=ALL&repDate=08%2F01%2F2013&endDate= 09%2F30%2F2014&compareLy=No.
35. Willems, Pieter, Robert van Ossenbruggen, and Ted Vonk. 2006. "The Effects of Panel Recruitment and Management on Research Results." Paper presented at the ESOMAR Panel Research Conference, Barcelona, Spain.