Computing response metrics for online panels

Public Opinion Quarterly

Volumn 72, Issue 5, 2008, Pages 1008-1032

  Callegaro, Mario ^a   Disogra, Charles ^a  

^a Knowledge Networks Inc   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 60449102446     PISSN: 0033362X     EISSN: 15375331     Source Type: Journal    
DOI: 10.1093/poq/nfn065     Document Type: Article

References (45)

1. American Association for Public Opinion Research. 2006. Final Dispositions of Case Codes and Outcomes Rates for Surveys. 4th ed. Lenexa, KS: AAPOR.
2. Arbeitskreis Deutscher Markt. 2001. "Standards for Quality Assurance for Online Surveys."
3. Arens, Zachary, and Darby Miller Steiger. 2006. "Time in Sample: Searching for Conditioning in a Consumer Panel." Public Opinion Pros (August).
4. Clinton, Joshua D. 2001. "Panel Bias from Attrition and Conditioning: A Case Study of the Knowledge Networks Panel." Paper presented at 56th Annual Conference of the American Association for Public Opinion Research, May, Montreal, Canada.
5. Comley, Peter. 2007. "Online Market Research." In Market Research Handbook, ed. ESOMAR, pp. 401-20. Hoboken, NJ: Wiley.
6. Couper, Mick. 2000. "Web Surveys. A Review of Issues and Approaches." Public Opinion Quarterly 64(4):464-94.
7. Couper, Mick. 2007. "Issues of Representation in Ehealth Research (with a Focus on Web Surveys)." American Journal of Preventive Medicine 32(5S):S83-9.
8. Couper, Mick, Arie Kapteyn, Matthias Schonlau, and Joachim Winter. 2007. "Noncoverage and Nonresponse in an Internet Survey." Social Science Research 36(1):131-48.
9. Couper, Mick, and Jeff Dominitz. 2007. "Using an RDD Survey to Recruit Online Panel Members." Paper presented at 2007 Biennial Conference of the European Survey Research Association, June 25-29, Prague.
10. DiSogra, Charles, Daniel Slotwiner, Sarah Clinton, Elisa Chan, Erlina Hendarwan, and Wei Zheng. 2007. "Nonresponse Bias in Two Methods of Panel Recruitment." Paper presented at Joint Statistical Meetings (JSM), July 29-August 2, Salt Lake City, UT, USA.
11. European Federation of Associations of Market Research Organizations. 2004. "EFAMRO - Quality Standards for Access Panel (QSAP)". Available at: http://www.efamro.com/shortprint2.html (accessed September 2008).
12. European Society for Opinion and Marketing Research. 2005. "Conducting Market and Opinion Research Using the Internet." Available at: http://www.esomar.org/uploads/pdf/ESOMAR-Codes&Guideline-Conducting- research-using-Internet.pdf (accessed September 2008).
13. European Society for Opinion and Marketing Research. 2008. "26 Questions to Help Researchers Buyers of Online Samples." Available at http://194.38.169.84/uploads/pdf/professional-standards/26questions.pdf (accessed September 2008).
14. Eysenbach, Gunther. 2004. "Improving the Quality of Web Surveys: The Checklist for Reporting Results from. Internet E-Surveys (Cherries)." Journal of Medical Internet Research 6(3): e34.
15. Ezzati-Rice, Trena M., Martin R. Frankel, David C. Hoaglin, John D. Loft, Victor G. Coronado, and Robert A. Wright. 2000. "An Alternative Measure of Response Rate in Random-Digit-Dialing That Screen for Eligible Subpopulations." Journal of Economic and Social Measurement 26(2):99-109.
16. Fricker, Ronald D., and Matthias Schonlau. 2002. "Advantages and Disadvantages of Internet Research Surveys: Evidence from the Literature." Social Science Computer Review 14(4):347-67.
17. Göritz, Anja S. 2007. "Using Online Panels in Psychological Research". In The Oxford Handbook of Internet Psychology, eds. Adam N. Joinson, Katelyn Y. A. McKenna, Tom Postmes, and Ulf-Dietrich Reips, pp. 473-85. Norfolk: Oxford University Press.
18. Groves, Robert M. 2006. "Nonresponse Rates and Nonresponse Bias in Household Surveys". Public Opinion Quarterly 70(5):646-75.
19. Groves, Robert, and Emilia Peytcheva. 2008. "The Impact of Nonresponse Rates on Nonresponse Bias. A Meta-Analysis." Public Opinion Quarterly 72(2):167-189.
20. Hoogendoorn, Adriaan W., and Jacco Daalmans. 2008. "Nonresponse in the Recruitment of an Internet Panel Based on a Probability Sample." Discussion Paper 08007. Statistics Netherlands, Voorburg/Heerlen.
21. Huggins, Vicki, and Joe Eyerman. 2001. "Probability Based Internet Surveys: A Synopsis of Early Methods and Survey Research Results." Paper presented at Federal Committee on Statistical Methodology Research Conference, November 14-16, Arlington, VA, USA.
22. Interactive Marketing Research Organization. 2006. "IMRO Guidelines for Best Practices in Online Sample and Panel Management." Available at http://www.imro.org/pdf/IMRO-Guidelines-for-Best-Practices-in-Online-Sample-and- Panel-Management.pdf (accessed September 2008).
23. Lee, Sunghee. 2006. "An Evaluation of Nonresponse and Coverage Errors in a Prerecruited Probability Web Panel Survey". Social Science Computer Review 24(4):460-75.
24. Lozar Manfreda, Katja, and Vasja Vehovar. 2002. "Survey Design Features Influencing Response Rates in Web Surveys." Paper presented at International Conference on Improving Surveys, August 25-28, Copenhagen, Denmark.
25. Lozar Manfreda, Katja, and Vasja Vehovar. 2008. "Internet Surveys." In International Handbook of Survey Methodology, eds. Edith De Leeuw, Joop Hox, and Don Dillman, pp. 264-84. New York: Lawrence Erlbaum.
26. Miller, Jeff. 2006. "Online Marketing Research." In The Handbook of Marketing Research. Uses, Abuses and Future Advances, eds. Rajiv Grover and Marco Vriens, pp. 110-31. Thousand Oaks, CA: Sage.
27. Office of Management and Budget (OMB). 2006. Questions and Answers When Designing Surveys for Information Collections. Washington, DC: OMB.
28. Pineau, Vicki J., Poom Nukulkij, and Xiuli Tang. 2006. "Assessing Panel Bias in the Knowledge Networks Panel: Updated Results from the 2005 Research." In Joint Statistical Meeting 2005 Proceedings [Cd-Rom], pp. 3480-6. Alexandria, VA: American Statistical Association.
29. Postoaca, Andrei. 2006a. The Anonymous Elect. Market Research through Online Access Panels. Berlin: Springer.
30. Postoaca, Andrei. 2006b. "Response Rates. Avoiding the Red Herrings." In Panel Research 2006. Amsterdam: ESOMAR.
31. Pratesi, Monica, Katja Lozar Manfreda, Silvia Biffignardi, and Vasja Vehovar. 2004. "List-Based Web Surveys: Quality, Timeliness, and Nonresponse in the Steps of the Participation Flow." Journal of Official Statistics 20(3):451-65.
32. Reips, Ulf-Dietrich. 2007. "The Methodology of Internet-Based Experiments." In The Oxford Handbook of Internet Psychology, eds. Adam N. Joinson, Katelyn Y. A. McKenna, Tom Postmes, and Ulf-Dietrich Reips, pp. 373-90. Norfolk: Oxford University Press.
33. Saris, Willem E. 1991. Computer Assisted Interviewing. Newbury Park, CA: Sage.
34. Saris, Willem E. 1998. "Ten Years of Interviewing without Interviewers: The Telepanel." In Computer Assisted Survey Information Collection, eds. Mick Couper, Reginald P. Baker, Jelke Bethleem, Cynthia Z. F. Clark, Jean Martin, William. L. Nicholls, and James M. O'Reilly, pp. 409-29. New York: Wiley.
35. Sayles, Harlan, and Zachary Arens. 2007. "A Study of Panel Member Attrition in the Gallup Panel." Paper presented at 62nd Annual Conference of the American Association for Public Opinion Research, May 1.7-20, Anaheim, CA, USA.
36. Schlengen, William. E., Jesta M. Caddell, Lori Ebert, Kathleen B. Jordan, Kathrin M. Rourke, David Wilson, Lisa Thalji, Michael J. Dennis, John A. Fairbank, and Richard A. Kulka. 2002. "Psychological Reactions to Terrorist Attacks. Findings from the National Study of American's Reactions to September 11." Journal of the American Medical Association 288(5):581-8.
37. Schonlau, Matthias, Arthur VanSoest, Arie Kapteyn, and Mick Couper. 2006. "Selection Bias in Web Surveys and the Use of Propensity Scores." Available at http://www.rand.org/pubs/working.papers/2006/RAND-WR279.pdf (accessed September 2008).
38. Schonlau, Matthias, Ronald D. Fricker, and Marc N. Elliott. 2002. Conducting Research Surveys Via E-Mail and the Web. Santa Monica, CA: RAND.
39. Sikkel, Dirk, and Adriaan Hoogendoorn. 2008. "Panel Surveys." In International Handbook of Survey Methodology, eds. Edith De Leeuw, Joop Hox, and Don Dillman, pp. 479-99. New York: Lawrence Erlbaum.
40. Smith, Tom W. 2002. "Developing Nonresponse Standards." In Survey Nonresponse, eds. Robert Groves, Don Dillman, John L. Eltinge, and Roderick J. A. Little, pp. 27-40. New York: Wiley.
41. Toepoel, Vera, Marcel Das, and Arthur van Soest, in press. "Design of Web Questionnaires: The Effects of the Number of Items per Screen." Field Methods.
42. Tortora, Robert. 2009. "Attrition in Consumer Panels." In Methodology of Longitudinal Surveys, ed. Peter Lynn, pp. 235-49. Hoboken, NJ: Wiley.
43. Tourangeau, Roger. 2003. "Web-Based Data Collection." In Survey Automation. Report and Workshop Proceedings, eds. Daniel L. Cork, Michael L. Cohen, Robert Groves, and William Kalsbeek, pp. 183-98. Washington, DC: National Academies Press.
44. Vis, Corrie. 2007. "Who Wants to Become an Online Panel Member? Effects of Respondent Characteristics on the Recruitment of an Online Panel." Paper presented at 2007 Biennial Conference of the European Survey Research Association, June 25-29th, Prague.
45. Vonk, Ted, Robert van Osenbruggen, and Pieter Willems. 2006. "The Effect of Panel Recruitment and Management on Research Results. A Study across 19 Online Panels." In Panel Research 2006. Amsterdam: ESOMAR.