Frequentist and bayesian approaches for comparing interviewer variance components in two groups of survey interviewers

Survey Methodology

Volumn 40, Issue 2, 2014, Pages 163-188

  West, Brady T ^a   Elliott, Michael R ^a  

^a UNIVERSITY OF MICHIGAN   (United States)

Author keywords

Bayesian analysis; Hierarchical generalized linear models; Interviewer variance; Likelihood ratio testing

Indexed keywords

EID: 84929252801     PISSN: 07140045     EISSN: 14920921     Source Type: Journal    
DOI: None     Document Type: Article

References (52)

1. Bates, D. (2009). Assessing the precision of estimates of variance components. Presentation to the Max Planck Institute for Ornithology, Seewiesen, July 21, 2009. Presentation can be downloaded from http://lme4.r-forge.r-project.org/slides/2009-07-21-Seewiesen/4PrecisionD.pdf.
2. Biemer, P.P. and Trewin, D. (1997). A review of measurement error effects on the analysis of survey data. Chapter 27 of Survey Measurement and Process Quality, Editors Lyberg, Biemer, Collins, de Leeuw, Dippo, Schwarz and Trewin. Wiley-Interscience, 603-632.
3. Binder, D.A. (1983). On the variances of asymptotically normal estimators from complex surveys. International Statistical Review, 51, 279-292.
4. Browne, W.J. and Draper, D. (2006). A comparison of Bayesian and likelihood-based methods for fitting multilevel models. Bayesian Analysis, 1(3), 473-514.
5. BUGS, http://www.mrc-bsu.cam.ac.uk/bugs/welcome.html.
6. Carlin, B.P. and Louis, T.A. (2009). Bayesian Methods for Data Analysis. Chapman and Hall/CRC Press.
7. Chaloner, K. (1987). A Bayesian approach to the estimation of variance components for the unbalanced one-way random model. Technometrics, 29(3), 323-337.
8. Collins, M. and Butcher, B. (1982). Interviewer and clustering effects in an attitude survey. Journal of the Market Research Society, 25, 39-58.
9. Durham, C.A., Pardoe, I. and Vega, E. (2004). A methodology for evaluating how product characteristics impact choice in retail settings with many zero observations: An application to restaurant wine purchase. Journal of Agricultural and Resource Economics, 29(1), 112-131.
10. Durrant, G.B., Groves, R.M., Staetsky, L. and Steele, F. (2010). Effects of interviewer attitudes and behaviors on refusal in household surveys. Public Opinion Quarterly, 74, 1-36.
11. Faraway, J.J. (2006). Extending the Linear Model with R: Generalized Linear, Mixed Effects and Nonparametric Regression Models. Chapman and Hall/CRC Press: Boca Raton, FL.
12. Farrell, P.J. (2000). Bayesian inference for small area proportions. Sankhya: The Indian Journal of Statistics, Series B (1960-2002), 62(3), 402-416.
13. Fowler, F.J. and Mangione, T.W. (1990). Standardized Survey Interviewing: Minimizing Interviewer-Related Error. Newbury Park, CA: Sage.
14. Gabler, S. and Lahiri, P. (2009). On the definition and interpretation of interviewer variability for a complex sampling design. Survey Methodology, 35(1), 85-99.
15. Gelman, A. (2006). Prior distributions for variance parameters in hierarchical models. Bayesian Analysis, 1(3), 515-533.
16. Gelman, A., Carlin, J.B., Stern, H.S. and Rubin, D.B. (2004). Bayesian Data Anaylsis. Chapman and Hall/CRC Press.
17. Gelman, A. and Hill, J. (2007). Data Analysis using Regression and Multilevel/Hierarchical Models. Cambridge University Press.
18. Gelman, A. and Rubin, D.B. (1992). Inference from iterative simulation using multiple sequences (with discussion). Statistical Science, 7, 457-511.
19. Gilks, W.R. and Wild, P. (1992). Adaptive rejection sampling for Gibbs sampling. Applied Statistics, 41, 337-348.
20. Goldstein, H. (1995). Multilevel Statistical Models, Second Edition. Kendall’s Library of Statistics 3, Edward Arnold.
21. Groves, R.M. (2004). Survey Errors and Survey Costs (2nd Edition). In chapter 8: The Interviewer as a Source of Survey Measurement Error. Wiley-Interscience.
22. Groves, R.M., Mosher, W.D., Lepkowski, J.M. and Kirgis, N.G. (2009). Planning and development of the continuous National Survey of Family Growth. National Center for Health Care Statistics. Vital Health Statistics, 1(48).
23. Hilbe, J.M. (2007). Negative Binomial Regression. Cambridge University Press.
24. Hox, J. (1998). Multilevel Modeling: When and Why. In I. Balderjahn, R. Mathar and M. Schader (Eds.). Classification, data anaylsis, and data highways. New York: Springer-Verlag, 147-154.
25. Kish, L. (1962). Studies of interviewer variance for attitudinal variables. Journal of the American Statistical Association, 57, 92-115.
26. Lambert, P.C., Sutton, A.J., Burton, P.R., Abrams, K.R. and Jones, D.R. (2005). How vague is vague? A simulation study of the impact of the use of vague prior distributions in MCMC using WinBUGS. Statistics in Medicine, 24(15), 2401-2428.
27. Lepkowski, J.M., Mosher, W.D., Davis, K.E., Groves, R.M. and Van Hoewyk, J. (2010). The 2006-2010 National Survey of Family Growth: sample design and analysis of a continuous survey. National Center for Health Statistics, Vital and Health Statistics, 2(150), June 2010.
28. Lynn, P., Kaminska, O. and Goldstein, H. (2011). Panel attrition: how important is it to keep the same interviewer? ISER Working Paper Series, Paper 2011-02.
29. Mahalanobis, P.C. (1946). Recent experiments in statistical sampling in the Indian Statistical Institute. Journal of the Royal Statistical Society, 109, 325-378.
30. Mangione, T.W., Fowler, F.J. and Louis, T.A. (1992). Question characteristics and interviewer effects. Journal of Official Statistics, 8(3), 293-307.
31. Molenberghs, G. and Verbeke, G. (2005). Models for Discrete Longitudinal Data. Springer-Verlag, Berlin.
32. O’Muircheartaigh, C. and Campanelli, P. (1998). The relative impact of interviewer effects and sample design effects on survey precision. Journal of the Royal Statistical Society, Series A, 161 (1), 63-77.
33. O’Muircheartaigh, C. and Campanelli, P. (1999). A multilevel exploration of the role of interviewers in survey non-response. Journal of the Royal Statistical Society, Series A, 162(3), 437-446.
34. Pfefferman, D., Skinner, C.J., Holmes, D.J., Goldstein, H. and Rasbash, J. (1998). Weighting for unequal selection probabilities in multilevel models. Journal of the Royal Statistical Society, Series B, 60(1), 23-40.
35. Pinheiro, J.C. and Chao, E.C. (2006). Efficient Laplacian and adaptive Gaussian quadrature algorithms for multilevel generalized linear mixed models. Journal of Computational and Graphical Statistics, 15, 58-81.
36. Rabe-Hesketh, S. and Skrondal, A. (2006). Multilevel modeling of complex survey data. Journal of the Royal Statistical Society, Series A, 169, 805-827.
37. Raudenbush, S.W. and Bryk, A.S. (2002). Hierarchical Linear Models: Applications and Data Analysis Methods. Sage Publications, Newbury Park, CA.
38. Rodriguez, G. and Goldman, N. (2001). Improved estimation procedures for multilevel models with binary response: a case-study. Journal of the Royal Statistical Society, Series A, 164(2), 339-355.
39. SAS Institute, Inc. (2010). Online Documentation for the GLIMMIX Procedure.
40. Savalei, V. and Kolenikov, S. (2008). Constrained versus unconstrained estimation in structural equation modeling. Psychological Methods, 13(2), 150-170.
41. Schaeffer, N.C., Dykema, J. and Maynard, D.W. (2010). Handbook of Survey Research, Second Edition. In Interviewers and Interviewing. J.D. Wright and P.V. Marsden (eds). Bingley, U.K.: Emerald Group Publishing Limited.
42. Schnell, R. and Kreuter, F. (2005). Separating interviewer and sampling-point effects. Journal of Official Statistics, 21(3), 389-410.
43. Schober, M. and Conrad, F. (1997). Does conversational interviewing reduce survey measurement error? Public Opinion Quarterly, 61, 576-602.
44. Singh, A.C., Stukel, D.M. and Pfeffermann, D. (1998). Bayesian versus frequentist measures of error in small area estimation. Journal of the Royal Statistical Society, Series B, 60(2), 377-396.
45. Ugarte, M.D., Goicoa, T. and Militino, A.F. (2009). Empirical bayes and fully bayes procedures to detect high-risk areas in disease mapping. Computational Statistics and Data Analysis, 53, 2938-2949.
46. Van Tassell, C.P. and Van Vleck, L.D. (1996). Multiple-trait Gibbs sampler for animal models: Flexible programs for Bayesian and likelihood-based (co)variance component inference. Journal of Animal Science, 74, 2586-2597.
47. Viechtbauer, W. (2007). Confidence intervals for the amount of heterogeneity in meta-analysis. Statistics in Medicine, 26, 37-52.
48. West, B.T. (2011). Bayesian analysis of between-group differences in variance components in hierarchical generalized linear models. In JSM Proceedings, Survey Research Methods Section. Alexandria, VA: American Statistical Association, 1828-1842.
49. West, B.T. and Galecki, A.T. (2011). An overview of current software procedures for fitting linear mixed models. The American Statistician, 65(4), 274-282.
50. West, B.T., Kreuter, F. and Jaenichen, U. (2013). “Interviewer” effects in face-to-face surveys: A function of sampling, measurement error, or nonresponse? Journal of Official Statistics, 29(2), 277-297.
51. West, B.T. and Olson, K. (2010). How much of interviewer variance is really nonresponse error variance? Public Opinion Quarterly, 74(5), 1004-1026.
52. Zhang, D. and Lin, X. (2010). Variance component testing in generalized linear mixed models for longitudinal/clustered data and other related topics. Random Effect and Latent Variable Model Selection. Springer Lecture Notes in Statistics, Volume 192.