Estimating agreement coefficients from sample survey data

Survey Methodology

Volumn 38, Issue 1, 2012, Pages 63-72

  Lin, Hung Mo ^a   Kim, Hae Young ^b   Williamson, John M ^c   Lesser, Virginia M ^d  

^a MOUNT SINAI SCHOOL OF MEDICINE   (United States)

^b NEW ENGLAND RESEARCH INSTITUTES   (United States)

^c KENYA MEDICAL RESEARCH INSTITUTE   (Kenya)

^d OREGON STATE UNIVERSITY   (United States)

Author keywords

Clustering; Concordance correlation coefficient; Generalized estimating equations; Jackknife estimator; Kappa coefficient; Sample weighting; Stratification; Taylor series linearization

Indexed keywords

EID: 84863843914     PISSN: 07140045     EISSN: 14920921     Source Type: Journal    
DOI: None     Document Type: Article

References (46)

1. Barnhart, H.X., and Williamson, J.M. (2001). Modeling concordance correlation via GEE to evaluate reproducibility. Biometrics, 57, 931-940.
2. Behavioral Risk Factor Surveillance System (BRFSS). http://www.cdc.gov/BRFSS.
3. Binder, D.A. (1983). On the variances of asymptoticall y normal estimators from complex surveys. International Statistical Review, 20, 37-46.
4. Binder, D.A. (1996). Linearization methods for single phase and twophase samples: A cookbook approach. Survey Methodology, 22, 17-22.
5. Carrasco, J.L., and Jover, L. (2003). Estimating the generalized concordance correlation coefficient through variance components. Biometrics, 59, 849-858.
6. Chinchilli, V.M., Martel, J.K., Kumanyika, S. and Lloyd, T. (1996). A weighted concordance correlation coefficient for repeated measurement designs. Biometrics, 52, 341-353.
7. Cochran, W.G. (1963). Sampling Techniques, 2nd Ed. New York: John Wiley & Sons, Inc.
8. Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20, 37-46.
9. Cohen, J. (1968). Weighted kappa: Nominal scale agreement with provision for scaled disagreement or partial credit. Psychological Bulletin, 70, 213-220.
10. Dixon, A.E., Sugar, E.A., Zinreich, S.J., Slavin, R.G., Corren, J., Naclerio, R.M., Ishii, M., Cohen, R.I., Brown, E.D., Wise, R.A. and Irvin, C.G. (2009). Criteria to screen for chronic sinonasal disease. Chest, 136 (5), 1324-1332.
11. Feinleib, M., Garrison, R.J., Fabsitz, R.R., Christian, J.C., Hrubec, Z., Borhani, N.O., Kannel, W.B., Roseman, R., Schwartz, J.T. and Wagner, J.O. (1977). The NHLBI Twin Study of cardiovascular disease risk factors: Methodology and summary of results. American Journal of Epidemiology, 106, 284-295.
12. Field, A.E., Aneja, P. and Rosner, B. (2007). The validity of selfreported weight change among adolescents and young adults. Obesity, 15, 2357-2364.
13. Fleiss, J.L. (1981). Statistical Methods for Rates and Proportions, 2nd Edition. New York: John Wiley & Sons, Inc.
14. Fleiss, J.L. (1986). The Design and Analysis of Clinical Experiments. New York: John Wiley & Sons, Inc.
15. Fleiss, J.L., Nee, J.C.M. and Landis, J.R. (1979). Large sample variance of kappa in the case of different sets of raters. Psychological Bulletin, 86, 974-977.
16. Gilmour, E., Ellerbrock, T.V., Koulos, J.P., Chiasson, M.A., Williamson, J.M., Kuhn, L. and Wright, T.C. (1997). Measuring cervical ectopy: Direct visual assessment versus computerized planimetry. American Journal of Obstetrics and Gynecology, 176, 108-111.
17. Gorber, S.C., Tremblay, M., Moher, D. and Gorber, B. (2007). A comparison of direct vs. self-report measures for assessing height, weight and body mass index: A systematic review. Obesity Review, 8, 373-374.
18. Hansen, M.H., Hurwitz, W.N. and Madow, W.G. (1953). Sample Survey Methods and Theory. New York: John Wiley & Sons, Inc. Vols I and II.
19. Khawaja, I.S., Olson, E.J., van der Walt, C., Bukartyk, J., Somers, V., Dierkhising, R. and Morgenthaler, T.I. (2010). Diagnostic accuracy of split-night polysomnograms. Journal of Clinical Sleep Medicine, 6 (4), 357-362.
20. Kish, L. (1965). Survey Sampling. New York: John Wiley & Sons, Inc.
21. Klar, N., Lipsitz, S.R. and Ibrahim, J.G. (2000). An estimating equations approach for modeling kappa. Biometrical Journal, 42, 45-58.
22. Kocks, J.W., Kerstjens, H.A., Snijders, S.L., de Vos, B., Biermann, J.J., van Hengel, P., Strijbos, J.H., Bosveld, H.E. and van der Molen, T. (2010). Health status in routine clinical practice: validity of the clinical COPD questionnaire at the individual patient level. Health and Quality of Life Outcomes. 8, 135-141.
23. Korten, A.E., Jorm, A.F., Henderson, A.S., McCusker, E. and Creasey, H. (1992). Control-informant agreement on exposure history in case-control studies of Alzheimer's disease. International Journal of Epidemiology, 21, 1121-1131.
24. Liang, K.Y., and Zeger, S.L. (1986). Longitudinal data analysis using generalized linear models. Biometrika, 73, 13-22.
25. Lin, L. (1989). A concordance correlation coefficient to evaluate reproducibility. Biometrics, 45, 255-268.
26. Lin, L. (1992). Assay validation using the concordance correlation coefficient. Biometrics, 48, 599-604.
27. Lin, L., and Chinchilli, V. (1997). Rejoinder to the letter to the editor from Atkinson and Nevill. Biometrics, 53, 777-778.
28. Liottol, N., Radaelli, T., Orsil, A., Taricco, E., Roggerol, P., Giann, M.L., Consonni, D., Moscal, F. and Cetin, I. (2010). Relationship between in utero sonographic evaluation and subcutaneous plicometry after birth in infants with intrauterine growth restriction: An exploratory study. Italian Journal of Pediatrics, 36, 70-77.
29. Lipsitz, S.R., Laird, N.M. and Brennan, T.A. (1994). Simple moment estimates of the κ-coefficient and its variance. Applied Statistics, 43, 309-323.
30. Lumley, T. (2010). Complex Surveys: A Guide to Analysis using R. Hoboken. New Jersey: John Wiley & Sons, Inc.
31. MacDougall, H.G., Weber, K.P., McGarvie, L.A., Halmagyi, G.M. and Curthoys, I.S. (2009). The video head impulse test. Diagnostic accuracy in peripheral vestibulopathy. Neurology, 73, 1134-1141.
32. Maclure, M., and Willett, W.C. (1987). Misinterpretation and misuse of the kappa statistic. American Journal of Epidemiology, 126, 161-169.
33. Mazaheri, Y., Hricak, H., Fine, S.W., Akin, O., Shukla-Dave, A., Ishill, N.M., Moskowitz, C.S., Grater, J.E., Reuter, V.E., Zakian, K.L., Touijer, K.A. and Koutcher, J.A. (2009). Prostate tumor volume measurement with combined T2-weighted imaging and diffusion-weighted MR: Correlation with pathologic tumor volume. Radiology, 252 (2), 449-457.
34. National Center for Health Statistics (2011). Third National Health and Nutrition Examination Survey, 1988-1994, NHANES III Examination data file (CD-ROM). http://www.cdc.gov/nchs/nhanes.htm.
35. National Health Interview Survey (NHIS) (2011). http://www.cdc.gov/nchs/nhis.htm.
36. Robieson, W. (1999). On weighted kappa and concordance correlation coefficient. Ph.D. thesis, University of Illinois in Chicago/Graduate College/Mathematics.
37. Rust, K.F., and Rao, J.N.K. (1996). Variance estimation for complex surveys using replication techniques. Statistical Methods in Medical Research, 5, 283-310.
38. Sherry, B., Jefferds, M.E. and Grummer-Strawn, L.M. (2007). Accuracy of adolescent self-report of height and weight in assessing overweight status: A literature review. Archive of Pediatrics Adolescent Medicine, 161, 1154-1161.
39. Shield, M., Gorber, S.C. and Tremblay, M.S. (2008). Effects of measurement on obesity and morbidity. Health Reports, 19, 77-84.
40. Slade, G.D., and Beck, J.D. (1999). Plausibility of periodontal disease estimates from NHANES III. Journal of Public Health Dentistry, 59, 67-72.
41. Talamayan, K.S., Springer, A.E., Kelder, S.H., Gorospe, E.C. and Joye, K.A. (2006). Prevalence of overweight misperception and weight control behaviors among normal weight adolescents in the United States. The Scientific World Journal, 6, 365-373.
42. Tanner, M.A., and Young, M.A. (1985). Modeling agreement among raters. Journal of the American Statistical Association, 80, 175-180.
43. Williamson, J.M., Manatunga, A.K. and Lipsitz, S.R. (2000). Modeling kappa for measuring dependent categorical agreement data. Biostatistics, 1, 191-202.
44. Winn, D.M., Johnson, C.L. and Kingman, A. (1999). Periodontal disease estimates in NHANES III: Clinical measurement and complex sample design issues. Journal of Public Health Dentistry, 59, 73-78.
45. Woodruff, R.S. (1971). A simple method for approximating the variance of a complicated estimate. Journal of the American Statistical Association, 66, 411-414.
46. Zar, J.H. (1996). Biostatistical Analysis. Upper Saddle River. New Jersey: Prentice Hall International.