When Do Latent Class Models Overstate Accuracy for Diagnostic and Other Classifiers in the Absence of a Gold Standard?

Biometrics

Volumn 68, Issue 2, 2012, Pages 559-566

  Spencer, Bruce D ^a  

^a NORTHWESTERN UNIVERSITY   (United States)

Author keywords

Classification error; Diagnostic test; Jury; Latent class model; Sensitivity; Specificity; Validity

Indexed keywords

DIAGNOSIS; ERRORS;

CLASSIFICATION ERRORS; DIAGNOSTIC TESTS; ERROR RATE; GOLD STANDARDS; JURY; LATENT CLASS MODEL; SENSITIVITY; SPECIFICITY; TYPE I AND TYPE II ERRORS; VALIDITY;

RANDOM PROCESSES;

ACCURACY ASSESSMENT; ERROR ANALYSIS; NUMERICAL MODEL; SENSITIVITY ANALYSIS;

EID: 84862891264     PISSN: 0006341X     EISSN: 15410420     Source Type: Journal    
DOI: 10.1111/j.1541-0420.2011.01694.x     Document Type: Article

References (36)

1. Afdhal, N. H. (2004). Biopsy or biomarkers: Is there a gold standard for diagnosis of liver fibrosis? Clinical Chemistry 50, 1299-1300.
2. Albert, P. S. and Dodd, L. E. (2004). A cautionary note on the robustness of latent class models for estimating diagnostic error without a gold standard. Biometrics 60, 427-435.
3. Albert, P. S., McShane, L. M., Shih, J. H., and the U.S. National Cancer Institute Bladder Tumor Marker Network (2001). Latent class modeling approaches for assessing diagnostic error without a gold standard: With applications to p53 immunohistochemical assays in bladder tumors. Biometrics 57, 610-619.
4. Berkson, J. (1947). Cost-utility as a measure of the efficiency of a test. Journal of the American Statistical Association 42, 246-255.
5. Bertrand, P., Bénichou, J., Grenier, P., and Chastang, C. (2005). Hui and Walter's latent-class reference-free approach may be more useful in assessing agreement than diagnostic performance. Journal of Clinical Epidemiology 58, 688-700.
6. Biemer, P. P. (2011). Latent Class Analysis of Survey Error. New York : Wiley.
7. Blackstone, W. (1825). Commentaries on the Laws of England. Book the Fourth, 16th edition. London : Strahan.
8. Bronsvoort, B. M. d. C., Wissmann, B. v., Fèvre, E. M., Handel, I. G., Picozzi, K., and Welburn, S. C. (2010). No gold standard estimation of the sensitivity and specificity of two molecular diagnostic protocols for Trypanosoma brucei spp. in western Kenya. PLoS ONE 5, e8628. doi:.
9. Clogg, C. C. (1995). Latent class models. In Handbook of Statistical Modeling for the Social and Behavioral Sciences, G. Arminger, C. C. Clogg, and M. E. Sobel (eds), 311-359. New York : Plenum.
10. Cochran, W. G. (1951). Improvement by means of selection. In Second Berkeley Symposium on Mathematical Statistics and Probability, J. Neyman (ed.), 449-470. Berkeley, California : University of California Press.
11. Cronbach, L. J. and Gleser, G. C. (1957). Psychological Tests and Personnel Decisions. Urbana, Illinois: University of Illinois Press.
12. Espeland, M. A. and Handelman, S. L. (1989). Using latent class models to characterize and assess relative error in discrete measurements. Biometrics 45, 587-599.
13. Garrett, E. S., Eaton, W. W., and Zeger, S. (2002). Methods for evaluating the performance of diagnostic tests in the absence of a gold standard: A latent class model approach. Statistics in Medicine 21, 1289-1307.
14. Gastwirth, J. L. and Sinclair, M. D. (1998). Diagnostic test methodology in the design and analysis of judge-jury agreement studies. Jurimetrics 39, 59-78.
15. Hadgu, A. and Qu, Y. (1998). A biomedical application of latent class models with random effects. Applied Statistics 47, 606-616.
16. Hall, P. and Zhou, X.-H. (2003). Nonparametric estimation of component distributions in a multivariate mixture. The Annals of Statistics 31, 201-224.
17. Holland, P. W. and Rosenbaum, P. R. (1986). Conditional association and unidimensionality in monotone latent variable models. The Annals of Statistics 14, 1523-1543.
18. Hui, S. L. and Walter, S. D., (1980). Estimating the error rates of diagnostic tests. Biometrics 36, 167-171.
19. Hui, S. L. and Zhou, X. H. (1998). Evaluation of diagnostic tests without gold standards. Statistical Methods in Medical Research 7, 354-370.
20. Julious, S. A. and Mullee, M. A. (1994). Confounding and Simpson's paradox. British Medical Journal 209, 1480-1481.
21. Kalven, H. and Zeisel, H. (1966). The American Jury. Boston, Massachusetts: Little Brown.
22. Keyfitz, N. (1977). Applied Mathematical Demography. New York : Wiley.
23. Kreuter, F., Yan, T., and Tourangeau, R. (2008). Good item or bad-can latent class analysis tell? The utility of latent class analysis for the evaluation of survey questions. Journal of the Royal Statistical Society, Series A 171, 723-738.
24. Laudan, L. (2006). Truth, Error, and Criminal Law: An Essay in Legal Epistemology. New York : Cambridge University Press.
25. Pepe, M. S. and Janes, H. (2007). Insights into latent class analysis of diagnostic test performance. Biostatistics 8, 474-484.
26. Qu, Y. and Hadgu, A. (1998). A model for evaluating sensitivity and specificity for correlated diagnostic tests in efficiency studies with an imperfect reference test. Journal of the American Statistical Association 93, 920-928.
27. Qu, Y., Tan, M., and Kutner, M. H. (1996). Random effects models in latent class analysis for evaluating accuracy of diagnostic tests. Biometrics 52, 797-810.
28. Sackett, D. L. and Haynes, R. B. (2002). The architecture of diagnostic research. British Medical Journal 324, 539-541.
29. Spencer, B. D. (2007). Estimating the accuracy of jury verdicts. Journal of Empirical Legal Studies 4, 305-329.
30. Torrance-Rynard, V. L. and Walter, S. D. (1997). Effects of dependent errors in the assessment of diagnostic test performance. Statistics in Medicine 16, 2157-2175.
31. Uebersax, J. S. (1988). Validity inferences from interobserver agreement. Psychological Bulletin 104, 405-416.
32. Vacek, P. M. (1985). The effect of conditional dependence on the evaluation of diagnostic tests. Biometrics 41, 959-968.
33. Volokh, A. (1997). n guilty men. University of Pennsylvania Law Review 146, 173-216.
34. Wells, A. U. (2004). Histopathologic diagnosis in diffuse lung disease: An ailing gold standard. American Journal of Respiratory and Critical Care Medicine 170, 828-829.
35. Xu, H. and Craig, B. A. (2009). A probit latent class model with general correlation structures for evaluating accuracy of diagnostic tests. Biometrics 65, 1145-1155.
36. Yang, I. and Becker, M. P. (1997). Latent variable modeling of diagnostic accuracy. Biometrics 53, 948-958.