Consensus-based reporting standards for diagnostic test accuracy studies for paratuberculosis in ruminants

Preventive Veterinary Medicine

Volumn 101, Issue 1-2, 2011, Pages 18-34

  Gardner, Ian A ^a   Nielsen, Søren S ^b   Whittington, Richard J ^c   Collins, Michael T ^d   Bakker, Douwe ^e   Harris, Beth ^f   Sreevatsan, Srinand ^g   Lombard, Jason E ^h   Sweeney, Raymond ⁱ   Smith, David R ^j   Gavalchin, Jerrie ^k   Eda, Shigetoshi ^l  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF COPENHAGEN   (Denmark)

^c UNIVERSITY OF SYDNEY   (Australia)

^d UNIVERSITY OF WISCONSIN MADISON   (United States)

^e WAGENINGEN UNIVERSITY   (Netherlands)

^f National Veterinary Services Laboratories   (United States)

^g UNIVERSITY OF MINNESOTA   (United States)

^h CENTERS FOR EPIDEMIOLOGY AND ANIMAL HEALTH   (United States)

ⁱ UNIVERSITY OF PENNSYLVANIA   (United States)

^j UNIVERSITY OF NEBRASKA LINCOLN   (United States)

^k Department of Obstetrics Gynecology   (United States)

^l UNIVERSITY OF TENNESSEE   (United States)

more..

Author keywords

Paratuberculosis; Reporting standards; Sensitivity and specificity; STARD; Test accuracy

Indexed keywords

ANIMAL; ANIMAL DISEASE; ARTICLE; BOVIDS; CONSENSUS; DIAGNOSTIC PROCEDURE; DIAGNOSTIC TEST; LABORATORY DIAGNOSIS; METHODOLOGY; PARATUBERCULOSIS; PRACTICE GUIDELINE; PUBLIC RELATIONS; SENSITIVITY AND SPECIFICITY; STANDARD;

ANIMALS; CLINICAL LABORATORY TECHNIQUES; CONSENSUS; DIAGNOSTIC TESTS, ROUTINE; INTERPROFESSIONAL RELATIONS; PARATUBERCULOSIS; PRACTICE GUIDELINES AS TOPIC; RUMINANTS; SENSITIVITY AND SPECIFICITY; SPECIMEN HANDLING;

ANIMALIA; BOVIDAE;

EID: 79959529834     PISSN: 01675877     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.prevetmed.2011.04.002     Document Type: Article

References (65)

1. Adaska J.M., Munoz-Zanzi C.A., Hietala S.K. Evaluation of result variability with a commercial Johne's disease enzyme-linked immunosorbent assay kit and repeat testing of samples. J. Vet. Diagn. Invest. 2002, 14:423-426.
2. Alinovi C.A., Ward M.P., Lin T.L., Moore G.E., Wu C.C. Real-time PCR, compared to liquid and solid culture media and ELISA, for the detection of Mycobacterium avium ssp. paratuberculosis. Vet. Microbiol. 2009, 136:177-179.
3. Aly S.S., Mangold B.L., Whitlock R.H., Sweeney R.W., Anderson R.J., Jiang J., Schukken Y.H., Hovingh E., Wolfgang D., Van Kessel J.A., Karns J.S., Lombard J.E., Smith J.M., Gardner I.A. Correlation between Herrold egg yolk medium culture and real-time quantitative polymerase chain reaction results for Mycobacterium avium subspecies paratuberculosis in pooled fecal and environmental samples. J. Vet. Diagn. Invest. 2010, 22:677-683.
4. Bossuyt P.M., Reitsma J.B., Bruns D.E., Gatsonis C.A., Glasziou P.P., Irwig L.M., Lijmer J.G., Moher D., Rennie D., de Vet H.C.W. Towards complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative. Clin. Chem. 2003, 49:1-6.
5. Bossuyt P.M., Reitsma J.B., Bruns D.E., Gatsonis C.A., Glasziou P.P., Irwig L.M., Moher D., Rennie D., de Vet H.C.W., Lijmer J.G. The STARD statement for reporting studies of diagnostic accuracy: explanation and elaboration. Clin. Chem. 2003, 49:7-18.
6. Brealey S., Scally A.J., Thomas N.B. Review article: methodological standards in radiographer plain film reading performance studies. Br. J. Radiol. 2002, 75:107-113.
7. Buddle B.M., Wilson T., Denis M., Greenwald R., Esfandiari J., Lyashchenko K.P., Liggett S., Mackintosh C.G. Sensitivity, specificity, and confounding factors of novel serological tests used for the rapid diagnosis of bovine tuberculosis in farmed red deer (Cervus elaphus). Clin. Vaccine Immunol. 2010, 17:626-630.
8. Bustin S.A., Benes V., Garson J.A., Hellemans J., Huggett J., Kubista M., Mueller R., Nolan T., Pfaffl M.W., Shipley G.L., Vandesompele J., Wittwer C.T. The MIQE guidelines: minimum information for publication of quantitative real-time PCR experiments. Clin. Chem. 2009, 55:611-622.
9. Caraguel C., Stryhn H., Gagné N., Dohoo I., Hammell L. Traditional descriptive analysis and novel visual representation of diagnostic repeatability and reproducibility: application to an infectious salmon anaemia virus RT-PCR assay. Prev. Vet. Med. 2009, 92:9-19.
10. Christensen J., Gardner I.A. Herd-level interpretation of diagnostic tests. Prev. Vet. Med. 2000, 45:83-106.
11. Collins M.T., Angulo A., Buergelt C.D., Hennager S.G., Hietala S.K., Jacobson R.H., Whipple D.L., Whitlock R.H. Reproducibility of a commercial enzyme-linked immunosorbent assay for bovine paratuberculosis among eight laboratories. J. Vet. Diagn. Invest. 1993, 5:52-55.
12. Collins M.T., Wells S.J., Petrini K.R., Collins J.E., Schultz R.D., Whitlock R.H. Evaluation of five antibody detection tests for diagnosis of bovine paratuberculosis. Clin. Diagn. Lab. Immunol. 2005, 12:685-692.
13. Collins M.T., Gardner I.A., Garry F.B., Roussel A.J., Wells S.J. Consensus recommendations on diagnostic testing for the detection of paratuberculosis in cattle in the United States. J. Am. Vet. Med. Assoc. 2006, 229:1912-1919.
14. Coughlin S., Trock B., Criqui M., Pickle L., Browner D., Tefft M. The logistic modeling of sensitivity, specificity, and predictive value of a diagnostic test. J. Clin. Epidemiol. 1992, 45:1-7.
15. Dargatz D.A., Hill G.W. Analysis of survey data. Prev. Vet. Med. 1996, 28:225-237.
16. Dargatz D.A., Byrum B.A., Collins M.T., Goyal S.M., Hietala S.K., Jacobson R.H., Kopral C.A., Martin B.M., McCluskey B.J., Tewari D. A multilaboratory evaluation of a commercial enzyme-linked immunosorbent assay test for the detection of antibodies against Mycobacterium avium subsp. paratuberculosis. J. Vet. Diagn. Invest. 2004, 16:509-514.
17. Dennis M.M., Reddacliff L.A., Whittington R.J. Longitudinal study of clinicopathological features of Johne's disease in sheep naturally exposed to Mycobacterium avium subspecies paratuberculosis. Vet. Pathol. 2011, 48:565-575.
18. Detrano R., Gianrossi R., Froelicher V. The diagnostic accuracy of the exercise electrocardiogram: a meta-analysis of 22 years of research. Prog. Cardiovasc. Dis. 1989, 32:173-206.
19. Dohoo I., Martin W., Stryhn H. Veterinary Epidemiologic Research 2009, VER Inc., Charlottetown, Prince Edward Island, Canada.
20. Dorshorst N.C., Collins M.T., Lombard J.E. Decision analysis model for paratuberculosis control in commercial dairy herds. Prev. Vet. Med. 2006, 75:92-122.
21. Eamens G.J., Turner M.J., Whittington R.J. Sampling and repeatability of radiometric faecal culture in bovine Johne's disease. Vet. Microbiol. 2007, 119:184-193.
22. Elmore J.G., Feinstein A.R. A bibliography of publications on observer variability. J. Clin. Epidemiol. 1992, 45:567-580.
23. Gardner I.A. Quality standards are needed for reporting of test accuracy studies for animal diseases. Prev. Vet. Med. 2010, 97:136-143.
24. Greiner M., Gardner I.A. Epidemiologic issues in the validation of veterinary diagnostic tests. Prev. Vet. Med. 2000, 45:3-22.
25. Gumber S., Eamens G., Whittington R.J. Evaluation of a Pourquier ELISA kit in relation to agar gel immunodiffusion (AGID) test for assessment of the humoral immune response in sheep and goats with and without Mycobacterium paratuberculosis infection. Vet. Microbiol. 2006, 115:91-101.
26. Hendrick S.H., Duffield T.E., Kelton D.E., Leslie K.E., Lissemore K.D., Archambault M. Evaluation of enzyme-linked immunosorbent assays performed on milk and serum samples for detection of paratuberculosis in lactating dairy cows. J. Am. Vet. Med. Assoc. 2005, 22:424-428.
27. Hendrick S.H., Kelton D.F., Leslie K.E., Lissemore K.D., Archambault M., Bagg R., Dick P., Duffield T.E. Efficacy of monensin sodium for the reduction of fecal shedding of Mycobacterium avium subsp. paratuberculosis in infected dairy cattle. Prev. Vet. Med. 2006, 75:206-220.
28. Hendrick S.H., Duffield T.E., Leslie K.E., Lissemore K.D., Archambault M., Bagg R., Dick P., Kelton D.F. Monensin might protect Ontario, Canada dairy cows from paratuberculosis milk-ELISA positivity. Prev. Vet. Med. 2006, 76:237-248.
29. Hope A.F., Kluver P.F., Jones S.L., Condron R.J. Sensitivity and specificity of two serological tests for the detection of ovine paratuberculosis. Aust. Vet. J. 2000, 78:850-856.
30. Huda A., Jungersen G., Lind P. Longitudinal study of interferon-gamma, serum antibody and milk antibody responses in cattle infected with Mycobacterium avium subsp. paratuberculosis. Vet. Microbiol. 2004, 104:43-53.
31. Jordan D. Aggregate testing for the evaluation of Johne's disease herd status. Aust. Vet. J. 1996, 73:16-19.
32. Kawaji S., Taylor D.L., Mori Y., Whittington R.J. Detection of Mycobacterium avium subsp. paratuberculosis in ovine faeces by direct quantitative PCR has similar or greater sensitivity compared to radiometric culture. Vet. Microbiol. 2007, 125:36-48.
33. Kostoulas P., Leontides L., Enoe C., Billinis C., Florou M., Sofia M. Bayesian estimation of sensitivity and specificity of serum ELISA and faecal culture for diagnosis of paratuberculosis in Greek dairy sheep and goats. Prev. Vet. Med. 2006, 76:56-73.
34. Lijmer J.G., Mol B.W., Heisterkamp S., Bonsel G.J., Prins M.H., van der Meulen J.H., Bossuyt P.M.M. Empirical evidence of design-related bias in studies of diagnostic tests. J. Am. Med. Assoc. 1999, 282:1061-1066.
35. Lombard J.E., Byrem T.M., Wagner B.A., McCluskey B.J. Comparison of milk and serum enzyme-linked immunosorbent assays for diagnosis of Mycobacterium avium subspecies paratuberculosis infection in dairy cattle. J. Vet. Diagn. Invest. 2006, 18:448-458.
36. Manning E.J., Cushing H.F., Hietala S., Wolf C.B. Impact of Corynebacterium pseudotuberculosis infection on serologic surveillance for Johne's disease in goats. J. Vet. Diagn. Invest. 2007, 19:187-190.
37. McConnel C.S., Churchill R.C., Richard M.M., Corkhill C.M., Reddacliff L.A., Whittington R.J. Surgical method for biopsy of terminal ileum and mesenteric lymph node of sheep for detection of Mycobacterium avium subsp paratuberculosis. Aust. Vet. J. 2004, 82:149-151.
38. McKenna S.L., Keefe G.P., Barkema H.W., Sockett D.C. Evaluation of three ELISAs for Mycobacterium avium subsp. paratuberculosis using tissue and fecal culture as comparison standards. Vet. Microbiol. 2005, 110:105-111.
39. McKenna S.L., Sockett D.C., Keefe G.P., McClure J., VanLeeuwen J.A., Barkema H.W. Comparison of two enzyme-linked immunosorbent assays for diagnosis of Mycobacterium avium subsp. paratuberculosis. J. Vet. Diagn. Invest. 2005, 17:463-466.
40. Newcombe R.G. Two-sided confidence intervals for the single proportion: comparison of seven methods. Stat. Med. 1998, 17:857-872.
41. Nielsen S.S., Toft N. Ante mortem diagnosis of paratuberculosis: a review of accuracies of ELISA, interferon-γ assay and faecal culture techniques. Vet. Microbiol. 2008, 129:217-235.
42. Nielsen S.S., Grønbæk C., Agger J.F., Houe H. Maximum-likelihood estimation of sensitivity and specificity of ELISAs and faecal culture for diagnosis of paratuberculosis. Prev. Vet. Med. 2002, 53:191-204.
43. Nielsen S.S., Toft N., Gardner I. Structured approach to design of diagnostic test evaluation studies for chronic progressive infections in animals. Vet. Microbiol. 2011, 150:115-125.
44. Norton S., Johnson W.O., Jones G., Heuer C. Evaluation of diagnostic tests for Johne's disease (Mycobacterium avium subspecies paratuberculosis) in New Zealand dairy cows. J. Vet. Diagn. Invest. 2010, 22:341-351.
45. O'Connor A.M., Sargeant J.M., Gardner I.A., Dickson J.S., Torrence M.E., Dewey C.E., Dohoo I.R., Evans R.B., Gray J.T., Greiner M., Keefe G., Lefebvre S.L., Morley P.S., Ramirez A., Sischo W., Smith D.R., Snedeker K., Sofos J., Ward M.P., Wills R. The REFLECT Statement: methods and processes of creating reporting guidelines for randomized control trials for livestock and food safety by modifying the CONSORT Statement. Zoonoses Public Health 2010, 57:95-104.
46. Office International des Epizooties (OIE), 2010. Manual of Diagnostic Tests and Vaccines for Terrestrial Animals 2010. Available at (accessed February 23, 2011). http://www.oie.int/en/international-standard-setting/terrestrial-manual/access-online.
47. Peeling R.W., Smith P.G., Bossuyt P.G.P.M. A guide for diagnostic evaluations. Nat. Rev. Microbiol. 2006, 4(12 Suppl):S2-S6.
48. Philbrick J.T., Horwitz R.I., Feinstein A.R. Methodologic problems of exercise testing for coronary artery disease: groups, analysis and bias. Am. J. Cardiol. 1980, 46:807-812.
49. Pitt D.J., Pinch D.S., Janmaat A., Condron R.J. An estimate of specificity for a Johne's disease absorbed ELISA in northern Australian cattle. Aust. Vet. J. 2002, 80:57-60.
50. Ransohoff D.F., Feinstein A.R. Problems of spectrum and bias in evaluating the efficacy of diagnostic tests. New Eng. J. Med. 1978, 299:926-930.
51. Scott H.M., Fosgate G.T., Libal M.C., Sneed L.W., Erol E., Angulo A.B., Jordan E.R. Field testing of an enhanced direct-fecal polymerase chain reaction procedure, bacterial culture of feces, and a serum enzyme-linked immunosorbent assary for detecting Mycobacterium avium subsp. paratuberculosis in adult dairy cattle. Am. J. Vet. Res. 2007, 68:236-245.
52. Sergeant E.S., Whittington R.J., More S.J. Sensitivity and specificity of pooled faecal culture and serology as flock-screening tests for detection of ovine paratuberculosis in Australia. Prev. Vet. Med. 2002, 52:199-211.
53. Sergeant E.S., Marshall D.J., Eamens G.J., Kearns C., Whittington R.J. Evaluation of an absorbed ELISA and an agar-gel immuno-diffusion test for ovine paratuberculosis in sheep in Australia. Prev. Vet. Med. 2003, 61:235-248.
54. TDR Evaluation of diagnostic tests for infectious diseases: general principles. Nat. Rev. Microbiol. 2006, 4(Suppl. 12):S20-S32. TDR Diagnostics Evaluation Expert Panel.
55. Turenne C.Y., Wallace R., Behr M.A. Mycobacterium avium in the postgenomic era. Clin. Microbiol. Rev. 2007, 20:205-229.
56. Van Weering H., van Schaik G., van der Meulen A., Waal M., Franken P., van Maanen K. Diagnostic performance of the Pourquier ELISA for detection of antibodies against Mycobacterium avium subspecies paratuberculosis in individual milk and bulk milk samples of dairy herds. Vet. Microbiol. 2007, 125:49-58.
57. Varges R., Marassi C.D., Oelemann W., Lilenbaum W. Interference of intradermal tuberculin tests on the serodiagnosis of paratuberculosis in cattle. Res. Vet. Sci. 2009, 86:371-372.
58. Wells S.J., Collins M.T., Faaberg K.S., Wees C., Tavornpanich S., Petrini K.R., Collins J.E., Cernicchiaro N., Whitlock R.H. Evaluation of a rapid fecal PCR test for detection of Mycobacterium avium subsp. paratuberculosis in dairy cattle. Clin. Vaccine Immunol. 2006, 13:1125-1130.
59. Whiting P., Rutjes A.W.S., Reitsma J.B., Bossuyt P.M., Kleijnen J. The development of QUADAS: a tool for the quality assessment of studies of diagnostic accuracy included in systematic reviews. BMC Med. Res. Methodol. 2003, 3:25.
60. Whitlock R.H., Wells S.J., Sweeney R.W., Van Tiem J. ELISA and fecal culture for paratuberculosis (Johne's disease): sensitivity and specificity of each method. Vet. Microbiol. 2000, 77:387-398.
61. Whittington R.J. Factors affecting isolation and identification of Mycobacterium avium subsp. paratuberculosis from faecal and tissue samples in a liquid culture system. J. Clin. Microbiol. 2009, 47:614-622.
62. Whittington R.J. Cultivation of Mycobacterium avium subsp. paratuberculosis. Paratuberculosis. Organism, Disease Control 2010, 244-266. CABI, Wallingford. M.A. Behr, D.M. Collins (Eds.).
63. Whittington R.J., Sergeant E.S. Progress towards understanding the spread, detection and control of Mycobacterium avium subsp. paratuberculosis in animal populations. Aust. Vet. J. 2001, 79:267-278.
64. Whittington R.J., Fell S., Walker D., McAllister S., Marsh I., Sergeant E., Taragel C.A., Marshall D.J., Links I.J. Use of pooled fecal culture for sensitive and economic detection of Mycobacterium avium subsp. paratuberculosis infection in flocks of sheep. J. Clin. Microbiol. 2000, 38:2550-2556.
65. Wilks C. Editorial: Gold standards and fool's gold. Aust. Vet. J. 2001, 79:115.