Comparison of scoring systems for invasive pests using ROC analysis and Monte Carlo simulations

Risk Analysis

Volumn 30, Issue 6, 2010, Pages 906-915

  Makowski, David ^a   Mittinty, Murthy Narasimha ^b  

^a INRA Institut National de la Recherche Agronomique   (France)

^b QUEENSLAND UNIVERSITY OF TECHNOLOGY   (Australia)

Author keywords

Invasive species; Pest risk assessment; ROC; Scoring systems; Sensitivity; Specificity; Stochastic model

Indexed keywords

ARITHMETIC MEAN; CUMULATIVE SUMS; INVASIVE SPECIES; MONTE CARLO SIMULATION; ORDINAL SCALE; PLANT PROTECTION; PROBABILISTIC MODELS; ROC; ROC ANALYSIS; SCORING SYSTEMS; SENSITIVITY AND SPECIFICITY; VIRTUAL DATA; WEIGHTED AVERAGES;

COMPUTER SIMULATION; MONTE CARLO METHODS; RISK MANAGEMENT; STOCHASTIC MODELS; STOCHASTIC SYSTEMS;

RISK ASSESSMENT;

ENVIRONMENTAL PROTECTION; INVASIVE SPECIES; MONTE CARLO ANALYSIS; NUMERICAL MODEL; PERFORMANCE ASSESSMENT; PEST SPECIES; PLANT-INSECT INTERACTION; QUESTIONNAIRE SURVEY; RISK ASSESSMENT; SENSITIVITY ANALYSIS; STOCHASTICITY;

ANIMAL; ARTICLE; COMPARATIVE STUDY; MONTE CARLO METHOD; RECEIVER OPERATING CHARACTERISTIC;

ANIMALS; MONTE CARLO METHOD; ROC CURVE;

EID: 77954101965     PISSN: 02724332     EISSN: 15396924     Source Type: Journal    
DOI: 10.1111/j.1539-6924.2010.01393.x     Document Type: Article

References (38)

1. IPPC. ISPM No. 11. Pest Risk Analysis for Quarantine Pests.
2. MacLeod A, Baker RHA. The EPPO pest risk assessment scheme: Assigning descriptions to scores for the questions on entry and establishment. EPPO Bulletin, 2003 33:313 320.
3. Rafoss T. Spatial stochastic simulation offers potential as a quantitative method for pest risk analysis. Risk Analysis, 2003 23 (4 651 661.
4. Stansbury CD, McKirdy SJ, Diggle AJ, Riley IT. Modelling the risk of entry, establishment, spread, containment, and economic impact of Tilletia indica, the cause of Karnal Bunt of Wheat, using an Australian context. Phytopathology, 2002 92:321 331.
5. Vose D. Risk Analysis, 2nd ed.
6. Roberts RG, Hale CN, van der Zwet T, Miller CE, Redlin SC. The potential for spread of Erwinia amylovora and fire blight via commercial apple fruit: A critical review and risk assessment. Crop Protection, 1998 17:19 28.
7. CFIA. Plant Health Risk Assessment.
8. USDA. USDA, APHIS, Qualitative Risk Assessment for Potential Federal Noxious Weeds - Template. Weed Risk Assessment Template - Version 5.3, 2004.
9. Pheloung PC, Williams PA, Halloy SR. A weed risk assessment model for use as a biosecurity tool evaluating plant introductions. Journal of Environmental Management, 1999 57:239 251.
10. Swets JA, Dawes RM, Monahan J. Better decisions through science. Scientific American, 2000 283:70 75.
11. Holt J. Score averaging for alien species risk assessment: A probabilistic alternative. Journal of Environmental Management, 2006 81:58 62.
12. Smith CS, Lonsdale WM, Fortune J. When to ignore advice: Invasion predictions and decision theory. Biological Invasions, 1999 1:89 96.
13. Hughes G, Madden LV. Evaluating predictive models with application in regulatory policy for invasive weeds. Agricultural Systems, 2003 76:755 774.
14. Copp GH, Vilizzi L, Mumford J, Fenwick GV, Godard MJ, Gozlan RE. Calibration of FISK, an invasiveness screening tool for non-native freshwater fishes. Risk Analysis, 2009 29:457 467.
15. Heidy Kikillus K, Hare KM, Hartley S. Minimizing false-negatives when predicting the potential distribution of an invasive species: A bioclimatic envelope for the red-eared slider at global and regional scales. Animal Conservation, 2010 13:1 11.
16. Peterson AT, Papeş M, Soberón J. Rethinking receiver operating characteristic analysis applications in ecological niche modelling. Ecological Modelling, 2008 213:63 72.
17. Taper ML, Staples DF, Shepard BB. Model structure adequacy analysis: Selecting models on the basis of their ability to answer scientific questions. Syntheses, 2008 163:357 370.
18. Bartell SM, Nair SK. Establishment risks for invasive species. Risk Analysis, 2003 24:833 845.
19. Peterson GL, Whitaker TB, Stefanski RJ, Podleckis EV, Phillips JG, Wu JS, Martinez WH. A risk assessment model for importation of United States milling wheat containing Tilletia contraversa. Plant Disease, 2009 93:560 575.
20. Gelman A, Carlin BJ, Stern SH, Rubin DB. Bayesian Data Analysis, 2nd ed.
21. CFIA. Canadian PHRA Rating Guidelines.
22. USDA. Guidelines for Pathway-Initiated Pest Risk Assessments, Version 5.02 USDA-APHIS-PPQ.
23. Biosecurity Australia. Guidelines for Import Risk Analysis: September 2001.
24. Mourichon X. Analyse du risque phytosanitaire Mycosphaerella fijiensis Morelet.
25. Sansford CE. Quantitative Versus Qualitative: Pest Risk Analysis in the UK and Europe Including the European and Mediterranean Plant Protection System, NAPPO PRA Symposium, Puerto Vallarta, Mexico, March 2002. Available at:http://www.nappo.org/PRA-Symposium/PDF-Final/Sansford.pdf, Accessed 2005.
26. Faraggi D, Reiser B. Estimation of the area under the ROC curve. Statistics in Medicine, 2002 21:3093 3106.
27. Makowski D, Denis J-B, Ruck L, Penaud A. A Bayesian approach to assess the accuracy of a diagnostic test based on plant disease measurement. Crop Protection, 2008 27:1187 1193.
28. Pepe MS. Three approaches to regression analysis of receiver operating characteristic curves for continuous test results. Biometrics, 1998 54:124 135.
29. O'Malley AJ, Zou KH, Fielding JR, Tempany CMC. Bayesian regression methodology for estimating a receiver operating characteristic curve with two radiologic applications: Prostate biopsy and spiral CT of ureteral stones. Academic Radiology, 2001 8:713 725.
30. Hanley JA, McNeil BJ. The meaning and use of the area under the receiver operating characteristic (ROC) curve. Radiology, 1982 143:29 36.
31. Sing T, Sander O, Beerenwinkel N, Lengauer T. ROCR: Visualizing classifier performance in R. Bioinformatics, 2005 21:3940 3941.
32. Vogt WP. Dictionary of Statistics and Methodology.
33. EPPO. Decision Support Scheme for Quarantine Pest PM5/3(3).
34. Australian Government Department of Agriculture, Fisheries and Forestry (AGDAFF). Import Risk Analysis Handbook.
35. Coombs C. Psychological scaling without a unit of measurement. Psychological Reviews, 1950 57:145 158.
36. Pearson K. On a new method of determining correlation between a measure character A and character B. Biometrika, 1909 7:96 105.
37. Higgins SJ, Richardson DM, Cowling RM. Modeling invasive plant spread: The role of plant-environment interactions and model structure. Ecology, 1996 77:2043 2054.
38. Cook DC, Thomas MB, Cunningham DL, De Barro PJ. Predicting the economic impact of an invasive species on an ecosystem service. Ecological Applications, 2007 17:1832 1840.