Data quality, performance, and uncertainty in taxonomic identification for biological assessments

Journal of the North American Benthological Society

Volumn 27, Issue 4, 2008, Pages 906-919

  Stribling, James B ^a   Pavlik, Kristen L ^a   Holdsworth, Susan M ^b   Leppo, Erik W ^a  

^a TETRA TECH INC   (United States)

^b U S ENVIRONMENTAL PROTECTION AGENCY   (United States)

Author keywords

Accuracy; Bioassessment; Data quality; Performance; Precision; Quality assurance quality control; Taxonomy; Uncertainty

Indexed keywords

ACCURACY ASSESSMENT; BIOLOGICAL SURVEY; DATA QUALITY; MACROINVERTEBRATE; PERFORMANCE ASSESSMENT; PRECISION; QUALITY CONTROL; TAXONOMY; UNCERTAINTY ANALYSIS;

NORTH AMERICA; UNITED STATES;

BAETIDAE; CERATOPOGONIDAE; CHIRONOMIDAE; HYDROPSYCHIDAE; ODONATA;

EID: 57649120952     PISSN: 08873593     EISSN: None     Source Type: Journal    
DOI: 10.1899/07-175.1     Document Type: Article

References (46)

1. st edition. American Public Health Association, American Water Works Association, and Water Environment Federation, Washington, DC.
2. BALL, S. L., P. D. N. HEBERT, S. K. BURIAN, AND J. M. WEBB. 2005. Biological identifications of mayflies (Ephemeroptera) using DNA barcodes. Journal of the North American Benthological Society 24:508-524.
3. BARBOUR, M. T., J. GERRITSEN, B. D. SNYDER, AND J. B. STRIBLING. 1999. Revision to the Rapid Bioassessment Protocols for streams and wadeable rivers: periphyton, benthic macroinvertebrates and fish. EPA/841-D-97-002. Office of Water, US Environmental Protection Agency, Washington, DC.
4. BERGER, W., H. MCCARTY, AND R. K. SMITH. 1996. Environmental laboratory data evaluation. Genium Publishing Corp., Amsterdam, New York.
5. CAO, Y., C. P. HAWKINS, AND M. R. VINSON. 2003. Measuring and controlling data quality in biological assemblage surveys with special reference to stream benthic macroinvertebrates. Freshwater Biology 48:1898-1911.
6. CHAPMAN, A. D. 2005. Principles of data quality. Version 1.0. Report for the Global Biodiversity Information Facility (GBIF). Global Biodiversity Information Facility, Copenhagen, Denmark. (Available from: http://www2.gbif.org/DataQuality.pdf)
7. CHESSMAN, B., S. WILLIAMS, AND C. BESLEY. 2007. Bioassessment of streams with macroinvertebrates: effect of sampled habitat and taxonomic resolution. Journal of the North American Benthological Society 26:546-565.
8. CLARKE, R. T. 2000. Uncertainty in estimates of biological quality based on RIVPACS. Pages 39-54 in J. F. Wright, D. W. Sutcliffe, and M. T. Furse (editors). Assessing the biological quality of fresh waters: RIVPACS and other techniques. Freshwater Biological Association, Ambleside, Cumbria, UK.
9. CLARKE, R. T., M. T. FURSE, J. F. WRIGHT, AND D. MOSS. 1996. Derivation of a biological quality index for river sites: comparison of the observed with the expected fauna. Journal of Applied Statistics 23:311-332.
10. CLARKE, R. T., J. F. WRIGHT, AND M. T. FURSE. 2003. RIVPACS models for predicting the expected macroinvertebrate fauna and assessing the ecological quality of rivers. Ecological Modeling 160:219-233.
11. CUFFNEY, T. F., M. D. BILGER, AND A. M. HAIGLER. 2007. Ambiguous taxa: effects on the characterization and interpretation of invertebrate assemblages. Journal of the North American Benthological Society 26:286-307.
12. DALCIN, E. C. 2004. Data quality concepts and techniques applied to taxonomic databases. PhD Thesis, School of Biological Sciences, Faculty of Medicine, Health and Life Sciences, University of Southampton, Southampton, UK. (Available from: http://www.dalcin.org/eduardo/downloads/ edalcin_thesis_submission.pdf)
13. DIAMOND, J. M., M. T. BARBOUR, AND J. B. STRIBLING. 1996. Characterizing and comparing bioassessment approaches and their results: a perspective. Journal of the North American Benthological Society 15:713-727.
14. DINES, R. A., AND J. A. D. MURRAY-B LIGH. 2000. Quality assurance and RIVPACS. Pages 71-78 in J. F. Wright, D. W. Sutcliffe, and M. T. Furse (editors). Assessing the biological quality of fresh waters: RIVPACS and other techniques. Freshwater Biological Association, Ambleside, Cumbria, UK.
15. nd edition. John Wiley and Sons, New York.
16. FLOTEMERSCH, J. E., J. B. STRIBLING, AND M. J. PAUL. 2006. Concepts and approaches for the bioassessment of non-wadeable streams and rivers. EPA/600/R-06/127. Office of Research and Development, US Environmental Protection Agency, Cincinnati, Ohio.
17. HAASE, P., J. MURRAY-BLIGH, S. LOHSE, S. PAULS, A. SUNDERMANN, R. GUNN, AND R. CLARKE. 2006. Assessing the impact of errors in sorting and identifying macroinvertebrate samples. Hydrobiologia 566:505-521.
18. HAWKINS, C. P. 2006. Quantifying biological integrity by taxonomic completeness: evaluation of a potential indicator for use in regional- and global-scale assessments. Ecological Applications 16:1277-1294.
19. HAWKINS, C. P., R. H. NORRIS, J. N. HOGUE, AND J. W. FEMINELLA. 2000. Development and evaluation of predictive models for measuring the biological integrity of streams. Ecological Applications 10:1456-1477.
20. HERBST, D. B., AND E. L. SILLDORF. 2006. Comparison of the performance of different bioassessment methods: similar evaluations of biotic integrity from separate programs and procedures. Journal of the North American Benthological Society 25:513-530.
21. HILL, B. H., A. T. HERLIHY, P. R. KAUFMANN, S. J. DECELLES, AND M. A. VANDER BORGH. 2003. Assessment of streams of the eastern United States using a periphyton index of biotic integrity. Ecological Indicators 2:325-338.
22. HILL, B. H., A. T. HERLIHY, P. R. KAUFMANN, R. J. STEVENSON, F. H. MCCORMICK, AND C. B. JOHNSON. 2000. Use of periphyton assemblage data as an index of biotic integrity. Journal of the North American Benthological Society 19:50-67.
23. HUGHES, R. M., P. R. KAUFMANN, A. T. HERLIHY, T. M. KINCAID, L. REYNOLDS, AND D. P. LARSEN. 1998. A process for developing and evaluating indices of fish assemblage integrity. Canadian Journal of Fisheries and Aquatic Sciences 55:1618-1631.
24. KARR, J. R., K. D. FAUSCH, P. L. ANGERMEIER, P. R. YANT, AND I. J. SCHLOSSER. 1986. Assessing biological integrity in running waters: a method and its rationale. Special publication 5. Illinois Natural History Survey, Champaign, Illinois.
25. KEITH, L. H. (EDITOR). 1988. Principles of environmental sampling. ACS Professional Reference Book. American Chemical Society, Columbus, Ohio.
26. KEITH, L. H. 1991. Environmental sampling and analysis. A practical guide. Lewis Publishers, Chelsea, Michigan.
27. KLEIN, B. D. 2001. Detecting errors in data: clarification of the impact of base rate expectations and incentives. Omega 29:391-404.
28. KLEMM, D. J., J. M. LAZORCHAK, AND P. A. LEWIS. 1998. Benthic macroinvertebrates. Pages 147-182 in J. M. Lazorchak, D. J. Klemm, and D. V. Peck (editors). Environmental monitoring and assessment program - surface waters: field operations and methods for measuring the ecological condition of wadeable streams. EPA/620/R-94/004F. US Environmental Protection Agency, Washington, DC.
29. MDEQ (MONTANA DEPARTMENT OF ENVIRONMENTAL QUALITY). 2006. Sample collection, sorting, and taxonomic identification of benthic macroinvertebrates. Standard operation procedure WQPBWQM-009, revision no. 2. Water Quality Planning Bureau, Montana Department of Environmental Quality, Helena, Montana. (Available from: http://www.deq.mt. gov/wqinfo/QAProgram/WQPBWQM-009rev2_final_web.pdf)
30. MOULTON, S. R., J. L. CARTER, S. A. GROTHEER, T. F. CUFFNEY, AND T. M. SHORT. 2000. Methods of analysis by the U.S. Geological Survey National Water Quality Laboratory - processing, taxonomy, and quality control of benthic macroinvertebrate samples. U.S. Geological Survey Open-File Report 00-212. National Water Quality Laboratory, US Geological Survey, Denver, Colorado.
31. NEW, T. R. 1996. Taxonomic focus and quality control in insect surveys for biodiversity conservation. Australian Journal of Entomology 35:97-106.
32. PAULSEN, S. G., A. MAYIO, D. V. PECK, J. L. STODDARD, E. TARQUINO, S. M. HOLDSWORTH, J. VAN SICKLE, L. L. YUAN, C. P. HAWKINS, A. T. HERLIHY, P. R. KAUFMANN, M. T. BARBOUR, D. P. LARSEN, AND A. R. OLSEN. 2008. Condition of stream ecosystems in the US: an overview of the first national assessment. Journal of the North American Benthological Society 27:812-821.
33. PETERS, J. A. 1988. Quality control infusion into stationary source sampling. Pages 317-333 in L. H. Keith (editor). Principles of environmental sampling. ACS Professional Reference Book. American Chemical Society, Columbus, Ohio.
34. SCHANDER, C., AND E. WILLASSEN. 2005. What can biological barcoding do for marine biology? Marine Biology Research 1:79-83.
35. SHAPIRO, M. H., S. M. HOLDSWORTH, AND S. G. PAULSEN. 2008. The need to assess the condition of aquatic resources in the US. Journal of the North American Benthological Society 27:808-811.
36. SHEWHART, W. A. 1986. Statistical method from the viewpoint of quality control. Dover Publications, New York.
37. SMITH, M. A., B. L. FISHER, AND P. D. N. HEBERT. 2005. DNA barcodmg for effective biodiversity assessment of a hyperdiverse arthropod group: the ants of Madagascar. Philosophical Transactions of the Royal Society of London Series B: Biological Sciences 360:1825-1834.
38. STODDARD, J. L., A. T. HERLIHY, D. V. PECK, R. M. HUGHES, T. R. WHITTIER, AND E. TARQUINIO. 2008. A process for creating multimetric indices for large-scale aquatic surveys. Journal of the North American Benthological Society 27:878-891.
39. STODDARD, J. L., D. V. PECK, S. C. PAULSEN, J. VAN SICKLE, C. P. HAWKINS, A. T. HERLIHY, R. M. HUGHES, P. R. KAUFMANN, D. P. LARSEN, G. LOMNICKY, A. R. OLSEN, S. A. PETERSON, P. L. RINGOLD, AND T. R. WHITTIER. 2005. An ecological assessment of western streams and rivers. EPA 620/R-05/005. US Environmental Protection Agency, Washington, DC.
40. STRIBLING, J. B., B. K. JESSUP, AND D. L. FELDMAN. 2008. Precision of benthic macroinvertebrate indicators of stream condition in Montana. Journal of the North American Benthological Society 27:58-67.
41. STRIBLING, J. B., S. R. MOULTON, AND G. L. LESTER. 2003. Determining the quality of taxonomic data. Journal of the North American Benthological Society 22:621-631.
42. USEPA (US ENVIRONMENTAL PROTECTION AGENCY). 2004a. Wadeable Stream Assessment: benthic laboratory methods. EPA 841-B-04007. Office of Water and Office of Research and Development, US Environmental Protection Agency, Washington, DC.
43. USEPA (US ENVIRONMENTAL PROTECTION AGENCY). 2004b. Wadeable Stream Assessment: field operations manual. EPA 841-B-04-004. Office of Water and Office of Research and Development, US Environmental Protection Agency, Washington, DC.
44. USEPA (US ENVIRONMENTAL PROTECTION AGENCY). 2006. Wadeable Streams Assessment. A collaborative survey of the nation's streams. EPA 841-B-06-002. Office of Research and Development and Office of Water, US Environmental Protection Agency Washington, DC.
45. VAN SICKLE, J., AND S. G. PAULSEN. 2008. Assessing the attributable risks, relative risks, and regional extents of aquatic stressors. Journal of the North American Benthological Society 27:920-931.
46. YUAN, L. L. 2007. Effects of measurement error on inferences of environmental conditions. Journal of the North American Benthological Society 26:152-163.