Estimating the mean and standard deviation of environmental data with below detection limit observations: Considering highly skewed data and model misspecification

Chemosphere

Volumn 138, Issue , 2015, Pages 599-608

  Shoari, Niloofar ^a,b   Dubé, Jean Sébastien ^a,b   Chenouri, Shoja'eddin ^a,b  

^a ÉCOLE DE TECHNOLOGIE SUPÉRIEURE   (Canada)

^b UNIVERSITY OF WATERLOO   (Canada)

Author keywords

Kaplan Meier; Left censored; Maximum likelihood; Regression on order statistics

Indexed keywords

CODES (SYMBOLS); HIGHER ORDER STATISTICS; MAXIMUM LIKELIHOOD; MAXIMUM LIKELIHOOD ESTIMATION; REGRESSION ANALYSIS;

CONCENTRATION MEASUREMENT; KAPLAN-MEIER; LEFT-CENSORED; MAXIMUM LIKELIHOOD ESTIMATORS (MLE); MEAN AND STANDARD DEVIATIONS; MODEL MISSPECIFICATION; NONPARAMETRIC APPROACHES; REGRESSION ON ORDER STATISTICS;

WEIBULL DISTRIBUTION;

CONCENTRATION (COMPOSITION); DATA INTERPRETATION; DETECTION METHOD; ESTIMATION METHOD; INSTRUMENTATION; MAXIMUM LIKELIHOOD ANALYSIS; REGRESSION ANALYSIS; SKEWNESS; WEIBULL THEORY;

ARTICLE; DATA ANALYSIS; ENVIRONMENTAL MONITORING; GAMMA REGRESSION ON ORDER STATISTIC; KAPLAN MEIER METHOD; LIMIT OF DETECTION; MAXIMUM LIKELIHOOD METHOD; MEASUREMENT; MONTE CARLO METHOD; NONPARAMETRIC TEST; ROBUST REGRESSION ON ORDER STATISTIC; SAMPLE SIZE; SOIL; STATISTICAL ANALYSIS; STATISTICAL PARAMETERS; ENVIRONMENT; STATISTICAL MODEL;

CANADA; MONTREAL; QUEBEC [CANADA];

ENVIRONMENT; LIKELIHOOD FUNCTIONS; LIMIT OF DETECTION; MODELS, STATISTICAL; SAMPLE SIZE;

EID: 84940952317     PISSN: 00456535     EISSN: 18791298     Source Type: Journal    
DOI: 10.1016/j.chemosphere.2015.07.009     Document Type: Article

References (33)

1. Baccarelli A., Pfeiffer R., Consonni D., Pesatori A., Bonzini M., Patterson D.G., Bertazzi P., Landi M. Handling of dioxin measurement data in the presence of non-detectable values: overview of available methods and their application in the Seveso chloracne study. Chemosphere 2005, 60:898-906.
2. Caudill S.P., Wong L.-Y., Turner W.E., Lee R., Henderson A., Patterson D.G. Percentile estimation using variable censored data. Chemosphere 2007, 68:169-180.
3. El-Shaarawi A. Inferences about the mean from censored water quality data. Water Resourc. Res. 1989, 25:685-690.
4. El-Shaarawi A.H., Piegorsch W.W. Encyclopedia of Environmetrics 2012, John Wiley & Sons. second ed.
5. EPA (Environmental Protection Agency), 2006. Data Quality Assessment: Statistical Methods for Practitioners. EPA/240/B-06/002. Office of Environmental Information, Washington, DC, USA.
6. European Food Safety Authority Management of left-censored data in dietary exposure assessment of chemical substances. EFSA J. 2010, 8:1-96.
7. Gardner M. Improving the interpretation of 'less than' values in environmental monitoring. Water Environ. J. 2012, 26:285-290.
8. Gilliom R.J., Helsel D.R. Estimation of distributional parameters for censored trace level water quality data 1. Estimation techniques. Water Resour. Res. 1986, 22:135-146.
9. He J. Mixture model based multivariate statistical analysis of multiply censored environmental data. Adv. Water Resour. 2013, 59:15-24.
10. Helsel D.R. Fabricating data: how substituting values for nondetects can ruin results, and what can be done about it. Chemosphere 2006, 65:2434-2439.
11. Helsel D. Much ado about next to nothing: incorporating nondetects in science. Ann. Occup. Hyg. 2010, 54:257-262.
12. Helsel D.R. Statistics for censored environmental data using Minitab and R 2012, Vol. 77. John Wiley & Sons.
13. Helsel D.R., Cohn T.A. Estimation of descriptive statistics for multiply censored water quality data. Water Resour. Res. 1988, 24:1997-2004.
14. Hewett P., Ganser G.H. A comparison of several methods for analyzing censored data. Ann. Occup. Hyg. 2007, 51:611-632.
15. Huybrechts T., Thas O., Dewulf J., Langenhove H.V. How to estimate moments and quantiles of environmental data sets with non-detected observations? a case study on volatile organic compounds in marine water samples. J. Chromatogr. A 2002, 975:123-133. Sample Handling.
16. Huynh T., Ramachandran G., Banerjee S., Monteiro J., Stenzel M., Sandler D.P., Engel L.S., Kwok R.K., Blair A., Stewart P.A. Comparison of methods for analyzing left-censored occupational exposure data. Ann. Occup. Hyg. 2014, 58:1126-1142.
17. Jain R.B., Caudill S.P., Wang R.Y., Monsell E. Evaluation of maximum likelihood procedures to estimate left censored observations. Anal. Chem. 2008, 80:1124-1132.
18. Jin Y., Hein M.J., Deddens J.A., Hines C.J. Analysis of lognormally distributed exposure data with repeated measures and values below the limit of detection using SAS. Ann. Occup. Hyg. 2011, 55:97-112.
19. Knight K. Mathematical Statistics. Texts in Statistical Science Series 2000, Chapman & Hall/CRC Press, Boca Raton, Fla.
20. Kroll C.N., Stedinger J.R. Estimation of moments and quantiles using censored data. Water Resour. Res. 1996, 32:1005-1012.
21. Kuttatharmmakul S., Smeyers-Verbeke J., Massart D., Coomans D., Noack S. The mean and standard deviation of data, some of which are below the detection limit: an introduction to maximum likelihood estimation. TrAC, Trends Anal. Chem. 2000, 19:215-222.
22. Lawless J.F. Statistical Models and Methods for Lifetime Data 2003, John Wiley & Sons, Hoboken, New Jersey.
23. Lee E.T., Wang J.W. Statistical Methods for Survival Data Analysis 2003, John Wiley & Sons.
24. Leith K.F., Bowerman W.W., Wierda M.R., Best D.A., Grubb T.G., Sikarske J.G. A comparison of techniques for assessing central tendency in left-censored data using PCB and p, p' DDE contaminant concentrations from Michigan's Bald Eagle Biosentinel Program. Chemosphere 2010, 80:7-12.
25. Lynn H.S. Maximum likelihood inference for left-censored HIV RNA data. Stat. Med. 2001, 20:33-45.
26. Ofungwu J. Statistical Applications for Environmental Analysis and Risk Assessment 2014, Wiley & Sons, Inc., Hoboken, New Jersey.
27. Perez A., Lefante J.J. Sample size determination and the effect of censoring when estimating the arithmetic mean of a lognormal distribution. Commun. Stat. Theory 1997, 26:2779-2801.
28. Schmoyeri R., Beauchamp J., Brandt C., Hoffman F. Difficulties with the lognormal model in mean estimation and testing. Environ. Ecol. Stat. 1996, 3:81-97.
29. She N. Analyzing censored water quality data using a non-parametric approach1. JAWRA J. Am. Water Resourc. Assoc. 1997, 33:615-624.
30. Shumway R.H., Azari R.S., Kayhanian M. Statistical approaches to estimating mean water quality concentrations with detection limits. Environ. Sci. Technol 2002, 36:3345-3353.
31. Singh, A., Singh, A.K., Iaci, R.J. 2002. Estimation of the exposure point concentration term using a gamma distribution. Technology Support Center Issue, EPA/600/R-02/084, EPA Technology Support Center for Monitoring and Site Characterization, Las Vegas, Nevada.
32. Singh A., Maichle R., Lee S.E., Sibert C. On the Computation of a 95% Upper Confidence Limit of the Unknown Population Mean Based Upon Data Sets with Below Detection Limit Observations 2006, US Environmental Protection Agency, Office of Research and Development.
33. Singh, A., Armbya, N., Singh, A. 2013. ProUCL Version 5.0.00 Technical Guide: Statistical Software for Environmental Applications for Data Sets with and without Nondetect Observations.