Gibbs Sampling Will Fail in Outlier Problems with Strong Masking

Journal of Computational and Graphical Statistics

Volumn 5, Issue 2, 1996, Pages 176-189

  Justel, Ana ^a   Peña, Daniel ^a  

^a UNIVERSIDAD CARLOS III DE MADRID   (Spain)

Author keywords

Bayesian analysis; Leverage; Linear regression; Scale contamination

Indexed keywords

EID: 0030525165     PISSN: 10618600     EISSN: 15372715     Source Type: Journal    
DOI: 10.1080/10618600.1996.10474703     Document Type: Article

References (29)

1. Box, G. E. P., and Tiao, C. G. (1968), “A Bayesian Approach to Some Outlier Problems,” Biometrika, 55, 119-129.
2. Casella, G., and George, E. I. (1992), “Explaining the Gibbs Sampler,” The American Statistician, 46, 167-174.
3. Daniel, C., and Wood, F. S. (1980), Fitting Equations to Data, New York: John Wiley.
4. Escobar, M. D. (1994), “Estimating Normal Means With a Dirichlet Process Prior,” Journal of the American Statistical Association, 89, 268-277.
5. Escobar, M. D., and West, M. (1995), “Bayesian Density Estimation and Inference Using Mixtures,” Journal of the American Statistical Association, 90, 577-588.
6. Ferguson, T. S. (1973), “A Bayesian Analysis of Some Nonparametric Problems,” The Annals of Statistics, 1, 209-230.
7. Geisser, S. (1991), “Diagnostics, Divergences and Perturbation Analysis,” in The IMA Volumes in Mathematics and its Applications, eds. W. Stahel and S. Weisberg, 33, Berlin: Springer Verlag, pp. 89-100.
8. Gelfand, A. E., and Smith, A. F. M. (1990), “Sampling-Based Approaches to Calculating Marginal Densities,” Journal of the American Statistical Association, 85, 398—409.
9. Gelman, A., and Rubin, D. B. (1992), “A Single Series From the Gibbs Sampler Provides a False Sense of Security,” in Bayesian Statistics 4, eds. J. Bernardo et al., Cambridge, MA: Oxford University Press, pp. 625-631.
10. Geman, S., and Geman, D. (1984), “Stochastic Relaxation, Gibbs Distributions and the Bayesian Restoration of Images,” IEEE Transactions on Pattern Analysis and Machine Intelligence, 6, 721-741.
11. Guttman, I. (1973), “Care and Handling of Univariate or Multivariate Outliers in Detecting Spuriousity—A Bayesian Approach,” Technometrics, 15, 723-738.
12. Guttman, I., Dutter, R., and Freeman, P. R. (1978), “Care and Handing of Univariate Outliers in the General Linear Model to Detect Spuriousity—A Bayesian Approach,” Technometrics, 20, 187-193.
13. Guttman, I., and Pena, D. (1993), “A Bayesian Look at Diagnostic in the Univariate Linear Model,” Statistica Sinica, 3, 367-390.
14. Hawkins, D. M., Bradu, D., and Kass, G. V. (1984), “Location of Several Outliers in Multiple Regression Data Using Elemental Sets,” Technometrics, 26, 197-208.
15. Hills, S. E., and Smith, A. F. M. (1992), “Parametrization Issues in Bayesian Inference,” in Bayesian Statistics 4, eds. J. Bernardo et al., Cambridge, MA: Oxford University Press, pp. 227-246.
16. Liu, J., Wong, W. H., and Kong, A. (1994), “Covariance Structure of the Gibbs Sampler With Applications to the Comparisons of Estimators and Augmentation Schemes,” Biometrika, 81, 27-40.
17. MacEachem, S. N. (1994), “Estimating Normal Means With a Conjugate Style Dirichlet Process Prior,” Communications in Statistics, Simulation and Computing, 23, 727-741.
18. Matthews, P. (1993), “A Slowly Mixing Markov Chain With Implications for Gibbs Sampling,” Statistics and Probability Letters, 17, 231-236.
19. Mengersen, K. L., and Robert, C. P. (in press), “Testing for Mixtures: A Bayesian Entropie Approach,” Bayesian Statistics 5.
20. Müller, P., Erkanli, A., and West, M. (1992), “Bayesian Curve Fitting Using Multivariate Normal Mixtures,” ISDS Discussion Paper 92-A09, Duke University.
21. Pena, D., and Guttman, I. (1993), “Comparing Probabilistic Methods for Outlier Detection in Linear Models,” Biometrika, 80, 603-610.
22. Pettit, L. I., and Smith, A. F. M. (1985), “Outliers and Influential Observations in Linear Models,” in Bayesian Statistics 2, eds. J. Bernardo et al., Cambridge, MA: Oxford University Press, pp. 473-494.
23. Poison, N. G. (in press), “Convergence of Markov Chain Monte Carlo Algorithms,” Bayesian Statistics 5.
24. Rousseeuw, P. J. (1984), “Least Median of Squares Regression,” Journal of the American Statistical Association, 79, 871-880.
25. Rousseeuw, P. J., and Leroy, A. M. (1987), Robust Regression and Outlier Detection, New York: John Wiley.
26. Rousseeuw, P. J., and vanZomeren, B. C. (1990), “Unmasking Multivariate Outliers and Leverage Points” (with discussion), Journal of the American Statistical Association, 85, 633-651.
27. Smith, A. F. M., and Roberts, G. O. (1993), “Bayesian Computation via the Gibbs Sampler and Related Markov Chain Monte Carlo Methods” (with discussion), Journal of the Royal Statistical Society, Ser. B, 55, 3-24.
28. Tukey, J. W. (1960), “A Survey of Sampling From Contaminated Distributions,” Contributions to Probability and Statistics: Volume Dedicated to Harold Hotelling, Stanford, CA: Stanford University Press.
29. Verdinelli, I., and Wasserman, L. (1991), “Bayesian Analysis of Outlier Problems Using the Gibbs Sampler,” Statistics and Computing, 1, 105-117.