Bayesian measures of surprise for outlier detection

Journal of Statistical Planning and Inference

Volumn 111, Issue 1-2, 2003, Pages 3-22

  Bayarri, M J ^a   Morales, J ^b  

^a UNIVERSITY OF VALENCIA   (Spain)

^b MIGUEL HERNÁNDEZ UNIVERSITY   (Spain)

Author keywords

Bayes factors; Nuisance parameters; Partial posterior predictive p value; Posterior predictive p value; Prior predictive p value

Indexed keywords

EID: 0037290207     PISSN: 03783758     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0378-3758(02)00282-3     Document Type: Article

References (69)

1. Abraham, B., Box, G.E.P., 1978. Linear models and spurious observations. Appl. Statist. 27, 120-130.
2. Aitkin, M., 1991. Posterior Bayes factors. J. Roy. Statist. Soc. Ser. B 53, 111-142.
3. Barnett, V., Lewis, T., 1996. Outliers in Statistical Data, 3rd Edition. Wiley, Chichester, UK.
4. Bayarri, M.J., Berger, J.O., 1994. Robust Bayesian bounds for outlier detection. In: Vilaplana, J.P., Puri, M.L. (Eds.), Recent Advances in Statistics and Probability, North-Holland, Amsterdam, pp. 175-190.
5. Bayarri, M.J., Berger, J.O., 1997. Measures of surprise in Bayesian analysis. ISDS Discussion paper, 97-46, Duke University.
6. Bayarri, M.J., Berger, J.O., 1999. Quantifying surprise in the data and model verification. In: Bernardo, J.M., Berger, J.O., Dawid, A.P., Smith, A.F.M. (Eds.), Bayesian Statistics, Vol. 6. Oxford University Press, Oxford, pp. 53-82.
7. Bayarri, M.J., Berger, J.O., 2000. P-values for composite null models. J. Amer. Statist. Assoc. 95, 1127-1142.
8. Bayarri, M.J., Morales, J., 1999. Bayesian measures of surprise for outlier detection. ISDS Discussion paper, 99-38, Duke University.
9. Berger, J.O., 1985. Statistical Decision Theory and Bayesian Analysis, 2nd Edition. Springer, New York.
10. Berger, J.O., Pericchi, L.R., 1996. The intrinsic Bayes factor for model selection and prediction. J. Amer. Statist. Assoc. 91, 109-122.
11. Berger, J.O., Sellke, T., 1987. Testing a point null hypothesis: the irreconciability of significance levels and evidence. J. Amer. Statist. Assoc. 82, 112-122.
12. Berger, J.O., Pericchi, L.R., Varshavsky, J., 1998. Bayes factors and marginal distributions in invariant situations. Sankhyā A 60, 307-321.
13. Box, G.E.P., 1980. Sampling and Bayes inference in scientific modeling and robustness. J. Roy. Statist. Soc. Ser. A 143, 383-430.
14. Box, G.E.P., Tiao, G.C., 1968. A Bayesian approach to some outlier problems. Biometrika 55, 119-129.
15. Bradlow, E.T., Zaslavsky, A., 1997. Case influence analysis in Bayesian inference. J. Comput. Graphical Statist. 6, 314-331.
16. Chaloner, K., 1994. Residual analysis and outliers in Bayesian hierarchical models. In: Smith, A., Freeman, P. (Eds.), Aspects of Uncertainty. Wiley, Chichester, UK.
17. Chaloner, K., Brant, R., 1988. A Bayesian approach to outlier detection and residual analysis. Biometrika 75, 651-659.
18. Dawid, A.P., 1973. Posterior expectations for large observations. Biometrika 60, 664-667.
19. DeFinetti, B., 1961. The Bayesian approach to the rejection of outliers. Proceedings of the Fourth Berkley Symposium on Probability and Statistics, Vol. 1. University Press, Berkley, CA, pp. 199-210.
20. Draper, D., 1996. Comment: utility, sensitivity analysis, and cross-validation in Bayesian model checking. Statist. Sinica 6, 760-767.
21. Evans, M., 1997. Bayesian inference procedures derived via the concept of relative surprise. Commun. Statist. Theory Meth. 26, 1125-1143.
22. Freeman, P.R., 1980. On the number of outliers in data from a linear model. In: Bernardo, J.M., DeGroot, M.H., Smith, A.F.M., Lindley, D.V. (Eds.), Bayesian Statistics. Valencia University Press, Valencia, pp. 349-365.
23. Geisser, S., 1980. Discussion of 'Sampling and Bayes inference in scientific modelling and robustness', by G.E.P. Box. J. Roy. Statist. Soc. Ser. A 143, 416-417.
24. Geisser, S., 1985. On the prediction of observables: a selective update. In: Bernardo, J.M., DeGroot, M.H., Smith, A.F.M., Lindley, D.V. (Eds.), Bayesian Statistics, Vol. 2. North-Holland, Amsterdam, pp. 203-229.
25. Geisser, S., 1987. Influential observations, diagnostics and discordancy tests. J. Appl. Statist. 14, 133-142.
26. Geisser, S., 1989. Predictive discordancy testing for exponential observations. Canad. J. Statist. 17, 19-26.
27. Geisser, S., 1990. Predictive approaches to discordancy testing. In: Geisser, S., Hodges, J.S., Press, S.J., Zellner, A. (Eds.), Bayesian and Likelihood Methods in Statistics and Econometrics. North-Holland, Amsterdam, pp. 321-335.
28. Gelfand, A.E., Dey, D.K., Chang, H., 1992. Model determination using predictive distributions with implementation via sampling-based methods. In: Bernardo, J.M., Berger, J.O., Dawid, A.P., Smith, A.F.M. (Eds.), Bayesian Statistics, Vol. 4. Clarendon Press, Oxford, pp. 147-167.
29. Gelman, A., Carlin, J.B., Stern, H.S., Rubin, D.B., 1995. Bayesian Data Analysis. Chapman & Hall, London.
30. Gelman, A., Meng, X.L., Stern, H., 1996. Posterior predictive assessment of model fitness via realized discrepancies (with discussion). Statist. Sinica 6, 733-807.
31. Girón, F.J., Martínez, M. L., Morcillo, C., 1992. A Bayesian justification for the analysis of residuals and influence measures. In: Bernardo, J.M., Berger, J.O., Dawid, A.P., Smith, A.F.M. (Eds.), Bayesian Statistics, Vol. 4. Clarendon Press, Oxford, pp. 365-388.
32. Gómez-Villegas, M.A., Maín, M., 1992. The influence of prior and likelihood tail behavior on the posterior distribution. In: Bernardo, J.M., Berger, J.O., Dawid, A.P., Smith, A.F.M. (Eds.), Bayesian Statistics, Vol. 4. Clarendon Press, Oxford, pp. 661-667.
33. Good, I.J., 1953. The appropriate mathematical tools for describing and measuring uncertainty. In: Carter, C.F., Meredith, G.P., Shackle, G.L.S. (Eds.), Uncertainty and Business Decisions. University Press, Liverpool, pp. 19-34.
34. Good, I.J., 1956. The surprise index for the multivariate normal distribution. Ann. Math. Statist. 27, 1130-1135.
35. Grubbs, F.E., 1956. Procedures for detecting outlying observations in samples. Technometrics 11, 1-21.
36. Guttman, I., 1967. The use of the concept of a future observation in goodness of fit problems. J. Roy. Statist. Soc. Ser. B 29, 83-100.
37. Guttman, I., 1973. Care and handling of univariate or multivariate outliers in detecting spuriosity: a Bayesian approach. Technometrics 15, 723-738.
38. Guttman, I., Dutter, R., Freeman, P.R., 1978. Care and handling of univariate outliers in the general linear model to detect spuriosity: a Bayesian approach. Technometrics 20, 187-193.
39. Guttman, I., Peña, 1988. Outliers and influence: evaluation by posteriors of parameters in the linear model. In: Bernardo, J.M., DeGroot, M.H., Smith, A.F.M., Lindley, D.V. (Eds.), Bayesian Statistics, Vol. 3. Clarendon Press, Oxford, pp. 631-640.
40. Hoeting, J., Raftery, A.E., Madigan, D., 1996. A method for simultaneous variable selection and outlier identification in linear regression. Comput. Statist. Data Anal. 22, 251-270.
41. Matthews, R., 1998. The great health hoax. The Sunday Telegraph, September 13 Review.
42. Meng, X.L., 1994. Posterior predictive p-values. Ann. Statist. 22, 1142-1160.
43. O'Hagan, A., 1979. On outlier rejection phenomena in Bayes inference. J. Roy. Statist. Soc. Ser. B 41, 358-367.
44. O'Hagan, A., 1988. Modelling with heavy tails. In: Bernardo, J.M., DeGroot, M.H., Smith, A.F.M., Lindley, D.V. (Eds.), Bayesian Statistics, Vol. 3. Clarendon Press, Oxford, pp. 631-640.
45. O'Hagan, A., 1990. Outliers and credence for location parameter inference. J. Amer. Statist. Assoc. 85, 172-176.
46. O'Hagan, A., 1994. Kendall's Advance Theory of Statistics, Vol. 2B: Bayesian Inference. Edward Arnold, London.
47. O'Hagan, A., 1995. Fractional Bayes factors for model comparison. J. Roy. Statist. Soc. Ser. B 57, 99-138.
48. Peña, D., Tiao, G.C., 1992. Bayesian robustness functions for linear models. In: Bernardo, J.M., Berger, J.O., Dawid, A.P., Smith, A.F.M. (Eds.), Bayesian Statistics, Vol. 4. Clarendon Press, Oxford, pp. 365-388.
49. Peña, D., Yohai, 1999. A fast procedure for outlier diagnostics in large regression problems. J. Amer. Statist. Assoc. 94, 434-445.
50. Pérez, J.M., Berger, J.O., 2000. Expected posterior prior distributions for model selection. ISDS Discussion paper, 00-08, Duke University.
51. Pettit, L.I., 1988. Bayes methods for outliers in exponential samples. J. Roy. Statist. Soc. Ser. B 50, 371-380.
52. Pettit, L.I., 1990. The conditional predictive ordinate for the normal distribution. J. Roy. Statist. Soc. Ser. B 52, 175-184.
53. Pettit, L.I., 1992. Bayes factors for outlier models using the device of imaginary observations. J. Amer. Statist. Assoc. 87, 541-545.
54. Pettit, L.I., Smith, A.F.M., 1983. Bayesian model comparison in the presence of outliers. Bull. Internat. Statist. Inst. 50, 292-309.
55. Pettit, L.I., Smith, A.F.M., 1985. Outliers and influential observations in linear models. In: Bernardo, J.M., DeGroot, M.H., Smith, A.F.M., Lindley, D.V. (Eds.), Bayesian Statistics, Vol. 2. North-Holland, Amsterdam, pp. 473-494.
56. Roberts, H.V., 1965. Probabilistic prediction. J. Amer. Statist. Assoc. 60, 50-62.
57. Robins, J.M., Van der Vaart, A., Ventura, V., 2000. The Asymptotic distribution of p-values in composite null models. J. Amer. Statist. Assoc. 95, 1143-1157.
58. Rubin, D.B., 1984. Bayesian justifiable and relevant calculations for the applied statistician. Ann. Statist. 12, 1151-1172.
59. Sellke, T., Bayarri, M.J., Berger, J.O., 2001. Calibration of p-values for precise null hypothesis. Amer. Stat. 55, 62-71.
60. Spiegelhalter, D.J., Smith, A.F.M., 1982. Bayes factors for linear and log-linear models with vague prior information. J. Roy. Statist. Soc. Ser. B 44, 377-387.
61. Verdinelli, I., Wasserman, L., 1991. Bayesian analysis of outlier problems using the Gibbs sampler. Statist. Comput. 1, 105-117.
62. Weaver, W., 1948. Probability, rarity, interest and surprise. Sci. Monthly 67, 390-392.
63. Weaver, W., 1963. Lady Luck: The Theory of Probability. Doubleday, New York.
64. Weiss, R., 1994. Residuals and outliers in Bayesian random effects model. Discussion paper, Vol. 161, University of California at Los Angeles, Department of Biostatistics.
65. Weiss, R., 1996. An approach to Bayesian sensitivity analysis. J. Roy. Statist. Soc. Ser. B 58, 739-750.
66. West, M., 1984. Outlier models and prior distributions in Bayesian linear regression. J. Roy. Statist. Soc. Ser. B 46, 431-439.
67. West, M., 1985. Generalized linear models; scale parameters, outlier accommodation and prior distributions. In: Bernardo, J.M., DeGroot, M.H., Smith, A.F.M., Lindley, D.V. (Eds.), Bayesian Statistics, Vol. 2. North-Holland, Amsterdam, pp. 531-558.
68. Zaslavsky, A., Bradlow, E.T., 1997. Posterior predictive outlier detection using sample reweighting. ASA Proceedings of the Section on Bayesian Statistical Science, pp. 66-71.
69. Zellner, A., 1975. Bayesian analysis of regression error terms. J. Amer. Statist. Assoc. 70, 138-144.