Idiot's Bayes - Not so stupid after all?

International Statistical Review

Volumn 69, Issue 3, 2001, Pages 385-398

  Hand, David J ^a   Yu, Keming ^b  

^a IMPERIAL COLLEGE LONDON   (United Kingdom)

^b UNIVERSITY OF PLYMOUTH   (United Kingdom)

Author keywords

Diagnosis; Independence model; Na ve Bayes; Simple Bayes; Supervised classification

Indexed keywords

EID: 0035528674     PISSN: 03067734     EISSN: None     Source Type: Journal    
DOI: 10.1111/j.1751-5823.2001.tb00465.x     Document Type: Article

References (85)

1. Adams, I.D., Chan, M., Clifford, P.C., et al. (1986). Computer-aided diagnosis of acute abdominal pain: a multicentre study. British Medical Journal, 293, 800-804.
2. Adams, N.M. & Hand, D.J. (1999). Comparing classifiers when the misallocation costs are uncertain. Pattern Recognition, 32, 1139-1147.
3. Altham, P.M.E. (1984). Improving the precision of estimation by fitting a model. Journal of the Royal Statistical Society, Series B, 46, 118-119.
4. Bailey, N.T.J. (1964). Probability methods of diagnosis based on small samples. In Mathematics and Computer Science in Biology and Medicine, pp. 103-107. London: HMSO.
5. Barker, D.J.P. & Bishop, J.M. (1970). Computer analysis of symptom patterns as a method of screening patients at a special risk of hyperthyroidism. British Journal of Preventive and Social Medicine, 24, 193-196.
6. Boyle, J.A., Greig, W.R., Franklin, D.A., Harden, R.M., Buchanan, W.W. & McGirr, E. (1966). Construction of a model for computer-assisted diagnosis: application to the problem of non-toxic goitre. Quarterly Journal of Medicine, 35, 565-588.
7. Brunk, H.D., Thomas, D.R., Elashoff, R.M. & Zippin, C. (1975). Computer aided prognosis. In Perspectives in Biometrics, Ed. R.M. Elashoff, Vol. 1, New York: Academic Press.
8. Cestnik, B. (1990). Estimating probabilities: a crucial task in machine learning. Proceedings of the Ninth European Conference on Artificial Intelligence. Stockholm, Sweden: Pitman.
9. Cestnik, G., Kononenko, I. & Bratko, I. (1987). ASSISTANT-86: A knowledge elicitation tool for sophisticated users. In Progress in Machine Learning, Eds. I. Bratko and N. Lavrac. Sigma Press.
10. Clark, P. & Niblett, T. (1989). The CN2 induction algorithm. Machine Learning, 3, 261-283.
11. Coomans, D., Broeckaert, I., Jonckheer, M. & Massart, D.L. (1983). Comparison of multivariate discrimination techniques for clinical data application to the thyroid functional state. Methods of Information in Medicine, 22, 93-101.
12. Cornfield, J. (1971). Statistical classification methods. In Proceedings of the Symposium on the Diagnostic Process. University of Michigan Press, Ann Arbor, June.
13. Cornfield, J., Dunn, R.A., Batchlor, C. & Pipberger, H. (1973). Multigroup diagnosis of electrocardiograms. Computers and Biomedical Research, 6, 97.
14. Crichton, N.J., Fryer, J.G. & Spicer, C.C. (1987). Some points on the use of 'independent Bayes' to diagnose acute abdominal pain. Statistics in Medicine, 6, 945-959.
15. Crichton, N.J. & Hinde, J.P. (1988). Correspondence analysis and independent Bayes for clinical diagnosis. Proceedings of IMA Conference on Applications of Statistics in Medicine, pp. 235-247.
16. Crichton, N.J. & Hinde, J.P. (1989). Correspondence analysis as a screening method for indicants for clinical diagnosis. Statistics in Medicine, 8, 1351-1362.
17. Croft, D.J. & Machol, R.E. (1987). Mathematical models in medical diagnosis. Ann. Biomed. Engng., 2, 69-89.
18. Dawid, A.P. (1976). Properties of diagnostic data distributions. Biometrics, 32, 647-658.
19. de Dombal, F.T. (1991). The diagnosis of acute abdominal pain with computer assistance: worldwide perspective. Ann. Chir., 45, 273-277.
20. de Dombal, F.T., Leaper, D.J., Staniland, J.R., McCann, A. & Horrocks, J. (1972). Computer aided diagnosis of acute abdominal pain. British Medical Journal, 2, 9-13.
21. Domingos, P. & Pazzani, M. (1997). On the optimality of the simple Bayesian classifier under zero-one loss. Machine Learning, 29, 103-130.
22. Dougherty, J., Kohavi, R. & Sahami, M. (1995). Supervised and unsupervised discretization of continuous features. Proceedings of the Twelfth International Conference on Machine Learning, pp. 194-202. Tahoe City, California: Morgan Kaufman.
23. duBoulay, G.H., Teather, D., Harling, D. & Clark, G. (1977). Improvements in computer-assisted diagnosis of cerebral tumours. British Journal of Radiology, 50, 849-854.
24. Edwards, F.H. & Davies, R.S. (1984). Use of a Bayesian algorithm in the computer-assisted diagnosis of appendicitis. Surg. Gynecol. Obstet., 158, 219-222.
25. Efron, B. (1975). The efficiency of logistic regression compared to normal discriminant analysis. Journal of the American Statistical Association, 70, 892-898.
26. Fisher, R.A. (1936). The use of multiple measurements in taxonomic problems. Annals of Eugenics, 7, 179-188.
27. Fox, J., Barber, D. & Bardhan, K.D. (1980). A quantitative comparison with rule-based diagnostic inference. Methods of Information in Medicine, 19, 210-215.
28. Freund, Y. & Schapire, R. (1996). Experiments with a new boosting algorithm. In Proceedings of the 13th International Conference on Machine Learning, pp. 256-285.
29. Friedman, J.H. (1997). On bias, variance, 0/1-loss, and the curse of dimensionality. Data Mining and Knowledge Discovery, 1, 55-77.
30. Friedman, N., Geiger, D. & Goldszmidt, M. (1997). Bayesian network classifiers. Machine Learning, 29, 131-163.
31. Fryback, D.G. (1978). Bayes' theorem and conditional nonindependence of data in medical diagnosis. Computers and Biomedical Research, 11, 423-434.
32. Gammerman, A. & Thatcher, A.R. (1991). Bayesian diagnostic probabilities without assuming independence of symptoms. Methods of Information in Medicine, 30, 15-22.
33. Goldberg, D.P. (1972). The Detection of Psychiatric Illness by Questionnaire. Maudsley Monograph 21, London: Oxford University Press.
34. Good, I.J. (1965). The estimation of probabilities. Cambridge, Massachusetts: MIT Press.
35. Gunn, A.A. (1991). The acute abdomen: the role of computer-assisted diagnosis. Baillieres Clin. Gastroenterology, 5, 639-635.
36. Hand, D.J. (1981). Discrimination and Classification. Chichester: John Wiley and Sons.
37. Hand, D.J. (1982). Kernel Discriminant Analysis. Letchworth: Research Studies Press.
38. Hand, D.J. (1992). Statistical methods in diagnosis. Statistical Methods in Medical Research, 1, 49-67.
39. Hand, D.J. (1997). Construction and Assessment of Classification Rules. Chichester: John Wiley and Sons.
40. Hand, D.J. & Adams, N.M. (2000). Defining attributes for scorecard construction. Journal of Applied Statistics, 27, 527-540.
41. Heckerman, D.E., Horvitz, E.J. & Nathwani, B.N. (1992). Toward normative expert systems: Part I: the Pathfinder project. Methods of Information in Medicine, 31, 90-105.
42. Heckerman, D.E. & Nathwani, B.N. (1992). An evaluation of the diagnostic accuracy of Pathfinder. Computers and Biomedical Research, 25, 56-74.
43. Hilden, J. (1984). Statistical diagnosis based on conditional independence does not require it. Computers in Biology and Medicine, 14, 429-435.
44. Hilden, J. & Bjerregaard, B. (1976). Computer-aided diagnosis and the atypical case. In Decision Making and Medical Care: Can Information Science Help, Eds. F.T. de Dombal and F. Gremy, pp. 365-378. Amsterdam: North Holland.
45. Jeffreys, H. (1961). Theory of Probability. Oxford: Clarendon Press.
46. John, G. & Langley, P. (1995). Estimating continuous distributions in Bayesian classifiers. Proceedings of the Eleventh Conference on Uncertainy in Artificial Intelligence, pp. 338-345. Montreal, Canada: Morgan Kaufman.
47. Kelly, M.G., Hand, D.J. & Adams, N.M. (2000). Choosing good predictive models for consumer credit data. Technical Report TR-00-15, Department of Mathematics, Imperial College, London.
48. King, R.D., Feng, C. & Sutherland, A. (1995). STATLOG - comparison of classification algorithms on large real-world problems. Applied Artificial Intelligence, 9, 289-333.
49. Kohavi, R. (1996). Scaling up the accuracy of naïve-Bayes classifiers: a decision-tree hybrid. Proceedings of the Second International Conference on Knowledge Discovery and Data Mining, pp. 202-207. Portland, Oregon: AAAI Press.
50. Kononenko, I. (1990). Comparison of inductive and naïve Bayesian learning approaches to automatic knowledge acquisition. In Current trends in knowledge acquisition, Eds. B. Wielinga et al. . Amsterdam: IOS Press.
51. Kontkanen, P., Myllymäki, P., Silander, T. & Tirri, H. (1999). On supervised selection of Bayesian networks. In Proceedings of the 15th International Conference on Uncertainty in Artificial Intelligence, Eds. K. Laskey and H. Prade. San Mateo, CA: Morgan Kaufmann.
52. Kontkanen, P., Myllymäki, P., Silander, T., Tirri, H. & Grünwald, P. (2000). On predictive distributions and Bayesian networks. Statistics and Computing, 10, 39-54.
53. Langley, P., Iba, W. & Thompson, K. (1992). An analysis of Bayesian classifiers. In Proceedings of the Tenth National Conference on Artificial Intelligence, pp. 223-228. San Jose, California: AAAI Press.
54. Langley, P. & Sage, S. (1994). Induction of selective Bayesian classifiers. In Proceedings of the 10th Conference on Uncertainty in Artificial Intelligence, pp. 399-406. Seattle, WA: Morgan Kaufmann.
55. Lowe, D. & Webb, A.R. (1990). Exploiting prior knowledge in network optimisation: an illustration form medical prognosis. Network Comput. Neural Sys., 1, 299-323.
56. Mani, S., Pazzani, M.J. & West, J. (1997). Knowledge discovery from a breast cancer database. Lecture Notes in Artificial Intelligence, 1211, 130-133.
57. McLachlan, G.J. (1992). Discriminant Analysis and Statistical Pattern Recognition. New York: John Wiley and Sons.
58. Michie, D., Spiegelhalter, D.J. & Taylor, C.C. (Eds.) (1994). Machine Learning, Neural and Statistical Classification. New York: Ellis Horwood.
59. Monti, S. & Cooper, G.F. (1999). A Bayesian network classifier that combines a finite mixture model and a naïve Bayes model. In Proceedings of the 15th Conference on Uncertainty in A1, Stockholm, Sweden.
60. Nordyke, R., Kulikowski, C.A. & Kulikowski, C.W. (1971). A comparison of methods for the automated diagnosis of thyroid dysfunction. Computers and Biomedical Research, 4, 374-389.
61. O'Connor, G.T. & Sox, H.C. (1991). Bayesian reasoning in medicine: the contributions of Lee B. Lusted, MD. Medical Decision Making, 11, 107-111.
62. Ohmann, C., Künneke, M., Zaczyk, R., Thon, K. & Lorenz, W. (1986). Selection of variables using 'independence Bayes' in computer-aided diagnosis of upper gastrointestinal bleeding. Statistics in Medicine, 5, 503-515.
63. Ohmann, C., Moustakis, V., Yang, Q. & Lang, K. (1996). Evaluation of automatic knowledge acquisition techniques in the diagnosis of acute abdominal pain. Artificial Intelligence in Medicine, 8, 23-36.
64. Ohmann, C., Yang, Q., Künneke, M., Stöltzing, H., Thon, K. & Lorenz, W. (1988). Bayes theorem and conditional dependence of symptoms: different models applied to data of upper gastrointestinal bleeding. Methods of Information in Medicine, 27, 73-83.
65. Ott, J. & Kronmal, R.A. (1976). Some classification procedures for multivariate binary data using orthogonal functions. Journal of the American Statistical Association, 71, 391.
66. Paterson-Brown, S., Vipond, M.N., Simms, K., Gatzen, C., Thompson, J.N. & Dudley, H.A.F. (1989). Clinical decision making and laparoscopy versus computer prediction in the management of the acute abdomen. British Journal of Surgery, 76, 1011-1013.
67. Pazzani, M., Muramatsu, J. & Billsus, D. (1996). Syskil and Webert: identifying interesting web sites. Proceedings of the Thirteenth National Conference on Artificial Intelligence, pp. 54-61. Portland, Oregon: AAAI Press.
68. Penny, W.D. & Frost, D.P. (1997). Neural network modelling of the level of observation decision in an acute psychiatric ward. Computers and Biomedical Research, 30, 1-17.
69. Ridgeway, G., Madigan, D. & Richardson, T. (1998). Interpretable boosted naïve Bayes classification. Proceedings of the Fourth International Conference on Knowledge Discovery and Data Mining, Eds. R. Agrawal, P. Stolorz and G. Piatetsky-Shapiro, pp. 101-104. AAAI Press, Menlo Park, California.
70. Ripley, B.D. (1996). Pattern Recognition and Neural Networks. Cambridge: Cambridge University Press.
71. Rissanen, J. (1978). Modeling by shortest data description. Automatica, 14, 465-471.
72. Russek, E., Kronmal, R.A. & Fisher, L.D. (1983). The effect of assuming independence in applying Bayes' theorem to risk estimation and classification in diagnosis. Computers and Biomedical Research, 16, 537-552.
73. Singh, M. & Provan, G. (1996). Efficient learning of selective Bayesian network classifiers. In Proceedings of the 13th International Conference on Machine Learning, pp. 453-461, Bari, Italy.
74. Spiegelhalter, D.J. & Knill-Jones, R.P. (1984). Statistical and knowledge-based approaches to clinical decision-support systems. Journal of the Royal Statistical Society, Series A, 147, 35-76.
75. Sutton, G.C. (1989). Computer-aided diagnosis: a review. British Journal of Surgery, 76, 82-85.
76. Thornton, J.G., Lilford, R.J. & Newcombe, R.G. (1991). Tables for estimation of individual risks of fetal neural tube and ventral wall defects, incorporating prior probability, maternal serum α-fetoprotein levels, and ultrasonographic examination results. American Journal of Obstetrics and Gynaecology, 164, 154-160.
77. Titterington, D.M., Murray, G.D., Murray, L.S., Spiegelhalter, D.J., Skene, A.M., Habbema, J.D.F. & Gelpke, G.J. (1981). Comparison of discrimination techniques applied to a complex data set of head injured patients. Journal of the Royal Statistical Society, Series A, 144, 145-175.
78. Todd, B.S. & Stamper, R. (1994). The relative accuracy of a variety of medical diagnostic programmes. Methods of Information in Medicine, 33, 402-416.
79. van Woerkom, A.J. & Brodman, K. (1961). Statistics for a diagnostic model. Biometrics, 17, 299-318.
80. Warner, H.R., Toronto, A.F., Veasey, L.R. & Stephenson, R. (1961). A mathematical model for medical diagnosis - application to congenital heart disease. Journal of the American Medical Association, 177, 177-184.
81. Webb, A. (1999). Statistical Pattern Recognition. London: Arnold.
82. Wellwood, J.M. & Spiegelhalter, D.J. (1989). Computers and the diagnosis of acute abdominal pain. British Journal of Hospital Medicine, 41, 564-567.
83. Willcox, W.R. & Lapage, S.P. (1975). Methods used in a program for computer-aided identification of bacteria. In Biological Identification with Computers, pp. 103-119. New York: Academic Press.
84. Willcox, W.R., Lapage, S.P. & Holmes, B. (1980). A review of numerical methods in bacterial identification. Antonie van Leeuwenhoek, 46, 233-299.
85. Willcox, W.R., Lapage, S.P., Bascomb, S. & Cursin, M.A. (1973). Identification of bacteria by computer: theory and programming. J. Gen. Microbiol., 77, 317-330.