Formal methods in pattern recognition: A review

European Journal of Operational Research

Volumn 120, Issue 3, 2000, Pages 459-495

  Nieddu, Luciano ^a   Patrizi, Giacomo ^a  

^a Dipartimento di Statistica   (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; EXPERT SYSTEMS; LEARNING ALGORITHMS; LEARNING SYSTEMS; OPTIMIZATION; PRECISION ENGINEERING; PROBABILITY;

FORMAL METHODS;

PATTERN RECOGNITION;

EID: 0033889012     PISSN: 03772217     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0377-2217(98)00368-3     Document Type: Review

References (97)

1. Aeberhard S., Coomans D., De Viel O. Comparative analysis of statistical pattern recognition methods in high dimensional settings. Pattern Recognition. 27:1994;1065-1077.
2. D.W. Aha, D. Kibler, IJCAI (1989).
3. Aha D.W., Kibler D., Albert M.K. Instance-based learning algorithms. Machine Learning. 6:1991;37-66.
4. D.W. Aha, Incremental constructive induction: An instance based approach, in: Proceedings of the Eighth International Workshop on Machine Learning, Evanston, IL, Morgan Kaufmann, San Mateo, CA, 1991, pp. 117-121.
5. Aizerman M.A., Braverman E.M., Rozonoer L.I. Theoretical foundations of the potential function method in pattern recognition learning. Automation and Remote Control. 25:1964;821-837.
6. American Statistical Association, Statlib Library, maintained by Carnegie Mellon University.
7. C.M. Bishop, Neural Networks for Pattern Recognition, Clarendon Press, Oxord, 1995.
8. Bohanec M., Rajkovic V. Expert systems for decision making. Sistemica. 1:1990;145-157.
9. G. Bonifazi, P. Massacci, L. Nieddu, G. Patrizi, The classification of industrial sand-ores by image recognition methods, in: Proceedings of 13th International Conference on Pattern Recognition, vol. 4, Parallel and Connectionist Systems, IEEE Computer Soc. Press, Los Alamitos, CA, 1996, pp. 174-179.
10. G. Bonifazi, P. Massacci, G. Patrizi, Alternative feature selection procedures for particle classification by pattern recognition techniques, in: V. Cantoni, Creutzburg, S. Levialdi, G. Wolf, (Eds.), Recent Issues in Pattern Analysis and Recognition, Lecture Notes in Computer Science, 399, Springer, Berlin, 1989, pp. 365-376.
11. G. Bonifazi, P. Massacci, G. Patrizi, Pattern recognition for texture classification of ornamental stone slabs, in: IEEE International Conference on Image Processing, ICIP'89, Conference Proceedings, vol. 2, Singapore, 1989.
12. G., Bonifazi, P. Massacci, G. Patrizi, C. Spera, Particle recognition by vectorial and parallel image processing procedures, in: D. Laforenza, R. Perego (Eds.), Supercomputing Tools for Science and Engineering, Consiglio Nazionale della Ricerche, Progetto Finalizzato Sistemi Informatici e Calcolo Parallelo, F. Angeli, Milan, 1990, pp. 61-76.
13. E. Boros, P.L. Hammer, A. Kogan, E. Mayoraz, I. Muchnik, Logical analysis of data: An overview, Rutcor Technical Report, RTR 1-94, 1994 (revised in July 1995).
14. P. Brazdil, J. Gama, B. Henery, Characterizing the applicability of classification algorithms using metalevel learning, in: F. Bergadano, L. de Raedt (Eds.), Proceedings of Machine Learning, ECML-94, Lecture Notes in Artificial Intelligence, vol. 784, Springer, Berlin, 1994.
15. P. Brazdil, J. Gama, Evaluation/characterization of classification algorithms, Unpublished Report, LIACC, University of Porto, Portugal.
16. M. Calamassi, G. Patrizi, La Progettazione di un Sistema Bibliografico di Interrogazione: SIBILLA, in: Associazione Italiana di Ricerca Operativa, Ricerca Operativa ed Intelligenza Artificiale, Atti delle Giornate di Lavoro A.I.R.O., Centro di Ricerca I.B.M., Pisa, 1988, pp. 589-605.
17. Cendrowska J. PRISM: An algorithm for inducing modular rules. International Journal of Man-Machine Studies. 27:1987;349-370.
18. G. Cestnik, I. Konenenko, I. Bratko, Assistant-86: A knowledge-elicitation tool for sophisticated users, in: I. Bratko, N. Lavrac (Eds.), Progress in Machine Learning, Sigma Press, Ljubljana, 1987, pp. 31-45.
19. V. Cherkassy, F. Mulier, Learning from Data: Concepts, Theory and Methods, Wiley, New York, 1998.
20. D. Clark, Z. Schreter, A. Adams, A quantitative comparison of dystal and backpropagation (submitted to Australian Conference on Neural Networks, ACNN'96).
21. J.W. Cooley, P.A.W. Lewis, P.D. Welch, The fast Fourier transform and its applications to time series analysis, in: K. Enslein, A. Ralston, H.S. Wilf (Eds.), Statistical Methods for Digital Computers, vol. 3 of: Mathematical Methods for Digital Computers, Wiley, New York, 1977, pp. 377-423.
22. D. Crevier, AI The Tumultuous History of the Search for Artificial Intelligence, Basic Books, New York, 1993.
23. R. Detrano, A. Janosi, W. Steinbrunn, M. Pfistere, J. Schmid, S. Sandhu, K. Guppy, S. Lee, V. Froelicher, International application of a new probability algorithm for diagnosis of coronary heart disease, American Journal of Cardiology 64 (1989) 304-310 (The principal investigator, Dr. M.D. Robert Detrano Ph.D. responsible for the collection of this data set is gratefully aknowledged).
24. L. Devroye, L. Györfi, G. Lugosi, A Probabilistic Theory of Pattern Recognition, Springer, New York, 1996.
25. S.M. Dowdy, S. Wearden, Statistics for Research, Wiley, New York, 1991.
26. R.O. Duda, P.E. Hart, Pattern Classification and Scene Analysis, Wiley, New York, 1973.
27. O. Elkin, P.L. Hammer, A. Kogan, P. Winter, Distance based classification methods, Rutcor Research Report, RRR 3-96, 1996.
28. Firschlein O., Fischler M. Automatic subclass determination for pattern recognition applications. IEEE Transactions on Electronic Computers. 12:1963;137-141.
29. Fisher R.A. The use of multiple measurements in taxonomic problems. Annals of Eugenics. 7:1936;179.
30. Flusser J., Suk T. Pattern recognition by affine moment invariants. Pattern Recognition. 26:1993;167-174.
31. R.S. Forsyth, PC/Beagle User's Guide, BUPA Medical Research Ltd., Nottingham, 1990 (Donor of the BUPA Liver Disorder data set).
32. Frey P.W., Slate D.J. Letter recognition using Holland-style adaptive classifiers. Machine Learning. 9:1991;161-182.
33. K.S. Fu, Syntactic Methods of Pattern Recognition, Academic Press, New York, 1974.
34. A.D. Gordon, Classification, Chapman & Hall, London, 1981.
35. U. Grenander, General Pattern Theory: A Mathematical Study of Regular Structures, Clarendon Press, Oxford, 1993.
36. Grinold R.C. A Note on pattern separation. Operations Research. 18:1970;187-190.
37. Grinold R.C. Mathematical programming methods of pattern classification. Management Science. 19:1972;272-289.
38. Güvenir H.A., Demiröz G., Ilter N. Learning differential diagnosis of Erythemato-Squamous diseases using voting feature intervals. Artificial Intelligence in Medicine. 13:1998;147-165.
39. J.A. Hartigan, Clustering Algorithms, Wiley, New York, 1975.
40. Hinton G.E. Connectionist learning procedures, Artificial Intelligence. 40:1989;185-234.
41. Hong Z.-Q., Yang J.-Y. Optimal discriminant plane for a small number of samples and the design method of classifier on the plane. Pattern Recognition. 24:1991;317-324.
42. P. Horton, K. Nakai, A probabilistic classification system for predicting the cellular localization sites of proteins, in: Intelligent Systems in Molecular Biology, St. Louis, MO, 1996, pp. 109-115.
43. R.S. Johannes, Using the ADAP learning algorithm to forecast the onset of diabetes mellitus, in: Proceedings of the Symposium on Computer Applications and Medical Care, IEEE Computer Society Press, 1988, pp. 261-265.
44. Kan G., Visser C., Kooler J., Dunning A. Short and long term predictive value of admission wall motion score in acute myocardial infarction. British Heart Journal. 56:1986;422-427.
45. Sir Maurice Kendall, Multivariate Analysis, Griffin, London, 1975.
46. P.A. Lachenbruch, Discriminant Analysis, Hafner, New York, 1975.
47. Laird J., Newell A., Rosenbloom P.S. SOAR: An architecture for general intelligence. Artificial Intelligence. 33:1987;1-64.
48. O.L. Mangasarian, private communication.
49. Mangasarian O.L. Linear and nonlinear separation of patterns by linear programming. Operations Research. 13:1965;444-452.
50. Mangasarian O.L. Multisurface method of pattern separation. IEEE Transactions on Information Theory. IT-14:1968;801-807.
51. O.L. Mangasarian, R. Setiono, W.H. Wolberg, Pattern recognition via linear programming: Theory and application to medical diagnosis, in: T.F. Coleman, Y. Li (Eds.), Large-Scale Numerical Optimization, Society for Industrial and Applied Mathematics, Philadelphia, PA, 1990, pp. 22-30.
52. C.J. Matheus, L.A. Rendell, Constructive induction on trees, in: Proceedings of the 11th International Joint Conference on Artificial Intelligence, Detroit, MI, Morgan Kaufmann, San Mateo, CA, 1989, pp. 645-650.
53. W.S. Meisel, Computer-Oriented Approaches to Pattern Recognition, Academic Press, New York, 1972.
54. D. Mitchie, D.J. Spiegelhalter, C. Taylor, Machine Learning, Neural and Statistical Learning, Ellis Horwood, New York, 1994.
55. S. Muggleton (Ed.), Inductive Logic Programming, Academic Press, New York, 1992.
56. Nakai K., Kanehisa M. A knowledge base for predicting protein localization sites in eukaryotic cells. Genomics. 14:1992;897-911.
57. G.L. Nemhauser, L.A. Wolsey, Integer and Combinatorial Optimization, Wiley, New York, 1988.
58. L. Nieddu, G. Patrizi, A general pattern recognition algorithm for objects with a complex combinatorial structure (submitted for pubblication).
59. L. Nieddu, G. Patrizi, Analysis and comparisons of certain pattern recognition algorithms (to appear).
60. L. Nieddu, G. Patrizi, Classification with probability one (to appear).
61. G. Patrizi, Optimal clustering properties, Ricerca Operativa, 10 (1979).
62. Patrizi G. A pattern recognition approach to judicial decisions (with reference to industrial property controversies). European Journal of Operational Research. 7:1981;133-142.
63. Patrizi G. SIBILLA: An implementation of an intelligent library system. European Journal of Operational Research. 64:1993;21-37.
64. Patrizi G. The equivalence of an LCP to a parametric linear problem with a scalar parameter. European Journal of Operational Research. 51:1991;367-386.
65. J. Pearl, Probabilistic Inference in Intelligent Systems: Networks of Plausible Inference, Morgan Kaufmann, San Mateo, CA, 1988.
66. J. Pfanzagl, Theory of Measurement, Physica-Verlag, Würzburg, 1971.
67. J.R. Quinlan, C4.5: Programs for Machine Learning, Morgan Kaufmann, San Mateo, CA, 1993.
68. Quinlan J.R. Simplifying decision trees. International Journal of Man-Machine Studies. 27:1987;221-234.
69. R. Quinlan, Combining instance-based and model-based learning, in: Proceedings of the Tenth International Conference of Machine Learning, University of Massachusetts, Amherst, Morgan Kaufmann, San Mateo, CA, pp. 236-243.
70. B.D. Ripley, Pattern Recognition and Neural Networks, Cambridge University Press, Cambridge, 1996.
71. D.E. Rumelhart, J.L. McClelland (Eds.), Parallel Distributed Processing: Explorations in the Microstructure of Cognition, vol.1: Foundations, The MIT Press, Cambridge, MA, 1986.
72. S.J. Russell, P. Norvig, Artificial Intelligence: A Modern Approach, Prentice-Hall, Englewood Cliffs, NJ, 1995.
73. R. Schalkoff, Pattern Recognition: Statistical, Structural and Neural Approaches, Wiley, New York, 1992.
74. J.C. Schlimmer, Concept acquisition through representational adjustment, Doctoral Dissertation for Department of Information and Computer Science, University of California, Irvine, CA, 1987.
75. Schultz T.R., Mareschall D., Schmidt W.C. Modeling cognitive development on balance scale phenomena. Machine Learning. 16:1994;57-86.
76. G.A.F. Seber, Multivariate Observations, Wiley, New York, 1984.
77. J. Siebert, Vehicle recognition using rule based methodologies, Turing Institute Research Memorandum, TIRM-87-018, Glasgow University, 1987 (The Turing Institute, Glasgow, Scotland, creator of the data set is gratefully acknowledged).
78. Siegler R.S. Three aspects of cognitive development. Cognitive Psychology. 8:1976;481-520.
79. Sigilito V.G., Wing S.P., Hutton L.V., Baker K.B. Classification of radar returns from the ionosphere using neural networks. Johns Hopkins APL Technical Digest. 10:1989;262-266.
80. L. Silvestri, J.R. Hill, Some problems on the taxonomic approach, in: V.H. Heywood, J. McNeill (Eds.), Phonetic and Philogenic Classification, Systematics Association, London, 1964, pp. 87-104.
81. Smith F.W. Pattern classifier design by linear programming. IEEE Transactions on Computers. C-17:1968;455-461.
82. F. Suppe (Ed.), The Structure of Scientific Theories, 2nd ed., University of Illinois Press, Urbana, IL, 1977.
83. F. Suppe, The Semantic Conception of Theories and Scientific Realism, University of Illinois Press, Urbana, IL, 1989.
84. J.R. Ullmann, Pattern Recognition Techniques, Butterworths, London, 1973.
85. University of California at Irvine, Repository of Machine Learning Databases and Domain Theories, ftp.ics.uci.edu: pub/machine- learning-databases, http://www.ics.uci.edu/ ~ mlearn/MLRepository.html.
86. V.N. Vapnik, Estimation of Dependencies Based on Empirical Data, Springer, New York, 1982.
87. V.N. Vapnik, Statistical Learning Theory, Wiley, New York, 1998.
88. V.N. Vapnik, The Nature of Statistical Learning Theory, Springer, Berlin, 1995, p. 26.
89. S. Watanabe, Pattern Recognition: Human and Mechanical, Wiley, New York, 1985.
90. S. Waugh, Extending and benchmarking cascade-correlation, Ph.D. Thesis, Computer Science Department, University of Tasmania, 1995.
91. P.H. Winston, Artificial Intelligence, 3rd ed., Addison-Wesley, Reading, MA, 1992.
92. Wolberg W.H., Street W.N., Heisey D.H., Mangasarian O.L. Computerized breast cancer diagnosis and prognosis from the fine-eedle aspirates. Archives of Surgery. 130:1995;511-516.
93. Wolberg W.H., Street W.N., Heisey D.H., Mangasarian O.L. Computer-derived nuclear features distinguishing malignant from benign breast cytology. Human Pathology. 26:1995;792-796.
94. H. Wold, Partial least squares, in: S. Kotz, N. Johnson (Eds.), Encyclopedia of Statistical Sciences, Wiley, New York, pp. 581-591.
95. T.Y. Young, T.W. Calvert, Classification, Estimation and Pattern Recognition, Elsevier, New York, 1974.
96. Young T.Y. The reliability of linear feature extractors. IEEE Trans. Computers. C-20:1971;967-971.
97. F. Zerr, J.G. Ganascia, Integrating an explanation-based learning mechanism into a general problem-solver, in: Y. Kodratoff (Ed.), Machine Learning - EWSL-91, Lecture Notes in Artificial Intelligence (Subseries of Lecture Notes in Computer Science), No. 482, Springer, Berlin, 1991, pp. 62-80.