Mathematical programming formulations for two-group classification with binary variables

Annals of Operations Research

Volumn 74, Issue , 1997, Pages 89-112

  Asparoukhov, Ognian K ^a   Stam, Antonie ^b  

^a CENTRE OF BIOMEDICAL ENGINEERING   (Bulgaria)

^b UNIVERSITY OF GEORGIA   (United States)

Author keywords

Binary variables; Classification analysis; Discriminant analysis; Linear programming; Mixed integer programming

Indexed keywords

EID: 0031501860     PISSN: 02545330     EISSN: 15729338     Source Type: Journal    
DOI: 10.1023/a:1018995010063     Document Type: Article

References (78)

1. A. Agresti, Categorical Data Analysis, Wiley, New York, 1990.
2. J. Aitchison and C.G.G. Aitken, Multivariate binary discrimination by the kernel method, Biometrika 63(1976)413-420.
3. J.A. Anderson, Separate sample logistic discrimination, Biometrika 59(1972)19-35.
4. J.A. Anderson, Quadratic logistic discrimination, Biometrika 62(1975)149-154.
5. T.W. Anderson, An Introduction to Multivariate Statistical Analysis, 2nd ed., Wiley, New York, 1984.
6. J.A. Anderson, K. Whaley, J. Williamson and W.W. Buchanan, A statistical aid to the diagnosis of keratoconjunctivitis sicca, Quarterly Journal of Medicine 41(1972)175-189.
7. O.K. Asparoukhov, Microprocessor system for investigation of thromboembolic complications, Unpublished Ph.D. Dissertation, Technical University of Sofia, Bulgaria (in Bulgarian), 1985.
8. O.K. Asparoukhov and T.B. Andreev, Comparison of one-stage classifiers for assessment of the ability of children to construct grammatical structures consciously, in: Multivariate Analysis in the Behavioral Sciences. Philosophical to Technical, I. Panchev, ed., Academic Publishing House 'Prof. Marin Drinov', Sofia, Bulgaria, 1995, pp. 1-13.
9. R.R. Bahadur, A representation of the joint distribution of response to n dichotomous items, in: Studies in Item Analysis and Prediction, H. Solomon, ed., Stanford University Press, Palo Alto, CA, 1961, pp. 158-168.
10. W.J. Banks and P.L. Abad, An efficient optimal solution algorithm for the classification problem, Decision Sciences 22(1991)1008-1023.
11. W.J. Banks and P.L. Abad, On the performance of linear programming heuristics applied on a quadratic transformation in the classification problem, European Journal of Operational Research 74(1994)23-28.
12. J.A. Benediktson and P.H. Swain, Consensus theoretic classification methods, IEEE Transactions on Systems, Man and Cybernetics SMC-22(1992)688-704.
13. D.R. Cox, Some procedures connected with the logistic qualitative response curve, in: Research Papers in Statistics: Festschrift for J. Neyman, F.N. David, ed., Wiley, New York, 1966, pp. 55-71.
14. S. Das Gupta, Theories and methods in classification: A review, in: Discriminant Analysis and Applications, T. Cacoullos, ed., Academic Press, New York, 1973, pp. 77-137.
15. N.B. Day and D.E. Kerridge, A general maximum likelihood discriminant, Biometrics 23(1967) 313-323.
16. W.R. Dillon and M. Goldstein, On the performance of some multinomial classification rules, Journal of the American Statistical Association 73(1978)305-313.
17. A.P. Duarte Silva, Minimizing misclassification costs in two-group classification analysis, Unpublished Ph.D. Dissertation, The University of Georgia, 1995.
18. A.P. Duarte Silva and A. Stam, Second order mathematical programming formulations for discriminant analysis, European Journal of Operational Research 72(1994)4-22.
19. R.A. Fisher, The use of multiple measurements in taxonomic problems, Annals of Eugenics 7(1936) 179-188.
20. N. Freed and F. Glover, A linear programming approach to the discriminant problem, Decision Sciences 12(1981)68-74.
21. N. Freed and F. Glover, Simple but powerful goal programming models for discriminant problems, European Journal of Operational Research 7(1981)44-60.
22. W.V. Gehrlein, General mathematical programming formulation for the statistical classification problem, Operations Research Letters 5(1986)299-304.
23. E.S. Gilbert, On discrimination using qualitative variables, Journal of the American Statistical Association 63(1968)1399-1412.
24. L.W. Glorfeld and M.W. Kattan, A comparison of the performance of three classification procedures when applied to contaminated data, in: Proceedings of the 21st Annual Meeting of the Decision Sciences Institute, 1989, pp. 1153-1155.
25. F. Glover, S. Keene and B. Duea, A new class of models for the discriminant problem, Decision Sciences 19(1988)269-280.
26. W. Gochet, A. Stam, V. Srinivasan and S. Chen, Multigroup discriminant analysis using linear programming, Operations Research 45(1997)213-225.
27. M. Goldstein and W.R. Dillon, Discrete Discriminant Analysis, Wiley, New York, 1978.
28. P. Hall, On nonparametric multivariate binary discrimination, Biometrika 68(1981)287-294.
29. P. Hall, Optimal near neighbour estimator for use in discriminant analysis, Biometrika 68(1981) 572-575.
30. D.J. Hand, Discrimination and Classification, Wiley, New York, 1981.
31. D.J. Hand, Statistical pattern recognition on binary variables, in: Pattern Recognition Theory and Applications, J. Kittler, K.S. Fu and L.F. Pau, eds., Reidel, Boston, MA, 1982, pp. 19-33.
32. D.J. Hand, A comparison of two methods of discriminant analysis applied to binary data, Biometrics 39(1983)683-694.
33. D.J. Hand, Discriminant analysis for categorical data, in: Lecture Notes and Program of the 4th European Courses in Advanced Statistics Program: Analysis of Categorical Data Theory and Application, Leiden, The Netherlands, 1993, pp. 135-174.
34. J.A. Hartigan, Clustering Algorithms, Wiley, New York, 1975.
35. M. Hills, Discrimination and allocation with discrete data, Applied Statistics 16(1967)237-250.
36. C.J. Huberty, Applied Discriminant Analysis, Wiley, 1994.
37. T. Ibaraki and S. Muroga, Adaptive linear classifier by linear programming, IEEE Transactions on Systems, Science and Cybernetics SSC-6(1970)53-62.
38. E.A. Joachimsthaler and A. Stam, Four approaches to the classification problem in discriminant analysis: An experimental study, Decision Sciences 19(1988)322-333.
39. E.A. Joachimsthaler and A. Stam, Mathematical programming approaches for the classification problem in two-group discriminant analysis, Multivariate Behavioral Research 25(1990)427-454.
40. G.J. Koehler and S.S. Erenguc, Minimizing misclassifications in linear discriminant analysis, Decision Sciences 21(1990)63-85.
41. W.J. Krzanowski, The performance of Fisher's linear discriminant function under non-optimal conditions, Technometrics 19(1977)191-200.
42. W.J. Krzanowski, Distance between populations using mixed continuous and categorical variables, Biometrika 70(1983)235-243.
43. W.J. Krzanowski, Principles of Multivariate Analysis, Clarendon Press, Oxford, England, 1988.
44. W.J. Krzanowski, The location model for mixture of categorical and continuous variables, Journal of Classification 10(1993)25-49.
45. P.A. Lachenbruch and M.R. Mickey, Estimation of error rates in discriminant analysis, Technometrics 10(1968)1-11.
46. K.F. Lam, E.U. Choo and W.C. Wedley, Linear goal programming in estimation of classification probability, European Journal of Operational Research 67(1993)101-110.
47. J.M. Liitschwager and C. Wang, Integer programming solution of a classification problem, Management Science 24(1978)1515-1525.
48. R.P. Lippmann, Pattern classification using neural networks, IEEE Communication Magazine (1989)47-64.
49. O.L. Mangasarian, Linear and nonlinear separation of patterns by linear programming, Operations Research 13(1965)444-452.
50. C.A. Markowski and E.P. Markowski, An experimental comparison of the discriminant problem with both qualitative and quantitative variables, European Journal of Operational Research 28 (1987)74-78.
51. D.C. Martin and R.A. Bradly, Probability models, estimation, and classification for multivariate dichotomous populations, Biometrics 28(1972)203-221.
52. E. Másson and Y.-J. Wang, Introduction to computation and learning in artificial neural networks, European Journal of Operational Research 47(1990)1-28.
53. G.J. McLachlan, Discriminant Analysis and Statistical Pattern Recognition, Wiley, New York, 1992.
54. R.C. Minnick, Linear-input logic, IEEE Transactions on Electronics and Computers EC-10(1961) 6-16.
55. D.H. Moore, Evaluation of five discriminant procedures for binary variables, Journal of the American Statistical Association 68(1973)399-404.
56. K.-C. Ng and B. Abramson, Consensus diagnosis: A simulation study, IEEE Transactions on Systems, Man and Cybernetics SMC-22(1992)916-928.
57. J. Ott and R.A. Kronmal, Some classification procedures for multivariate binary data using orthogonal functions, Journal of the American Statistical Association 71(1976)391-399.
58. C.T. Ragsdale and A. Stam, Introducing discriminant analysis to the business statistics curriculum, Decision Sciences 23(1992)724-745.
59. P.A. Rubin, Evaluating the maximize minimum distance formulation to the linear discriminant problem, European Journal of Operational Research 41(1989)272-282.
60. P.A. Rubin, A comment regarding polynomial discriminant analysis, European Journal of Operational Research 72(1994)29-31.
61. B. Rypley, Neural networks and related methods for classification, Journal of the Royal Statistical Society Series B 56(1994)409-456.
62. L.M. Salchenberger, E.M. Cinar and N.A. Lash, Neural networks: A new tool for predicting thrift failures, Decision Sciences 23(1992)899-916.
63. L. Schrage, LINDO: User's Manual, Release 5.0, The Scientific Press, South San Francisco, CA, 1991.
64. C.A.B. Smith, Some examples of discrimination, Annals of Eugenics 13(1947)272-282.
65. F.W. Smith, Pattern classifier design by linear programming, IEEE Transactions on Computing C-17(1968)367-372.
66. R.C. Soltysik and P.R. Yarnold, ODA 1.0: Optimal Discriminant Analysis for DOS, Optimal Data Analysis, Chicago, IL, 1993.
67. R.C. Soltysik and P.R. Yarnold, The Warmack-Gonzalez algorithm for linear two-category multivariate optimal discriminant analysis, Computers and Operations Research 21(1994)735-745.
68. A. Stam and E.A. Joachimsthaler, Solving the classification problem in discriminant analysis via linear and nonlinear programming methods, Decision Sciences 20(1989)285-293.
69. A. Stam and E.A. Joachimsthaler, A comparison of a robust mixed-integer approach to existing methods for establishing classification rules for the discriminant problem, European Journal of Operational Research 46(1990)113-122.
70. A. Stam and D.G. Jones, Classification performance of mathematical programming techniques in discriminant analysis: Results for small and medium sample sizes, Managerial and Decision Economics 11(1990)243-253.
71. E. Sturt, Algorithm AS 165. An algorithm to construct a discriminant function in FORTRAN for categorical data, Applied Statistics 30(1980)313-325.
72. K.Y. Tam and M.Y. Kiang, Managerial applications of neural networks: The case of bank failure predictions, Management Science 38(1992)926-947.
73. D.M. Titterington, G.D. Murray, L.S. Murray, D.J. Spiegelhalter, A.M. Skene, J.D.F. Habbema and G.J. Gelpke, Comparison of discriminant techniques applied to a complex data set of head injured patients (with discussion), Journal of the Royal Statistical Society, Series A, 144(1981)145-175.
74. H.J. Trampisch, Classical discriminant analysis and Lancaster models for qualitative data, in: Compstat 1978, Proceedings in Computational Statistics, Physica-Verlag, Vienna, 1978, pp. 205-211.
75. P. Wanarat and R. Pavur, Examining the effect of second-order terms in mathematical programming approaches to the classification problem, European Journal of Operational Research, to appear.
76. L. Xu, A. Krzyzak and C.Y. Suen, Methods of combining multiple classifiers and their application to handwriting recognition, IEEE Transactions on Systems, Man and Cybernetics SMC-22(1992) 418-435.
77. P.R. Yarnold, R.C. Soltysik and G.J. Martin, Heart rate variability and susceptibility for sudden cardiac death: An example of multivariable optimal discriminant analysis, Statistics in Medicine 13(1994)1015-1021.
78. T.Y. Young, P.S. Liu and R.J. Rondon, Statistical pattern classification with binary variables, IEEE Transactions on Pattern Analysis and Machine Intelligence 2(1981)155-163.