Intelligent statistical data mining with information complexity and genetic algorithms

Statistical Data Mining and Knowledge Discovery

Volumn , Issue , 2003, Pages 15-56

  Bozdogan, Hamparsum ^a  

^a UNIVERSITY OF TENNESSEE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 85057372026     PISSN: None     EISSN: None     Source Type: Book    
DOI: None     Document Type: Chapter

References (84)

1. Akaike, H. (1973). Information theory and an extension of the maximum likelihood principle. In B.N. Petrov and F. Csaki (Eds.), Second international symposium on information theory, Academiai Kiado, Budapest, 267-281.
2. Akaike, H. (1974). A new look at the statistical model identification. IEEE Transactions on Automatic Control, AC-19, 716-723.
3. Akaike, H. (1987). Factor analysis and AIC. Psychometrika, 52, 317-332.
4. Akaike, H. (1994). Implications of informational point of view on the development of statistical science. In H. Bozdogan (Ed.), Engineering & scientific applications of informational modeling, Volume 3, pp. 27-38. Proceedings of the first US/Japan conference on the frontiers of statistical modeling: An informational approach. Kluwer Academic Publishers, the Netherlands, Dordrecht.
5. Bailey, Covert (1994). Smart Exercise: Burning Fat, Getting Fit, Houghton-Mifflin Co., Boston, pp. 179-186.
6. Bauer, R. J. Jr. (1994). Genetic Algorithm and Investment Strategies. John Wiley & Sons, New York.
7. Baxter, R. A. (1996). Minimum Message Length Inference: Theory and Applications. Unpublished Ph.D. Thesis, Department of Computer Science, Monash University, Clayton, Victoria, Australia.
8. Bearse, P. M. and Bozdogan, H. (1998). Subset selection in vector autoregressive (VAR) models using the genetic algorithm with informational complexity as the fitness function. Systems Analysis, Modeling, Simulation (SAMS), 31, 61-91.
9. Bearse, P.M. and Bozdogan, H. (2002). Multivariate regressions, Genetic Algorithms, and Information Complexity: A Three Way Hybrid. In Measurement and Multivariate Analysis, S. Nishisato, Y. Baba, H. Bozdogan, and K. Kanefuji (Eds.), Springer, Tokyo, 2002,269-278.
10. Behboodian, J. (1964). Information for Estimating the Parameters in Mixtures of Exponential and Normal Distributions. Ph.D.Thesis, Department of Mathematics, University of Michigan, Ann Arbor, MI.
11. Behnke, A.R. and Wilmore, J.H. (1974). Evaluation and Regulation of Body Build and Composition, Prentice-Hall, Englewood Cliffs, NJ.
12. Bellman, R. (1961). Adaptive Control Processes: A Guided Tour. Princeton University Press, Princeton, NJ.
13. Blahut, R. E. (1987). Principles and Practice of Information Theory. Addison-Wesley Publishing Company, Reading, MA.
14. Bock, H. H. (1994). Information and entropy in cluster analysis. In In Multivariate Statistical Modeling, H. Bozdogan (Ed.), Vol. 2, Proceedings of the First US/Japan Conference on the Frontiers of Statistical Modeling: An Informational Approach, Kluwer Academic Publishers, the Netherlands, Dordrecht; 115-147.
15. Bozdogan, H. (1987). Model selection and Akaike’s Information Criterion (AIC): The general theory and its analytical extensions. Psychometrika, 52(3), 345-370.
16. Bozdogan, H. (1988). ICOMP: a new model-selection criterion. In Classification and Related Methods of Data Analysis, H. H. Bock (Ed.), Elsevier Science Publishers, Amsterdam; 599-608.
17. Bozdogan, H. (1990). On the information-based measure of covariance complexity and its application to the evaluation of multivariate linear models. Communications in Statistics, Theory and Methods, 19, 221-278.
18. Bozdogan, H. (1994). Mixture-model cluster analysis using a new informational complexity and model selection criteria. In Multivariate Statistical Modeling, H. Bozdogan (Ed.), Vol. 2, Proceedings of the First US/Japan Conference on the Frontiers of Statistical Modeling: An Informational Approach, Kluwer Academic Publishers, the Netherlands, Dordrecht, 69-113.
19. Bozdogan, H. (2000). Akaike’s information criterion and recent developments in information complexity. Journal of Mathematical Psychology, 44, 62-91.
20. Bozdogan, H. (2004). Statistical Modeling and Model Evaluation: A New Informational Approach. To appear.
21. Bozdogan, H. and Haughton, D.M.A. (1998). Informational complexity criteria for regression models. Computational Statistics and Data Analysis, 28, 51-76.
22. Bozdogan, H. and Ueno, M. (2000). A unified approach to information-theoretic and Bayesian model selection criteria. Invited paper presented in the Technical Session Track C on: Information Theoretic Methods and Bayesian Modeling at the 6th World Meeting of the International Society for Bayesian Analysis (ISBA), May 28-June 1, 2000, Hersonissos-Heraklion, Crete.
23. Bozdogan, H. and Magnus, J. R. (2003). Misspecification resistant model selection using information complexity. Working paper.
24. Burnham, K. P. and Anderson D. R. (1998). Model Selection and Inference: A Practical Information-Theoretic Approach. Springer, New York.
25. Boyce, D. E., Farhi, A., and Weischedel, R. (1974). Optimal Subset Selection: Multiple Regression, Interdependence, and Optimal Network Algorithms. SpringerVerlag, New York.
26. Chen, X. (1996). Model Selection in Nonlinear Regression Analysis. Unpublished Ph.D. Thesis, The University of Tennessee, Knoxville, TN.
27. Chen, X. and Bozdogan, H. (2004). Model Selection in Nonlinear Regression Analysis: A New Information Complexity Approach. Working research monograph.
28. Chernoff, H. (1956). Large sample theory: parametric case, Annals of Mathematical Statistics, 27, 1-22.
29. Cover, T. M., Gacs, P., and Gray, R. M. (1989). Kolmogorov’s contibutions to information theory and algorithmic complexity. Ann. Prob., 17, 840-865.
30. Cramer, H. (1946). Mathematical Methods of Statistics. Princeton University Press, Princeton, NJ.
31. Forrest, S. (1993). Genetic algorithms: principles of natural selection applied to computation, Science, 261(2.4), 872-878.
32. Graham, A. (1987). Nonnegative Matrices and Applicable Topics in Linear Algebra. Halsted Press, a Division of John Wiley and Sons, New York.
33. Goldberg, D. E. (1989). Genetic Algorithms in Search, Optimization, and Machine Learning, Addison-Wesley, New York.
34. Gosh, J. K. (1988) (Ed.). Statistical Information and Likelihood: A Collection of Critical Essays by Dr. D. Basu. Springer-Verlag, New York.
35. Harris, C. J. (1978). An information theoretic approach to estimation. In M. J. Greg-son (Ed.), Recent Theoretical Developments in Control, Academic Press, London, 563-590.
36. Hocking, R. R. (1976). The analysis and selection variables in linear regression, Biometrics, 32, 1044.
37. Hocking, R. R. (1983). Developments in linear regression methodology: 1959-1982, Technometrics, 25, 219-230.
38. Holland, J. (1992). Genetic algorithms. Scientific American, 66-72.
39. Irizarry, R. A. (2001). Information and posterior probability criteria for model selection in local likelihood estimation. Journal of the American Statistical Association, March 2001, Vol. 96, No. 453, 303-315.
40. Katch, F. and McArdle, W. (1977). Nutrition, Weight Control, and Exercise, Houghton Mifflin Co., Boston.
41. Kauffman, S. A. (1993). The Origins of Order: Self-organization and Selection in Evolution, Oxford University Press, Oxford.
42. Kolmogorov, A. N. (1983). Combinatorial foundations of information theory and the calculus of probabilities. Russian Math Surveys, 38, 29-40.
43. Kullback, S. (1968). Information Theory and Statistics. Dover, New York.
44. Kullback, S. and Leibler, R. (1951). On information and sufficiency. Ann. Math. Statist., 22, 79-86.
45. Lanning, M. J. and Bozdogan, H. (2003). Ordinal Logistic Modeling Using ICOMP as a Goodness-of-Fit Criteria. In Statistical Data Mining and Knowledge Discovery, H. Bozdogan (Ed.), Chapman & Hall/CRC, Boca Raton, FL.
46. Ljung, L. and Rissanen, J. (1978). On canonical forms, parameter identifiability and the concept of complexity. In Identification and System Parameter Estimation, N. S. Rajbman (Ed.), North-Holland, Amsterdam, 1415-1426.
47. Magnus, J. R. and Neudecker, H. (1999). Matrix Differential Calculus, 2nd Edition, John Wiley & Sons, New York.
48. Mahfoud, S. W. (1994). Population Sizing for Sharing Methods, Illinois Genetic Algorithms Laboratory Report No. 94005. University of Illinois, Champaign-Urbana, IL.
49. Maklad, M. S. and Nichols, T. (1980). A new approach to model structure discrimination. IEEE Trans. on Syst., Man, and Cybernetics, SMC 10, 78-84.
50. Mantel, N. (1970). Why stepdown procedures in variables selection, Technometrics, 12, 591-612.
51. Peirce, C. S. (1955). Abduction and Induction. In Philosophical Writings of Peirce, J. Buchler (Ed.), Dover, New York, 150-156.
52. McQuarie, A. D. R. and Tsai, C-L. (1998). Regression and Time Series Model Selection. World Scientific Publishing Company, Singapore.
53. Michalewicz, Z. (1992). Genetic Algorithms + Data Structures = Evolution Programs, Springer-Verlag, New York.
54. Miller, A. J. (1990). Subset selection in regression, Chapman and Hall, London.
55. Morgera, S. D. (1985). Information theoretic covariance complexity and its relation to pattern recognition. IEEE Trans. on Syst., Man, and Cybernetics, SMC 15, 608-619.
56. Mustonen, S. (1997). A measure of total variability in multivariate normal distribution. Comp. Statist. and Data Ana., 23, 321-334.
57. Moses, L. E. (1986). Think and Explain with Statistics, Addison-Wesley, Reading, MA.
58. Rao, C. R. (1945). Information and accuracy attainable in the estimation of statistical parameters. Bull. Calcutta Math Soc., 37, 81.
59. Rao, C. R. (1947). Minimum variance and the estimation of several parameters. Proc. Cam. Phil. Soc., 43, 280.
60. Rao, C. R. (1948). Sufficient statistics and minimum variance estimates. Proc. Cam. Phil. Soc., 45, 213.
61. Rao, C. R. (1965). Linear Statistical Inference and Its Applications. John Wiley & Sons, New York.
62. Rissanen, J. (1976). Minmax entropy estimation of models for vector processes. In System Identification,: R. K. Mehra and D. G. Lainiotis (Eds.), Academic Press, New York, 97-119.
63. Rissanen, J. (1978). Modeling by shortest data description. Automatica, 14, 465-471.
64. Rissanen, J. (1986). Stochastic complexity and modeling. Ann. Statist., 14, 1080-1100.
65. Rissanen, J. (1987). Stochastic complexity. (With discussion), J. of the Royal Statist. Soc., Series B, 49, 223-239.
66. Rissanen, J. (1989). Stochastic Complexity in Statistical Inquiry. World Scientific Publishing Company, Teaneck, NJ.
67. Roughgarden, J. (1979). Theory of Population Genetics and Evolutionary Ecology: An Introduction, MacMillian Publishing, New York.
68. Sakamoto, Y., Ishiguro, M., and Kitagawa, G. (1986). Akaike Information Criterion Statistics, KTK Scientific Publishers, Tokyo.
69. Schwarz, G. (1978). Estimating the dimension of a model. Ann. Statist., 6,461-464.
70. Sclove, S. L. (1987). Application of model-selection criteria to some problems in multivariate analysis. Psychometrika, 52, 333-343.
71. Shannon, C. E. (1948). A mathematical theory of communication. Bell Systems Technology Journal, 27, 379-423.
72. Siri, W.E. (1956). Gross composition of the body. In Advances in Biological and Medical Physics, Vol. IV, J.H. Lawrence and C.A. Tobias (Eds.), Academic Press, New York.
73. Sokal, R. R. and Rohlf, F. J. (1981). Biometry, 2nded., W. H. Freeman and Company, New York.
74. Srinivas, M. and Patnaik, L. M. (1994). Genetic algorithms: a survey, IEEE Transactions of Signal Processing, 42 (4), 927-935.
75. Sumida, B. H., Houston, A. I., McNamara, J. M. and Hamilton, W. D. (1990). Genetic algorithms and evolution. J. Theoretical Biology,147, 59-84.
76. Theil, H. and Fiebig, D. G. (1984). Exploiting Continuity: Maximum Entropy Estimation of Continuous Distributions. Ballinger Publishing Company, Cambridge, MA.
77. van Emden, M. H. (1971). An Analysis of Complexity. Mathematical Centre Tracts, Amsterdam, 35.
78. von Neumann, J. (1966). Theory of Self-Reproducing Automata. In A. W. Burks (Ed.), University of Illinois Press, Urbana.
79. Wallace, C. S. and Freeman, P. R. (1987). Estimation and inference by compact coding. (With discussion). J. Royal Statist. Soc., Series B, 49, 240-265.
80. Wallace, C. S. and Dowe, D. L. (1993). MML estimation of the von Mises concentration parameter. Technical Report 93/193, Department of Computer Science, Monash University, Clayton 3168, Australia.
81. Watanabe, S. (1985). Pattern Recognition: Human and Mechanical. John Wiley and Sons, New York.
82. White, H. 1982. Maximum likelihood estimation of misspecified models, Economet-rica, 50, 1-26.
83. Wilkinson, L. (1989). SYSTAT: The System for Statistics, SYSTAT, Evanston, IL.
84. Wilmore, Jack (1976). Athletic Training and Physical Fitness: Physiological Principles of the Conditioning Process, Allyn and Bacon, Inc., Boston.