Information importance of predictors: Concept, measures, Bayesian inference, and applications

Computational Statistics and Data Analysis

Volumn 53, Issue 6, 2009, Pages 2363-2377

  Retzer, J J ^a   Soofi, E S ^b,c   Soyer, R ^d  

^a Maritz Research   (United States)

^b UNIVERSITY OF WISCONSIN MILWAUKEE   (United States)

^c UNIVERSITY OF WISCONSIN MILWAUKEE   (United States)

^d GEORGE WASHINGTON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

APPLICATIONS; BAYESIAN NETWORKS; ENTROPY; INFERENCE ENGINES; PROBABILITY DENSITY FUNCTION;

BAYESIAN INFERENCE PROCEDURES; BAYESIAN INFERENCES; CHARACTERIZATION OF PROBABILITY DISTRIBUTIONS; CONCAVE FUNCTIONS; CONTINGENCY TABLES; DATA TYPES; GLOBAL MAXIMUM; INFORMATION IMPORTANCES; MAXIMUM ENTROPIES; MEASURES OF INFORMATIONS; RELATIVE IMPORTANCES; SHANNON ENTROPIES; STATISTICAL QUANTITIES; UNCERTAINTY REDUCTIONS; UNIFORM DISTRIBUTIONS;

PROBABILITY DISTRIBUTIONS;

EID: 61549120419     PISSN: 01679473     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.csda.2008.03.010     Document Type: Article

References (39)

1. Azen R., and Budescu D.V. The dominance analysis approach for comparing predictors in multiple regression. Psychological Methods 8 (2003) 129-148
2. Budescu D.V. Dominance analysis: A new approach to the problem of relative importance of predictors in multiple regression. Psychological Bulletin 114 (1993) 542-551
3. Chevan A., and Sutherland M. Hierarchical partitioning. The American Statistician 45 (1991) 90-96
4. Chib S., and Greenberg E. Understanding the Metropolis-Hastings algorithm. The American Statistician 49 (1995) 327-335
5. Coin D. Goodness-of-fit test for normality based on polynomial regression. Computational Statistics & Data Analysis 52 (2008) 2185-2198
6. Cover T.M., and Thomas J.A. Elements of Information Theory (1991), John Wiley, New York
7. Cox L.A. A new measure of attributable risk for public health applications. Management Science 31 (1985) 800-813
8. DeGroot M.H. Uncertainty, information, and sequential experiments. Annals of Mathematics and Statistics 33 (1962) 404-419
9. Dempster A.P. The direct use of likelihood for significance testing. Statistics and Computing 7 (1997) 247-252
10. Ebrahimi, N., Kirmani, S.N.U.A., Soofi, E.S., 2007a. Dynamic information about parameters of lifetime distribution. In: 56th Session of International Statistical Institute, Lisbon, Portugal
11. Ebrahimi N., Soofi E.S., and Soyer R. Multivariate maximum entropy identification, transformation, and dependence. Journal of Multivariate Analysis (2007) Available at Science Direct.
12. Frees E.W. Data Analysis Using Regression Models: The Business Perspective (1996), Prentice-Hall, Englewood Cliffs, NJ
13. 2 in multiple regression with correlated variables. Statistica Sinia 3 (1993) 407-420
14. Gokhale D.V., and Kullback S. The Information in Contingency Tables (1978), Marcel Dekker, New York
15. Grömping U. Estimators of relative importance in linear regression based on variance decomposition. The American Statistician 61 (2007) 139-147
16. Jaynes E.T. Information theory and statistical mechanics. Physics Review 106 (1957) 620-630
17. Jaynes E.T. On the rationale of maximum-entropy methods. Proceedings of IEEE 70 (1968) 939-952
18. Johnson J.W. A heuristic method for estimating the relative weight of predictor variables in multiple regression. Applied Behavioral Research 35 (2000) 1-19
19. Kass R.E., and Raftery A.E. Bayes factors. Journal of the American Statistical Association 90 (1995) 773-795
20. Kruskal W. Concepts of relative importance. Qüestiiò 8 (1984) 39-45
21. Kruskal W. Relative importance by averaging over orderings. The American Statistician 41 (1987) 6-10
22. Kruskal W., and Majors R. Concepts of relative importance in scientific literature. The American Statistician 43 (1989) 2-6
23. Lindeman R.H., Merenda P.F., and Gold R.Z. Introduction to Bivariate and Multivariate Analysis (1980), Scott, Foresman, and Company, Glenview, IL
24. Lipovetsky H., and Conklin M. Analysis of regression in game theory approach. Applied Stochastic Models in Business and Industry 17 (2001) 319-330
25. Mazzuchi, T, A., Soyer, R., Soofi, E.S., Retzer, J.J., 2000. Maximum entropy Dirichlet modeling of consumer choice. In: American Statistical Association Proceedings of Section on Bayesian Statistical Science, pp. 56-61
26. Pourahmadi M., and Soofi E.S. Predictive variance and information worth of observations in time series. Journal of Time Series Analysis 21 (2000) 413-434
27. Pratt, J.W., 1990. Measuring relative variable importance. in: ASA Proceedings of the Business and Economic Statistics Section, American Statistical Association.
28. Press S.J., and Zellner A. Posterior distribution for the multiple correlation coefficient with fixed regressors. Journal of Econometrics 8 (1978) 307-321
29. Quali A., Cherif A.R., and Krebs M.-0. Data mining based on Bayesian networks for best classification. Computational Statistics & Data Analysis 51 (2006) 1278-1292
30. Schemper M. The relative importance of prognostic factors in studies of survival. Statistics in Medicine 12 (1993) 2377-2382
31. Soofi E.S. A generalizable formulation of conditional logit with diagnostics. Journal of the American Statistical Association 87 (1992) 812-816
32. Soofi E.S. Capturing the intangible concept of information. Journal of the American Statistical Association 89 (1994) 1243-1254
33. Soofi E.S., and Retzer J.J. Information indices: Unification and applications. Journal of Econometrics 107 (2002) 17-40
34. Soofi E.S., Retzer J.J., and Yasai-Ardekani M. A framework for measuring the importance of variables with applications to management research and decision models. Decision Sciences 31 (2000) 595-625
35. Spiegelhalter D.J., Best N.G., Carlin B.P., and van der Linde A. Bayesian measures of model complexity and fit. Journal of the Royal Statistical Society, Series B 64 (2002) 1-34
36. Spiegelhalter D., Thomas A., Best N., and Gilks W. Bayesian Inference Using Gibbs Sampling Manual (version ii). MRC Biostatistics Unit (1996), Cambridge University
37. Theil H., and Chung C. Information-theoretic measures of fit for univariate and multivariate linear regressions. The American Statistician 42 (1988) 249-252
38. Zellner A. Bayesian Analysis in Econometrics and Statistics: The Zellner View and Papers (1997), Edward Elgar, Cheltenham UK
39. Zellner A. An Introduction to Bayesian Inference in Econometrics (1971), Wiley, New York reprinted in 1996 by Wiley