An overview of statistical decomposition techniques applied to complex systems

Computational Statistics and Data Analysis

Volumn 52, Issue 5, 2008, Pages 2292-2310

  Tuncer, Yalcin ^a,b   Tanik, Murat M ^c   Allison, David B ^c  

^a MIDDLE EAST TECHNICAL UNIVERSITY   (Turkey)

^b ANKARA UNIVERSITY   (Turkey)

^c UNIVERSITY OF ALABAMA AT BIRMINGHAM   (United States)

Author keywords

Bipartite network; Blind source separation; Complexity; Composition; Entropy; Independent component analysis; Information; Information transfer; Integration; Mutual information; Negentropy; Network component analysis: Principal component analysis; Singular value decomposition

Indexed keywords

BLIND SOURCE SEPARATION; COMPUTATIONAL COMPLEXITY; DATA TRANSFER; ENTROPY; INDEPENDENT COMPONENT ANALYSIS; PRINCIPAL COMPONENT ANALYSIS;

BIPARTITE NETWORK; INFORMATION TRANSFER; MUTUAL INFORMATION; NETWORK COMPONENT ANALYSIS;

SINGULAR VALUE DECOMPOSITION;

EID: 38149031614     PISSN: 01679473     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.csda.2007.09.012     Document Type: Article

References (34)

1. Anderson T.W. An Introduction to Multivariate Statistical Analysis (1984), Wiley, New York
2. Arnold B., Sarabia J.-M., and Castillo E. Conditional specification of statistical models: models and applications, Springer Series in Statistics (1999), Springer, New York
3. Ash R.B. Information Theory (1990), Dover, New York
4. Barlow R.E., and Prochan F. Statistical Theory of Reliability and Life Testing (1975), Holt, Rinehart and Winston, New York
5. Browning T.R. Applying the design structure matrix to system decomposition and integration problems: A review and new directions. IEEE Trans. Engng. Management 48 3 (2001) 292-306
6. Butterfly, P., Sudbery, A., Szule, J., 2005. Compatibility of subsystem states. Quantum Phys. 3 (arXiv:quant-ph/0407227 v 3 22 Apr 2005).
7. Chung, S., Seabrook, C., 2004. A singular value decomposition: analysis of grade distributions, Georgia Institute of technology, VIGRE REU, 〈http://www.its.caltech.edu/~mason/research/carstep.pdf〉.
8. Comon P. Independent component analysis, a new concept?. Signal Process. 36 (1994) 287-314
9. Conant, R.G., 1968. Information transfer in complex systems with applications to regulation, unpublished Ph.D. dissertation, University of Illinois.
10. Conant R.G. Detecting subsystems of a complex system. IEEE Trans. Systems Man Cybernet (1972) 550-553
11. Dall'Aglio, G., 1972. Frechet classes and compatibility of distribution functions. Sympos. Math. 9, 131-150.
12. Donoho, S., 2000. High-dimensional data analysis: the blessings and curses of dimensionality. in: AMS special conference "On mathematical challenges of the 21st century", 6-11 August 2000, UCLA, Los Angeles.
13. Eckart C., and Young G. Approximation of one matrix by another of lower rank. Psychometrika. 1 (1936) 211-218
14. Fan, J., Li, R., 2006. Statistical challenges with high dimensionality: feature selection in knowledge discovery. The Mathematics Arxive: math. ST/0602133.
15. Gurrera, M.D.C., 2005. Construction of bivariate distributions and statistical dependence operations. Ph. D. Dissertation, Department of Statistics, University of Barcelona.
16. Hastie T., Tibshirani R., Eisen M.E., Alizadeh A., Levy R., Staudt L., Chan W.C., and Botstein D. "Gene shaving" as a method for identifying distinct sets of genes with similar expression patterns. Genome Biol. 1 (2000)
17. Hotelling, H., 1933. Analysis of a complex of statistical variables with principal components. J. Ed. Psychology. 24, 417-441, 498-520.
18. Hyvarinen A., and Oja E. Independent component analysis: algorithms and applications. Neural Networks 13 (2000) 411-430
19. Hyvarinen A., Karhunen J., and Oja E. Independent Component Analysis (2001), Wiley, New York
20. Johnson, R.A., Wichern, D.W. 2002. Applied Multivariate Statistical Analysis. fifth ed. Prentice-Hall, Englewood Cliffs, New Jersey.
21. Jolliffe, I.T., 2002. Principal Component Analysis, second ed. Springer, New York.
22. Jutten C., and Herault J. Blind separation of sources, part 1: an adaptive algorithm based on neuromimatic architecture. Signal Process. 24 (1991) 1-10
23. Kendall M. Multivariate Analysis (1975), Charles Griffin & Company, London
24. Kullback S. Information and Statistics (1959), Wiley, New York
25. Lawson, C.L., Hanson, R.J., 1995. Solving Least Squares Problems, third ed. SIAM Classics in Appl. Math. vol. 15, Philadelphia.
26. Lee, T.W., Girolami, M., Bell, A.J., Sejnowski, T.J., 2000. A unifying information theoretic framework for independent component analysis. Internat. J. Math. Comput. Modeling 39, 1-21.
27. Liao R., Boscolo Y.-L., Yang L.M., Tran C.S., and Roychowdhury V.P. Network component analysis. PNAS 100 (2003) 15522-15527
28. Papoulis A., and Pillai S.U. Probability Random Variables and Stochastic Processes. fourth ed (2002), McGraw-Hill, New York
29. Pearson K. On lines and planes of closest fit to systems of points in space. Philos. Magazine 2 (1901) 559-572
30. Press W.H., Teukolsky S.A., Vetterling W.T., and Flannery B.P. Numerical Recipes in C. second ed (1992), Cambridge University Press, Cambridge
31. Scheffe H. The Analysis of Variance (1959), Wiley, New York
32. Schroedinger E. What Is Life? (1944), Cambridge University Press, Cambridge
33. Seber G.A.F. Multivariate Observations (1984), Wiley, New York
34. Stewart G.W. On the early history of the singular value decomposition. SIAM Rev. 35 4 (1993) 551-566