A mutual information based distance for multivariate Gaussian processes

Lecture Notes in Control and Information Sciences

Volumn 364, Issue , 2007, Pages 15-33

  Boets, Jeroen ^a   De Cock, Katrien ^a   De Moor, Bart ^a  

^a UNIVERSITY OF LEUVEN   (Belgium)

Author keywords

[No Author keywords available]

Indexed keywords

RANDOM PROCESSES;

CEPSTRAL; GAUSSIANS; MULTIVARIATE GAUSSIAN PROCESS; MULTIVARIATE PROCESS; MUTUAL INFORMATIONS; SPECIAL CLASS;

STOCHASTIC SYSTEMS;

EID: 35548971123     PISSN: 01708643     EISSN: None     Source Type: Book Series    
DOI: 10.1007/978-3-540-73570-0_3     Document Type: Conference Paper

References (34)

1. H. Akaike. Markovian representation of stochastic processes by canonical variables. SIAM Journal on Control, 13(1):162-173, 1975.
2. C. W. Anderson, E. A. Stolz, and S. Shamsunder. Multivariate autoregressive models for classification of spontaneous electroencephalografic signals during mental tasks. IEEE Transactions on Biomedical Engineering, 45(3):277-286, March 1998.
3. M. Basseville. Distance measures for signal processing and pattern recognition. Signal Processing, 18(4):349-369, December 1989.
4. A. Bissacco, A. Chiuso, Y. Ma, and S. Soatto. Recognition of human gaits. In Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition (CVPR 01), volume II, pages 52-58, Kauai, Hawaii, December 2001.
5. J. Boets, K. De Cock, and B. De Moor. Distances between dynamical models for clustering time series. In Proceedings of the 14th IFAC Symposium on System Identification (SYSID 2006), pages 392-397, Newcastle, Australia, March 2006.
6. J. Boets, K. De Cock, M. Espinoza, and B. De Moor. Clustering time series, subspace identification and cepstral distances. Communications in Information and Systems, 5(1):69-96, 2005.
7. T. M. Cover and J. A. Thomas. Elements of Information Theory. Wiley Series in Telecommunications. Wiley, New York, 1991.
8. K. De Cock. Principal Angles in System Theory, Information theory and Signal Processing. PhD thesis, K.U.Leuven, Leuven, Belgium, May 2002. Available as "ftp://ftp.esat.kuleuven.be/pub/SISTA/decock/reports/phd.ps. gz".
9. K. De Cock and B. De Moor. Subspace angles between ARMA models. Systems & Control Letters, 46(4): 265-270, July 2002.
10. U. B. Desai, D. Pal, and R. D. Kirkpatrick. A realization approach to stochastic model reduction. International Journal of Control, 42(4):821-838, 1985.
11. G. Doretto, A. Chiuso, Y. N. Wu, and S. Soatto. Dynamic textures. International Journal of Computer Vision, 51(2):91-109, 2003.
12. W. Gersch. Nearest, neighbor rule in classification of stationary and nonstationary time series. In D. F. Findley, editor, Applied Time Series Analysis II, pages 221-270. Academic Press, New York, 1981.
13. R. M. Gray, A. Buzo, A. H. Gray, Jr., and Y. Matsuyama. Distortion measures for speech processing. IEEE Transactions on Acoustics, Speech, and Signal Processing, ASSP-28(4):367-376, August 1980.
14. A. H. Gray, Jr. and J. D. Markel. Distance measures for speech processing. IEEE Transactions on Acoustics, Speech, and Signal Processing, ASSP-24(5):380-391, October 1976.
15. E. J. Hannan and D. S. Poskitt. Unit canonical correlations between future and past. The Annals of Statistics, 16(2):784-790, June 1988.
16. H. Hotelling. Relations between two sets of variates. Biometrika, 28:321-372, 1936.
17. I. A. Ibragimov and Y. A. Rozanov. Gaussian Random Processes. Springer, New York, 1978.
18. F. Itakura and T. Umezaki. Distance measure for speech recognition based on the smoothed group delay spectrum. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP87), volume 3, pages 1257-1260, 1987.
19. N. P. Jewell and P. Bloomfleld. Canonical, correlations of past and future for time series: definitions and theory. The Annals of Statistics, 11(3):837-847, 1983.
20. N. P. Jewell, P. Bloomfleld, and F. C. Bartmann. Canonical correlations of past and future for time series: bounds and computation. The Annals of Statistics, 11(3):848-855, 1983.
21. C. Jordan. Essai sur la géométrie ä n dimensions. Bulletin de la Société Mathématique, 3:103-174, 1875.
22. Y. Kakizawa, R. H. Shumway, and M. Taniguchi. Discrimination and clustering for multivariate time series. Journal of the American Statistical Association, 93:328-340, 1998.
23. K. Kalpakis, D. Gada, and V. Puttagunta. Distance measures for effective clustering of ARIMA time-series. In Proceedings of the 2001 IEEE International Conference on Data Mining (ICDM'01), pages 273-280, San Jose, CA, November-December 2001.
24. T. Katayama and G. Picci. Realization of stochastic systems with, exogenous inputs and subspace identification methods. Automatica, 35(10): 1635-1652, 1999.
25. D. Kazakos and P. Papantoni-Kazakos. Spectral, distance measures between Gaussian processes. IEEE Transactions on Automatic Control, 25(5):950-959, 1980.
26. L. Li and Z. Xie. Model selection and order determination for time series by information between the past and the future. Journal of time series analysis, 17(1):65-84, 1996.
27. A. Lindquist and G. Picci. Canonical correlation analysis, approximate covariance extension, and identification of stationary time series. Automatica, 32(5):709-733, 1996.
28. R. J. Martin. A metric for ARMA processes. IEEE Transactions on Signal Processing, 48(4): 1164-1170, April 2000.
29. M. S. Pinsker. Information and Information Stability of Random Variables and Processes. Holden-Day, San Francisco, 1964. Originally published in Russian in 1960.
30. F. C. Schweppe. On the Bhattacharyya distance and the divergence between Gaussian processes. Information and Control, 11(4):373-395, 1967.
31. F. C. Schweppe. State space evaluation of the Bhattacharyya distance between two Gaussian processes. Information and Control, 11(3):352-372, 1967.
32. R. H. Shumway and A. N. Unger. Linear discriminant functions for stationary time series. Journal of the American Statistical Association, 69:948-956, December 1974.
33. P. Van Overschee and B. De Moor. Subspace algorithms for the stochastic identification problem. Automatica, 29:649-660, 1993.
34. P. Van Overschee and B. De Moor. Subspace Identification for Linear Systems: Theory Implementation - Applications. Kluwer Academic Publishers, Boston, 1996.