Tutorial on Higher-Order Statistics (Spectra) in Signal Processing and System Theory: Theoretical Results and Some Applications

Proceedings of the IEEE

Volumn 79, Issue 3, 1991, Pages 278-305

  Mendel, Jerry M ^a  

^a UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

MATHEMATICAL STATISTICS; MATHEMATICAL TECHNIQUES - HARMONIC ANALYSIS; SIGNAL PROCESSING; SYSTEMS SCIENCE AND CYBERNETICS - IDENTIFICATION;

ARMA COEFFICIENTS; AUTOREGRESSIVE COEFFICIENTS; BICEPTRAL FORMULAS; CUMULANTS ESTIMATES; HIGHER-ORDER STATISTICS; MOVING AVERAGE COEFFICIENTS;

SIGNAL THEORY;

EID: 0026119462     PISSN: 00189219     EISSN: 15582256     Source Type: Journal    
DOI: 10.1109/5.75086     Document Type: Article

References (71)

1. B. D. O. Anderson and J. B. Moore, Optimal Filtering. Englewood Cliffs, NJ: Prentice-Hall, 1979.
2. M. S. Bartlett, An Introduction to Stochastic Processes. London, U.K.: Cambridge Univ. Press, 1955.
3. G. E. P. Box and G. M. Jenkins, Time Series Analysis, Forecasting and Control. San Francisco, CA: Holden-Day, 1970.
4. J. W. Brewer, “Kronecker products and matrix calculus in system theory,” IEEE Trans. Circuits Syst., vol. CAS-25, pp. 772–781, 1978.
5. D. R. Brillinger and M. Rosenblatt, ‘‘Computation and interpretation of kth-order spectra,” in Spectral Analysis of Time Series, B. Harris, Ed. New York: Wiley, pp. 189–232, 1967.
6. J. A. Cadzow, ‘‘Spectral estimation: An overdetermined rational model equation approach,” Proc. IEEE, vol. 70, pp. 907–938, 1982.
7. J. W. Dalle Molle and M. J. Hinich, ‘‘The trispectrum,” in Proc. Workshop on Higher-Order Spectral Analysis, Vail, CO, 1989, pp. 68–72.
8. B. Friedlander and B. Porat, ‘‘Adaptive IIR algorithms based on high-order statistics,” IEEE Trans. Acoust., Speech, Signal Processing, vol. 37, pp. 485–495, 1989.
9. B. Friedlander and B. Porat, ‘‘Asymptotically optimal estimation of MA and ARMA parameters of non-Gaussian processes from high-order moments,” IEEE Trans. Automat. Contr., vol. 35, pp. 27–35, 1990.
10. G. B. Giannakis, ‘‘Signal processing using higher-order statistics,” Ph.D. dissertation, Dep. Elec. Eng., Univ. Southern California, Los Angeles, CA, 1987.
11. G. B. Giannakis, ‘‘Cumulants: A powerful tool in signal processing,” Proc. IEEE, vol. 75, 1333–1334, 1987.
12. G. B. Giannakis, “On the identifiability of non-Gaussian ARMA models using cumulants,” IEEE Trans. Automat. Contr., vol. 35, pp. 18–26, 1990.
13. G. B. Giannakis, Y. Inouye, and J. M. Mendel, ‘‘Cumulant based identification of multichannel moving-average models,” IEEE Trans. Automat. Contr., vol. 34, pp. 783–787, July 1989.
14. G. B. Giannakis and J. M. Mendel, ‘‘Stochastic realization of nonminimum phase systems,” in Proc. Amer. Control Conf., vol. 2, Seattle, WA, 1986, pp. 1254–1259.
15. G. B. Giannakis and J. M. Mendel, ‘‘ARMA order determination via higher-order statistics,” presented at the MTNS Conf., Phoenix, AZ, 1987.
16. G. B. Giannakis and J. M. Mendel, ‘‘Identification of nonminimum phase systems using higherorder statistics,” IEEE Trans. Acoust., Speech, Signal Processing, vol. 37, pp. 360–377, 1989.
17. G. B. Giannakis and J. M. Mendel, “Cumulant-based order determination of non-Gaussian ARMA models,” IEEE Trans. Acoust., Speech, Signal Processing, vol. 38, pp. 1411–1423, 1990.
18. G. B. Giannakis and A. Swami, ‘‘New results on state-space and input-output identification of non-Gaussian processes using cumulants,” in Proc. SPIE-87, Advanced Algorithms and Architectures for Signal Processing II, San Diego, CA, 1987, 199–204.
19. G. B. Giannakis and A. Swami, “On estimating noncausal nonminimum phase ARMA models of non-Gaussian processes,” IEEE Trans. Acoust., Speech, Signal Processing, vol. 38, pp. 478–495, 1990.
20. G. H. Golub and C. F. Van Loan, Matrix Computations. Baltimore, MD: The John Hopkins Univ. Press, 1983.
21. H. P. Graf, L. D. Jackel, and W. E. Hubbard, ‘‘VLSI implementation of a neural network model,” Computer, pp. 41–49, 1988.
22. M. Huzii, ‘‘Estimation of coefficients of an AR process by using higher-order moment,” J. Time Series Anal., vol. 2, pp. 87–93, 1981.
23. V. P. Leonov and A. N. Shiryaev, “On a method of calculation of semi-invariants,” Theory Prob. Appl., vol. 4, pp. 319–328, 1959.
24. K-S. Lii and M. Rosenblatt, “Deconvolution and estimation of transfer function phase and coefficients for non-Gaussian linear processes,” in The Annals of Statistics, vol. 10, pp. 1195–1208, 1982.
25. L. Ljung and T. Soderstrom, Theory and Practice of Recursive Identification. Cambridge, MA: The MIT Press, 1983.
26. A. W. Lohmann, G. Weigelt, and B. Wimitzer, “Speckle masking in astronomy: Triple correlation theory and applications,” Appl. Opt., vol. 22, pp. 4028–4037, 1983.
27. A. W. Lohmann and B. Wimitzer, “Triple correlations,” Proc. IEEE, vol. 72, pp. 889–901, 1984.
28. J. M. Meridel, Lessons in Digital Estimation Theory. Englewood Cliffs, NJ: Prentice-Hall, 1987.
29. J. M. Meridel, “Use of higher-order statistics in signal processing and system theory: A short perspective,” presented at 8th Int'l. Symp. on MTNS, Phoenix, AZ, 1987; in Linear Circuits, Systems and Signal Processing: Theory and Applications., C. I. Byrnes, C. F. Martin, and R. E. Saeks, Eds. New York, NY: North Holland, 1988, pp. 217–224.
30. J. M. Meridel, “Use of higher-order statistics in signal processing and system theory: An update,” in Proc. SPIE Conf. on Advanced Algorithms and Architectures for Signal Processing III, San Diego, CA, 1988, pp. 126–144.
31. J. M. Meridel, “A compendium of new theoretical results associated with using higher-order statistics in signal processing and system theory,” in Proc. of Indo-U.S. Workshop on Spectral Analysis in One or Two Dimensions, New Delhi, India, Nov. 1989.
32. J. M. Mendel and L. Wang, “Identification of moving average systems using higher-order statistics and learning,” in Neural Networks: A Dynamical Approach to Machine Intelligence, B. Kosko, Ed. Englewood Cliffs, NJ: Prentice-Hall, 1990
33. “Cumulant-based parameter estimation using stuctured networks,” IEEE Trans. Neural Networks, vol. 2, pp. 73–83, Jan. 1991
34. C. L. Nikias and H. Chiang, “Higher-order spectrum estimation via noncausal autoregressive modeling and deconvolution,” IEEE Trans. Acoust., Speech, Signal Processing, vol. 36, pp. 1911—1913, Dec. 1988.
35. C. L. Nikias and R. Pan, “Nonminimum phase system identification via cepstrum modeling of higher-order moments,” in Proc. ICASSP-87, Dallas, TX, 1987, pp. 980–983.
36. C. L. Nikias and M. Raghuveer, “Bispectrum estimation: A digital signal processing framework,” Proc. IEEE, vol. 75, pp. 869–891, 1987.
37. A. V. Oppenheim and R. W. Shafer, Discrete-Time Signal Processing. Englewood Cliffs, NJ: Prentice-Hall, 1989.
38. R. Pan and C. L. Nikias, “The complex cepstrum of higher-order moments,” IEEE Trans. Acoust., Speech, Signal Processing, vol. 36, pp. 186–205, 1988.
39. A. Papoulis, Probability, Random Variables and Stochastic Processes. New York: McGraw-Hill, 1984.
40. B. Porat and B. Friedlander, “Performance analysis of parameter estimation algorithms based on high-order moments,” Int. J. Adaptive Control and Signal Processing, vol. 3, pp. 191–229, 1989.
41. S. Prasad, R. T. Williams, A. K. Mahalanabis, and L. H. Sibul, “A transform-based covariance differencing approach for some classes of parameter estimation problems,” IEEE Trans. Acoust., Speech, Signal Processing, vol. 36, pp. 631–641, 1988.
42. M. B. Priestley, Spectral Analysis and Time Series. London, UK: Academic Press, 1981.
43. M. Raghuveer and C. L. Nikias, “Bispectrum estimation: A parametric approach,” IEEE Trans. Acoust., Speech, Signal Processing, vol. 33, pp. 1213–1230, 1985.
44. M. Rosenblatt, Stationary Sequences and Random Processes. Boston, MA: Birkhauser, 1985.
45. M. Rosenblatt and J. W. Van Ness, “Estimation of the bispectrum,” Ann. Math. Stat. pp. 420–436, 1965.
46. A. Swami, “System identification using cumulants,” Ph.D. dissertation, USC SIPI Report 140, Dep. Elec. Eng.-Syst., Univ. Southern California, Los Angeles, CA, 1988.
47. A. Swami, G. B. Giannakis, and J. M. Mendel, “A unified approach to modeling multichannel ARMA processes,” in Proc. ICASSP-89, Glascow, Scotland, 1989, 2182–2185.
48. A. Swami, G. B. Giannakis, and J. M. Mendel, “Modeling of multi-dimensional non-Gaussian processes using cumulants,” J. Multidimensional Signals and Systems, vol. 1, pp. 1–37, Mar. 1990.
49. A. Swami and J. M. Mendel, “Closed-form recursive estimation of MA coefficient using autocorrelations and third-order cumulants,” IEEE Trans. Acoust., Speech, Signal Processing, vol. 37, pp. 1794–1795, Nov. 1989.
50. A. Swami and J. M. Mendel, “ARMA parameter estimation using only output cumulants, “’ in Proc. IV IEEE ASSP Workshop on Spectrum Estimation and Modeling, Minneapolis, MN, 1988, pp. 193-198
51. IEEE Trans. Acoust., Speech, Signal Processing, vol. 38, July 1990, pp. 1257–1265.
52. A. Swami and J. M. Mendel, “Computation of cumulants of ARMA processes,” in Proc. ICASSP-89, Glascow, Scotland, 1989, pp. 2318–2321.
53. A. Swami and J. M. Mendel, “AR identifiability using cumulants,” in Proc. Workshop on Higher-Order Spectral Analysis, Vail, CO, 1989, pp. 1–6.
54. A. Swami and J. M. Mendel, “Identifiability of the parameters of an ARMA process using cumulants,” IEEE Trans. Automat. Contr., 1991.
55. A. Swami and J. M. Mendel, “Time and lag recursive computation of cumulants from a state space model,” USC-SIPI Rep. 121, Los Angeles, CA, 1988; also, in IEEE Trans. Automat. Contr., vol. 35, pp. 4–17, 1990.
56. A. Swami and J. M. Mendel, “Cumulant-based approach to the harmonic retrieval prob-lem,” in Proc. ICASSP-88, New York, NY, 1988, pp. 2264–2267.
57. A. Swami and J. M. Mendel, “Cumulant-based approach to the harmonic retrieval and related problems,” IEEE Trans. Acoust., Speech, Signal Processing, 1991.
58. M. A. Tekalp and A. T. Erdem, “Higher-order spectrum factorization in one and two dimensions with applications in signal modeling and nonminimum phase system identification,” IEEE Trans. Acoust., Speech, Signal Processing, vol. 37, pp. 1537–1549, Oct. 1989.
59. P. V. Tryon, “The bispectrum and higher-order spectra: A bibli-ography,” NBS Tech. Note 1036, National Bureau of Standards, Boulder, CO, 1981.
60. J. Tugnait, “Identification of nonminimum phase linear stochastic systems,” Automatica, vol. 22, pp. 454–464, 1986.
61. J. Tugnait, “Order reduction of SISO nonminimum phase stochastic systems,” IEEE Trans. Automat. Contr., vol. 31, pp. 623–632, July 1986.
62. J. Tugnait, “Realization and reduction of SISO nonminimum-phase parametric models of non-Gaussian linear processes: modeling, parameter estimation and system identification,” presented at MTNS Conf., Phoenix, AZ, 1987.
63. J. Tugnait, “Identification of linear stochastic systems via second—and fourth—order cumulant matching,” IEEE Trans. Inform. Theory, vol. 33, pp. 393–407, 1987.
64. J. Tugnait, “Fitting noncausal AR signal plus noise models to noisy non-Gaussian linear processes,” IEEE Trans. Automat. Contr., vol. 32, pp. 547–552, 1987.
65. “Approaches to FIR system identification with noisy data using higher-order statistics,” in Proc. Workshop on Higher-Order Spectral Analysis, Vail, CO, 1989, pp. 13-18
66. IEEE Trans. Acoust., Speech, Signal Processing, vol. 38, pp. 1307–1317, July 1990.
67. A. P. Petropulu and C. L. Nikias, “The complex cepstrum and bicepstrum: Analytic performance evaluation in the presence of Gaussian noise,” IEEE Trans. Acoust., Speech, Signal Processing, vol. 38, pp. 1246–1256, July 1990.
68. E. Parzen, “Time series analysis for models of signal plus white noise,” in Spectral Analysis of Time Series, B. Harris, Ed. New York: Wiley, 1967, pp. 233–257.
69. H. Akaike, “Note on higher order spectra,” Annals of the Institute of Statistical Mathematics. Tokyo, vol. 18, 1966, pp. 123–126.
70. H. Akaike, “On the use of non-Gaussian processes in the identification of a linear dynamic system,” Research Memo 3, Institute of Statistical Mathematics, Tokyo, 1966.
71. J. K. Tugnait, “Recovering the poles from third-order cumulants of system output,” IEEE Trans, on Automat. Conr., vol. 34, pp. 1085–-1089 1989.