Time-frequency features for pattern recognition using high-resolution TFDs: A tutorial review

Digital Signal Processing: A Review Journal

Volumn 40, Issue 1, 2015, Pages 1-30

  Boashash, Boualem ^a,b   Khan, Nabeel Ali ^a   Ben Jabeur, Taoufik ^a  

^a QATAR UNIVERSITY   (Qatar)

^b UNIVERSITY OF QUEENSLAND   (Australia)

Author keywords

Compact kernel distribution; Newborn EEG seizure abnormality; Non stationary signals; Quadratic time frequency distributions; Time frequency feature extraction; Time frequency image processing

Indexed keywords

BIOMEDICAL SIGNAL PROCESSING; CLASSIFICATION (OF INFORMATION); EXTRACTION; FREQUENCY DOMAIN ANALYSIS; IMAGE ENHANCEMENT; TIME DOMAIN ANALYSIS; FEATURE EXTRACTION; IMAGE PROCESSING; PATTERN RECOGNITION; SIGNAL ANALYSIS; SIGNAL DETECTION; SIGNAL PROCESSING;

KERNEL DISTRIBUTION; NEWBORN EEG SEIZURE ABNORMALITY; NONSTATIONARY SIGNALS; QUADRATIC TIME-FREQUENCY; TIME FREQUENCY FEATURES; TIME-FREQUENCY IMAGES;

FEATURE EXTRACTION; TIME DOMAIN ANALYSIS;

EID: 84933673687     PISSN: 10512004     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.dsp.2014.12.015     Document Type: Review

References (82)

1. B. Boashash, G. Azemi, J.M. O'Toole, Time-frequency processing of nonstationary signals: advanced TFD design to aid diagnosis with highlights from medical applications, IEEE Signal Process. Mag. 30 (6) (2013) 108-119, http://dx.doi.org/10.1109/MSP.2013.2265914.
2. V. Chen, H. Ling, Joint time-frequency analysis for radar signal and image processing, IEEE Signal Process. Mag. 16 (2) (1999) 81-93, http://dx.doi.org/10.1109/79.752053.
3. G. Gaunaurd, H. Strifors, Signal analysis by means of time-frequency (Wigner-type) distributions - applications to sonar and radar echoes, Proc. IEEE 84 (9) (1996) 1231-1248, http://dx.doi.org/10.1109/5.535243.
4. B. Boashash, B. Escudie, Wigner-Ville analysis of asymptotic signals and applications, Signal Process. 8 (3) (1985) 315-327, http://dx.doi.org/10.1016/0165-1684(85)90109-4.
5. L.D. Avendano-Valencia, J.I. Gondino-Llorente, M. Blanco-Velasco, G. Castellanos-Dominguez, Feature extraction from parametric time frequency representations for heart murmur detection, Ann. Biomed. Eng. 38 (8) (2010) 2716-2732, http://dx.doi.org/10.1007/s10439-010-0077-4.
6. A.T. Tzallas, M.G. Tsipouras, D.I. Fotiadis, Automatic seizure detection based on time-frequency analysis and artificial neural networks, Comput. Intell. Neurosci. 1 (2007) 1-13, http://dx.doi.org/10.1155/2007/80510.
7. A.T. Tzallas, M.G. Tsipouras, D.I. Fotiadis, Epileptic seizure detection in EEGs using time-frequency analysis, IEEE Trans. Inf. Technol. Biomed. 13 (5) (2009) 703-710, http://dx.doi.org/10.1109/TITB.2009.2017939.
8. L.J. Stanković, M. Daković, T. Thayaparan, Time-Frequency Signal Analysis with Applications, Artech House, Boston, 2014.
9. H. Lee, Z.Z. Bien, A variable bandwidth filter for estimation of instantaneous frequency and reconstruction of signals with time-varying spectral content, IEEE Trans. Signal Process. 59 (5) (2011) 2052-2071, http://dx.doi.org/10.1109/TSP.2011.2113345.
10. M. Abed, A. Belouchrani, M. Cheriet, B. Boashash, Time-frequency distributions based on compact support kernels: properties and performance evaluation, IEEE Trans. Signal Process. 60 (6) (2012) 2814-2827, http://dx.doi.org/10.1109/TSP.2012.2190065.
11. S. Gomez, V. Naranjo, R. Miralles, Removing interference components in time frequency representations using morphological operators, J. Vis. Commun. Image Represent. 22 (5) (2011) 401-410, http://dx.doi.org/10.1016/j.jvcir.2011.03.007.
12. N.A. Khan, I.A. Taj, M.N. Jaffri, S. Ijaz, Cross-term elimination in Wigner distribution based on 2D signal processing techniques, Signal Process. 91 (3) (2011) 590-599, http://dx.doi.org/10.1016/j.sigpro.2010.06.004.
13. E. Sejdic, I. Djurovic, J. Jiang, Time-frequency feature representation using energy concentration: an overview of recent advances, Digit. Signal Process. 19 (1) (2009) 153-183, http://dx.doi.org/10.1016/j.dsp.2007.12.004.
14. M. Mboup, T. Adali, A generalization of the Fourier transform and its application to spectral analysis of chirp-like signals, Appl. Comput. Harmon. Anal. 32 (2) (2012) 305-312, http://dx.doi.org/10.1016/j.acha.2011.11.002.
15. B. Boashash, Time-frequency signal analysis, in: Advances in Spectral Analysis and Array Processing, Prentice Hall, 1991, pp. 418-517, http://qspace.qu.edu.qa/handle/10576/10832.
16. E. Bedrosian, A product theorem for Hilbert transforms, Proc. IEEE 51 (5) (1963) 868-869, http://dx.doi.org/10.1109/PROC.1963.2308.
17. B. Boashash, Estimating and interpreting the instantaneous frequency of a signal, I: fundamentals, Proc. IEEE 80 (4) (1992) 520-538, http://dx.doi.org/10.1109/5.135376.
18. T.-P. Jung, S. Makeig, C. Humphries, T.-W. Lee, M.J. Mckeown, V. Iragui, T.J. Sejnowski, Removing electroencephalographic artifacts by blind source separation, Psychophysiology 37 (2) (2000) 163-178, http://dx.doi.org/10.1111/1469-8986.3720163.
19. M. Sun, S. Qian, X. Yan, S.B. Baumann, X.-G. Xia, R. Dahl, N. Ryan, R. Sclabassi, Localizing functional activity in the brain through time-frequency analysis and synthesis of the EEG, Proc. IEEE 84 (9) (1996) 1302-1311, http://dx.doi.org/10.1109/5.535248.
20. A. Subasi, E. Ercelebi, A. Alkan, E. Koklukaya, Comparison of subspace-based methods with AR parametric methods in epileptic seizure detection, Comput. Biol. Med. 36 (2) (2006) 195-208, http://dx.doi.org/10.1016/j.compbiomed.2004.11.001.
21. S. Altunay, Z. Telatar, O. Erogul, Epileptic EEG detection using the linear prediction error energy, Expert Syst. Appl. 37 (8) (2010) 5661-5665, http://dx.doi.org/10.1016/j.eswa.2010.02.045.
22. V. Srinivasan, C. Eswaran, N. Sriraam, Approximate entropy-based epileptic EEG detection using artificial neural networks, IEEE Trans. Inf. Technol. Biomed. 11 (3) (2007) 288-295, http://dx.doi.org/10.1109/TITB.2006.884369.
23. K. Polat, S. Gunes, Classification of epileptiform EEG using a hybrid system based on decision tree classifier and fast Fourier transform, Appl. Math. Comput. 187 (2) (2007) 1017-1026, http://dx.doi.org/10.1016/j.amc.2006.09.022.
24. N. Kannathal, M.L. Choo, U.R. Acharya, P. Sadasivan, Entropies for detection of epilepsy in EEG, Comput. Methods Programs Biomed. 80 (3) (2005) 187-194, http://dx.doi.org/10.1016/j.cmpb.2005.06.012.
25. B. Boashash, L. Boubchir, G. Azemi, A methodology for time-frequency image processing applied to the classification of non-stationary multichannel signals using instantaneous frequency descriptors with application to newborn EEG signals, EURASIP J. Adv. Signal Process. 2012 (1) (2012) 1-21, http://dx.doi.org/10.1186/1687-6180-2012-117.
26. B. Boashash, G. Azemi, N.A. Khan, Principles of time-frequency feature extraction for change detection in non-stationary signals: applications to newborn EEG abnormality detection, Pattern Recognit. 48 (3) (2015) 616-627, http://dx.doi.org/10.1016/j.patcog.2014.08.016.
27. S.S. Abeysekera, B. Boashash, Methods of signal classification using the images produced by the Wigner-Ville distribution, Pattern Recognit. Lett. 12 (11) (1991) 717-729, http://dx.doi.org/10.1016/0167-8655(91)90010-J.
28. J. Terrien, C. Marque, G. Germain, Ridge extraction from the time-frequency representation (TFR) of signals based on an image processing approach: application to the analysis of uterine electromyogram AR TFR, IEEE Trans. Biomed. Eng. 55 (5) (2008) 1496-1503, http://dx.doi.org/10.1109/TBME.2008.918556.
29. J.D. Martinez-Vargas, J.I. Godino-Llorente, G. Castellanos-Dominguez, Time-frequency based feature selection for discrimination of non-stationary biosignals, EURASIP J. Adv. Signal Process. 2012 (1) (2012) 1-18, http://dx.doi.org/10.1186/1687-6180-2012-219.
30. P. Honeine, C. Richard, P. Flandrin, Time-frequency learning machines, IEEE Trans. Signal Process. 55 (7) (2007) 3930-3936, http://dx.doi.org/10.1109/TSP.2007.894252.
31. S. Aviyente, E.M. Bernat, S.M. Malone, W.G. Iacono, Time-frequency data reduction for event related potentials: combining principal component analysis and matching pursuit, EURASIP J. Adv. Signal Process. 2010 (2010) 1-14, http://dx.doi.org/10.1155/2010/289571.
32. B. Boashash, T. Ben-Jabeur, Design of a high-resolution separable-kernel quadratic TFD for improving newborn health outcomes using fetal movement detection, in: 11th International Conference on Information Science, Signal Processing and Their Applications, 2012, pp. 354-359.
33. B. Boashash, Time-Frequency Signal Analysis and Processing: A Comprehensive Reference, Elsevier, Oxford, 2003.
34. W.-k. Lu, Q. Zhang, Deconvolutive short-time Fourier transform spectrogram, IEEE Signal Process. Lett. 16 (7) (2009) 576-579, http://dx.doi.org/10.1109/LSP.2009.2020887.
35. L.J. Stanković, A method for time-frequency analysis, IEEE Trans. Signal Process. 42 (1) (1994) 225-229, http://dx.doi.org/10.1109/78.258146.
36. F. Hlawatsch, Interference terms in the Wigner distribution, Digit. Signal Process. 84 (1984) 363-367.
37. B. Barkat, B. Boashash, A high-resolution quadratic time-frequency distribution for multicomponent signals analysis, IEEE Trans. Signal Process. 49 (10) (2001) 2232-2239, http://dx.doi.org/10.1109/78.950779.
38. B. Boashash, V. Sucic, Resolution measure criteria for the objective assessment of the performance of quadratic time-frequency distributions, IEEE Trans. Signal Process. 51 (5) (2003) 1253-1263, http://dx.doi.org/10.1109/TSP.2003.810300.
39. C. Yeh, A. Roebel, X. Rodet, Multiple fundamental frequency estimation and polyphony inference of polyphonic music signals, IEEE Trans. Audio Speech Lang. Process. 18 (6) (2010) 1116-1126, http://dx.doi.org/10.1109/TASL.2009.2030006.
40. B. Boashash, Estimating and interpreting the instantaneous frequency of a signal, II: algorithms and applications, Proc. IEEE 80 (4) (1992) 540-568, http://dx.doi.org/10.1109/5.135378.
41. V. Katkovnik, L.J. Stanković, Instantaneous frequency estimation using the Wigner distribution with varying and data-driven window length, IEEE Trans. Signal Process. 46 (9) (1998) 2315-2325, http://dx.doi.org/10.1109/78.709514.
42. M.K. Emresoy, A. El-Jaroudi, Iterative instantaneous frequency estimation and adaptive matched spectrogram, Signal Process. 64 (2) (1998) 157-165, http://dx.doi.org/10.1016/S0165-1684(97)00183-7.
43. P.L. Shui, H.Y. Shang, Y.B. Zhao, Instantaneous frequency estimation based on directionally smoothed pseudo-Wigner-Ville distribution bank, IET Radar Sonar Navig. 1 (4) (2007) 317-325, http://dx.doi.org/10.1049/rsn:20060123.
44. L. Rankine, M. Mesbah, B. Boashash, IF estimation for multicomponent signals using image processing techniques in the time frequency domain, Signal Process. 87 (6) (2007) 1234-1250, http://dx.doi.org/10.1016/j.sigpro.2006.10.013.
45. J. Lerga, V. Sucic, B. Boashash, An efficient algorithm for instantaneous frequency estimation of nonstationary multicomponent signals in low SNR, EURASIP J. Adv. Signal Process. 2011 (1) (2011) 1-16, http://dx.doi.org/10.1155/2011/725189.
46. S. Dong, G. Azemi, B. Lingwood, P.B. Colditz, B. Boashash, Performance evaluation of multi-component instantaneous frequency estimation techniques for heart rate variability analysis, in: 11th International Conference on Information Science, Signal Processing and Their Applications, 2012, pp. 1211-1216.
47. N.A. Khan, B. Boashash, Instantaneous frequency estimation of multicomponent nonstationary signals using multiview time-frequency distributions based on the adaptive fractional spectrogram, IEEE Signal Process. Lett. 20 (2) (2013) 157-160, http://dx.doi.org/10.1109/LSP.2012.2236088.
48. I.M. Sobol, Simulation and the Monte Carlo Method, CRC Press, 2008.
49. I. Shafi, J. Ahmad, S.I. Shah, F.M. Kashif, Computing deblurred time-frequency distributions using artificial neural networks, Circuits Syst. Signal Process. 27 (3) (2008) 277-294, http://dx.doi.org/10.1007/s00034-008-9027-x.
50. L.J. Stanković, Analysis of noise in time-frequency distributions, IEEE Signal Process. Lett. 9 (9) (2002) 286-289, http://dx.doi.org/10.1109/LSP.2002.803409.
51. K. Konstantinides, B. Natarajan, G.S. Yovanof, Noise estimation and filtering using block-based singular value decomposition, IEEE Trans. Image Process. 6 (3) (1997) 479-483, http://dx.doi.org/10.1109/83.557359.
52. H. Hassanpour, A time-frequency approach for noise reduction, Digit. Signal Process. 18 (5) (2008) 728-738, http://dx.doi.org/10.1016/j.dsp.2007.09.014.
53. R.G. Baraniuk, Wavelet soft-thresholding of time-frequency representations, in: IEEE International Conference on Image Processing, vol. 1, 1994, pp. 71-74, http://dx.doi.org/10.1109/ICIP.1994.413277.
54. R.M. Haralick, S.R. Sternberg, X. Zhuang, Image analysis using mathematical morphology, IEEE Trans. Pattern Anal. Mach. Intell. 9 (4) (1987) 532-550, http://dx.doi.org/10.1109/TPAMI.1987.4767941.
55. B. Dugnol, C. Fernández, G. Galiano, Wolf population counting by spectrogram image processing, Appl. Math. Comput. 186 (1) (2007) 820-830, http:// dx.doi.org/10.1016/j.amc.2006.08.173.
56. G.R. Arce, S.R. Hasan, Elimination of interference terms of the discrete Wigner distribution using nonlinear filtering, IEEE Trans. Signal Process. 48 (8) (2000) 2321-2331, http://dx.doi.org/10.1109/78.852013.
57. L.J. Stanković, A measure of some time-frequency distributions concentration, Signal Process. 81 (3) (2001) 621-631, http://dx.doi.org/10.1016/S0165-1684(00)00236-X, special section on Digital Signal Processing for Multimedia.
58. R.G. Baraniuk, D.L. Jones, A signal dependent time-frequency representation: fast algorithm for optimal kernel design, IEEE Trans. Signal Process. 42 (1) (1994) 134-146, http://dx.doi.org/10.1109/78.258128.
59. D.L. Jones, R.G. Baraniuk, An adaptive optimal-kernel time-frequency representation, IEEE Trans. Signal Process. 43 (10) (1995) 2361-2371, http://dx.doi.org/10.1109/78.469854.
60. T.-H. Sang, W. Williams, Renyi information and signal-dependent optimal kernel design, in: International Conference on Acoustics, Speech, and Signal Processing, vol. 2, 1995, pp. 997-1000, http://dx.doi.org/10.1109/ICASSP.1995.480344.
61. D.L. Jones, T.W. Parks, A high resolution data-adaptive time-frequency representation, IEEE Trans. Acoust. Speech Signal Process. 38 (12) (1990) 2127-2135, http://dx.doi.org/10.1109/29.61539.
62. M.J. Bastiaans, Comment on the t-class of time-frequency distributions: time-only kernels with amplitude estimation, J. Franklin Inst. 348 (9) (2011) 2670-2673, http://dx.doi.org/10.1016/j.jfranklin.2011.07.009.
63. M.J. Bastiaans, T. Alieva, L.J. Stanković, On rotated time-frequency kernels, IEEE Signal Process. Lett. 9 (11) (2002) 378-381, http://dx.doi.org/10.1109/LSP.2002.805118.
64. S. Choomchuay, K. Sihalath, An application of second derivative of gaussian filters in fingerprint image enhancement, in: 4th International Conference on Bioinformatics and Biomedical Engineering, 2010, pp. 1-4.
65. Y. Liu, L. Mejias, Z. Li, Fast power line detection and localization using steerable filter for active UAV guidance, in: 12th International Society for Photogrammetry & Remote Sensing, Melbourne Convention and Exhibition Centre, Melbourne, VIC, 2012, http://eprints.qut.edu.au/53977/.
66. M. Jacob, M. Unser, Design of steerable filters for feature detection using canny-like criteria, IEEE Trans. Pattern Anal. Mach. Intell. 26 (2004) 1007-1019, http://dx.doi.org/10.1109/TPAMI.2004.44.
67. A.K. Ozdemir, O. Arikan, A high resolution time frequency representation with significantly reduced cross-terms, in: IEEE International Conference on Acoustics, Speech, and Signal Processing, vol. 2, 2000, pp. 693-696.
68. D. Gabor, Theory of communication, Part 1: the analysis of information, Proc. Inst. Electr. Eng., Part 3, Radio Commun. Eng. 93 (26) (1946) 429-441, http://dx.doi.org/10.1049/ji-3-2.1946.0074.
69. J.M. O'Toole, B. Boashash, Fast and memory-efficient algorithms for computing quadratic time-frequency distributions, Appl. Comput. Harmon. Anal. 35 (2) (2013) 350-358, http://dx.doi.org/10.1016/j.acha.2013.01.003.
70. J. Lofhede, M. Thordstein, N. Löfgren, A. Flisberg, M. Rosa-Zurera, I. Kjellmer, K. Lindecrantz, Automatic classification of background EEG activity in healthy and sick neonates, J. Neural Eng. 7 (1) (2007) 1-12, http://dx.doi.org/10.1088/1741-2560/7/1/016007.
71. V. Sucic, N. Saulig, B. Boashash, Estimating the number of components of a multicomponent nonstationary signal using the short-term time-frequency Renyi entropy, EURASIP J. Adv. Signal Process. 2011 (1) (2011) 1-11, http://dx.doi.org/10.1186/1687-6180-2011-125.
72. R.G. Baraniuk, P. Flandrin, A.J.E.M. Janssen, O.J.J. Michel, Measuring time-frequency information content using the Renyi entropies, IEEE Trans. Inf. Theory 47 (4) (2001) 1391-1409, http://dx.doi.org/10.1109/18.923723.
73. L. Rankine, M. Mesbah, B. Boashash, A matching pursuit-based signal complexity measure for the analysis of newborn EEG, Med. Biol. Eng. Comput. 45 (3) (2007) 251-260, http://dx.doi.org/10.1007/s11517-006-0143-0.
74. T. Fawcett, An introduction to ROC analysis, Pattern Recognit. Lett. 27 (8) (2006) 861-874, http://dx.doi.org/10.1016/j.patrec.2005.10.010.
75. N.J. Stevenson, M. Mesbah, G.B. Boylan, P.B. Colditz, B. Boashash, A nonlinear model of newborn EEG with nonstationary inputs, Ann. Biomed. Eng. 38 (9) (2010) 3010-3021, http://dx.doi.org/10.1007/s10439-010-0041-3.
76. A.M. Sayeed, D.L. Jones, Optimal kernels for nonstationary spectral estimation, IEEE Trans. Signal Process. 43 (2) (1995) 478-491, http://dx.doi.org/10.1109/78.348130.
77. F. Auger, P. Flandrin, Y.-T. Lin, S. McLaughlin, S. Meignen, T. Oberlin, H.-T. Wu, Time-frequency reassignment and synchrosqueezing: an overview, IEEE Signal Process. Mag. 30 (6) (2013) 32-41, http://dx.doi.org/10.1109/MSP.2013.2265316.
78. A. Loza, N. Canagarajah, D. Bull, Region feature-based segmentation of time-frequency images, in: International Workshop on Systems, Signals and Image Processing, Ambient Multimedia, Poznan, 2004, pp. 375-378.
79. N. Whitelonis, H. Ling, Radar signature analysis using a joint time-frequency distribution based on compressed sensing, IEEE Trans. Antennas Propag. 62 (2) (2014) 755-763, http://dx.doi.org/10.1109/TAP.2013.2291893.
80. T.H. Cormen, C. Stein, R.L. Rivest, C.E. Leiserson, Introduction to Algorithms, 2nd edition, McGraw-Hill Higher Education, 2001.
81. M. Hansson-Sandsten, Multitaper Wigner and Choi-Williams distributions with predetermined Doppler-lag bandwidth and sidelobe suppression, in: Fourier Related Transforms for Non-Stationary Signals, Signal Process. 91 (6) (2011) 1457-1465, http://dx.doi.org/10.1016/j.sigpro.2010.10.010.
82. B. Boashash, Algorithms for time-frequency signal analysis, in: Time-Frequency Signal Analysis - Methods & Applications, Longman-Cheshire, John Wiley Halsted Press, Melbourne, 1992, pp. 163-181, http://qspace.qu.edu.qa/bitstream/handle/10576/10811/Boashash-Reilly-1992-Longman-Cheshire-TFSA-book-Algorithms-4-TFSA.pdf?sequence=1.