Combining least-squares support vector machines for classification of biomedical signals: A case study with knee-joint vibroarthrographic signals

Journal of Experimental and Theoretical Artificial Intelligence

Volumn 23, Issue 1, 2011, Pages 63-77

  Wu, Yunfeng ^a   Krishnan, Sridhar ^a  

^a RYERSON UNIVERSITY   (Canada)

Author keywords

Ensemble learning; Fusion; Knee joint vibration; Least squares support vector machine; Multiple classifier systems; Pattern recognition; Vibroarthrography

Indexed keywords

ENSEMBLE LEARNING; FUSION; KNEE-JOINT VIBRATION; LEAST-SQUARES SUPPORT VECTOR MACHINE; MULTIPLE CLASSIFIER SYSTEMS; VIBROARTHROGRAPHY;

BIOELECTRIC PHENOMENA; CARTILAGE; COMPUTER HARDWARE; GEARS; PATTERN RECOGNITION; RECURRENT NEURAL NETWORKS; SUPPORT VECTOR MACHINES;

JOINTS (ANATOMY);

EID: 79956124873     PISSN: 0952813X     EISSN: 13623079     Source Type: Journal    
DOI: 10.1080/0952813X.2010.506288     Document Type: Conference Paper

References (43)

1. Breiman, L. (1996), 'Bagging Predictors', Machine Learning, 24, 123-140. (Pubitemid 126724382)
2. Cashman, P. M. M., Kitney, R. I., Gariba, M. A., and Carter, M. E. (2002), 'Automated Techniques for Visualization and Mapping of Articular Cartilage in MR Images of the Osteoarthritic Knee: A Base Technique for the Assessment of Microdamage and Submicro Damage', IEEE Transactions on Nanobioscience, 1, 42-51. (Pubitemid 44357762)
3. Chan, W. P., Lang, P., Stevens, M. P., Sack, K., Majumdar, S., Stoller, D. W., Basch, C., and Genant, H. K. (1991), 'Osteoarthritis of the Knee: Comparison of Radiography, CT, and MR Imaging to Assess Extent and Severity', American Journal of Roentgenology, 157, 799-806.
4. Cortes, C., and Vapnik, V. N. (1995), 'Support-vector Networks', Machine Learning, 20, 273-297.
5. Cybenko, G. (1989), 'Approximation by Superpositions of a Sigmoidal Function', Mathematics of Control, Signals, and Systems, 2, 303-314.
6. Duda, R. O., Hart, P. E., and Stork, D. G. (2001), Pattern Classification (2nd ed.), New York, NY: Wiley.
7. Efron, B., and Tibshirani, R. (1993), An Introduction to the Bootstrap, New York, NY: Chapman and Hall.
8. Frank, C. B., Rangayyan, R. M., and Bell, G. D. (1990), 'Analysis of Knee Sound Signals for Noninvasive Diagnosis of Cartilage Pathology', IEEE Engineering in Medicine and Biology Magazine, 9, 65-68. (Pubitemid 20250655)
9. Freund, Y., and Schapire, R. E. (1997), 'A Decision-theoretic Generalisation of On-line Learning and an Application to Boosting', Journal of Computer and System Sciences, 55, 119-139. (Pubitemid 127433398)
10. Fumera, G., and Roli, F. (2005), 'A Theoretical and Experimental Analysis of Linear Combiners for Multiple Classifier Systems', IEEE Transactions on Pattern Analysis and Machine Intelligence, 27, 942-956. (Pubitemid 40889844)
11. Hansen, L. K., and Salamon, P. (1990), 'Neural Network Ensembles', IEEE Transactions on Pattern Analysis and Machine Intelligence, 12, 993-1001.
12. Hashem, S., and Schmeiser, B. (1995), 'Improving Model Accuracy using Optimal Linear Combinations of Trained Neural Networks', IEEE Transactions on Neural Networks, 6, 792-794.
13. Haykin, S. (1998), Neural Networks: A Comprehensive Foundation (2nd ed.), Englewood Cliffs, NJ: Prentice Hall PTR.
14. Hornik, K. M., Stinchcombe, M., and White, H. (1989), 'Multilayer Feedforward Networks are Universal Approximators', Neural Networks, 2, 359-366. (Pubitemid 20609008)
15. Kittler, J., Hatef, M., Duin, R. P. W., and Matus, J. (1998), 'On Combining Classifiers', IEEE Transactions on Pattern Analysis and Machine Intelligence, 20, 226-239. (Pubitemid 128741312)
16. Krishnan, S., Rangayyan, R. M., Bell, G. D., and Frank, C. B. (2000), 'Adaptive Time-frequency Analysis of Knee Joint Vibroarthrographic Signals for Noninvasive Screening of Articular Cartilage Pathology', IEEE Transactions on Biomedical Engineering, 47, 773-783. (Pubitemid 30332016)
17. Krishnan, S., Rangayyan, R. M., Bell, G. D., and Frank, C. B. (2001), 'Auditory Display of Kneejoint Vibration Signals', Journal of the Acoustical Society of America, 110, 3292-3304. (Pubitemid 33144328)
18. Krishnan, S., Rangayyan, R. M., Bell, G. D., Frank, C. B., and Ladly, K. O. (1997), 'Adaptive Filtering, Modelling, and Classification of Knee Joint Vibroarthrographic Signals for Noninvasive Diagnosis of Articular Cartilage Pathology', Medical and Biological Engineering and Computing, 35, 677-684. (Pubitemid 27519195)
19. Kuncheva, L. I. (2002), 'A Theoretical Study on Six Classifier Fusion Strategies', IEEE Transactions on Pattern Analysis and Machine Intelligence, 24, 281-286. (Pubitemid 34198215)
20. McCoy, G. F., McCrea, J. D., Beverland, D. E., Kernohan, W. G., and Mollan, R. A. B. (1987), 'Vibration Arthrography As a Diagnostic Aid in Diseases of the Knee', The Journal of Bone and Joint Surgery, 69-B, 288-293. (Pubitemid 17093639)
21. Metcalf, R. W. (1984), 'Arthroscopic Knee Surgery', Advances in Surgery, 17, 197-240.
22. Nash, S. G., and Sofer, A. (1995), Linear and Nonlinear Programming, Columbus, OH: McGraw-Hill.
23. Opitz, D. W., and Maclin, R. (1999), 'Popular Ensemble Methods: An Empirical Study', Journal of Artificial Intelligence Research, 11, 169-198. (Pubitemid 129628763)
24. Rangayyan, R. M. (2002), Biomedical Signal Analysis: A Case-Study Approach, New York, NY: IEEE and Wiley.
25. Rangayyan, R. M., Krishnan, S., Bell, G. D., Frank, C. B., and Ladly, K. O. (1997), 'Parametric Representation and Screening of Knee Joint Vibroarthrographic Signals', IEEE Transactions on Biomedical Engineering, 44, 1068-1074. (Pubitemid 27467385)
26. Rangayyan, R. M., and Wu, Y. F. (2008), 'Screening of Knee-joint Vibroarthrographic Signals using Statistical Parameters and Radial Basis Functions', Medical and Biological Engineering and Computing, 46, 223-232. (Pubitemid 351279724)
27. Rangayyan, R. M., and Wu, Y. F. (2009), 'Analysis of Vibroarthrographic Signals with Features Related to Signal Variability and Radial-basis Functions', Annals of Biomedical Engineering, 37, 156-163.
28. Rangayyan, R. M., and Wu, Y. F. (2010), 'Screening of Knee Joint Vibroarthographic Signals Using Probability Density Functions Estimated with Parcen Windows', Biomedical Signal Processing and Control, 5, 53-58.
29. Ridgeway, G. (1999), 'The State of Boosting', Computing Science and Statistics, 31, 172-181.
30. Roli, F., and Giacinto, G. (2002), 'Design of Multiple Classifier Systems', in Hybrid Methods in Pattern Recognition, eds. H. Bunke and A. Kandel, Singapore: World Scientific Publishing.
31. Sinha, A., Chen, H., Danu, D. G., Kirubarajan, T., and Farooq, M. (2008), 'Estimation and Decision Fusion: A Survey', Neurocomputing, 71, 2650-2656.
32. Suykens, J. A. K., Van Gestel, T., De Brabanter, J., De Moor, B., and Vandewalle, J. (2002), Least Squares Support Vector Machines, Singapore: World Scientific Publishing.
33. Ueda, N. (2000), 'Optimal Linear Combination of Neural Networks for Improving Classification Performance', IEEE Transactions on Pattern Analysis and Machine Intelligence, 22, 207-215.
34. Umapathy, K., and Krishnan, S. (2006), 'Modified Local Discriminant Bases Algorithm and its Application in Analysis of Human Knee Joint Vibration Signals', IEEE Transactions on Biomedical Engineering, 53, 517-523. (Pubitemid 43288829)
35. Valentini, G. and Masulli, F. (2002), 'Ensembles of learning machines', in Proceedings of the 13th Italian Workshop on Neural Nets (WIRN'02), LNCS 2486, Vietri sul Mare, Italy, pp. 3-19.
36. Vapnik, V. N. (1998), Statistical Learning Theory, New York, NY: Wiley.
37. Vigorita, V. J. (1999), Orthopaedic Pathology, Philadelphia, PA: Lippincott Williams & Wilkins.
38. Woods, K., Kegelmeyer, W. P., and Bowyer, K. (1997), 'Combination of Multiple Classifier Systems', IEEE Transactions on Pattern Analysis and Machine Intelligence, 19, 405-410.
39. Wu, Y. F., and Arribas, J. I. (2003), 'Fusing Output Information in Neural Networks: Ensemble Performs Better', in Proceedings of the 25th Annual International Conference of IEEE EMBS (EMBC'03), Cancun, Mexico, pp. 2265-2268.
40. Wu, Y. F., He, J. J., Man, Y., and Arribas, J. I. (2004), 'Neural Network Fusion Strategies for Identifying Breast Masses', in Proceedings of the 2004 International Joint Conference on Neural Networks (IJCNN'04), Budapest, Hungary, pp. 2437-2442. (Pubitemid 40006639)
41. Wu, Y. F., and Ng, S. C. (2007), 'Unbiased Linear Neural-based Fusion with Normalized Weighted Average Algorithm for Regression', in Proceedings of the 4th International Symposium on Neural Networks (ISNN'07), LNCS 4493, Nanjing, China, pp. 664-670. (Pubitemid 350270113)
42. Wu, Y. F., Wang, C., Ng, S. C., Madabhushi, A., and Zhong, Y. X. (2006), 'Breast Cancer Diagnosis using Neural-based Linear Fusion Strategies', in Proceedings of the 13th International Conference on Neural Information Processing (ICONIP'06), LNCS 4234, Hong Kong, pp. 165-175. (Pubitemid 44699852)
43. Zhang, Y. T., Rangayyan, R. M., Frank, C. B., and Bell, G. D. (1994), 'Adaptive Cancellation of Muscle Contraction Interference from Knee Joint Vibration Signals', IEEE Transactions on Biomedical Engineering, 41, 181-191. (Pubitemid 24152758)