Evaluation of global and local training techniques over feed-forward neural network architecture spaces for computer-aided medical diagnosis

Expert Systems with Applications

Volumn 37, Issue 12, 2010, Pages 8450-8461

  Ince, Turker ^a   Kiranyaz, Serkan ^b   Pulkkinen, Jenni ^b   Gabbouj, Moncef ^b  

^a IZMIR UNIVERSITY OF ECONOMICS   (Turkey)

^b TAMPERE UNIVERSITY OF TECHNOLOGY   (Finland)

Author keywords

Artificial neural networks; Backpropagation; Particle swarm optimization

Indexed keywords

ARTIFICIAL INTELLIGENCE; BACKPROPAGATION; BENCHMARKING; CLASSIFICATION (OF INFORMATION); COMPUTER AIDED DIAGNOSIS; COMPUTER ARCHITECTURE; DECISION SUPPORT SYSTEMS; DEEP NEURAL NETWORKS; DIAGNOSIS; DISEASES; MEDICAL PROBLEMS; NEURAL NETWORKS; OPTIMIZATION; PARTICLE SWARM OPTIMIZATION (PSO); PROBLEM SOLVING; STATISTICAL TESTS;

ARCHITECTURAL ANALYSIS; CLASSIFICATION PERFORMANCE; CLASSIFIER PERFORMANCE; COMPUTER-AIDED DECISION SUPPORTS; GENERALIZATION ABILITY; NEURAL NETWORK CLASSIFIER; NEURAL NETWORK TRAINING; PERFORMANCE ASSESSMENT;

NETWORK ARCHITECTURE;

EID: 77957841884     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2010.05.033     Document Type: Article

References (43)

1. Amari, S., Murata, N., Muller, K. R., Finke, M., & Yang, H. H. (1997). Asymptotic statistical theory of overtraining and cross-validation. IEEE Transactions on Neural Networks, 8(5), 985-996.
2. Andersen, T., & Martinez, T. (1999). Cross validation and MLP architecture selection. In Proceedings of international conference on neural networks (pp. 1614-1619).
3. Back, A., & Tsoi, A. C. (1994). On the backpropagation algorithm: Paralysis in multilayer perceptrons. In Proceedings of the fifth Australian conference on neural networks (pp. 102-104).
4. Back, T., & Kursawe, F. (1995). Evolutionary algorithms for fuzzy logic: A brief overview. In Fuzzy logic and soft computing (pp. 3-10). Singapore: World Scientific.
5. Baxt, W. G. (1990). Use of an artificial neural network for data analysis in clinical decision-making: The diagnosis of acute coronary occlusion. Neural Computing, 2, 480-489.
6. Carvalho, M., & Ludermir, T. B. (2007). Particle swarm optimization of neural network architectures and weights. In Proceedings of the 7th international conference on hybrid intelligent systems, Washington DC (pp. 336-339).
7. Chauvin, Y., & Rumelhart, D. E. (1995). Back propagation: Theory, architectures, and applications. Associates Publishers, Hillsdale, NJ, USA: Lawrence Erlbaum.
8. Christopher, K. M., & Seppi, K. D. (2004). The Kalman swarm. A new approach to particle motion in swarm optimization. In Proceedings of the genetic and evolutionary computation conference, GECCO (pp. 140-150).
9. Clerc, M. (1999). The swarm and the queen: Towards a deterministic and adaptive particle swarm optimization. In Proceedings of the IEEE congress on evolutionary computation (Vol. 3, pp. 1951-1957).
10. Eberhart, R. C. & Hu, X. (1999). Human tremor analysis using particle swarm optimization. In Proceedings of the congress on evolutionary computation (pp. 1927-1930).
11. Fayyad, U. M., Shapire, G. P., Smyth, P., & Uthurusamy, R. (1996). Advances in knowledge discovery and data mining. Cambridge, MA: MIT Press.
12. Goldberg, D. (1989). Genetic algorithms in search. Optimization and machine learning. Reading MA: Addison-Wesley. pp. 1-25.
13. Gudise, V. G., & Venayagamoorthy, G. K. (2003). Comparison of particle swarm optimization and backpropagation as training algorithms for neural networks. In Proceedings of the 2003 IEEE swarm intelligence symposium (pp. 110-117).
14. Haselsteiner, E., & Pfurtscheller, G. (2000). Using time dependent neural networks for eeg classification. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 8(4), 457-463.
15. Haykin, S. (1999). Neural networks: A comprehensive foundation, 2/E. New York: Prentice Hall.
16. Higashi, H., & Iba, H. (2003). Particle swarm optimization with gaussian mutation. In Proceedings of the IEEE swarm intelligence symposium (pp. 72-79).
17. Hosseini, H. G., Luo, D., & Reynolds, K. J. (2006). The comparison of different feed forward neural network architectures for ECG signal diagnosis. Medical Engineering and Physics, 28, 372-378.
18. Hu, X., & Shi, Y. (2004). Recent advances in particle swarm. In Proceedings of IEEE congress on evolutionary computation (pp. 90-97).
19. Joost, M., & Schiffmann, W. (1998). Speeding up backpropagation algorithms by using cross-entropy combined with pattern normalization. International Journal of Uncertainty, Fuzziness Knowledge-based Systems, 6(2), 117-126.
20. Kennedy, J., & Eberhart, R. (1995). Particle swarm optimization. In Proceedings of of IEEE international conference on neural networks, Perth, Australia (Vol. 4, pp. 1942-1948).
21. Kolen, J. F., & Pollack, J. B. (1990). Back propagation is sensitive to initial conditions. Complex Systems, 4, 860-867.
22. Koza, J. (1992). Genetic programming: On the programming of computers by means of natural selection. Massachussetts: MIT Press, Cambridge.
23. Lippmann, R. P. (1987). An introduction to computing with neural nets. IEEE ASSP Magazine(1987), 4-22.
24. Lisboa, P. J. (2002). A review of evidence of health benefit from artificial neural networks in medical intervention. Neural Networks, 15, 11-39.
25. Lisboa, P. J., & Taktak, A. F. G. (2006). The use of artificial neural networks in decision support in cancer: A systematic review. Neural Networks, 19(4), 408-415.
26. Lovberg, M. (2002). Improving particle swarm optimization by hybridization of stochastic search heuristics and self-organized criticality. MSc thesis, Department of Computer Science, University of Aarhus, Denmark.
27. Lovberg, M. & Krink, T. (2002). Extending particle swarm optimisers with selforganized criticality. In Proceedings of the IEEE congress on evolutionary computation (Vol. 2, pp. 1588-1593).
28. Mazurowski, M. A., Habas, P. A., Zurada, J. M., Lo, J. Y., Baker, J. A., & Tourassi, G. D. (2008). Training neural network classifiers for medical decision making: The effects of imbalanced datasets on classification performance. Neural Networks, 21, 427-436.
29. Meissner, M., Schmuker, M., & Schneider, G. (2006). Optimized particle swarm optimization (OPSO) and its application to artificial neural network training. BMC Bioinformatics, 7, 125.
30. Prechelt, L. (1994). Proben1 - A set of neural network benchmark problems and benchmark rules. Technical Report 21/94, Fakultät für Informatik, Universität Karlsruhe, Germany.
31. Riedmiller, M., & Braun, H. (1993). A direct adaptive method for faster backpropagation learning: The RPROP algorithm. In Proceedings of the IEEE international conference on neural networks (pp. 586-591).
32. Riget, J., & Vesterstrom, J. S. (2002). A diversity-guided particle swarm optimizer - The ARPSO. Technical Report, Department of Computer Science, University of Aarhus.
33. Rumelhart, D., Hinton, G., & Williams, R. (1986). Learning internal representation by error propagation. In Parallel distributed processing: Explorations in the microstructure of cognition (pp. 318-362). Cambridge, MA: MIT Press.
34. Settles, M., Rodebaugh, B., & Soule, T. (2003). Comparison of genetic algorithm and particle swarm optimizer when evolving a recurrent neural network. In Lecture notes in computer science (LNCS) no.2723: Proc. of the genetic and evolutionary computation conference 2003 (GECCO 2003), Chicago, IL, USA (pp. 151-152).
35. Sexton, R. S., & Dorsey, R. E. (2000). Reliable classification using neural networks: A genetic algorithm and back propagation comparison. Decision Support Systems, 30, 11-22.
36. Shi, Y., & Eberhart, R. C. (1998). A modified particle swarm optimizer. In Proceedings of the IEEE congress on evolutionary computation (pp. 69-73).
37. Silverman, R. H., & Noetzel, A. S. (1990). Image processing and pattern recognition in ultrasonograms by backpropagation. Neural Networks, 3, 593-603.
38. Tourassi, G. D., Floyd, C. E., Sostman, H. D., & Coleman, R. E. (1993). Acute pulmonary embolism: Artificial neural network approach for diagnosis. Radiology, 189, 555-558.
39. Van den Bergh, F. (2002). An analysis of particle swarm optimizers. Ph.D. thesis, Department of Computer Science, University of Pretoria, Pretoria, South Africa.
40. Van den Bergh, F., & Engelbrecht, A. P. (2002). A new locally convergent particle swarm optimizer. In Proceedings of the IEEE international conference on systems, man, and cybernetics (pp. 96-101).
41. West, D., & West, V. (2000). Improving diagnostic accuracy using a hierarchical neural network to model decision subtasks. International Journal Medical Informatics, 57(1), 41-55.
42. Wilson, E. O. (1975). Sociobiology: The new synthesis. Cambridge, MA: Belknap Press.
43. Yu, J., Xi, L., & Wang, S. (2007). An improved particle swarm optimization for evolving feedforward artificial neural networks. Neural Processing Letters, 26(3), 217-231.