A parallel & distributed implementation of the harmony search based supervised training of artificial neural networks

Proceedings - 2011 2nd International Conference on Intelligent Systems, Modelling and Simulation, ISMS 2011

Volumn , Issue , 2011, Pages 277-283

  Kattan, Ali ^a   Abdullah, Rosni ^a  

^a SCHOOL OF PHYSICS   (Malaysia)

Author keywords

Harmony search; Neural network; Parallel distributed processing; Pattern classification

Indexed keywords

ARTIFICIAL NEURAL NETWORK; BENCHMARKING PROBLEMS; CLUSTER COMPUTER; DISTRIBUTED IMPLEMENTATION; EXECUTION TIME; FEED-FORWARD ARTIFICIAL NEURAL NETWORKS; HARMONY SEARCH; HARMONY SEARCH ALGORITHMS; HETEROGENEOUS SYSTEMS; HOMOGENEOUS SYSTEM; HYBRID TECHNIQUES; MASTER-SLAVE; NETWORK PARTITIONING; NOVEL TECHNIQUES; PARALLEL SYSTEM; PATTERN-CLASSIFICATION; SEQUENTIAL IMPLEMENTATION; SWITCHED NETWORKS; TRAINING METHODS;

BENCHMARKING; CLUSTER COMPUTING; DISTRIBUTED PARAMETER NETWORKS; INTELLIGENT SYSTEMS; SWITCHING CIRCUITS;

NEURAL NETWORKS;

EID: 79953744983     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ISMS.2011.49     Document Type: Conference Paper

References (36)

1. M. b. Nasr and M. Chtourou, "A Hybrid Training Algorithm for Feedforward Neural Networks" Neural Processing Letters, vol. 24, pp. 107-117, 2006. (Pubitemid 44570115)
2. F. Liang, "Annealing stochastic approximation Monte Carlo algorithm for neural network training," Mach Learn, vol. 68, pp. 201-233, 2007. (Pubitemid 47312488)
3. D. Kim, H. Kim, and D. Chung, "A Modified Genetic Algorithm for Fast Training Neural Networks," in Advances in Neural Networks - ISNN 2005. vol. 3496/2005: Springer Berlin / Heidelberg, 2005, pp. 660-665. (Pubitemid 41314354)
4. G. Wei, "Study on Evolutionary Neural Network Based on Ant Colony Optimization," in International Conference on Computational Intelligence and Security Workshops Harbin, Heilongjiang, China, 2007, pp. 3-6.
5. J. Yu, S. Wang, and L. Xi, "Evolving artificial neural networks using an improved PSO and DPSO," Neurocomputing, vol. 71, pp. 1054-1060, 2008.
6. K. S. Lee and Z. W. Geem, "A New Meta-heuristic Algorithm for Continuous Engineering Optimization: Harmony Search Theory and Practice," Computer Methods in Applied Mechanics and Engineering, vol. 194, pp. 3902-3933, 2005. (Pubitemid 40815237)
7. A. Kattan, R. Abdullah, and R. A. Salam, "Harmony Search Based Supervised Training of Artificial Neural Networks," in International Conference on Intelligent Systems, Modeling and Simulation (ISMS2010), Liverpool, England, 2010, pp. 105-110.
8. M. Mahdavi, M. Fesanghary, and E. Damangir, "An Improved Harmony Search Algorithm for Solving Optimization Problems," Applied Mathematics and Computation, vol. 188, pp. 1567-1579, 2007. (Pubitemid 46710046)
9. M. G. H. Omran and M. Mahdavi, "Globel-Best Harmony Search," Applied Mathematics and Computation, vol. 198, pp. 643-656, 2008.
10. Q.-K. Pan, P. N. Suganthan, M. F. Tasgetiren, and J. J. Liang, "A self-adaptive global best harmony search algorithm for continuous optimization problems," Applied Mathematics and Computation, vol. 216, pp. 830-848, 2010.
11. R. W. Duren, R. J. Marks II, and P. D. Reynolds, "Real-Time Neural Network Inversion on the SRC-6e Reconfigurable Computer," IEEE TRANSACTIONS ON NEURAL NETWORKS, vol. 18, pp. 889-901, 2007. (Pubitemid 46773752)
12. M. D. Hill and M. R. Marty, "Amdahl's Law in the Multicore Era," Computer, vol. 41, pp. 33-38, 2008.
13. K. Mathia and J. Clark, "On neural network hardware and programming paradigms," in Proceedings of the 2002 International Joint Conference on Neural Networks (IJCNN '02). vol. 3 Hawaii, USA, 2002, pp. 2692-2697. (Pubitemid 34648057)
14. T. L. Freeman and C. Phillips, Parallel Numerical Algorithms: Prentice Hall, 1992.
15. U. Seiffert, "Artificial neural networks on massively parallel computer hardware," Neurocomputing, vol. 57, pp. 135-150, 2004. (Pubitemid 38351866)
16. A. Kattan, R. Abdullah, and R. A. Salam, "A Survey on Neural Network Implementation Techniques from a Parallel and Distributed Perspective," in Malaysian Joint Conference on Artificial Inteligence (MJCAI2009) Kuala Lumpur, Malaysia, 2009.
17. A. T. Chronopoulos and J. Sarangapani, "A distributed discrete-time neural network architecture for pattern allocation and control," in Proceedings of the International Parallel and Distributed Processing Symposium (IPDPS'02), Florida, USA, 2002, pp. 204-211.
18. D. Calvert and J. Guan, "Distributed Artificial Neural Network Architectures," in Proceedings of the 19th International Symposium on High Performance Computing Systems and Applications (HPCS'05), Guelph, Ontario, 2005, pp. 2-10. (Pubitemid 41756588)
19. E. R. Sykes and A. Mirkovic, "A fully parallel and scalable implementation of a Hopfield neural network on the SHARC-net supercomputer," in 19th International Symposium on High Performance Computing Systems and Applications (HPCS 2005) Ontario, Canada, 2005, pp. 103-109. (Pubitemid 41756603)
20. R. J. Howlett and S. D. Walters, "Multi-computer neural networks architecture," Electronics Letters, vol. 35, pp. 1350-1352, 1999.
21. J. H. Park and B. A. Demirdag, "High Performance Pattern Matching with Dynamic Load Balancing on Heterogeneous Systems," in 14th Euromicro International Conference on Parallel, Distributed, and Network-Based Processing (PDP'06): IEEE Computer Society, 2006, p. 6.
22. Z. Wang, T. Wild, S. Ruping, and B. Lippmann, "Benchmarking Domain Specific Processors: A Case Study of Evaluating a Smart Card Processor Design," in IEEE Computer Society Annual Symposium on VLSI (ISVLSI '08), 2008, pp. 16 - 21.
23. F. Almeida, D. Gonzalez, and L. M. Moreno, "The master-slave paradigm on heterogeneous systems: A dynamic programming approach for the optimal mapping," Journal of Systems Architecture, vol. 52, pp. 105-116, 2006. (Pubitemid 43098941)
24. D. A. Grove and P. D. Coddington, "Communication benchmarking and performance modelling of MPI programs on cluster computers," in Proceedings of the 18th International Parallel and Distributed Processing Symposium., 2004, pp. 249.
25. E. J. H. Yero and M. A. A. Henriques, "Speedup and scalability analysis of Master-Slave applications on large heterogeneous clusters," Journal of Parallel and Distributed Computing, vol. 67, pp. 1155-1167, 2007.
26. V. Donaldson, F. Berman, and R. Paturi, "Program speedup in a heterogeneous computing network," Journal of Parallel and Distributed Computing, vol. 21, pp. 316-322, 1994.
27. D. Moncrieff, R. E. Overill, and S. Wilson, "Heterogeneous computing machines and Amdahl's law," Parallel Computing, vol. 22, pp. 407-413, 1996. (Pubitemid 126343063)
28. A. Clematis and A. Corana, "Modeling performance of heterogeneous parallel computing systems," Parallel Computing, vol. 25, pp. 1131-1145, 1999.
29. M. Jaberipour and E. Khorram, "Two improved harmony search algorithms for solving engineering optimization problems," Commun Nonlinear Sci Numer Simulat, vol. 15, pp. 3316-3331, 2010.
30. P. Tangpattanakul and P. Artrit, "Minimum-time trajectory of robot manipulator using Harmony Search algorithm," in 6th International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology (ECTI-CON 2009) vol. 01 Pattaya, Thailand: IEEE, 2009, pp. 354-357.
31. Z. W. Geem, "Harmony Search Applications in Industry," in Soft Computing Applications in Industry. vol. 226/2008: Springer Berlin / Heidelberg, 2008, pp. 117-134.
32. J.-H. Lee and Y.-S. Yoon, "Modified Harmony Search Algorithm and Neural Networks for Concrete Mix Proportion Design," Journal of Computing in Civil Engineering, vol. 23, pp. 57-61, 2009.
33. R. M. Yoo, H.-H. S. Lee, H. Lee, and K. Chow, "Hierarchical Means: Single Number Benchmarking with Workload Cluster Analysis," in IEEE 10th International Symposium on Workload Characterization (IISWC 2007), Boston, MA, USA, 2007, pp. 204 - 213.
34. A. Frank and A. Asuncion, "UCI Machine Learning Repository, University of California, Irvine, School of Information & Computer Sciences." vol. 2010, 2010.
35. B. Goetz, T. Peierls, J. Bloch, J. Bowbeer, D. Holmes, and D. Lea, Java Concurrency in Practice: Addison-Wesley Professional, 2006.
36. H. Oi, "Local variable access behavior of hardware-translation based Java virtual machine," The Journal of Systems and Software, vol. 81, pp. 2059-2068, 2008.