Decentralized asynchronous learning in cellular neural networks

IEEE Transactions on Neural Networks and Learning Systems

Volumn 23, Issue 11, 2012, Pages 1755-1766

  Luitel, Bipul ^a   Venayagamoorthy, Ganesh Kumar ^a  

^a Clemson University   (United States)

Author keywords

Cellular neural network; decentralized asynchronous learning; high performance computer; multilayer perceptron; particle swarm optimization; power systems; simultaneous recurrent neural network; wide area monitoring

Indexed keywords

ASYNCHRONOUS LEARNING; DISTRIBUTED ENVIRONMENTS; GENERIC ARCHITECTURE; HARDWARE/SOFTWARE; HIGH-PERFORMANCE COMPUTERS; MULTI LAYER PERCEPTRON; WIDE AREA MONITORING;

CELLS; CYTOLOGY; PARTICLE SWARM OPTIMIZATION (PSO); RECURRENT NEURAL NETWORKS; STANDBY POWER SYSTEMS;

CELLULAR NEURAL NETWORKS;

ALGORITHM; ARTIFICIAL NEURAL NETWORK; BIOLOGICAL MODEL; HUMAN; INFORMATION PROCESSING; LEARNING; NONLINEAR SYSTEM; SOCIAL BEHAVIOR; TIME;

ALGORITHMS; DATASETS AS TOPIC; HUMANS; LEARNING; MODELS, NEUROLOGICAL; NEURAL NETWORKS (COMPUTER); NONLINEAR DYNAMICS; SOCIAL BEHAVIOR; TIME FACTORS;

EID: 84874972476     PISSN: 2162237X     EISSN: 21622388     Source Type: Journal    
DOI: 10.1109/TNNLS.2012.2216900     Document Type: Article

References (32)

1. P. Tzionas, A. Thanailakis, and P. Tsalides, "A hybrid cellular automaton/neural network classifier for multi-valued patterns and its VLSI implementation," Integr., VLSI J., vol. 20, no. 2, pp. 211-237, 1996.
2. T. Su, Y. Du, Y. Cheng, and Y. Su, "A fingerprint recognition system using cellular neural networks," in Proc. Int. Workshop Cellular Neural Netw. Appl., 2005, pp. 170-173.
3. L. Chua and L. Yang, "Cellular neural networks: Theory," IEEE Trans. Circuits Syst., vol. 35, no. 10, pp. 1257-1272, Oct. 1988.
4. I. Aizenberg, N. Aizenberg, J. Hiltner, C. Moraga, and E. M. zu Bexten, "Cellular neural networks and computational intelligence in medical image processing," Image Vis. Comput., vol. 19, no. 4, pp. 177-183, 2001.
5. Z. Zeng and W. X. Zheng, "Multistability of neural networks with timevarying delays and concave-convex characteristics," IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 2, pp. 293-305, Feb. 2012.
6. P. Werbos and X. Pang, "Generalized maze navigation: SRN critics solve what feedforward or Hebbian nets cannot," in Proc. IEEE Int. Conf. Syst., Man, Cybern., vol. 3. Oct. 1996, pp. 1764-1769.
7. D. Wunsch, "The cellular simultaneous recurrent network adaptive critic design for the generalized maze problem has a simple closed-form solution," in Proc. IEEE-INNS-ENNS Int. Joint Conf. Neural Netw., vol. 3. Jul. 2000, pp. 79-82.
8. R. Ilin, R. Kozma, and P. Werbos, "Beyond feedforward models trained by backpropagation: A practical training tool for a more efficient universal approximator," IEEE Trans. Neural Netw., vol. 19, no. 6, pp. 929-937, Jun. 2008.
9. Y. Ren, K. Anderson, K. Iftekharuddin, P. Kim, and E. White, "Pose invariant face recognition using cellular simultaneous recurrent networks," in Proc. Int. Joint Conf. Neural Netw., Jun. 2009, pp. 2634-2641.
10. K. Anderson, K. Iftekharuddin, E. White, and P. Kim, "Binary image registration using cellular simultaneous recurrent networks," in Proc. IEEE Symp. Comput. Intell. Multimedia Signal Vis. Process., Apr. 2009, pp. 61-67.
11. Y. Shen and J.Wang, "Robustness analysis of global exponential stability of recurrent neural networks in the presence of time delays and random disturbances," IEEE Trans. Neural Netw. Learn. Syst., vol. 23, no. 1, pp. 87-96, Jan. 2012.
12. L. Grant and G. Venayagamoorthy, "Voltage prediction using a cellular network," in Proc. IEEE Power Energy Soc. General Meeting, Jul. 2010, pp. 1-7.
13. J. Hunt and D. Cooke, "An adaptive, distributed learning system based on the immune system," in Proc. IEEE Int. Conf. Syst., Man Cybern., vol. 3. Mar. 1995, pp. 2494-2499.
14. F. Provost and D. Hennessy, "Scaling up: Distributed machine learning with cooperation," in Proc. Nat. Conf. Artif. Intell., 1996, pp. 74-79.
15. P. Auer, H. Burgsteiner, and W. Maass, "Reducing communication for distributed learning in neural networks," in Proc. Int. Conf. Artif. Neural Netw., 2002, pp. 123-128.
16. A. Asuncion, P. Smyth, and M. Welling, "Asynchronous distributed learning of topic models," in Advances in Neural Information Processing Systems, vol. 21. Cambridge, MA: MIT Press, 2008, pp. 81-88.
17. T. Alpcan and C. Bauckhage, "A distributed machine learning framework," in Proc. 48th IEEE Conf. Decision Control, Dec. 2009, pp. 2546-2551.
18. M. Dorigo and L. Gambardella, "Ant colony system: A cooperative learning approach to the traveling salesman problem," IEEE Trans. Evol. Comput., vol. 1, no. 1, pp. 53-66, Apr. 1997.
19. O. Tilak and S. Mukhopadhyay, "Decentralized and partially decentralized reinforcement learning for distributed combinatorial optimization problems," in Proc. 9th Int. Conf. Mach. Learn. Appl., Dec. 2010, pp. 389-394.
20. L. Huang, M. I. Jordan, A. Joseph, M. Garofalakis, and N. Taft, "Innetwork PCA and anomaly detection," in Advances in Neural Information Processing Systems, vol. 21. Cambridge, MA: MIT Press, 2006, pp. 617-624.
21. C. Dede, "Emerging technologies and distributed learning," Amer. J. Distance Educ., vol. 10, no. 2, pp. 4-36, 1996.
22. M. Alavi, G. Marakas, and Y. Yoo, "A comparative study of distributed learning environments on learning outcomes," Inf. Syst. Res., vol. 13, no. 4, pp. 404-415, 2002.
23. G. Salomon and D. Perkins, "Individual and social aspects of learning," Rev. Res. Educ., vol. 23, pp. 1-24, Jan. 1998.
24. P. Kundur, Power System Stability and Control. New York: McGraw-Hill, 1994.
25. A. Abur and A. Exposito, Power System State Estimation: Theory and Implementation, vol. 24. Boca Raton, FL: CRC Press, 2004.
26. P. J. Werbos, "Intelligence in the brain: A theory of how it works and how to build it," Neural Netw., vol. 22, no. 3, pp. 200-212, 2009.
27. L. Werbos and P. Werbos, "Self-organization in CNN-based object nets," in Proc. 12th Int. Workshop Cellular Nanoscale Netw. Appl., Feb. 2010, pp. 1-6.
28. J. Kennedy and R. Eberhart, "Particle swarm optimization," in Proc. IEEE Int. Conf. Neural Netw., vol. 4. Nov.-Dec. 1995, pp. 1942-1948.
29. C. Zhang, H. Shao, and Y. Li, "Particle swarm optimisation for evolving artificial neural network," in Proc. IEEE Int. Conf. Syst., Man, Cybern., vol. 4. Oct. 2000, pp. 2487-2490.
30. R. Eberhart and Y. Shi, "Particle swarm optimization: Developments, applications and resources," in Proc. Congr. Evol. Comput., vol. 1. 2001, pp. 81-86.
31. Real Time Digital Simulator Tutorial Manual (RSCAD Version), RTDS Technologies, Winnipeg, MB, Mar. 2008.
32. J. Hauer, C. Demeure, and L. Scharf, "Initial results in prony analysis of power system response signals," IEEE Trans. Power Syst., vol. 5, no. 1, pp. 80-89, Feb. 1990.