The random neural network: A survey

Computer Journal

Volumn 53, Issue 3, 2010, Pages 251-267

  Timotheou, Stelios ^a  

^a IMPERIAL COLLEGE LONDON   (United Kingdom)

Author keywords

Applications; Learning algorithms; Random neural network (RNN); RNN extension models; Survey

Indexed keywords

ANALYTICAL EQUATIONS; ARTIFICIAL NEURAL NETWORK MODELS; CLASSIFICATION ,; CONTINUOUS FUNCTIONS; EXTENSION MODELS; GENE REGULATORY NETWORKS; LOW COMPLEXITY; NEURONAL NETWORKS; RANDOM NEURAL NETWORK; RECURRENT NEURAL NETWORK MODEL; RESEARCH ACTIVITIES; RNN EXTENSION MODELS; UNIVERSAL APPROXIMATORS;

COMBINATORIAL OPTIMIZATION; COMMUNICATION SYSTEMS; IMAGE COMMUNICATION SYSTEMS; IMAGE PROCESSING; PATTERN RECOGNITION SYSTEMS; RECURRENT NEURAL NETWORKS; SURVEYS;

LEARNING ALGORITHMS;

EID: 77649317294     PISSN: 00104620     EISSN: 14602067     Source Type: Journal    
DOI: 10.1093/comjnl/bxp032     Document Type: Article

References (97)

1. Gelenbe, E. (1989) Random neural networks with negative and positive signals and product form solution. Neural Comput., 1, 502-510.
2. Gelenbe, E. (1991) Theory of the Random Neural Network. In Gelenbe, E. (ed.), Neural Networks: Advances and Applications, pp. 1-20. Elsevier Science Publishers B.V.
3. Gelenbe, E. (1990) Stability of the random neural network. Neural Comput., 2, 239-247.
4. Gelenbe, E. and Batty, F. (1992) Minimum Graph Covering with the Random Neural Network Model. In Gelenbe, E. (ed.), Neural Networks: Advances and Applications, Vol.2, pp. 215-222. Elsevier Science Publishers B.V.
5. Gelenbe, E. (1993) Learning in the recurrent random network. Neural Comput., 5, 154-164.
6. Gelenbe, E., Stafylopatis, A. and Likas, A. (1991) Associative Memory Operations of the Random Neural Network. Proc. Int. Conf. Artificial Neural Networks, Espoo, Finland, June 24-28 pp. 307-312. North-Holland, Amsterdam.
7. Sungho, J., Yin, J. and Zhi-Hong, M. (2005) Random neural networks with state-dependent firing neurons. IEEE Trans. Neural Netw., 16, 980-983.
8. Gelenbe, E. and Timotheou, S. (2008) Synchronised interactions in spiked neuronal networks. Comp. J., 51, 723-730.
9. Gelenbe, E. and Timotheou, S. (2008) Random neural networks with synchronised interactions. Neural Comput., 20, 2308-2324.
10. Gelenbe, E. (2007) Steady-state solution of probabilistic gene regulatory networks. Phys. Rev. E, 76, 031903.
11. Gelenbe, E. and Fourneau, J.M. (1999) Random neural networks with multiple classes of signals. Neural Comput., 11, 953-963.
12. Fourneau, J. Computing the Steady State Distribution of Networks with Positive and Negative Customers. Proc. 13th IMACS World Cong. Computational and Applied Mathematics, Dublin, Ireland, July. North-Holland, Amsterdam.
13. Halici, U. and Karaoz, E. (1998) A Linear Approximation for Training Recurrent Random Neural Networks. Proc. 13th Int. Symp. Computer and Information Sciences, Antalya, Turkey, October 26-28, pp. 149-156. IOS Press, Amsterdam.
14. Hubert, C. (1993) Supervised learning and recall of simple images with the random neural network. C. R. Acad. Sci. I, 316, 93-96.
15. Atalay, V. (1998) Learning by Optimization in Random Neural Networks. Proc. 13th Int. Symp. Computer and Information Sciences, Antalya, Turkey, October 26-28, pp. 143-148. IOS Press, Amsterdam.
16. Timotheou, S. (2008) Nonnegative Least Squares Learning for the Random Neural Network. Proc. 18th Int. Conf. Artificial Neural Networks (ICANN 2008), Prague, Czech Republic, September 3-6, pp. 195-204. Springer, Berlin, Heidelberg.
17. Timotheou, S. (2009). A novel weight initialization method for the random neural network. Neurocomputing, to appear.
18. Hubert, C. (1993) Learning internal representations with the N-M-N random neural network. C. R. Acad. Sci. II, 317, 451-456.
19. Aguilar, J. and Colmenares, A. (1998) Resolution of pattern recognition problems using a hybrid genetic/random neural network learning algorithm. Pattern Anal. Appl., 1, 52-61.
20. Likas, A. and Stafylopatis, A. (2000) Training the random neural network using quasi-Newton methods. Eur. J. Oper. Res., 126, 331-339.
21. Gelenbe, E. and Hussain, K. (2002) Learning in the multiple class random neural network. IEEE Trans. Neural Netw., 13, 1257-1267.
22. Halici, U. (1997) Reinforcement learning in random neural networks for cascaded decisions. Biosystems, 40, 83-91.
23. Halici, U. (2000) Reinforcement learning with internal expectation for the random neural network. Eur. J. Oper. Res., 126, 288-307.
24. Halici, U. (2001) Reinforcement learning with internal expectation in the random neural networks for cascaded decisions. Biosystems, 63, 21-34.
25. Gelenbe, E. (1994) G-networks: a unifying model for neural and queueing networks. Ann. Oper. Res., 48, 433-461.
26. Gelenbe, E. (1991) Product-form queueing networks with negative and positive customers. J. Appl. Probab., 28, 656-663.
27. Gelenbe, E. (2000) The first decade of G-networks. Eur. J. Oper. Res., 126, 231-232.
28. Gelenbe, E. (1993) G-networks with triggered customer movement. J. App. Probab., 30, 742-748.
29. Gelenbe, E. and Fourneau, J.-M. (2002) G-networks with resets. Perform. Eval., 49, 179-191.
30. Fourneau, J.M., Gelenbe, E. and Suros, R. (1996) G-networks with multiple classes of positive and negative customers. Theoret. Comput. Sci., 155, 141-156.
31. Gelenbe, E. and Labed, A. (1998) G-networks with multiple classes of signals and positive customers. Eur. J. Oper. Res., 108, 293-305.
32. Fourneau, J.-M. and Gelenbe, E. (2004) Flow equivalence and stochastic equivalence in G-networks. Comput. Manage. Sci., 1, 179-192.
33. Artalejo, J.R. (2000) G-networks: a versatile approach for work removal in queueing networks. Eur. J. Ope. Res., 126, 233-249.
34. Gelenbe, E. (1997) A class of genetic algorithms with analytical solution. Robot. Auton. Syst., 22, 59-64.
35. Gelenbe, E. and Cramer, C. (1998) Oscillatory corticothalamic response to somatosensory input. Biosystems, 48, 67-75.
36. Hopfield, J. and Tank, D. (1985) "Neural" computation of decisions in optimization problems. Biol. Cybern., 52, 141-152.
37. Smith, K. (1999) Neural networks for combinatorial optimization: a review of more than a decade of research. INFORMS J. Comput, 11, 15-34.
38. Smith, K., Palaniswami, M. and Krishnamoorthy, M. (1998) Neural techniques for combinatorial optimization with applications. IEEE Trans. Neural Netw., 9, 1301-1318. (Pubitemid 128742410)
39. Aguilar, J. and Gelenbe, E. (1997) Task assignment and transaction clustering heuristics for distributed systems. Inform. Sci.-Inform. Comput. Sci, 97, 199-221.
40. Gelenbe, E. (1992) A probabilistic generalization of the SAT problem. C. R. Acad. Sci. I, 315, 339-342.
41. Gelenbe, E., Ghanwani, A. and Srinivasan, V. (1997) Improved neural heuristics for multicast routing. IEEE J. Sel. Areas Commun., 15, 147-155.
42. Aiello, G., Gaglio, S., Re, G.L. and Urso, A. (2004) A random neural network for the dynamic multicast problem.WSEASTrans. Comput., 3, 1545-1550.
43. Cancela, H., Robledo, F. and Rubino, G. (2004) A GRASP algorithm with RNN based local search for designing a WAN access network. Electron. Notes Discrete Math., 18, 59-65.
44. Ghanwani, A. (1994)A qualitative comparison of neural network models applied to the vertex covering problem. Turk. J. Electr. Eng. Comput. Sci., 2, 11-18.
45. Pekergin, F. (1992) Combinatorial optimization by random neural network model-Application to the independent set problem. Int. Conf. Artificial Neural Networks (ICANN'92), Brighton, England, September 4-7, pp. 437-440. North-Holland, Amsterdam.
46. Gelenbe, E.,Koubi,V. and Pekergin, F. (1994) Dynamical random neural network approach to the traveling salesman problem. Turk. J. Electr. Eng. Comput. Sci., 2, 1-10.
47. Zhong,Y., Sun, D. andWu, J. (2005) Dynamical Random Neural NetworkApproach to a Problem of Optimal Resource Allocation. Proc. 8th Int.Work-Conf. Artificial Neural Networks, Barcelona, Spain, June 8-10, pp. 1157-1163. Springer, Berlin.
48. Koubi, V. (1994) Reseaux de neurones et optimization combinatoire. PhD Thesis, Universit de Paris 05, Paris, France.
49. Aguilar, J. (1998) Definition of an energy function for the random neural to solve optimization problems. Neural Netw., 11, 731-737.
50. Cerkez, C., Aybay, I. and Halici, U. (1997) A Digital Neuron Realization for the Random Neural Network Model. Proc. Int. Conf. Neural Networks, Houston, TX, USA, June 09-12, pp. 1000-1004. IEEE, Piscataway, NJ.
51. Abdelbaki, H., Gelenbe, E. and El-Khamy, S. (2000) Analog Hardware Implementation of the Random Neural Network Model. Proc. IEEE/INNS/ENNS Int. Joint Conf. Neural Networks (IJCNN 2000), Como, Italy, July 24-27, pp. 197-201. IEEE Computer Society, Los Alamitos, CA.
52. Kocak, T., Seeber, J. and Terzioglu, H. (2003) Design and implementation of a random neural network routing engine. IEEE Trans. Neural Netw., 14, 1128-1143.
53. Hey, L.A. (2008) Reduced complexity algorithms for cognitive packet network routers. Comput. Commun., 31, 3822-3830.
54. Akgul, B.E.S., Chakrapani, L.N., Korkmaz, P. and Palem, K.V. (2006) Probabilistic CMOS Technology: A Survey and Future Directions. Proc. 14th IFIP Int. Conf. Very Large Scale Integration of System-on-Chip, Nice, France, October 16-18, pp. 1-6. IEEE, Piscataway, NJ.
55. Chakrapani, L.N., Korkmaz, P., Akgul, B.E.S. and Palem, K.V. (2007) Probabilistic system-on-a-chip architectures. ACMTrans. Des. Autom. Electron. Sys., 12, 1-28.
56. Gelenbe, E., Mao, Z.-H. and Li, Y.-D. (1999) Function approximation with spiked random networks. IEEETrans. Neural Netw., 10, 3-9.
57. Gelenbe, E., Mao, Z.-H. and Li, Y.-D. (2004) Function approximation by random neural networks with a bounded number of layers. J. Differ. Equ. Dyn. Syst., 12, 143-170.
58. Atalay,V., Gelenbe, E. andYalabik, N. (1992) The random neural network model for texture generation. Int. J. Pattern Recognit. Artif. Intell., 6, 131-141.
59. Gelenbe, E., Hussain, K. and Abdelbaki, H. (2000) Random Neural Network Texture Model. Proc. 5th Conf. Applications of Artificial Neural Networks in Image Processing, San Jose, CA, USA, January 27-28, pp. 104-111. SPIE, Bellingham,WA.
60. Atalay, V. and Gelenbe, E. (1992) Parallel algorithm for colour texture generation using the random neural network model. Int. J. Pattern Recognit. Artif. Intell., 6, 437-446.
61. Teke,A. and Atalay,V. (2006) Texture classification and retrieval using random neural network model. Comput. Manage. Sci., 3, 193-205.
62. Gelenbe, E., Feng, T. and Krishnan, K.R.R. (1996) Neural network methods for volumetric magnetic resonance imaging of the human brain. Proc. IEEE, 84, 1488-1496.
63. Lu, R. and Shen,Y. (2005) Image Segmentation Based onRandom Neural Network Model and Gabor Filters. Proc. 27th Annual Int. Conf. Engineering in Medicine and Biology Society, Shanghai, China, September 1-4, pp. 6464-6467. IEEE, Piscataway, NJ.
64. Bakircioglu, H., Gelenbe, E. and Koçak, T. (1997) Image Enhancement and Fusion with the Random Neural Network. Turk. J. Electr. Eng. Comput. Sci., 5, 65-77.
65. Bakircioglu, H. and Kocak, T. (2000) Survey of random neural network applications. Eur. J. Oper. Res., 126, 319-330.
66. Cramer, C.,Gelenbe, E. and Gelenbe, P. (1998) Image and video compression. IEEE Potentials, 17, 29-33.
67. Gelenbe, E., Cramer, C., Sungur, M. and Gelenbe, P. (1996) Traffic and video quality in adaptive neural compression. Multimedia Syst., 4, 357-369.
68. Cramer, C., Gelenbe, E. and Bakircioglu, H. (1996) Low bit rate video compression with neural networks and temporal subsampling. Proc. IEEE, 84, 1529-1543.
69. Cramer, C. and Gelenbe, E. (2000)Video quality and traffic QoS in learning-based subsampled and receiver-interpolated video sequences. IEEE J. Sel. Areas Commun., 18, 150-167.
70. Gelenbe, E., Lent, R. and Xu, Z. (2001) Measurement and performance of a cognitive packet network. Comput. Netw., 37, 691-791.
71. Gelenbe, E., Lent, R. and Xu, Z. (2001) Design and performance of cognitive packet networks. Perform. Eval., 46, 155-176.
72. Gelenbe, E., Lent, R. and Nunez, A. (2004) Self-aware networks and QoS. Proc. IEEE, 92, 1478-1489.
73. Gelenbe, E., Sakellari, G. and Arienzo, M.D. (2008) Admission of QoS aware users in a smart network.ACMTrans.Auton. Adapt. Syst., 3, 4:1-4:28.
74. Gelenbe, E. (2003) Sensible decisions based on QoS. Comput. Manage. Sci., 1, 1-14.
75. Gelenbe, E. and Lent, R. (2004) Power-aware ad hoc cognitive packet networks. Ad Hoc Netw. J., 2, 205-216.
76. Hey, L. (2008) Power Aware Smart Routing in Wireless Sensor Networks. Proc. Conf. Next Generation Internet Networks, Krakow, Poland, April 28-30, pp. 195-202. IEEE, Piscataway, NJ.
77. Gelenbe, E. (2006) Users and services in intelligent networks. Proc. IEE (ITS), 153, 213-220.
78. Oke, G. and Loukas, G. (2007) A denial of service detector based on maximum likelihood detection and the random neural network. Comp. J., 50, 717-727.
79. Mohamed, S. and Rubino, G. (2002)A study of real-time packet video quality using random neural networks. IEEETrans. Circuits Syst. Video Technol., 12, 1071-1083.
80. Mohamed, S., Rubino, G. and Varela, M. (2004) Performance evaluation of real-time speech through a packet network: a random neural networks-based approach. Perform. Eval., 57, 141-161.
81. Rubino, G., Varela, M. and Bonnin, J. (2006) Controlling multimedia QoS in the future home network using the PSQA metric. Comp. J., 49, 137-155.
82. da Silva, A.P.C., Varela, M., de Souza e Silva, E., Leao, R. M.M. and Rubino, G. (2008) Quality assessment of interactive voice applications. Comput. Netw., 52, 1179-1192.
83. Rubino, G., Tirilly, P. and Varela, M. (2006) Evaluating Users Satisfaction in Packet Networks Using Random Neural Networks. Proc. 16th Int. Conf. Artificial Neural Networks (ICANN 2006), Athens, Greece, September 10-14, pp. 303-312. Springer, Berlin.
84. Aussem, A. (1994) Call Admission Control in ATM Networks with the Random Neural Network. Proc. IEEE Int. Conf. Neural Networks, Orlando, FL, USA, June 28-July 2, pp. 2482-2487. IEEE, Piscataway, NJ.
85. Gelenbe, E. and Shachnai, H. (2000) On G-networks and resource allocation in multimedia systems. Eur. J. Oper. Res., 126, 308-318.
86. Gelenbe, E., Seref, E. and Xu, Z. (2001) Simulation with learning agents. Proc. IEEE, 89, 148-157.
87. Gelenbe, E., Hussain, K. and Kaptan, V. (2005) Simulating autonomous agents in augmented reality. J. Syst. Softw., 74, 255-268.
88. Stafylopatis, A. and Likas, A. (1992) Pictorial informationretrieval using the random neural network. IEEE Trans. Softw. Eng., 18, 590-600.
89. Likas, A. and Stafylopatis, A. (1996) High capacity associative memory based on the random Neural Network model. Int. J. Pattern Recognit. Artif. Intell., 10, 919-937.
90. Aguilar, J. (2001) Learning algorithm and retrieval process for the multiple classes random neural network model. Neural Process. Lett., 13, 81-91.
91. Bakircioglu, H. and Gelenbe, E. (1998) Random Neural Network Recognition of Shaped Objects in Strong Clutter. Proc. 3rd Conf. Applications of Artificial Neural Networks in Image Processing, San Jose, CA, USA, January 26-27, pp. 22-28. SPIE, Bellingham,WA.
92. Hussain, K. and Moussa, G.S. (2005) Laser Intensity Vehicle Classification System Based on Random Neural Network. Proc. 43rd Annual Southeast Regional Conf., Kennesaw, Georgia, Alabama, USA, March 18-19, pp. 31-35. ACM, NewYork.
93. Gelenbe, E. and Kocak, T. (2004) Wafer surface reconstruction from top-down scanning electron microscope images. Microelctron Eng., 75, 216-233.
94. Abdelbaki, H., Gelenbe, E. and Kocak, T. (1999) Matched Neural Filters for EMI Based Mine Detection. Proc. Int. Joint Conf. Neural Networks (IJCNN 99), Washington, DC, July 10-16, pp. 3236-3240. IEEE, Piscataway, NJ.
95. Abdelbaki, H., Gelenbe, E. and Kocak, T. (2005) Neural algorithms and energy measures for EMI based mine detection. J. Differ. Equ. Dyn. Sys., 13, 63-86.
96. Gelenbe, E. and Kocak, T. (2000) Area-based results for mine detection. IEEE Trans. Geosci. Remote Sens., 38, 1-14.
97. Gelenbe, E. and Cao, Y. (1998) Autonomous search for mines. Eur. J. Oper. Res., 108, 319-333.