Sparsely connected autoassociative fuzzy implicative memories and their application for the reconstruction of large gray-scale images

Neurocomputing

Volumn 74, Issue 1-3, 2010, Pages 343-353

  Valle, Marcos Eduardo ^a  

^a STATE UNIVERSITY OF LONDRINA   (Brazil)

Author keywords

Fuzzy associative memory; Large gray scale images; Noise tolerance; Sparse encoding; Storage capacity

Indexed keywords

FUZZY ASSOCIATIVE MEMORY; LARGE GRAY-SCALE IMAGES; NOISE TOLERANCE; SPARSE ENCODING; STORAGE CAPACITY;

ASSOCIATIVE PROCESSING; ASSOCIATIVE STORAGE; ELECTRIC NETWORK TOPOLOGY; ENCODING (SYMBOLS); NEURAL NETWORKS; OPTIMIZATION;

IMAGE CODING;

ARTICLE; ASSOCIATIVE MEMORY; COMPUTER MEMORY; FUZZY SYSTEM; IMAGE RECONSTRUCTION; INFORMATION PROCESSING; INTERMETHOD COMPARISON; PRIORITY JOURNAL; THEORETICAL MODEL;

EID: 77958478077     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2010.03.017     Document Type: Article

References (55)

1. Acharya T., Ray A. Image Processing: Principles and Applications 2005, John Wiley and Sons, Hoboken, NJ.
2. Adams R., Calcraft L., Davey N. Using a genetic algorithm to investigate efficient connectivity in associative memories. Neurocomputing 2009, 72(4-6):732-742.
3. Anderson J. An Introduction to Neural Networks 1995, MIT Press, Massachusetts.
4. Birkhoff G. Lattice Theory 1993, American Mathematical Society, Providence. third ed.
5. Blyth T., Janowitz M. Residuation Theory 1972, Pergamon Press, Oxford.
6. Bohland J., Minai A. Efficient associative memory using small-world architecture. Neurocomputing 2001, 38-40:489-496.
7. Bosch H., Kurfess F.J. Information storage capacity of incompletely connected associative memories. Neural Networks 1998, 11(5):869-876.
8. Calcraft L., Adams R., Davey N. Efficient connection strategies in 1d and 2d associative memory models with and without displaced connectivity. Biosystems 2008, 94(1-2):87-94.
9. Chung F., Lee T. On fuzzy associative memory with multiple-rule storage capacity. IEEE Transactions on Fuzzy Systems 1996, 4(3):375-384.
10. Costantini G., Casali D., Perfetti R. Neural associative memory storing gray-coded gray-scale images. IEEE Transactions on Neural Networks 2003, 14(3):703-707.
11. N. Davey, B. Christianson, R. Adam, High capacity associative memories and small world networks, in: Proceedings of IEEE International Joint Conference on Neural Networks (IJCNN), vol. 1, Budapest, Hungary, 2004.
12. Delbem A., Correa L., Zhao L. Design of associative memories using cellular neural networks. Neurocomputing 2009, 72(10-12):2180-2188.
13. Deng T., Heijmans H. Grey-scale morphology based on fuzzy logic. Journal of Mathematical Imaging and Vision 2002, 16(2):155-171.
14. Dubois D., Prade H. Fuzzy Sets and Systems: Theory and Applications 1980, Academic Press, New York.
15. Golub G., van Loan C. Matrix Computations 1996, John Hopkins University Press, Baltimore, MD. third ed.
16. Grassi G. On discrete-time cellular neural networks for associative memories. IEEE Transactions on Circuits and Systems I: Fundamental Theory and Applications 2001, 48(1):107-111.
17. M.H. Hassoun (Ed.), Associative Neural Memories: Theory and Implementation, Oxford University Press, Oxford, UK, 1993.
18. Haykin S. Neural Networks: A Comprehensive Foundation 1999, Prentice-Hall, Upper Saddle River, NJ.
19. Heijmans H. Morphological Image Operators 1994, Academic Press, New York, NY.
20. Hopfield J.J. Neural networks and physical systems with emergent collective computational abilities. Proceedings of the National Academy of Sciences 1982, 79:2554-2558.
21. Jankowski S., Lozowski A., Zurada J. Complex-valued multi-state neural associative memory. IEEE Transactions on Neural Networks 1996, 7:1491-1496.
22. K. Keizer, High density impulse noise removal, MATLAB Central File Exchange, available at: 〈〉, 2008. http://www.mathworks.com/matlabcentral/fileexchange/21868.
23. Klir G.J., Yuan B. Fuzzy Sets and Fuzzy Logic: Theory and Applications 1995, Prentice-Hall, Upper Saddle River, NY.
24. Kohonen T. Self-Organization and Associative Memory 1984, Springer Verlag, Berlin.
25. Kosko B. Neural Networks and Fuzzy Systems: A Dynamical Systems Approach to Machine Intelligence 1992, Prentice-Hall, Englewood Cliffs, NJ.
26. Lee D.-L. Improvements of complex-valued hopfield associative memory by using generalized projection rules. IEEE Transactions on Neural Networks 2006, 17(5):1341-1347.
27. Liu D., Michel A. Sparsely interconnected neural networks for associative memories with applications to cellular neural networks. IEEE Transactions on Circuits and Systems-II: Analog and Digital Signal Processing 1994, 41(4):295-307.
28. Müezzinoǧlu M., Güzeliş C., Zurada J. A new design method for the complex-valued multistate Hopfield associative memory. IEEE Transactions on Neural Networks 2003, 14(4):891-899.
29. Nguyen H.T., Walker E.A. A First Course in Fuzzy Logic 2000, Chapman & Hall/CRC, Boca Raton. second ed.
30. Olshausen B., Field D. Sparse coding of sensory inputs. Current Opinion in Neurobiology 2004, 14(4):481-487.
31. Pedrycz W., Gomide F. Fuzzy Systems Engineering: Toward Human-Centric Computing 2007, Wiley-IEEE Press, New York.
32. Quiroga R.Q., Reddy L., Kreiman G., Koch C., Fried I. Invariant visual representation by single neurons in the human brain. Nature 2005, 435(7045):1102-1107.
33. Ritter G.X., Sussner P., de Leon J.L.D. Morphological associative memories. IEEE Transactions on Neural Networks 1998, 9(2):281-293.
34. Serra J. Image Analysis and Mathematical Morphology 1982, Academic Press, London.
35. Serra J. Image analysis and mathematical morphology. Theoretical Advances 1988, vol. 2. Academic Press, New York.
36. Soille P. Morphological Image Analysis 1999, Springer Verlag, Berlin.
37. Srinivasan K., Ebenezer D. A new fast and efficient decision-based algorithm for removal of high-density impulse noises. IEEE Signal Processing Letters 2007, 14(3):189-192.
38. P. Sussner, R. Miyasaki, M.E. Valle, An introduction to parameterized IFAM models with applications in prediction, in: Proceedings of the 2009 IFSA World Congress and 2009 EUSFLAT Conference, Lisbon, Portugal, 2009.
39. Sussner P., Valle M.E. Grayscale morphological associative memories. IEEE Transactions on Neural Networks 2006, 17(3):559-570.
40. Sussner P., Valle M.E. Implicative fuzzy associative memories. IEEE Transactions on Fuzzy Systems 2006, 14(6):793-807.
41. Sussner P., Valle M.E. Morphological and certain fuzzy morphological associative memories for classification and prediction. Computational Intelligence Based on Lattice Theory 2007, 149-172. Springer-Verlag, Heidelberg, Germany, (Chapter 8). V. Kaburlasos, G. Ritter (Eds.).
42. Sussner P., Valle M.E. Fuzzy associative memories and their relationship to mathematical morphology. Handbook of Granular Computing 2008, 733-754. John Wiley and Sons, Inc., New York, (Chapter 33). W. Pedrycz, A. Skowron, V. Kreinovich (Eds.).
43. Szolgay P., Szatmári I., László K. A fast fixed point learning method to implement associative memory on cnns. IEEE Transactions on Circuits and Systems I: Fundamental Theory and Applications 1997, 44(4):362-366.
44. G. Tanaka, K. Aihara, Complex-valued multistate associative memory with nonlinear multilevel functions for gray-level image reconstruction, in: Proceedings of the IEEE World Conference on Computational Intelligence 2008 (WCCI 2008), Hong Kong, China, 2008.
45. Tanaka G., Aihara K. Complex-valued multistate associative memory with nonlinear multilevel functions for gray-level image reconstruction. IEEE Transactions on Neural Networks 2009, 20(9):1463-1473.
46. Teddy S.D., Quek C., Lai E.M.-K. PSECMAC: a novel self-organizing multiresolution associative memory architecture. IEEE Transactions on Neural Networks 2008, 19(4):689-712.
47. M.E. Valle, P. Sussner, Storage and recall capabilities of fuzzy morphological associative memories with adjunction-based learning, submitted for publication.
48. Valle M.E., Sussner P. A general framework for fuzzy morphological associative memories. Fuzzy Sets and Systems 2008, 159(7):747-768.
49. M.E. Valle, P. Sussner, F. Gomide, Introduction to implicative fuzzy associative memories, in: Proceedings of the IEEE International Joint Conference on Neural Networks, Budapest, Hungary, 2004.
50. Wang Z., Zhang D. Restoration of impulse noise corrupted images using long-range correlation. IEEE Signal Processing Letters 1998, 5(1):4-7.
51. Watkins D. Fundamentals of Matrix Computations 2002, John Wiley and Sons, New York, USA. second ed.
52. Watts D., Strogatz S. Collective dynamics of 'small-world' networks. Nature 1998, 393(6684):440-442.
53. Zadeh L.A. Fuzzy sets. Information and Control 1965, 8(3):338-353.
54. Zhang B.-L., Zhang H., Ge S.S. Face recognition by applying wavelet subband representation and kernel associative memory. IEEE Transactions on Neural Networks 2004, 15(1):166-177.
55. Zhang D., Zuo W. Computational intelligence-based biometric technologies. IEEE Computational Intelligence Magazine 2007, 2(2):26-36.