ARPOP: An appetitive reward-based pseudo-outer-product neural fuzzy inference system inspired from the operant conditioning of feeding behavior in aplysia

IEEE Transactions on Neural Networks and Learning Systems

Volumn 23, Issue 2, 2012, Pages 317-329

  Cheu, Eng Yeow ^a   Quek, Chai ^a   Ng, See Kiong ^b  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^b INSTITUTE FOR INFOCOMM RESEARCH   (Singapore)

Author keywords

Appetitive reward; fuzzy systems; Hebbian concomitant learning; intrinsic neuronal excitability; neural nets; neuro fuzzy systems; operant conditioning; synaptic plasticity

Indexed keywords

APPETITIVE REWARD; HEBBIAN; INTRINSIC NEURONAL EXCITABILITY; NEUROFUZZY SYSTEM; OPERANT CONDITIONING; SYNAPTIC PLASTICITY;

FEEDING; LEARNING ALGORITHMS; NEURAL NETWORKS; NEURONS; SEMANTICS;

FUZZY SYSTEMS;

ALGORITHM; ANIMAL; APLYSIA; APPETITE; ARTIFICIAL INTELLIGENCE; ARTIFICIAL NEURAL NETWORK; AUTOMATED PATTERN RECOGNITION; BIOMIMETICS; FEEDING BEHAVIOR; FUZZY LOGIC; INSTRUMENTAL CONDITIONING; PHYSIOLOGY; PROCEDURES; REWARD;

ALGORITHMS; ANIMALS; APLYSIA; APPETITE; ARTIFICIAL INTELLIGENCE; BIOMIMETICS; CONDITIONING, OPERANT; FEEDING BEHAVIOR; FUZZY LOGIC; NEURAL NETWORKS (COMPUTER); PATTERN RECOGNITION, AUTOMATED; REWARD;

EID: 84863088595     PISSN: 2162237X     EISSN: 21622388     Source Type: Journal    
DOI: 10.1109/TNNLS.2011.2178529     Document Type: Article

References (82)

1. E. L. Thorndike, Animal Intelligence: Experimental Studies. New York: Macmillan, 1911.
2. B. F. Skinner, The Behavior of Organisms. New York: Appleton, 1938.
3. I. P. Pavlov, Conditioned Reflexes. London, U.K.: Oxford Univ. Press, 1927.
4. D. O. Hebb, The Organization of Behavior: A Neuropsychological Theory. New York: Wiley, 1949.
5. S. J. Martin, P. D. Grimwood, and R. G. M. Morris, "Synaptic plasticity and memory: An evaluation of the hypothesis," Annu. Rev. Neurosci., vol. 23, no. 1, pp. 649-711, Mar. 2000.
6. T. Abel and K. M. Lattal, "Molecular mechanisms of memory acquisition, consolidation and retrieval," Curr. Opin. Neurobiol., vol. 11, no. 2, pp. 180-187, Apr. 2001.
7. S. J. Martin and R. G. M. Morris, "New life in an old idea: The synaptic plasticity and memory hypothesis revisited," Hippocampus, vol. 12, no. 5, pp. 609-636, 2002.
8. S. Fusi, P. J. Drew, and L. F. Abbott, "Cascade models of synaptically stored memories," Neuron, vol. 45, no. 4, pp. 599-611, Feb. 2005.
9. I. M. Ethell and E. B. Pasquale, "Molecular mechanisms of dendritic spine development and remodeling," Progr. Neurobiol., vol. 75, no. 3, pp. 161-205, Feb. 2005.
10. Z. Xie, R. L. Huganir, and P. Penzes, "Activity-dependent dendritic spine structural plasticity is regulated by small GTPase Rap1 and its target AF-6," Neuron, vol. 48, no. 4, pp. 605-618, Nov. 2005.
11. C. A. Chapleau and L. Pozzo-Miller, "Activity-dependent structural plasticity of dendritic spines" in Learning and Memory: A Comprehensive Reference, J. H. Byrne, Ed. New York: Academic, 2008, pp. 695-719.
12. P. Poirazi and B. W. Mel, "Impact of active dendrites and structural plasticity on the memory capacity of neural tissue," Neuron, vol. 29, no. 3, pp. 779-796, Mar. 2001.
13. B. Brembs, F. D. Lorenzetti, F. D. Reyes, D. A. Baxter, and J. H. Byrne, "Operant reward learning in Aplysia: Neuronal correlates and mechanisms," Science, vol. 296, no. 5573, pp. 1706-1709, May 2002.
14. R. Nargeot, M. Le Bon-Jego, and J. Simmers, "Cellular and network mechanisms of operant learning-induced compulsive behavior in Aplysia," Curr. Biol., vol. 19, no. 12, pp. 975-984, Jun. 2009.
15. R. Mozzachiodi and J. H. Byrne, "More than synaptic plasticity: Role of nonsynaptic plasticity in learning and memory," Trends Neurosci., vol. 33, no. 1, pp. 17-26, Jan. 2010.
16. G. B. Huang, P. Saratchandran, and N. Sundararajan, "A generalized growing and pruning RBF (GGAP-RBF) neural network for function approximation," IEEE Trans. Neural Netw., vol. 16, no. 1, pp. 57-67, Jan. 2005.
17. J. Tan and C. Quek, "ACPOP: Ambiguity correction-based pseudo-outerproduct fuzzy rule identification algorithm," in Proc. IEEE Int. Conf. Fuzzy Syst., Singapore, Aug. 2009, pp. 74-79.
18. L. A. Zadeh, "Fuzzy sets," Inf. Control, vol. 8, no. 3, pp. 338-353, Jun. 1965.
19. J. M. Mendel, Uncertain Rule-Based Fuzzy Logic Systems: Introduction and New Directions. Upper Saddle River, NJ: Prentice-Hall, 2001.
20. T. V. P. Bliss and G. L. Collingridge, "A synaptic model of memory: Long-term potentiation in the hippocampus," Nature, vol. 361, no. 6407, pp. 31-39, Jan. 1993.
21. B. Rasch and J. Born, "Maintaining memories by reactivation," Curr. Opin. Neurobiol., vol. 17, no. 6, pp. 698-703, Dec. 2007.
22. J. L. C. Lee, "Reconsolidation: Maintaining memory relevance," Trends Neurosci., vol. 32, no. 8, pp. 413-420, Aug. 2009.
23. J. Jing, E. C. Cropper, I. Hurwitz, and K. R. Weiss, "The construction of movement with behavior-specific and behavior-independent modules," J. Neurosci., vol. 24, no. 28, pp. 6315-6325, Jul. 2004.
24. J. Jing and K. R. Weiss, "Generation of variants of a motor act in a modular and hierarchical motor network," Curr. Biol., vol. 15, no. 19, pp. 1712-1721, Oct. 2005.
25. I. Hurwitz and A. J. Susswein, "B64, a newly identified central pattern generator element producing a phase switch from protraction to retraction in buccal motor programs of Aplysia californica," J. Neurophysiol., vol. 75, no. 4, pp. 1327-1344, Apr. 1996.
26. C. G. Evans and E. C. Cropper, "Proprioceptive input to feeding motor programs in Aplysia," J. Neurosci., vol. 18, no. 19, pp. 8016-8031, Oct. 1998.
27. R. Nargeot, D. A. Baxter, and J. H. Byrne, "In vitro analog of operant conditioning in Aplysia. II. Modifications of the functional dynamics of an identified neuron contribute to motor pattern selection," J. Neurosci., vol. 19, no. 6, pp. 2261-2272, Mar. 1999.
28. R. Nargeot, D. A. Baxter, and J. H. Byrne, "In vitro analog of operant conditioning in Aplysia. I. Contingent reinforcement modifies the functional dynamics of an identified neuron," J. Neurosci., vol. 19, no. 6, pp. 2247-2260, Mar. 1999.
29. T. J. Sejnowski and G. Tesauro, "The Hebb rule for synaptic plasticity: Algorithms and implementations," in Neural Models of Plasticity, J. H. Byrne and W. O. Berry, Eds. New York: Academic, 1989, ch. 6, pp. 94-103.
30. W. Siler and J. J. Buckley, Fuzzy Expert Systems and Fuzzy Reasoning. Hoboken, NJ: Wiley, 2005.
31. W. Pedrycz, "Why triangular membership functions?" Fuzzy Sets Syst., vol. 64, no. 1, pp. 21-30, May 1994.
32. S. M. Zhou and J. Q. Gan, "Low-level interpretability and high-level interpretability: A unified view of data-driven interpretable fuzzy system modelling," Fuzzy Sets Syst., vol. 159, no. 23, pp. 3091-3131, 2008.
33. C. T. Sun, "Rule-base structure identification in an adaptive-networkbased fuzzy inference system," IEEE Trans. Fuzzy. Syst., vol. 2, no. 1, pp. 64-73, Feb. 1994.
34. C. W. Ting and C. Quek, "A novel blood glucose regulation using TSK0-FCMAC: A fuzzy CMAC based on the zero-ordered TSK fuzzy inference scheme," IEEE Trans. Neural Netw., vol. 20, no. 5, pp. 856-871, May 2009.
35. S. Moldakarimov and T. J. Sejnowski, "Neural computation theories of learning," in Learning and Memory: A Comprehensive Reference, J. H. Byrne, Ed. New York: Academic, 2008, pp. 667-679.
36. J. Kim and N. Kasabov, "HyFIS: Adaptive neuro-fuzzy inference systems and their application to nonlinear dynamical systems," Neural Netw., vol. 12, no. 9, pp. 1301-1319, Nov. 1999.
37. C. T. Lin and C. F. Juang, "An adaptive neural fuzzy filter and its applications," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 27, no. 4, pp. 635-656, Aug. 1997.
38. K. Cpalka, "A new method for design and reduction of neuro-fuzzy classification systems," IEEE Trans. Neural Netw., vol. 20, no. 4, pp. 701-714, Apr. 2009.
39. R. W. Zhou and C. Quek, "POPFNN: A pseudo outer-product based fuzzy neural network," Neural Netw., vol. 9, no. 9, pp. 1569-1581, Dec. 1996.
40. L. X. Wang and J. M. Mendel, "Generating fuzzy rules by learning from examples," IEEE Trans. Syst., Man, Cybern., vol. 22, no. 6, pp. 1414-1427, Nov.-Dec. 1992.
41. C. J. Lin and C. T. Lin, "An ART-based fuzzy adaptive learning control network," IEEE Trans. Fuzzy. Syst., vol. 5, no. 4, pp. 477-496, Nov. 1997.
42. T. Takagi and M. Sugeno, "Fuzzy identification of systems and its applications to modeling and control," IEEE Trans. Syst., Man, Cybern., vol. 15, no. 1, pp. 116-132, Feb. 1985.
43. M. Sugeno and G. T. Kang, "Fuzzy modelling and control of multilayer incinerator," Fuzzy Sets Syst., vol. 18, no. 3, pp. 329-345, Apr. 1986.
44. W. L. Tung and C. Quek, "GenSoFNN: A generic self-organizing fuzzy neural network," IEEE Trans. Neural Netw., vol. 13, no. 5, pp. 1075-1086, Sep. 2002.
45. J. C. Bezdek, R. Ehrlich, and W. Full, "FCM: The fuzzy C-means clustering algorithm," Comput. Geosci., vol. 10, nos. 2-3, pp. 191-203, 1984.
46. C. Quek and R. Zhou, "POPFNN-AAR(S): A pseudo outer-product based fuzzy neural network," IEEE Trans. Syst., Man, Cybern. Part B: Cybern., vol. 29, no. 6, pp. 859-870, Dec. 1999.
47. K. K. Ang, C. Quek, and M. Pasquier, "POPFNN-CRI(s): Pseudo outer product based fuzzy neural network using the compositional rule of inference and singleton fuzzifier," IEEE Trans. Syst., Man, Cybern. Part B: Cybern., vol. 33, no. 6, pp. 838-849, Dec. 2003.
48. K. K. Ang and C. Quek, "RSPOP: Rough set-based pseudo outer-product fuzzy rule identification algorithm," Neural Comput., vol. 17, no. 1, pp. 205-243, Jan. 2005.
49. C. Quek and A. Singh, "POP-Yager: A novel self-organizing fuzzy neural network based on the Yager inference," Expert Syst. Appl., vol. 29, no. 1, pp. 229-242, Jul. 2005.
50. K. K. Ang, "POPFNN-CRI(S): A fuzzy neural network based on the compositional rule of inference," M.S. thesis, School Comput. Eng., Nanyang Technological Univ., Singapore, 1998.
51. C. Quek and R. W. Zhou, "The POP learning algorithms: Reducing work in identifying fuzzy rules," Neural Netw., vol. 14, no. 10, pp. 1431-1445, Dec. 2001.
52. W.-C. Wong, S.-Y. Cho, and C. Quek, "R-POPTVR: A novel reinforcement-based POPTVR fuzzy neural network for pattern classification, " IEEE Trans. Neural Netw., vol. 20, no. 11, pp. 1740-1755, Nov. 2009.
53. H.-J. Rong, N. Sundararajan, G.-B. Huang, and P. Saratchandran, "Sequential adaptive fuzzy inference system (SAFIS) for nonlinear system identification and prediction," Fuzzy Sets Syst., vol. 157, no. 9, pp. 1260-1275, May 2006.
54. Y. Lu, N. Sundararajan, and P. Saratchandran, "A sequential learning scheme for function approximation using minimal radial basis function neural networks," Neural Comput., vol. 9, no. 2, pp. 461-478, Feb. 1997.
55. V. Kadirkamanathan and M. Niranjan, "A function estimation approach to sequential learning with neural networks," Neural Comput., vol. 5, no. 6, pp. 954-975, Nov. 1993.
56. J.-S. R. Jang, "ANFIS: Adaptive-network-based fuzzy inference system," IEEE Trans. Syst., Man, Cybern., vol. 23, no. 3, pp. 665-685, May-Jun. 1993.
57. C. F. Juang and C. T. Lin, "An on-line self-constructing neural fuzzy inference network and its applications," IEEE Trans. Fuzzy. Syst., vol. 6, no. 1, pp. 12-32, Feb. 1998.
58. P. Angelov and D. P. Filev, "SimpleTS: A simplified method for learning evolving Takagi-Sugeno fuzzy models," in Proc. IEEE Int. Conf. Fuzzy Syst., Detroit, MI, May 2005, pp. 1068-1073.
59. P. P. Angelov and D. P. Filev "An approach to online identification of Takagi-Sugeno fuzzy models," IEEE Trans. Syst., Man, Cybern. Part B: Cybern., vol. 34, no. 1, pp. 484-498, Feb. 2004.
60. N. Kasabov and Q. Song, "DENFIS: Dynamic evolving neural-fuzzy inference system and its application for time-series prediction," IEEE Trans. Fuzzy. Syst., vol. 10, no. 2, pp. 144-154, Apr. 2002.
61. N. Kasabov, "Evolving fuzzy neural networks for supervised/ unsupervised online knowledge-based learning," IEEE Trans. Syst., Man, Cybern. Part B: Cybern., vol. 31, no. 6, pp. 902-918, Dec. 2001.
62. J. Casillas, O. Cordón, F. Herrera, and L. Magdalena, "Interpretability improvements to find the balance interpretability- accuracy in fuzzy modeling: An overview," in Interpretability Issues in Fuzzy Modeling, Studies in Fuzziness Soft Computing, J. Casillas, O. Cordón, F. Herrera, and L. Magdalena, Eds. New York: Springer-Verlag, 2003, pp. 3-22.
63. E. H. Mamdani, "Application of fuzzy algorithms for control of simple dynamic plant," Proc. Inst. Electr. Eng., vol. 121, no. 12, pp. 1585-1588, Dec. 1974.
64. J. Platt, "A resource allocating network for function interpolation," Neural Comput., vol. 3, no. 2, pp. 213-225, 1991.
65. J. V. De Oliveira, "Semantic constraints for membership function optimization," IEEE Trans. Syst., Man, Cybern. A, Syst., Humans, vol. 29, no. 1, pp. 128-138, Jan. 1999.
66. R. Goldman and J. Weinberg, Statistics: An Introduction. Englewood Cliffs, NJ: Prentice-Hall, 1985.
67. J. Moody, L. Wu, Y. Liao, and M. Saffell, "Performance functions and reinforcement learning for trading systems and portfolios," J. Forecast., vol. 17, nos. 5-6, pp. 441-470, 1998.
68. W. Enders, Applied Econometric Times Series, 3rd ed. New York: Wiley, 2010.
69. C. Quek, M. Pasquier, and B. Lim, "POP-TRAFFIC: A novel fuzzy neural approach to road traffic analysis and prediction," IEEE Trans. Intell. Transp. Syst., vol. 7, no. 2, pp. 133-146, Jun. 2006.
70. B. H. Teo. (2011, Dec. 6). Development and Verification of Kinematic Wave Analytical Rainfall-Runoff Model. School Civil Environmental Eng., Nanyang Technological Univ., Singapore [Online]. Available: http://hdl.handle.net/10356/ 15848
71. F. Liu, C. Quek, and G. S. Ng, "A novel generic hebbian ordering-based fuzzy rule base reduction approach to Mamdani neuro-fuzzy system," Neural Comput., vol. 19, no. 6, pp. 1656-1680, Jun. 2007.
72. J. E. Nash and J. V. Sutcliffe, "River flow forecasting through conceptual models part I-A discussion of principles," J. Hydrol., vol. 10, no. 3, pp. 282-290, Apr. 1970.
73. P. Andres-Barquin, "Ramón y Cajal: A century after the publication of his masterpiece," Endeavour, vol. 25, no. 1, pp. 13-17, Mar. 2001.
74. E. R. Kandel, "The biology of memory: A forty-year perspective," J. Neurosci., vol. 29, no. 41, pp. 12748-12756, Oct. 2009.
75. O. Kiehn, "Locomotor circuits in the mammalian spinal cord," Annu. Rev. Neurosci., vol. 29, no. 1, pp. 279-306, Jul. 2006.
76. T. G. Brown, "The intrinsic factors in the act of progression in the mammal," Proc. Royal Soc. London. Ser. B: Biol. Char., vol. 84, no. 572, pp. 308-319, Dec. 1911.
77. S. Grillner, "Biological pattern generation: The cellular and computational logic of networks in motion," Neuron, vol. 52, no. 5, pp. 751-766, Dec. 2006.
78. D. A. Baxter and J. H. Byrne, "Feeding behavior of Aplysia: A model system for comparing cellular mechanisms of classical and operant conditioning," Learn. Memory, vol. 13, no. 6, pp. 669-680, 2006.
79. K. Lukowiak, S. Sangha, C. McComb, N. Varshney, D. Rosenegger, H. Sadamoto, and A. Scheibenstock, "Associative learning and memory in lymnaea stagnalis: How well do they remember?" J. Exp. Biol., vol. 206, no. 13, pp. 2097-2103, Jul. 2003.
80. R. Mozzachiodi and J. H. Byrne, "Plasticity of intrinsic excitability as a mechanism for memory storage," in Learning and Memory: A Comprehensive Reference, J. H. Byrne, Ed. New York: Academic, 2008, pp. 829-838.
81. D. E. Rumelhart, G. E. Hinton, and R. J. Williams, "Learning internal representations by error propagation," in Parallel Distributed Processing: Explorations in the Microstructure of Cognition, vol. 1, D. E. Rumelhart and J. L. McClelland, Eds. Cambridge, MA: MIT Press, 1986, pp. 318-362.
82. T. Bäck, Evolutionary Algorithms in Theory and Practice: Evolution Strategies, Evolutionary Programming, Genetic Algorithms. New York: Oxford Univ. Press, 1996.