Subsymbolically managing pieces of symbolical functions for sorting

IEEE Transactions on Neural Networks

Volumn 10, Issue 5, 1999, Pages 1099-1122

  Apolloni, Bruno ^a   Zoppis, Italo ^a  

^a Dipartimento di Scienze dell'Informazione   (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

BACKPROPAGATION; DECISION THEORY; ERROR ANALYSIS; FUNCTIONS; FUZZY SETS; LEARNING ALGORITHMS; MATHEMATICAL MODELS; SORTING; TREES (MATHEMATICS);

SYMBOLICAL FUNCTIONS;

RECURRENT NEURAL NETWORKS;

EID: 0032594941     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/72.788650     Document Type: Article

References (78)

1. G. Dorffner, Ed., Neural Networks and a New Artificial Intelligence. London, U.K.: Thomson Computer Press, 1997.
2. R. Sun, Integrating Rules and Connectionism for Robust Commonsense Reasoning. New York: Wiley, 1994.
3. O. Omidvar and D. L. Elliot, Eds., Neural Systems for Control. San Diego, CA: Academic, 1997.
4. L. R. Medsker, Hybrid Intelligent Systems. Boston, MA: Kluwer, 1995.
5. H. Rogers, Jr., Theory of Recursive Functions and Effective Computability. New York: McGraw-Hill, 1967.
6. H. T. Siegelmann and E. D. Sontag, "On the computational power of neural networks," J. Comput. Syst. Sci., vol. 50, pp. 132-150, 1995.
7. R. A. Jacobs and M. I. Jordan, "Learning piecewise control strategies in a modular neural network architecture," IEEE Trans. Syst., Man, Cybern., vol. 23, pp. 337-345, 1993.
8. P. T. Szymanski, M. Lemmon, and C. J. Bett, "Hybrid interior point training of modular neural networks," Neural Networks, vol. 11, no. 2, pp. 215-234, 1998.
9. Y. Freund and R. E. Schapire, "A decision-theoretic generalization of on-line learning and an application to boosting," in Proc. II European Conf. Comput. Learning Theory, Barcelona, Spain, Mar. 1995.
10. P. Frasconi, M. Gori, and A. Sperduti, "A general framework for adaptive processing of data structures," IEEE Trans. Neural Networks, vol. 9, pp. 768-786, 1998.
11. C. Goller and A. Kuchler, "Learning task-dependent distributed structure-representations by backpropagation through structure," in IEEE Int. Conf. Neural Networks, 1996, pp. 347-352.
12. E. Adams, The Logic of Conditionals. Dordrecht, The Netherlands: Reidel, 1975.
13. H. X. Li and V. C. Yen, Fuzzy Sets and Decision-Making. Boca Raton, FL: CRC, 1995.
14. D. A. Handelman, S. H. Lane, and J. J. Gelfand, "Integrating knowledge-based system and neural-network techniques for robotic skill acquisition," in Proc. 11th Int. Joint Conf. Artificial Intell. San Mateo, CA: Morgan Kaufmann, 1989, pp. 193-198.
15. J. A. Hendler, "Problem solving and reasoning: A connectionist perspective," in Connectionism in Perspective, R. Pfeifer, Z. Schreter, and F. Fogelman-Soulié, Eds. Amsterdam, The Netherlands: Elsevier, 1989, pp. 229-243.
16. D. H. Ballard, "Parallel logical inference and energy minimization," Comp. Sci. Dept, Univ. Rochester, NY, Tech. Rep. 142, 1986.
17. V. Hanovar and L. Uhr, Artificial Intelligence and Neural Networks: Steps Toward Principled Integration. Boston, MA: Academic, 1994.
18. R. Sun and L. A. Bookman, Computational Architectures Integrating Neural and Symbolic Processes: A Perspective on the State of the Art. Boston, MA: Kluwer, 1995.
19. P. J. G. Lisboa, "Neural networks for control: Evolution, revolution, or renaissance," in Application of Neural Networks to Modeling and Control. London, U.K.: Chapman and Hall, 1993, pp. 9-24.
20. G. Towell and J. Shavlik, "The extraction of refined rules from knowledge-based neural networks," Machine Learning, vol. 131, pp. 71-101, 1993.
21. J. R. Quinlan, C4.5: Programs for Machine Learning. San Mateo, CA: Morgan Kaufmann, 1993.
22. L. Breiman, J. H. Friedman, K. H. Olshen, and C. J. Stone, Classification and Regression Trees. Belmont, CA: Wadsworth, 1984.
23. L. Fu, "Learning in certainty-factor-based multilayer neural networks for classification, IEEE Trans. Neural Networks, vol. 9, pp. 151-158, 1998.
24. M. Hilario, "An overview of strategies for neurosymbolic integration," in Connectionist-Symbolic Processing, R. Sun and F. Alexandre, Eds. Hillsdale, NJ: Lawrence Erlbaum, 1997, pp. 13-35.
25. S. Piramuthu and M. I. Shaw, "On using decision trees as feature selector for feed-forward neural networks," in Int. Symp. Integrating Knowledge Neural Heuristics, Pensacola, FL, 1994, pp. 67-74.
26. R. Miikkulainen, Subsymbolic Natural Language Processing. Cambodge, MA: MIT Press, 1993.
27. A. Sperduti, "Encoding of labeled graphs by labeling RAAM," in Advances Neural Inform. Processing Syst. 6, J. Cowan, G. Tesauro, and J. Alspector, Eds. San Mateo, CA: Morgan Kaufmann, 1994, pp. 1125-1132.
28. R. Sun, "Schemas, logics, and neural assemblies," Appl. Intell., vol. 5, no. 2, pp. 135-151, 1995.
29. M. Jabri, S. Pickard, P. Leong, Z. Chi, B. Flower, and Y. Xie, "Ann based classification for heart defibrillators," in Advance in Neural Information Processing, J. E. Moody, S. Hanson, and R. P. Lippman, Eds. San Mateo, CA: Morgan-Kaufmann, 1992, vol. 4, pp. 637-644.
30. B. Apolloni, F. Battini, and C. Lucisano, "A cooperating neural approach for spacecraft attitude control," Neural Comput., vol. 16, no. 4, pp. 279-317, 1977.
31. D. E. Knuth, The Art of Computer Programming: Sorting and Searching. Reading, MA: Addison-Wesley, 1973.
32. R. Sedgewick, Algorithms in C. Reading, MA: Addison-Wesley, 1990.
33. D. P. Agarwall and K. K. Agarwall, "Efficient sorting with CCD's and magnetic bubble memories, "IEEE Trans. Comput., vol. 30, pp. 153-156, 1981.
34. D. T. Lee, H. Cen, and C. K. Wong, "An on-chip compare/steer bubble sorter," IEEE Trans. Comput., vol. 30, pp. 396-405, 1981.
35. G. Bilardi and F. P. Preparata, "A minimum area VLSI network for O(log n) time sorting," IEEE Trans. Comput., vol. 34, pp. 36-343, 1985.
36. H. M. Alnuweiri and V. K. P. Kumar, "Optimal VLSI sorting with reduced number of processors," IEEE Trans. Comput., vol. 40, pp. 105-110, 1991.
37. D. Rotem, N. Santora, and J. B. Sydney, "Distributed sorting," IEEE Trans. Comput., vol. 34, pp. 336-343, 1985.
38. J. J. Hopfield, "Neural networks and physical systems with emergent collective computational abilities," in Proc. Nat. Academy Sci. USA, vol. 79, 1982, pp. 2554-2558.
39. W. T. Chen and K. R. Hsieh, "A neural sorting network with O(1) time complexity," Inform. Processing Lett., vol. 45, pp. 309-313, 1993.
40. P. J. Zwietering, E. H. L. Aarts, and J. Wessels, "The construction of minimal multilayered perceptrons: A case study for sorting," Neurocomput., vol. 5, pp. 197-210, 1993.
41. J. Wang, "Analysis and design of an analog sorting network," IEEE Trans. Neural Networks, vol. 6, pp. 962-971, 1995.
42. M. Atkins, "Sorting by Hopfield net," in Proc. Int. Joint Conf. Neural Networks, Washington, D.C., 1989, pp. 65-68, vol. II.
43. T. M. Kwon and M. Zervakis, "A parallel sorting network without comparators: A neural-network approach," in Proc. Int. Joint Conf. Neural Networks, Baltimore, MD, 1992, pp. 701-706, vol. I.
44. Y. Takefuji and K. C. Lee, "A super parallel sorting algorithm based on neural networks," IEEE Trans. Circuits Syst., vol. 37, pp. 1425-1429, 1990.
45. M. Budinich, "Sorting with self-organizing maps," Neural Comput., vol. 7, pp. 1188-1190, 1995.
46. S. Lin and S. Hsu, "A low-cost neural sorting network with O(1) time complexity," Neurocomput., vol. 14, pp. 289-299, 1997.
47. P. Werbos, "Backpropagation through time: What it does and how to do it," IEEE Proc., vol. 78, no. 10, pp. 1550-1560, 1990.
48. R. J. Williams and J. Peng, "An efficient gradient-based algorithm for on-line training of recurrent network trajectories," Neural Comput., vol. 2, pp. 490-501, 1990.
49. S. Santini and A. del Bimbo, "Properties of block feedback neural networks," Neural Networks, vol. 8, no. 4, pp. 579-596, 1995.
50. D. E. Rumelhart, G. E. Hinton, and R. J. Williams, "Learning internal representations by error propagation," in Parallel Distributed Processing: Exploration in the Micro structure of Cognition - Vol. 1: Foundations, D. E. Rumelhart and J. L. McClelland, Eds. Cambridge, MA: MIT Press, 1986.
51. A. Küchler and Ch. Goller, "Inductive learning in symbolic domains using structure-driven recurrent neural networks," in Proc. Annual German Conf. Artificial Intell., 1996, pp. 183-197.
52. S. W. Piché, "Steepest descent algorithms for neural networks controllers and filters," IEEE Trans. Neural Networks, vol. 5, pp. 198-212, 1994.
53. R. O. Duda and P. E. Hart, Pattern Classification and Scene Analysis. New York: Wiley, 1973.
54. H. Akaike, "A new look at the statistical model identification," IEEE Trans Automat. Contr., vol. 19, pp. 716-723, 1985.
55. B. Apolloni and G. Ronchini, "Dynamic sizing of multilayer perceptrons," Biol. Cybern., vol. 71, pp. 49-63, 1994.
56. N. Murata, S. Yoshizawa, and S. Amari, "Network information criterion - Determining the number of hidden units for an artificial neural-network model," IEEE Trans. Neural Networks, vol. 5, pp. 865-872, 1995.
57. G. A. Carpenter and S. Grossberg, "The ART of adaptive pattern recognition by self-organizing neural networks," Computer, vol. 21, no. 3, pp. 77-78, 1988.
58. R. Miikkulainen, "Subsymbolic case-role analysis of sentences with embedded clauses," Cognitive Sci., vol. 20, pp. 47-73, 1996.
59. A. Simon, Models of Thought. New Haven, CT: Yale Univ. Press, 1979.
60. R. J. Williams and D. Zipser, "A learning algorithm for continually running fully recurrent neural networks," Neural Comput., vol. 1, no. 2, pp. 270-280, 1989.
61. B. Apolloni, A. Piccolboni, and E. Sozio, "Hybrid symbolic subsymbolic system for controlling a single link flexible arm," J. Syst. Eng. 6, pp. 208-222, 1996.
62. K. S. Narendra and K. Parthasarathy, "Identification and control of dynamical systems using neural networks," IEEE Trans. Neural Networks, vol. 1, pp. 4-27, 1990.
63. R. A. Jacobs, M. J. Jordan, S. J. Nowlan, and J. Hinton, "Adaptive mixtures of local experts," Neural Comput., vol. 3, pp. 79-87, 1991.
64. B. Apolloni, G. Zamponi, and A. Zanaboni, "Learning fuzzy decision trees," Neural Networks, vol. 11, pp. 885-895, 1998.
65. S. Haykin, Neural Networks - A Comprehensive Foundation. New York: Macmillan, 1994.
66. C. M. Bishop, Neural Networks for Pattern Recognition. Oxford, U.K.: Clarendon, 1995.
67. H. T. Siegelman, "On NIL: The software constructor for neural net-works," Parallel Processing Lett., vol. 6, pp. 575-582, 1996.
68. A. Sperduti, A. Starita, and C. Goller, "Distributed representations for terms in hybrid reasoning systems," in Connectionist Symbolic Integration, R. Sun and F. Alexandre, Eds. Hillsdale, NJ: Lawrence Erlbaum, to be published.
69. A. Sperduti and T. Starita, "Supervised neural networks for classification of structures," IEEE Trans. Neural Networks, vol. 8, pp. 714-735, 1997.
70. P. Frasconi, M. Gori, M. Maggini, and G. Soda, "Unified integration of explicit knowledge and learning by example in recurrent networks," IEEE Trans. Knowledge Data Engineering, vol. 17, pp. 340-346, 1995.
71. M. Casey, "The dynamics of discrete-time computation, with application to recurrent neural networks and finite state machine extraction," Neural Comput., vol. 8, pp. 1135-1178, 1996.
72. H. A. Siegelmann and E. D. Sontag, "Turing computability with neural nets," Appl. Math. Lett., vol. 4, no. 6, pp. 77-80, 1991.
73. C. W. Omlin and C. L. Giles, "Extraction of rules from discrete-time recurrent neural networks," Neural Networks, vol. 9, no. 1, pp. 41-52, 1996.
74. Y. S. Abu Mostafa, "Hints," Neural Comput., vol. 7, no. 4, 1995.
75. B. G. Horne and D. R. Hush, "Bounds on the complexity of recurrent neural network implementations of finite state machines," Neural Networks, vol. 9, no. 2, pp. 243-252, 1996.
76. S. Das and M. Mozer, "Dynamic on-line clustering and state extraction: An approach to symbolic learning," Neural Networks, vol. 11, no. 1, pp. 53-64.
77. C. A. R. Hoare, "Quicksort," Comput. J., vol. 5, no. 1, pp. 10-15, 1962.
78. S. S. Wilks, Mathematical Statistics. New York: Wiley, 1962.