Unsupervised query-based learning of neural networks using selective-attention and self-regulation

IEEE Transactions on Neural Networks

Volumn 8, Issue 2, 1997, Pages 205-217

  Chang, Ray I ^a   Hsiao, Pei Yung ^a  

^a NATIONAL CHIAO TUNG UNIVERSITY   (Taiwan)

Author keywords

Force directed method; Query based method; Selective attention; Self regulation; Self organizing maps; Unqupervised learning

Indexed keywords

ALGORITHMS; BRAIN; COGNITIVE SYSTEMS; COMPUTER SIMULATION; CONTROL THEORY; HUMAN ENGINEERING; NEURAL NETWORKS;

FORCE DIRECTED METHOD; SELECTIVE ATTENTION; SELF ORGANIZING MAPS; SELF REGULATION; UNSUPERVISED QUERY BASED LEARNING;

LEARNING SYSTEMS;

EID: 0031094206     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/72.557657     Document Type: Article

References (48)

1. L. G. Valiant, "A theory of the learnable," Comm. ACM, vol. 11, pp. 1134-1142, 1984.
2. D. Angluin, "Queries and concept learning," Machine Learning, vol. 4, pp. 319-342, 1988.
3. J. N. Hwang, J. J. Choi, S. Oh, and R. J. Marks, II, "QBL applied to partially trained multilayer perceptrons," IEEE Trans. Neural Networks, vol. 1, pp. 131-136, 1991.
4. E. B. Baum, "Neural-net algorithms that learn in polynomial time from examples and queries," IEEE Trans. Neural Networks, vol. 1, pp. 5-19, 1991.
5. R. C. Eberhart, "The role of genetic algorithms in neural network QBL and explanation facilities," in Proc. Int. Wkshp. Combinations of GA and NN, 1992, pp. 169-183.
6. A. Linden and J. Kindermann, "Inversion of multilayer nets," in Proc. Int. Joint Conf. Neural Networks, 1989, pp. 425-430.
7. S. Oh, R. J. Marks, II, and M. A. El-Sharkawi, "QBL in multilayered perceptrons in the presence of data jitter," in Proc. Int. Forum Applications of NN to Power Systems, 1991, pp. 72-75.
8. M. A. El-Sharkawi and S. S. Huang, "Application of QBL to power system static security assessment," in Proc. Int. Forum Applications of NN to Power Systems, 1993, pp. 111-117.
9. W. T. Powers, Behavior: The Control of Perception. Chicago: Aldine, 1973.
10. C. S. Carver and M. F. Scheier, Attention and Self-Regulation: A Control-Theory Approach to Human Behavior. New York: Springer-Verlag, 1981.
11. W. Glasser, Stations of the Mind: New Directions for Reality Therapy. Cambridge: Harper and Row, 1981.
12. L. E. Bourne, R. L. Dominowski, and E. F. Loftus, Cognitive Processes. Englewood Cliffs, NJ: Erlbaum, 1980.
13. D. E. Rumelhart, G. E. Hinton, and R. J. Williams, "Learning internal representations by error propagation," in Parallel Distributed Processing (PDP): Exploration in the Microstructure of Cognition, D. E. Rumelhart and G. E. Hinton, Eds. Cambridge, MA: MIT Press, 1986, ch. 8.
14. R. P. Lippmann, "An introduction to computing with neural nets," IEEE Acoust., Speech, Signal Processing Mag., pp. 4-22, 1987.
15. T. Kohonen, Self-Organization and Associative Memory. New York: Springer-Verlag, 1989.
16. S. Y. Kung, Digital Neural Networks. Singapore: Prentice-Hall, 1993.
17. J. J. Hopfield and D. W. Tank, "Neural computation of decisions in optimization problems," Biol. Cybern., vol. 52, pp. 141-152, 1985.
18. V. V. Tolat, "An analysis of Kohonen's self-organizing maps using a system of energy functions," Biol. Cybern., vol. 64, pp. 155-164, 1990.
19. A. Newell and H. A. Simon, "Computer simulation and human thinking," Sci., vol. 134, pp. 2011-2017, 1961.
20. J. C. Loehlin, Computer Models of Personality. New York: Random House, 1968.
21. B. Berelson and G. A. Steiner, Human Behavior: An Inventory of Scientific Findings. Orlando, FL: Harcourt Brace World, 1973.
22. S. Duval and R. A. Wicklund, A Theory of Objective Self-Awareness. New York: Academic, 1972.
23. E. Kryszig, Advanced Engineering Mathematics. New York: Wiley, 1983.
24. T. Kohonen, "Clustering, taxonomy, and topological maps of patterns," in Proc. Int. Conf. Pattern Recognition, 1982, pp. 182-185.
25. _, "The 'neural' phonetic typewriter," IEEE Trans. Comput., vol. 8, pp. 11-22, 1988.
26. B. Angeliol, G. De La Vaubols, and J. Y. Le Texier, "Self-organizing feature maps and the travelling salesman problem," Neural Networks, vol. 1, pp. 289-293, 1988.
27. H. Ritter, T. Martinetz, and K. Schulten, "Topology conserving maps for learning visuomotor-coordination," Neural Networks, vol. 2, pp. 159-168, 1988.
28. R.-I Chang, K. Y. Huang, and H. T. Yen, "Self-organizing neural network for picking of seismic horizons," in Proc. Symp. Telecommunications, 1990, pp. 431-434.
29. D. S. Bradburn, "Reducing transmission error effects using a self-organizing networks," in Proc. Int. Joint Conf. Neural Networks, 1989, pp. 531-538.
30. C. X. Zhang and D. A. Mlynski, "Neural somatotopical mapping for VLSI placement optimization," in Proc. Int. Joint Conf. Neural Networks, 1991, pp. 863-868.
31. H. Robbins and S. Monro, "A stochastic approximation method," Ann. Math. Statist., vol. 22, pp. 400-407, 1951.
32. T. Kohonen, "Things you haven't heard about the self-organizing map," in Proc. IEEE Int. Conf. Neural Networks, 1993, pp. 1147-1156.
33. N. R. Quinn and M. A. Breuer, "A force directed component placement procedure for print circuit boards," IEEE Trans. Circuits Syst., vol. CAS-3, pp. 377-388, 1979.
34. P. G. Paulin and J. P. Knight, "Force-directed scheduling in automatic data path synthesis," in Proc. 24th ACM/IEEE Design Automat. Conf., 1987, pp. 195-202.
35. _, "Force-directed scheduling for the behavioral synthesis for ASIC's," IEEE Trans. Computer-Aided Design, vol. 8, pp. 661-679, 1989.
36. K. Shahookar and P. Mazumder, "VLSI cell placement techniques," ACM Computing Surveys, vol. 2, pp. 143-220, 1991.
37. K. M. Hall, "An r-dimensional quadratic placement algorithm," Management Sci., vol. 17, pp. 219-229, 1970.
38. R.-I Chang and P. Y. Hsiao, "Force directed self-organizing maps and its application to VLSI cell placement," in Proc. IEEE Int. Conf. Neural Networks, 1993, pp. 103-109.
39. _, "VLSI cell placement for custom-chip design using force directed self-organizing maps," IEEE Trans. Neural Networks, to be published.
40. _, "VLSI circuit placement with rectilinear modules using three-layer force directed self-organizing maps," IEEE Trans. Neural Networks, to be published.
41. A. Hemani and A. Postula, "Cell placement by self-organization," Neural Networks, vol. 3, pp. 377-383, 1990.
42. S. S. Kim and C. M. Kyung, "Circuit placement in arbitrarily-shaped regions using the self-organization principle," IEEE Trans. Computer-Aided Design, vol. 11, pp. 844-854, 1992.
43. D. I. Choi and S. H. Park, "Self-creating and organizing neural networks," IEEE Trans. Neural Networks, vol. 4, pp. 561-575, 1994.
44. T. Kohonen, J. Kangas, J. Laaksonen, and K. Torkkola, "LVQ_PAK: A program package for the correct application of learning vector quantization algorithms," in Proc. Int. J. Conf. Neural Networks, 1992, pp. I-725-730.
45. G. A. Carpenter and S. Grossberg, "ART2: Self-organization of stable catagory recognition codes for analog input patterns," Appl. Opt., vol. 26, pp. 4919-4930, 1987.
46. Y. H. Pao, Adaptive Pattern Recognition and Neural Networks. Reading, MA: Addison-Wesley, 1989.
47. R. G. Geen and J. J. Gange, "Drive theory of social facilitation: Twelve years of theory and research," Psych. Bull., vol. 84, pp. 1267-1288, 1977.
48. R.-I Chang and P. Y. Hsiao, "UQBL algorithm and its application to Kohonen's self-organizing maps," IEEE Int. Conf. Neural Networks, to be published.