A heuristic method for learning Bayesian networks using discrete particle swarm optimization

Knowledge and Information Systems

Volumn 24, Issue 2, 2010, Pages 269-281

  Wang, Tong ^a   Yang, Jie ^a  

^a SHANGHAI JIAO TONG UNIVERSITY   (China)

Author keywords

Bayesian networks; Discrete PSO; Genetic algorithms; PSO; Structural learning; Uncertainty

Indexed keywords

BAYESIAN NETWORKS; GENETIC ALGORITHMS; HEURISTIC ALGORITHMS; HEURISTIC METHODS; LEARNING SYSTEMS; PARTICLE SWARM OPTIMIZATION (PSO); STRUCTURAL OPTIMIZATION; SWARM INTELLIGENCE;

DISCRETE PARTICLE SWARM OPTIMIZATION; DISCRETE PSO; GA (GENETIC ALGORITHM); HEURISTIC SEARCH ALGORITHMS; LEARNING BAYESIAN NETWORKS; PSO(PARTICLE SWARM OPTIMIZATION); STRUCTURAL LEARNING; UNCERTAINTY;

LEARNING ALGORITHMS;

EID: 77954957899     PISSN: 02191377     EISSN: 02193116     Source Type: Journal    
DOI: 10.1007/s10115-009-0239-6     Document Type: Article

References (34)

1. Pearl J (1988) Probabilistic reasoning in intelligent systems: networks of plausible inference. Morgan Kaufman, San Mateo.
2. Heckerman D (1997) Bayesian networks for data mining. Data Mining Knowl Discov 1: 79-119.
3. Heckerman D, Geiger D et al (1995) Learning Bayesian networks: the combination of knowledge and statistical data. Mach Learn 2: 197-243.
4. Etxeberria R, Larrañaga P, Picaza JM (1997) Analysis of the behaviour of genetic algorithms when learning Bayesian network structure from data. Pattern Recognit Lett 18: 1269-1273.
5. Suzuki J (1999) Learning Bayesian belief networks based on the minimum description length principle: basic properties. IEICE Trans Fundam Electron Commun Comput Sci E82-A: 2237-2245.
6. Cheng J, Greiner R, Kelly J, Bell D, Liu W (2002) Learning Bayesian network from data: an information-theory based approached. Artif Intell 137: 43-90.
7. Robinson RW (1977) Counting unlabeled acyclic digraphs. In: Little CHC (ed) Combinatorial mathematics. Springer Lecture Notes in Math., vol 622, pp 28-43.
8. Chickering DM, Geiger D, Heckerman D (1994) Learning Bayesian networks is NP-hard. Microsoft Res., Redmond, WA, MSR-TR-94-17.
9. Reeves CR (1993) Modern heuristic techniques for combinatorial problems. Blackwell Scientific Publications, Oxford.
10. Alcobé JR (2004) Incremental Hill-climbing search applied to Bayesian network structure learning. In: Proceedings of the 15th European Conference on Machine Learning, Pisa, Italy.
11. Larrañaga P, Murga RH, Poza M, Kuijpers CMH (1995) Structure learning of Bayesian networks by hybrid genetic algorithms. In: Preliminary Papers of the Fifth International Workshop on Artificial Intelligence and Statistics, pp 310-316.
12. Larrañaga P, Poza M, Yurramendi Y, Murga RH, Kuijpers CMH (1996) Structure learning of Bayesian networks by genetical algorithms: a performance analysis of control parameters. IEEE Trans Pattern Anal Mach Intell 18: 912-926.
13. Larrañaga P, Kuijpers CMH, Murga RH, Yurramendi Y (1996) Learning Bayesian network structures by searching for best ordering with genetic algorithm. IEEE Trans Syst Man Cybernet 26(4): 487-493.
14. Lam W, Bacchus F (1994) Learning Bayesian belief networks-an approach based on the MDL principle. Comput Intell 10: 269-293.
15. Kennedy J, Eberhart RC (1995) Particle swarm optimization. In: Proceedings of IEEE international conference on neural networks, Perth, pp 1942-1948.
16. Senthil Arumugam M, Rao MVC, Chandramohan A (2008) A new and improved version of particles warm optimization algorithm with global-local best parameters. Knowl Inform Syst 16(3): 331-357.
17. Holland J (1975) Adaptation in natural and artificial systems. University of Michigan Press, Michigan.
18. Kirkpatrick S, Gelatt CD, Vecchi MP (1983) Optimization by simulated annealing. Science 264(5163): 1297-1301.
19. Salman A, Ahmad I, Al-Madani S (2002) Particle swarm optimization for task assignment problem. Microprocessors Microsyst 26: 363-371.
20. Heng X-C, Qin Z, Wang X-H, Shao L-P (2006) Research on learning Bayesian networks by particle swarm optimization. Inform Technol J 5(3): 540-545.
21. Heng X-C, Qin Z, Tian L, Shao L-P (2007) Learning bayesian network structures with discrete particle swarm optimization algorithm. FOCI 2007, pp 47-52.
22. Heng X-C, Qin Z, Tian L, Shao L-P (2007) Research on structure learning of dynamic bayesian networks by particle swarm optimization. CI-ALife 2007, pp 85-91.
23. Li X-L, Wang S-C, He X-D (2006) Learning Bayesian networks structures based on memory binary particle swarm optimization. SEAL 2006, LNCS 4247, pp 568-574.
24. Cooper GF, Herskovits EA (1992) A Bayesian method for the induction of probabilistic networks from data. Mach Learn 9: 309-347.
25. Shi Y, Eberhart RC (1998) A modified particle swarm optimizer. Proc. IEEE Int. Conf. On Evolutionary Computation. Anchorage, AK, USA, pp. 69-73.
26. Kennedy J, Eberhart RC (1997) A Discrete binary version of the particle swarm algorithm. In: Proceedings of IEEE conference on systems, man and cybernetics, pp 4104-4108.
27. Wang XY, Yang J, Teng XL, Xia WJ, Jensen R (2007) Feature selection based on rough sets and particle swarm optimization. Pattern Recognit Lett 28: 459-471.
28. Beinlinch IA, Suermondt HJ, Chavez RM, and Cooper GF (1989) The ALARM Monitoring System: A Case Study with Two Probabilistic Inference Techniques for Belief Networks. In: Proceedings of the Second European Conf. Artificial Intelligence in Medicine, pp. 247-256.
29. Henrion M (1988) Propagating uncertainty in Bayesian networks by logic sampling. In: Lemmar J, Kanal L (eds) Proceedings of the 2nd conference on uncertainty artificial intelligence, Amsterdam, pp 149-163.
30. Herskovits E (1991) Computer based probabilistic-network construction. Doctoral dissertation. Medical Information Sciences, Stanford University.
31. Kennedy J, Eberhart RC (1995) A new optimizer using particle swarm theory. In: Sixth international symposium on micro machine and human science, Nagoya, pp 39-43.
32. Wang Z, Wang Q, Wang D-W (2009) Bayesian network based business information retrieval model. Knowl Inform Syst 20(1): 63-79.
33. Kjaulff U (1992) A computational scheme for reasoning in dynamic probabilistic networks. In: Proceedings of the eighth conferebce on uncertainty in artificial intelligence, pp 121-129.
34. Wang KJ, Zhang JY, Shen FS, Shi LF (2008) Adaptive learning of dynamic Bayesian networks with changing structures by detecting geometric structures of time series. Knowl Inform Syst 17(1): 121-133.