Learning discriminative Bayesian networks from high-dimensional continuous neuroimaging data

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 38, Issue 11, 2016, Pages 2269-2283

  Zhou, Luping ^a   Wang, Lei ^a   Liu, Lingqiao ^b   Ogunbona, Philip ^a   Shen, Dinggang ^c,d  

^a UNIVERSITY OF WOLLONGONG   (Australia)

^b UNIVERSITY OF ADELAIDE   (Australia)

^c UNIVERSITY OF NORTH CAROLINA SCHOOL OF MEDICINE   (United States)

^d Korea University   (South Korea)

Author keywords

Bayesian network; Brain network; Discriminative learning; Fisher kernel learning; Max margin

Indexed keywords

DIRECTED GRAPHS; NEUROIMAGING; PROBABILITY DISTRIBUTIONS; SEMANTICS; SUPPORT VECTOR MACHINES;

BRAIN NETWORKS; CLASSIFICATION PERFORMANCE; DIRECTED ACYCLIC GRAPH (DAG); DISCRIMINATIVE LEARNING; FISHER KERNELS; GAUSSIAN BAYESIAN NETWORKS; GENERALIZATION ERROR BOUNDS; MAX-MARGIN;

BAYESIAN NETWORKS;

EID: 84991693784     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2015.2511754     Document Type: Article

References (50)

1. T. Verma and J. Pearl, "Equivalence and synthesis of causal models," in Proc. 6th Annu. Conf. Uncertainty Artif. Intell., 1991, vol. 6, pp. 255-268.
2. P. Spirtes and C. Glymour, "An algorithm for fast recovery of sparse causal graphs," Social Science Comput. Rev., vol. 9, no. 1, pp. 62-72, 1991.
3. A. Fast, "Learning the structure of Bayesian networks with constraint satisfaction," Ph.D. dissertation, Univ. Massachusetts Amherst, Amherst, MA, USA, 2010.
4. M. Scutari, "Bayesian network constraint-based structure learning algorithms: Parallel and optimised implementations in the bnlearn r package," CoRR, vol. abs/1406.7648, 2014.
5. N. Friedman and D. Koller, "Being Bayesian about network structure. A Bayesian approach to structure discovery in Bayesian networks," Mach. Learn., vol. 50, nos. 1/2, pp. 95-125, 2003.
6. M. Koivisto and K. Sood, "Exact Bayesian structure discovery in Bayesian networks," J. Mach. Learn. Res., vol. 5, pp. 549-573, 2004.
7. D. Geiger and D. Heckerman, "Learning Gaussian networks," CoRR, vol. abs/1302.6808, 2013
8. J. Suzuki, "A construction of Bayesian networks from databases based on an MDL principle," in Proc. 9th Int. Conf. Uncertainty Artif. Intell., 1993, pp. 266-273.
9. S. Acid and L. Campos, "Searching for Bayesian network structures in the space of restricted acyclic partially directed graphs," J. Artif. Intell. Res., vol. 18, pp. 445-490, 2003.
10. I. Tsamardinos, L. Brown, and C. Aliferis, "The max-min hillclimbing Bayesian network structure learning algorithm," Mach. Learn., vol. 65, no. 1, pp. 31-78, 2006.
11. J. L. M. Jose A. Gamez, and J. M. Puerta, "Learning Bayesian networks by hill climbing: Efficient methods based on progressive restriction of the neighborhood," Data Mining Knowl. Discovery, vol. 22, nos. 1/2, pp. 106-148, 2011.
12. M. Schmidt, A. Niculescu-Mizil, and K. Murphy, "Learning graphical model structures using L1-regularization paths," in Proc. 22nd Nat. Conf. Artif. Intell., 2007, pp. 1278-1283.
13. J. Pellet and A. Elisseeff, "Using Markov blankets for causal structure learning," J. Mach. Learn. Res., vol. 9, pp. 1295-1342, 2008.
14. S. Huang, J. Li, J. Ye, A. Fleisher, K. Chen, T. Wu, and E. Reiman, "A sparse structure learning algorithm for Gaussian Bayesian network identification from high-dimensional data," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 6, pp. 1328-1342, Jun. 2013.
15. J. Xiang and S. Kim, "A∗Lasso for learning a sparse Bayesian network structure for continuous variables," in Proc. Adv. Neural Inf. Process. Syst., 2013, pp. 2418-2426.
16. F. Pernkopf and J. Bilmes, "Efficient heuristics for discriminative structure learning of Bayesian network classifiers," J. Mach. Learn. Res., vol. 11, pp. 2323-2360, 2010.
17. F. Pernkopf, M. Wohlmayr, and S. Tschiatschek, "Maximum margin Bayesian network classifiers," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 3, pp. 521-532, Mar. 2012.
18. Y. Guo, D. Wilkinson, and D. Schuurmans, "Maximum margin Bayesian networks," in Proc. Uncertainty Artif. Intell., 2005, pp. 233-242.
19. T. Jaakkola and D. Haussler, "Exploiting generative models in discriminative classifiers," in Proc. Conf. Adv. Neural Inf. Process. Syst., 1998, pp. 487-493.
20. E. Bullmore and O. Sporns, "Complex brain networks: Graph theoretical analysis of structural and functional systems," Nat. Rev. Neurosci., vol. 10, no. 3, pp. 186-198, 2009.
21. S. Smith, K. Miller, G. Khorshidi, M. Webster, C. Beckmann, T. Nichols, J. Ramsey, and M. Woolrich, "Network modeling methods for fMRI," Neuroimage, vol. 54, no. 2, pp. 875-891, 2011.
22. R. Li, J. Yu, S. Zhang, F. Bao, P. Wang, X. Huang, and J. Li, "Bayesian network analysis reveals alterations to default mode network connectivity in individuals at risk for Alzheimer's disease," PLoS One, vol. 8, no. 12, p. e82104, 2013.
23. R. Li, X. Wu, K. Chen, A. Fleisher, E. Reiman, and L. Yao, "Alterations of directional connectivity among resting-state networks in Alzheimer disease," Am. J. Neuroradiol., vol. 34, pp. 340- 345, 2012.
24. X. Li, D. Coyle, L. Maguire, D. Watson, and T. McGinnity, "Gray matter concentration and effective connectivity changes in Alzheimers disease: A longitudinal structural MRI study," Neuroradiology, vol. 53, no. 10, pp. 733-748, 2011.
25. L. Zhou, L. Wang, L. Liu, P. Ogunbona, and D. Shen, "Discriminative brain effective connectivity analysis for Alzheimers disease: A kernel learning approach upon sparse Gaussian Bayesian network," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2013, pp. 2243-2250.
26. L. Zhou, L. Wang, L. Liu, P. Ogunbona, and D. Shen, "Max-margin based learning for discriminative Bayesian network from neuroimaging data," in Proc. 17th Int. Conf. Med. Image Comput. Comput.-Assisted Intervention, 2014, pp. 321-328.
27. J. Kim, W. Zhu, L. Chang, P. Bentler, and T. Ernst, "Unified structural equation modeling approach for the analysis of multisubject, multivariate functional MRI data," Human Brain Mapping, vol. 28, pp. 85-93, 2007.
28. K. Friston, L. Harrison, and W. Penney, "Dynamic causal modeling," Neuroimage, vol. 19, pp. 1273-1302, 2003.
29. A. Perina, M. Cristani, U. Castellani, V. Murino, and N. Jojic, "Free energy score spaces: Using generative information in discriminative classifiers," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 7, pp. 1249-1262, Jul. 2012.
30. F. Perronnin and C. Dance, "Fisher kernels on visual vocabularies for image categorization," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2007, pp. 1-8.
31. J. Krapac, J. Verbeek, and F. Jurie, "Modeling spatial layout with Fisher vectors for image categorization," in Proc. IEEE Int. Conf. Comput. Vis., 2011, pp. 1487-1494.
32. V. Sydorov, M. Sakurada, and C. Lampert, "Deep fisher kernels- end to end learning of the fisher kernel GMM parameters," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., 2014, pp. 1402-1409.
33. L. Maaten, "Learning discriminative Fisher kernels," in Proc. Int. Conf. Mach. Learn., 2011, pp. 217-224.
34. O. Chapelle, V. Vapnik, O. Bousquet, and S. Mukherjee, "Choosing multiple parameters for support vector machines," Mach. Learn., vol. 46, nos. 1-3, pp. 131-159, 2002.
35. L. Wang, "Feature selection with kernel class separability," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 9, pp. 1534-1546, Sep. 2008.
36. X. Liu, L. Wang, J. Yin, E. Zhu, and J. Zhang, "An efficient approach to integrating radius information into multiple kernel learning," IEEE Trans. Cybern., vol. 43, no. 2, pp. 557-569, Apr. 2013.
37. C. Bishop, Pattern Recognition and Machine Learning. New York, NY, USA: Springer, 2007.
38. R. Peharz and F. Pernkopf, "Exactmaximummargin structure learning of Bayesian networks," in Proc. Int. Conf. Mach. Learn., 2012, pp. 1047-1054.
39. H. Zou, "The adaptive lasso and its oracle properties," J. Amer. Statistical Assoc., vol. 101, no. 476, pp. 1418-1429, 2006.
40. A. Shojaie and G. Michailidis, "Penalized likelihood methods for estimation of sparse high dimensional directed acyclic graphs," Biometrika, vol. 97, no. 3, pp. 519-538, 2010.
41. F. Fu and Q. Zhou, "Learning sparse causal Gaussian networkswith experimental intervention: Regularization and coordinate descent," J.Amer. Statistical Assoc., vol. 108, no. 501, pp. 288-300, 2013.
42. ADNI. (2004). [Online]. Available: http://www.adni-info.org
43. B. Tijms, P. Seris, D. Willshaw, and S. Lawrie, "Similarity-based extraction of individual networks from gray matter MRI scans," Cereb Cortex, vol. 22, no. 7, pp. 1530-1541, 2012.
44. D. Mackey, Information Theory, Inference, and Learning Algorithms. Cambridge, U.K.: Cambridge Univ. Press, 2003.
45. D. Margaritis and S. Thrun, "Bayesian network induction via local neighborhoods," in Proc. Adv. Neural Inf. Process. Syst., 1999, pp. 505-511.
46. I. Tsamardinos and C. Aliferis, "Towards principled feature selection: Relevancy, filters and wrappers," in Proc. 9th Int. Workshop Artif. Intell. Statist., 2003, pp. 1-8.
47. P. Spirtes, C. Glymour, and R. Scheines, Causation, Prediction, and Search. New York, NY, USA: Springer-Verlag, 1993.
48. K. Supekar, V. Menon, D. Rubin, M. Musen, and M. Greicius, "Network analysis of intrinsic functional brain connectivity in Alzheimer's disease," PLoS Comput. Biol., vol. 4, no. 6, pp. 1-11, 2008.
49. K. Wang, M. Liang, L. Wang, L. Tian, X. Zhang, K. Li, and T. Jiang, "Altered functional connectivity in early Alzheimer's disease: za resting-state fMRI study," Human Brain Mapping, vol. 28, no. 10, pp. 967-978, 2007.
50. R. Gould, B. Arroyo, R. Brown, A. Owen, E. Bullmore, and R. Howard, "Brain mechanisms of successful compensation during learning in Alzheimer disease," Neurology, vol. 67, no. 6, pp. 1011- 1017, 2006.