High-dimensional structured feature screening using binary markov random fields

Journal of Machine Learning Research

Volumn 22, Issue , 2012, Pages 712-721

  Liu, Jie ^a   Zhang, Chunming ^b   McCarty, Catherine ^c   Peissig, Peggy ^d   Burnside, Elizabeth ^b   Page, David ^b  

^a University of Wisconsin   (United States)

^b UNIVERSITY OF WISCONSIN MADISON   (United States)

^c ESSENTIA INSTITUTE OF RURAL HEALTH   (United States)

^d MARSHFIELD CLINIC   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; CLUSTERING ALGORITHMS; IMAGE SEGMENTATION; INTERFACES (COMPUTER); MARKOV PROCESSES;

CORRELATION STRUCTURE; FEATURE SCREENING; HIGH DIMENSIONAL DATA; INDIVIDUAL FEATURES; MARKOV RANDOM FIELDS; PENALIZED LEAST-SQUARES; PREDICTION ERRORS; RELEVANT FEATURES;

FEATURE EXTRACTION;

EID: 84954468219     PISSN: 15324435     EISSN: 15337928     Source Type: Journal    
DOI: None     Document Type: Conference Paper

References (48)

1. Boykov, Y., Veksler, O., & Zabih, R. (2001). Fast approximate energy minimization via graph cuts. IEEE Transactions on Pattern Analysis and Machine Intelligence, 23, 1222-1239.
2. Candés, E., & Tao, T. (2007). Rejoinder: the Dantzig selector: statistical estimation when p is much larger than n. Annals of Statistics, 35, 2392-2404.
3. Celeux, G., Forbes, F., & Peyrard, N. (2003). EM procedures using mean field-like approximations for Markov model-based image segmentation. Pattern Recognition, 36, 131-144.
4. Efron, B., Hastie, T., Johnstone, L., & Tibshirani, R. (2004). Least angle regression. Annals of Statistics, 32, 407-499.
5. Fan, J., & Li, R. (2001). Variable selection via nonconcave penalized likelihood and its oracle properties. Journal of the American Statistical Association, 96, 1348-1360.
6. Fan, J., Samworth, R., & Wu, Y. (2009). Ultrahigh dimensional feature selection: Beyond the linear model. Journal of Machine Learning Research, 10, 2013-2038.
7. Ford, L. R., & Fulkerson, D. R. (1958). Constructing maximal dynamic flows from static flows. Operations Research, 6, 419-433.
8. Goldberg, A. V., & Tarjan, R. E. (1986). A new approach to the maximum flow problem. The 18th ACM Symposium on Theory of Computing.
9. Guyon, I., & Elisseeff, A. (2003). An introduction to variable and feature selection. Journal of Machine Learning Research, 3, 1157-1182.
10. Guyon, I., Weston, J., Barnhill, S., & Vapnik, V. (2002). Gene selection for cancer classification using support vector machines. Machine Learning, 46, 389-422.
11. Hans, C. (2009). Bayesian lasso regression. Biometrika, 96, 835-845.
12. Hunter, D. J., Kraft, P., Jacobs, K. B., Cox, D. G., Yeager, M., Hankinson, S. E., Wacholder, S., Wang, Z., Welch, R., Hutchinson, A., Wang, J., Yu, K., Chatterjee, N., Orr, N., Willett, W. C., Colditz, G. A., Ziegler, R. G., Berg, C. D., Buys, S. S., Mccarty, C. A., Feigelson, H. S., Calle, E. E., Thun, M. J., Hayes, R. B., Tucker, M., Gerhard, D. S., Fraumeni, J. F., Hoover, R. N., Thomas, G., & Chanock, S. J. (2007). A genome-wide association study identifies alleles in FGFR2 associated with risk of sporadic postmenopausal breast cancer. Nature Genetics, 39, 870-874.
13. Jacob, L., Obozinski, G., & Vert, J.-P. (2009). Group lasso with overlap and graph lasso. ICML.
14. Jenatton, R., Audibert, J.-Y., & Bach, F. (2009). Structured variable selection with sparsity-inducing norms. Technical report.
15. Kira, K., & Rendell, L. A. (1992). A practical approach to feature selection. The Ninth International Workshop on Machine learning.
16. Kolmogorov, V., & Zabih, R. (2004). What energy functions can be minimized via graph cuts? IEEE Transactions on Pattern Analysis and Machine Intelligence, 26, 147-159.
17. Lichtenstein, P., Holm, N. V., Verkasalo, P. K., Iliadou, A., Kaprio, J., Koskenvuo, M., Pukkala, E., Skytthe, A., & Hemminki, K. (2000). Environmental and heritable factors in the causation of cancer-analyses of cohorts of twins from sweden, denmark, and finland. New England Journal of Medicine, 343, 78-85.
18. Liu, H., Zhang, J., Jiang, X., & Liu, J. (2010). The group Dantzig selector. AISTATS.
19. Lorbert, A., Eis, D., Kostina, V., Blei, D., & Ramadge, P. (2010). Exploiting covariate similarity in sparse regression via the pairwise elastic net. AISTATS.
20. McCarty, C., Wilke, R., Giampietro, P., Wesbrook, S., & Caldwell, M. (2005). Marshfield Clinic Personalized Medicine Research Project (PMRP): design, methods and recruitment for a large populationbased biobank. Personalized Med, 2, 49-79.
21. McCarty, C. A., Chisholm, R. L., Chute, C. G., Kullo, I. J., Jarvik, G. P., Larson, E. B., Li, R., Masys, D. R., Ritchie, M. D., Roden, D. M., Struewing, J. P., Wolf, W. A., & eMERGE Team (2011). The eMERGE Network: a consortium of biorepositories linked to electronic medical records data for conducting genomic studies. BMC Medical Genomics, 4, 13.
22. Meyer, P. E., Schretter, C., & Bontempi, G. (2008). Information-theoretic feature selection in microarray data using variable complementarity. Selected Topics in Signal Processing, IEEE Journal of, 2, 261-274.
23. Mukhopadhyay, I., Feingold, E., Weeks, D. E., & Thalamuthu, A. (2010). Association tests using kernelbased measures of multi-locus genotype similarity between individuals. Genetic Epidemiology, 34, 213-221.
24. Nilsson, R., Peña, J. M., Björkegren, J., & Tegnér, J. (2007). Consistent feature selection for pattern recognition in polynomial time. Journal of Machine Learning Research, 8, 589-612.
25. Peng, H., Long, F., & Ding, C. (2005). Feature selection based on mutual information: criteria of maxdependency, max-relevance, and min-redundancy. IEEE Transactions on Pattern Analysis and Machine Intelligence, 27, 1226-1238.
26. Pharoah, P. D. P., Antoniou, A. C., Easton, D. F., & Ponder, B. A. J. (2008). Polygenes, risk prediction, and targeted prevention of breast cancer. New England Journal of Medicine, 358, 2796-2803.
27. Qi, Y., & Yan, F. (2011). EigenNet: A Bayesian hybrid of generative and conditional models for sparse learning. NIPS.
28. Rosasco, L., Santoro, M., Mosci, S., Verri, A., & Villa, S. (2010). A regularization approach to nonlinear variable selection. AISTATS.
29. Tibshirani, R. (1996). Regression shrinkage and selection via the lasso. Journal of The Royal Statistical Society Series B-Statistical Methodology, 58, 267-288.
30. Tibshirani, R., & Saunders, M. (2005). Sparsity and smoothness via the fused lasso. Journal of The Royal Statistical Society Series B-Statistical Methodology, 67, 91-108.
31. Vignes, M., & Forbes, F. (2009). Gene clustering via integrated markov models combining individual and pairwise features. IEEE/ACM Trans. Comput. Biol. Bioinformatics, 6, 260-270.
32. Wainwright, M. J., Jaakkola, T. S., & Willsky, A. S. (2003). Tree-reweighted belief propagation algorithms and approximate ML estimation via pseudomoment matching. AISTATS.
33. Wainwright, M. J., & Jordan, M. I. (2006). Logdeterminant relaxation for approximate inference in discrete Markov random fields. IEEE Transactions on Signal Processing, 54, 2099-2109.
34. Wasserman, L., & Roeder, K. (2009). Highdimensional variable selection. Annals of Statistics, 37, 2178-2201.
35. Wei, Z., Wang, K., Qu, H.-Q., Zhang, H., Bradfield, J., Kim, C., Frackleton, E., Hou, C., Glessner, J. T., Chiavacci, R., Stanley, C., Monos, D., Grant, S. F. A., Polychronakos, C., & Hakonarson, H. (2009). From disease association to risk assessment: An optimistic view from genome-wide association studies on type 1 diabetes. PLoS Genetics, 5, e1000678.
36. Welling, M., & Sutton, C. (2005). Learning in Markov random fields with contrastive free energies. AISTATS.
37. Wessel, J., & Schork, N. J. (2006). Generalized genomic distance-based regression methodology for multilocus association analysis. American Journal of Human Genetics, 79, 792-806.
38. Wu, M. C., Kraft, P., Epstein, M. P., Taylor, D. M., Chanock, S. J., Hunter, D. J., & Lin, X. (2010). Powerful SNP-set analysis for case-control genomewide association studies. American Journal of Human Genetics, 86, 929-942.
39. Wu, T. T., Chen, Y. F., Hastie, T., Sobel, E. M., & Lange, K. (2009). Genome-wide association analysis by lasso penalized logistic regression. Bioinformatics, 25, 714-721.
40. Ye, G., Chen, Y., & Xie, X. (2011). Efficient variable selection in support vector machines via the alternating direction method of multipliers. AISTATS.
41. Yu, L., & Liu, H. (2004). Efficient feature selection via analysis of relevance and redundancy. Journal of Machine Learning Research, 5, 1205-1224.
42. Yuan, M., & Lin, Y. (2006). Model selection and estimation in regression with grouped variables. Journal of The Royal Statistical Society Series B-Statistical Methodology, 68, 49-67.
43. Zhang, H. H., Ahn, J., & Lin, X. (2006). Gene selection using support vector machines with nonconvex penalty. Bioinformatics, 22, 88-95.
44. Zhou, Y., Jin, R., & Hoi, S. C. (2010). Exclusive lasso for multi-task feature selection. AISTATS.
45. Zou, H., & Hastie, T. (2005). Regularization and variable selection via the Elastic Net. Journal of The Royal Statistical Society Series B-Statistical Methodology, 67, 301-320.
46. Zou, H., & Zhang, H. H. (2009). On the adaptive elastic-net with a diverging number of parameters. Annals of Statistics, 37, 1733.
47. Zuber, V., & Strimmer, K. (2009). Gene ranking and biomarker discovery under correlation. Bioinformatics, 25, 2700-2707.
48. Zuber, V., & Strimmer, K. (2011). High-dimensional regression and variable selection using CAR scores. Statistical Applications in Genetics and Molecular Biology, 10.