Sparse probit linear mixed model

Machine Learning

Volumn 106, Issue 9-10, 2017, Pages 1621-1642

  Mandt, Stephan ^a   Wenzel, Florian ^b   Nakajima, Shinichi ^c   Cunningham, John ^a   Lippert, Christoph ^d   Kloft, Marius ^b  

^a Columbia University ^*  (United States)

^b HUMBOLDT UNIVERSITY   (Germany)

^c TECHNISCHE UNIVERSITÄT BERLIN   (Germany)

^d Human Longevity Inc   (United States)

Author keywords

Approximate Bayesian inference; Causality; Feature selection; Statistical genetics

Indexed keywords

BAYESIAN NETWORKS; BIT ERROR RATE; CHROMOSOMES; INFERENCE ENGINES;

APPROXIMATE BAYESIAN INFERENCE; APPROXIMATE INFERENCE; CAUSALITY; HIGH DIMENSIONAL DATA; LIKELIHOOD FUNCTIONS; POPULATION STRUCTURES; STATISTICAL GENETICS; TECHNICAL CHALLENGES;

FEATURE EXTRACTION;

EID: 85023771836     PISSN: 08856125     EISSN: 15730565     Source Type: Journal    
DOI: 10.1007/s10994-017-5652-6     Document Type: Article

References (51)

1. Arp, D., Spreitzenbarth, M., Hübner, M., Gascon, H., Rieck, K., & Siemens, C. (2014). DREBIN: Effective and explainable detection of android malware in your pocket. In Proceedings of NDSS.
2. Astle, W., & Balding, D. J. (2009). Population structure and cryptic relatedness in genetic association studies. Statistical Science, 24, 451–471.
3. Atwell, S., Huang, Y. S., Vilhjálmsson, B. J., Willems, G., Horton, M., Li, Y., et al. (2010). Genome-wide association study of 107 phenotypes in Arabidopsis thaliana inbred lines. Nature, 465(7298), 627–631.
4. Berry, M. P., Graham, C. M., McNab, F. W., Xu, Z., Bloch, S. A., Oni, T., et al. (2010). An interferon-inducible neutrophil-driven blood transcriptional signature in human tuberculosis. Nature, 466(7309), 973–977.
5. Bliss, C. I. (1934). The method of probits. Science, 79(2037), 38–39.
6. Boufounos, P. T., & Baraniuk, R. G. (2008). 1-Bit compressive sensing. In IEEE 42nd Annual Conference on Information sciences and systems, 2008. CISS 2008 (pp. 16–21).
7. Boyd, S., Parikh, N., Chu, E., Peleato, B., & Eckstein, J. (2011). Distributed optimization and statistical learning via the alternating direction method of multipliers. Foundations and Trends in Machine Learning, 3(1), 1–122.
8. Breslow, N. E., & Clayton, D. G. (1993). Approximate inference in generalized linear mixed models. Journal of the American Statistical Association, 88(421), 9–25.
9. Candès, E. J., & Tao, T. (2006). Near optimal signal recovery from random projections: Universal encoding strategies? IEEE Transactions Information Theory, 52(12), 5406–5425.
10. Carbonetto, P., Stephens, M., et al. (2012). Scalable variational inference for bayesian variable selection in regression, and its accuracy in genetic association studies. Bayesian Analysis, 7(1), 73–108.
11. Cox, D. R. (1958). The regression analysis of binary sequences. Journal of the Royal Statistical Society. Series B (Methodological), 20(2), 215–242.
12. Craddock, N., Hurles, M. E., Cardin, N., et al. (2010). Genome-wide association study of CNVs in 16,000 cases of eight common diseases and 3,000 shared controls. Nature, 464(7289), 713–720.
13. Cunningham, J. P., Hennig, P., & Lacoste-Julien, S. (2011). Gaussian probabilities and expectation propagation. arXiv:1111.6832.
14. Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977). Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society. Series B (methodological), 39(1), 1–38.
15. Donoho, D. L. (2006). Compressed sensing. IEEE Transactions Information Theory, 52(4), 1289–1306.
16. Eckstein, J., & Bertsekas, D. P. (1992). On the Douglas-Rachford splitting method and the proximal point algorithm for maximal monotone operators. Mathematical Programming, 55, 293–318.
17. Fahrmeir, L., Kneib, T., Lang, S., & Marx, B. (2013). Regression. Berlin: Springer.
18. Fawcett, T. (2006). An introduction to ROC analysis. Pattern Recognition Letters, 27(8), 861–874.
19. Fisher, R. A. (1919). The correlation between relatives on the supposition of mendelian inheritance. Transactions of the Royal Society of Edinburgh, 52(02), 399–433.
20. Fusi, N., Stegle, O., & Lawrence, N. D. (2012). Joint modelling of confounding factors and prominent genetic regulators provides increased accuracy in genetical studies. PLoS Computational Biology, 8(1), e1002330.
21. Henderson, C. R. (1950). Estimation of genetic parameters. Annals of Mathematical Statistics, 6, 186–187.
22. Hoffman, M. D., Blei, D. M., Wang, C., & Paisley, J. (2013). Stochastic variational inference. The Journal of Machine Learning Research, 14(1), 1303–1347.
23. Imbens, G. W., & Rubin, D. B. (2015). Causal inference in statistics, social, and biomedical sciences. Cambridge: Cambridge University Press.
24. Klasen, J. R., Barbez, E., Meier, L., Meinshausen, N., Bühlmann, P., Koornneef, M., et al. (2016). A multi-marker association method for genome-wide association studies without the need for population structure correction. Nature Communications, 7, 13299.
25. Kraft, P., Zeggini, E., & Ioannidis, J. P. (2009). Replication in genome-wide association studies. Statistical Science: A Review Journal of the Institute of Mathematical Statistics, 24(4), 561.
26. Li, L., Rakitsch, B., & Borgwardt, K. M. (2011). ccSVM: Correcting support vector machines for confounding factors in biological data classification. Bioinformatics, 27(13), 342–348.
27. Lippert, C. (2013). Linear mixed models for genome-wide association studies. Ph.D. Thesis, Eberhard Karls Universität Tübingen.
28. Lippert, C., Listgarten, J., Liu, Y., Kadie, C., Davidson, R., & Heckerman, D. (2011). FaST linear mixed models for genome-wide association studies. Nature Methods, 8, 833–835.
29. Manolio, T. A., Collins, F. S., Cox, N. J., Goldstein, D. B., Hindorff, L. A., Hunter, D. J., et al. (2009). Finding the missing heritability of complex diseases. Nature, 461(7265), 747–753.
30. Meinshausen, N., & Bühlmann, P. (2010). Stability selection. Journal of the Royal Statistical Society, Series B, 72, 417–473.
31. Minka, T. P. (2001). Expectation propagation for approximate bayesian inference, In Proceedings of the seventeenth conference on uncertainty in artificial intelligence (pp. 362–369). Morgan Kaufmann Publishers Inc.
32. Mohamed, S., Heller, K., & Ghahramani, Z. (2011). Bayesian and L1 approaches for sparse unsupervised learning. arXiv:1106.1157.
33. Morgan, S. L., & Winship, C. (2014). Counterfactuals and causal inference. Cambridge: Cambridge University Press.
34. Neyman, J., & Pearson, E. (1933). On the problem of the most efficient tests of statistical hypotheses. Philosophical Transactions of the Royal Society of London Series A, 231, 289–337.
35. NHGR Institute. (2009). Proceedings of the workshop on the dark matter of genomic associations with complex diseases: Explaining the unexplained heritability from genome-wide association studies.
36. Patterson, H. D., & Thompson, R. (1971). Recovery of inter-block information when block sizes are unequal. Biometrika, 58(3), 545–554.
37. Pearl, J., et al. (2009). Causal inference in statistics: An overview. Statistics Surveys, 3, 96–146.
38. Plan, Y., & Vershynin, R. (2012). One-bit compressed sensing by linear programming. arXiv:1109.4299.
39. Prékopa, A. (1973). On logarithmic concave measures and functions. Acta Scientiarum Mathematicarum, 34, 35–343.
40. Price, A. L., Patterson, N. J., Plenge, R. M., Weinblatt, M. E., Shadick, N. A., & Reich, D. (2006). Principal components analysis corrects for stratification in genome-wide association studies. Nature Genetics, 38, 904–909.
41. Price, A. L., Zaitlen, N. A., Reich, D., & Patterson, N. (2010). New approaches to population stratification in genome-wide association studies. Nature Reviews Genetics, 11(7), 459–463.
42. Ragab, A. (1991). On multivariate generalized logistic distribution. Microelectronics and Reliability, 31(2), 511–519.
43. Rakitsch, B., Lippert, C., Stegle, O., & Borgwardt, K. (2013). A Lasso multi-marker mixed model for association mapping with population structure correction. Bioinformatics, 29(2), 206–214.
44. Rasmussen, C. E., & Williams, C. K. I. (2006). Gaussian processes for machine learning. Cambridge, MA, USA: MIT Press.
45. Seeger, M. W., & Nickisch, H. (2011). Large scale Bayesian inference and experimental design for sparse linear models. SIAM Journal on Imaging Sciences, 4(1), 166–199.
46. Song, M., Hao, W., & Storey, J. D. (2015). Testing for genetic associations in arbitrarily structured populations. Nature Genetics, 47(5), 550–554.
47. Tibshirani, R. (1996). Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society. Series B (Methodological), 58(1), 267–288.
48. Vattikuti, S., Lee, J. J., Chang, C. C., Hsu, S. D., & Chow, C. C. (2014). Applying compressed sensing to genome-wide association studies. GigaScience, 3(1), 10.
49. Vilhjálmsson, B. J., & Nordborg, M. (2013). The nature of confounding in genome-wide association studies. Nature Reviews Genetics, 14(1), 1–2.
50. Yu, J., Pressoir, G., Briggs, W. H., Bi, I. V., Yamasaki, M., Doebley, J. F., et al. (2006). A unified mixed-model method for association mapping that accounts for multiple levels of relatedness. Nature Genetics, 38(2), 203–208.
51. Zou, H., & Hastie, T. (2005). Regularization and variable selection via the elastic net. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 67(2), 301–320.