Experimental design on a budget for sparse linear models and applications

33rd International Conference on Machine Learning, ICML 2016

Volumn 2, Issue , 2016, Pages 875-884

  Ravi, Sathya N ^a   Ithapu, Vamsi K ^a   Johnson, Sterling C ^b   Singh, Vikas ^a  

^a UNIVERSITY OF WISCONSIN MADISON   (United States)

^b WILLIAM S MIDDLETON MEMORIAL VETERANS HOSPITAL   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTIFICIAL INTELLIGENCE; BUDGET CONTROL; LEARNING SYSTEMS; NEUROIMAGING; REGRESSION ANALYSIS;

CONSTRAINED DESIGN; CONSTRAINED OPTIMAL DESIGNS; HIGH-DIMENSIONAL; LINEAR FUNCTIONS; NOVEL STRATEGIES; REGRESSION MODEL; SCIENTIFIC STUDIES; TRACTABLE ALGORITHMS;

DESIGN OF EXPERIMENTS;

EID: 84998655193     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (38)

1. Ageev, Alexander A and Sviridenko, Maxim I. Pipage rounding: A new method of constructing algorithms with proven performance guarantee. Journal of Combinatorial Optimization, 8(3):307-328, 2004.
2. Bandeira, Afonso S, Dobriban, Edgar, Mixon, Dustin G, and Sawin, William F. Certifying the restricted isometry property is hard. arXiv preprint arXiv: 1204.1580, 2012.
3. Berger, James O and Sellke, Thomas. Testing a point null hypothesis: the irreconcilability of p values and evidence. Journal of the American statistical Association, 82(397):112-122, 1987.
4. Bertsekas, Dimitri P and Tsitsiklis, John N. Parallel and distributed computation: numerical methods. Prentice-Hall, Inc., 1989.
5. Bertsimas, Dimitris, Johnson, Mac, and Kallus, Nathan. The power of optimization over randomization in designing experiments involving small samples. Operations Research, 2015.
6. Candes, Emmanuel J and Plan, Yaniv. Near-ideal model selection by 11 minimization. The Annals of Statistics, 37(5 A):2145-2177, 2009.
7. Candes, Emmanuel J and Tao, Terence. Decoding by linear programming. Information Theory, IEEE Transactions on, 51(12):4203-4215, 2005.
8. Chaloner, Kathryn and Verdinelli, Isabella. Bayesian experimental design: A review. Statistical Science, pp. 273-304, 1995.
9. Chekuri, Chandra, Vondrák, Jan, and Zenklusen, Rico. Dependent randomized rounding for matroid polytopes and applications. arXiv preprint arXiv. 0909.4348, 2009.
10. Chen, Yudong, Bhojanapalli, Srinadh, Sanghavi, Sujay, and Ward, Rachel. Coherent matrix completion. In Proceedings of The 31st International Conference on Machine Learning, pp. 674-682, 2014.
11. Collins, Maxwell D, Liu, Ji, Xu, Jia, Mukherjee, Lopamudra, and Singh, Vikas. Spectral clustering with a convex regularizer on millions of images. In Computer Vision-ECCV 2014, pp. 282-298. Springer, 2014.
12. Das, Ashish. An introduction to optimality criteria and some results on optimal block design.
13. Dette, Holger, Pepelyšev, Andrej, and Žigljavskij, Anatolij A. Optimal design for linear models with correlated observations. 2011.
14. Drineas, Petros, Magdon-Ismail, Malik, Mahoney, Michael W, and Woodruff, David P. Fast approximation of matrix coherence and statistical leverage. The Journal of Machine Learning Research, 13(1):3475-3506, 2012.
15. Efron, Bradley, Hastie, Trevor, Johnstone, Iain, Tibshirani, Robert, et al. Least angle regression. The Annals of statistics, 32(2):407-499, 2004.
16. Gorski, Jochen, Pfeuffer, Frank, and Klamroth, Kathrin. Biconvex sets and optimization with biconvex functions: a survey and extensions. Mathematical Methods of Operations Research, 66(3):373-407, 2007.
17. Harvey, Nicholas JA and Olver, Neil. Pipage rounding, pessimistic estimators and matrix concentration. In Proceedings of the Twenty-Fifth Annual ACM-SIAM Symposium on Discrete Algorithms, pp. 926-945. SIAM, 2014.
18. Hinrichs, Chris, Singh, Vikas, Xu, Guofan, Johnson, Sterling C, Initiative, Alzheimers Disease Neuroimaging, et al. Predictive markers for ad in a multi-modality framework: an analysis of mci progression in the adni population. Neuroimage, 55(2):574-589, 2011.
19. Hinrichs, Chris, Dowling, N Maritza, Johnson, Sterling C, and Singh, Vikas. Mkl-based sample enrichment and customized outcomes enable smaller ad clinical trials. In Machine Learning and Interpretation in Neuroimaging, pp. 124-131. Springer, 2012.
20. Horel, Thibaut, Ioannidis, Stratis, and Muthukrishnan, S. Budget feasible mechanisms for experimental design. In LATIN 2014: Theoretical Informatics, pp. 719-730. Springer, 2014.
21. Ithapu, Vamsi K, Singh, Vikas, Okonkwo, Ozioma C, Chappell, Richard J, Dowling, N Maritza, Johnson, Sterling C, Initiative, Alzheimer's Disease Neuroimaging, et al. Imaging-based enrichment criteria using deep learning algorithms for efficient clinical trials in mild cognitive impairment. Alzheimer's & Dementia, 11(12):1489-1499, 2015.
22. Jaggi, Martin. Revisiting frank-wolfe: Projection-free sparse convex optimization. In Proceedings of the 30th International Conference on Machine Learning (ICML-13), pp. 427-435, 2013.
23. Juditsky, Anatoli and Nemirovski, Arkadi. On verifiable sufficient conditions for sparse signal recovery via 1 minimization. Mathematical programming, 127(1):57-88, 2011.
24. Kempthorne, Oscar. The design and analysis of experiments. 1952.
25. Kingma, Diederik and Ba, Jimmy. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980, 2014.
26. Kirk, Roger E. Experimental design. Wiley Online Library, 1982.
27. Konstantinou, Maria, Biedermann, Stefanie, and Kimber, Alan. Optimal designs for two-parameter nonlinear models with application to survival models. 2011.
28. Landau, SM, Harvey, D, Madison, CM, Reiman, EM, Foster, NL, Aisen, PS, Petersen, RC, Shaw, LM, Trojanowski, JQ, Jack, CR, et al. Comparing predictors of conversion and decline in mild cognitive impairment. Neurology, 75(3):230-238, 2010.
29. Li, Jia. Linear, ridge regression, and principal component analysis, 2008.
30. Li, Xin and Guo, Yuhong. Adaptive active learning for image classification. In Computer Vision and Pattern Recognition (CVPR), 2013 IEEE Conference on, pp. 859-866. IEEE, 2013.
31. Nocedal, J. and Wright, S. J. Numerical Optimization. Springer, New York, 2nd edition, 2006.
32. Pesaran, M Hashem and Weeks, Melvyn. Non-nested hypothesis testing: an overview. A Companion to Theoretical Econometrics, pp. 279-309, 2001.
33. Pukelsheim, Friedrich. Optimal design of experiments, volume 50. siam, 1993.
34. Recht, Benjamin, Re, Christopher, Wright, Stephen, and Niu, Feng. Hogwild: A lock-free approach to parallelizing stochastic gradient descent. In Advances in Neural Information Processing Systems, pp. 693-701, 2011.
35. Saigal, Romesh. On the inverse of a matrix with several rank one. Ann Arbor, 1001:48109-2117, 1993.
36. Searcey, Terena, Bierer, Linda, and Davis, Kenneth L. A longitudinal study of alzheimers disease: measurement, rate, and predictors of cognitive deterioration. Am J Psychiatry, 1:51, 1994.
37. Tibshirani, Robert. Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society. Series B (Methodological), pp. 267-288, 1996.
38. Wen, Zaiwen and Yin, Wotao. A feasible method for optimization with orthogonality constraints. Mathematical Programming, 142(1-2):397-434, 2013.