A path algorithm for constrained estimation

Journal of Computational and Graphical Statistics

Volumn 22, Issue 2, 2013, Pages 261-283

  Zhou, Hua ^a   Lange, Kenneth ^b  

^a NORTH CAROLINA STATE UNIVERSITY   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Exact penalty; Shape restricted regression; pipe 1 regularization

Indexed keywords

EID: 84884363386     PISSN: 10618600     EISSN: 15372715     Source Type: Journal    
DOI: 10.1080/10618600.2012.681248     Document Type: Article

References (36)

1. Beresteanu, A. (2004), "Nonparametric Estimation of Regression Functions Under Restrictions on Partial Derivatives, " Working Papers 04-06, Duke University, Department of Economics. [279].
2. Brunk, H. D. (1955), "Maximum Likelihood Estimates of Monotone Parameters, " Annals of Mathematical Statistics, 26, 607-616. [279].
3. Chen, X., Lin, Q., Kim, S., Carbonell, J., and Xing, E. (2012), "Smoothing Proximal GradientMethod for General Structured Sparse Regression, " Annals of Applied Statistics, 6, 719-752. [269, 277].
4. de Leeuw, J., Hornik, K., and Mair, P. (2009), "Isotone Optimization in R: Pool-Adjacent-Violators Algorithm (PAVA) and Active Set Methods, " Journal of Statistical Software, 32 (5), 1-24. [280].
5. Dempster, A. P. (1969), Elements of Continuous Multivariate Analysis (Addison-Wesley Series in Behavioral Sciences), Reading, MA: Addison-Wesley. [269].
6. Efron, B. (2004), "The Estimation of Prediction Error: Covariance Penalties and Cross-Validation" (with discussion), Journal of the American Statistical Association, 99, 619-642. [263, 274].
7. Efron, B., Hastie, T., Johnstone, I., and Tibshirani, R. (2004), "Least Angle Regression" (with discussion), The Annals of Statistics, 32, 407-499. [262, 273].
8. Friedman, J. (2008), "Fast Sparse Regression and Classification, " [online] in Proceedings of the 23rd International Workshop on Statistical Modelling, pp. 27-57. Available at http://www-stat. stanford. edu/-jhf/ftp/GPSpaper. pdf [262].
9. Friedman, J., Hastie, T., Höfling, H., and Tibshirani, R. (2007), "Pathwise Coordinate Optimization, " Annals of Applied Statistics, 1, 302-332. [269].
10. Goodnight, J. H. (1979), "A Tutorial on the Sweep Operator, " The American Statistician, 33, 149-158. [269].
11. Grenander, U. (1956), "On the Theory of Mortality Measurement. Part II, " Skand Aktuarietidskr, 39, 125-153. [279].
12. Groeneboom, P., Jongbloed, G., and Wellner, J. A. (2001), "Estimation of a Convex Function: Characterizations and Asymptotic Theory, " The Annals of Statistics, 29, 1653-1698. [263, 279].
13. Hanson, D. L., and Pledger, G. (1976), "Consistency in Concave Regression, " The Annals of Statistics, 4, 1038-1050. [263, 279].
14. Hildreth, C. (1954), "Point Estimates of Ordinates of Concave Functions, " Journal of the American Statistical Association, 49, 598-619. [263].
15. Jennrich, R. (1977), "Stepwise Regression, " in Statistical Methods for Digital Computers, eds. A. Ralston, K. Enslein, and H. S. Wilf, New York: Wiley-Interscience, pp. 58-75. [269].
16. Lange, K. (2010), Numerical Analysis for Statisticians (2nd ed., Statistics and Computing), New York: Springer. [269].
17. Lawson, C. L., and Hanson, R. J. (1987), Solving Least Squares Problems (New ed., Classics in Applied Mathematics), Philadelphia, PA: Society for Industrial and Applied Mathematics. [273, 274].
18. Li, C., and Li, H. (2008), "Network-Constrained Regularization and Variable Selection for Analysis of Genomic Data, " Bioinformatics, 24, 1175-1182. [277].
19. Little, R. J. A., andRubin, D. B. (2002), Statistical AnalysisWith Missing Data (2nd ed., Wiley Series in Probability and Statistics), Hoboken, NJ: Wiley-Interscience. [269].
20. Liu, J., Yuan, L., and Ye, J. (2010), "An Efficient Algorithm for a Class of Fused Lasso Problems, " in Proceedings of the 16th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, pp. 323-332. [269].
21. Magnus, J. R., and Neudecker, H. (1999), Matrix Differential Calculus With Applications in Statistics and Econometrics (Wiley Series in Probability and Statistics), Chichester: Wiley. [273].
22. Mammen, E. (1991), "Nonparametric Regression Under Qualitative Smoothness Assumptions, " The Annals of Statistics, 19, 741-759. [263, 279].
23. Meyer, M., andWoodroofe, M. (2000), "On the Degrees of Freedom in Shape-Restricted Regression, " The Annals of Statistics, 28, 1083-1104. [274].
24. Nocedal, J., and Wright, S. J. (2006), Numerical Optimization (2nd ed., Springer Series in Operations Research and Financial Engineering), New York: Springer. [273, 281].
25. Robertson, T., Wright, F. T., and Dykstra, R. L. (1988), Order Restricted Statistical Inference (Wiley Series in Probability and Mathematical Statistics: Probability and Mathematical Statistics), Chichester: Wiley. [277, 278].
26. Rosset, S., and Zhu, J. (2007), "Piecewise Linear Regularized Solution Paths, " The Annals of Statistics, 35, 1012-1030. [262].
27. Ruszczýnski, A. (2006), Nonlinear Optimization, Princeton, NJ: Princeton University Press. [265].
28. Savage, C. (1997), "A Survey of Combinatorial Gray Codes, " SIAM Review, 39, 605-629. [269].
29. Schoenfeld, D. A. (1986), "Confidence Bounds for Normal Means Under Order Restrictions, With Application to Dose-Response Curves, Toxicology Experiments, and Low-Dose Extrapolation, " Journal of the American Statistical Association, 81, 186-195. [275].
30. Shen, X., andWong, W. H. (1994), "Convergence Rate of Sieve Estimates, " The Annals of Statistics, 22, 580-615. [279].
31. Silvapulle, M. J., and Sen, P. K. (2005), Constrained Statistical Inference: Inequality, Order, and Shape Restrictions (Wiley Series in Probability and Statistics), Hoboken, NJ: Wiley-Interscience. [277].
32. Stein, C. M. (1981), "Estimation of the Mean of a Multivariate Normal Distribution, " The Annals of Statistics, 9, 1135-1151. [274].
33. Tibshirani, R., and Taylor, J. (2011), "The Solution Path of the Generalized Lasso, " The Annals of Statistics, 39, 1335-1371. [262, 265, 273, 274, 276, 277, 280].
34. Tibshirani, R. J., Hoefling, H., and Tibshirani, R. (2011), "Nearly-Isotonic Regression, " Technometrics, 53, 54-61. [264].
35. Wu, T. T., and Lange, K. (2008), "Coordinate Descent Algorithms for Lasso Penalized Regression, " Annals of Applied Statistics, 2, 224-244. [269].
36. Zou, H., Hastie, T., and Tibshirani, R. (2007), "On the 'Degrees of Freedom' of the Lasso, " The Annals of Statistics, 35, 2173-2192. [262, 274].