Isotone optimization in R: Pool-adjacent-violators algorithm (PAVA) and active set methods

Journal of Statistical Software

Volumn 32, Issue 5, 2009, Pages 1-24

  de Leeuw, Jan ^a   Hornik, Kurt ^b   Mair, Patrick ^b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b UNIVERSITY OF VIENNA   (Austria)

Author keywords

Active set; Isotone optimization; Monotone regression; PAVA; R

Indexed keywords

EID: 70450171127     PISSN: 15487660     EISSN: 15487660     Source Type: Journal    
DOI: None     Document Type: Article

References (45)

1. Ahuja RK, Orlin JB (2001). A Fast Scaling Algorithm for Minimizing Separable Convex Functions Subject to Chain Constraints. Operations Research, 49, 784-789.
2. Ayer M, Brunk HD, Ewing GM, Reid WT, Silverman E (1955). An Empirical Distribution Function for Sampling with Incomplete Information. The Annals of Mathematical Statistics, 26, 641-647.
3. Barlow RE, Bartholomew DJ, Bremner JM, Brunk HD (1972). Statistical Inference Under Order Restrictions. John Wiley & Sons, New York.
4. Barlow RE, Brunk HD (1972). The Isotonic Regression Problem and Its Dual. Journal of the American Statistical Association, 67, 140-147.
5. Bartholomew DJ (1959a). A Test of Homogeneity for Ordered Alternatives. Biometrika, 46,36-48.
6. Bartholomew DJ (1959b). A Test of Homogeneity for Ordered Alternatives II. Biometrika, 46,328-335.
7. Best MJ, Chakravarti N (1990). Active Set Algorithms for Isotonic Regression: A Unifying Framework. Mathematical Programming, 47, 425-439.
8. Best MJ, Chakravarti N, Ubhaya VA (2000).Minimizing Separable Convex Functions Subject to Simple Chain Constraints. SIAM Journal on Optimization, 10, 658-672.
9. Boyd S, Vandenberghe L (2004). Convex Optimization. Cambridge University Press, Cambridge, MA.
10. Broberg P (2009). SAGx: Statistical Analysis of the GeneChip. R package version 1.18.0, URL http://www.bioconductor.org/packages/2.4/bioc/html/SAGx.html.
11. Brunk HB (1955). Maximum Likelihood Estimates of Monotone Parameters. The Annals of Mathematical Statistics, 26, 607-616.
12. Burdakov O, Grimvall A, Hussian M (2004). A Generalised PAV Algorithm for Monotonic Regression in Several Variables. In J Antoch (ed.), COMPSTAT, Proceedings of the 16th Symposium in Computational Statistics, pp. 761-767. Springer-Verlag, New York.
13. Chu W, Keerthi SS, Ong CJ (2004). Bayesian Support Vector Regression Using a Unified Loss Function. IEEE Transactions on Neural Networks, 15, 29-44.
14. Danskin JM (1966). The Theory of Max-Min with Applications. SIAM Journal on Applied Mathematics, 14, 641-664.
15. de Leeuw J (1977). Correctness of Kruskal's Algorithms for Monotone Regression with Ties. Psychometrika, 42, 141-144.
16. de Leeuw J (2005). Monotonic Regression. In BS Everitt, DC Howell (eds.), Encyclopedia of Statistics in Behavioral Science (Vol. 3), pp. 1260-1261. John Wiley & Sons, New York.
17. de Leeuw J, Mair P (2009). Multidimensional Scaling Using Majorization: SMACOF in R. Journal of Statistical Software, 31(3), 1-30. URL http://www.jstatsoft.org/v31/i03/.
18. Dykstra RL (1981). An Isotonic Regression Algorithm. Journal of Statistical Planning and Inference, 5, 355-363.
19. Dykstra RL, Robertson T (1982). An Algorithm for Isotonic Regression for Two or More Independent Variables. The Annals of Statistics, 10, 708-719.
20. Efron B (1991). Regression Percentiles Using Asymmetric Squared Error Loss. Statistica Sinica, 1, 93-125.
21. Fletcher R (1987). Practical Optimization. John Wiley & Sons, Chichester.
22. Hansohm J (2007). Algorithms and Error Estimations for Monotone Regression on Partially Preordered Sets. Journal of Multivariate Analysis, 98, 1043-1050.
23. Henschel V, Heiss C, Mansmann U (2009). Intcox: Iterated Convex Minorant Algorithm for Interval Censored Event Data. R package version 0.9.2, URL http://CRAN.R-project.org/package=intcox.
24. Hornik K (2005). A CLUE for CLUster Ensembles. Journal of Statistical Software, 14(12), 1-25. URL http://www.jstatsoft.org/v14/i12/.
25. Huber P (1981). Robust Statistics. John Wiley & Sons, New York.
26. Koenker R (2005). Quantile Regression. Cambridge University Press, Cambridge, MA.
27. Kruskal JB (1964). Nonmetric Multidimensional Scaling: A Numerical Method. Psychometrika, 29, 115-129.
28. Leitner C, Mair P, Paul B, Wick F, Mittermaier C, Sycha T, Ebenbichler G (2009).Reliability of Posturographic Measurements in the Assessment of Impaired Sensorimotor Function in Chronic Low Back Pain. Journal of Electromyography and Kinesiology, 19, 380-390.
29. Miles RE (1959). The Complete Almagamation into Blocks, by Weighted Means, of a Finite Set of Real Numbers. Biometrika, 46, 317-327.
30. Nocedal J, Wright SJ (1999). Numerical Optimization. Springer-Verlag, New York.
31. Oron AP (2008). Cir: Nonparametric Estimation of Monotone Functions via Isotonic Re-gression and Centered Isotonic Regression. R package version 1.0, URL http://CRAN.R-project.org/package=cir.
32. Panier ER (1987). An Active Set Method for Solving Linearly Constrained Nonsmooth Optimization Problems. Mathematical Programming, 37, 269-292.
33. Pilz K, Titoff S (2009). Monreg: Nonparametric Monotone Regression. R package version 0.1.1, URL http://CRAN.R-project.org/package=monreg.
34. Pothoff RF, Roy SN (1964). A Generalized Multivariate Analysis of Variance Model Useful Especially for Growth Curve Problems. Biometrika, 51, 313-326.
35. R Development Core Team (2009). R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria. ISBN 3-900051-07-0, URL http://www.R-project.org.
36. Robertson T, Wright FT, Dykstra RL (1988). Order Restricted Statistical Inference. John Wiley & Sons, New York.
37. Rockafellar RT (1970). Convex Analysis. Princeton University Press, Princeton, NJ.
38. Rufibach K, Duembgen L (2009). logcondens: Estimate a Log-Concave Probability Den-sity from iid Observations. R package version 1.3.4, URL http://CRAN.R-project.org/package=logcondens.
39. Strimmer K (2008). Fdrtool: Estimation and Control of (Local) False Discovery Rates. R package version 1.2.5, URL http://CRAN.R-project.org/package=fdrtool.
40. Strömberg U (1991). An Algorithm for Isotonic Regression with Arbitrary Convex Distance Function. Computational Statistics & Data Analysis, 11, 205-219.
41. Turner R (2009). Iso: Functions to Perform Isotonic Regression. R package version 0.0-7, URL http://CRAN.R-project.org/package=Iso.
42. van Eeden C (1958). Testing and Estimating Ordered Parameters of Probability Distributions. Ph.D. thesis, University of Amsterdam.
43. Warshall S (1962). "A Theorem for Boolean Matrices." Journal of the Association of Computer Machinery, 9, 11-12.
44. Zangwill WI (1969). Nonlinear Programming: A Unified Approach. Prentice-Hall, Engelwood Cliffs, NJ.
45. Zeileis A (2004). Econometric Computing with HC and HAC Covariance Matrix Estimators. Journal of Statistical Software, 11(10), 1-17. URL http://www.jstatsoft.org/v11/i10/.