The gaussian hare and the laplacian tortoise: Computability of squared-error versus absolute-error estimators

Statistical Science

Volumn 12, Issue 4, 1997, Pages 279-296

  Portnoy, Stephen ^a   Koenker, Roger ^a  

^a UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

Author keywords

Interior point; L1; Least absolute deviations; Linear programming; Median; Regression quantiles; Simplex method; Simultaneous confidence bands; Statistical preprocessing; 1

Indexed keywords

EID: 0000976724     PISSN: 08834237     EISSN: None     Source Type: Journal    
DOI: 10.1214/ss/1030037960     Document Type: Article

References (53)

1. Anderson, E., Bai, Z., Bischof, C., Demmell, J., Dongaera, J., DuCroz, J., Greenbaüm, A., Hammerling, S., McKen-ney, A., Ostrouchov, S. and Sorenson, D. (1995). LAPACK Users’ Guide. SIAM, Philadelphia.
2. Barrodale, I. and Roberts, F. D. K. (1974). Solution of an overdetermined system of equations in the ii norm. Communications of the ACM 17 319-320.
3. Bartels, r. and Conn, A. (1980). Linearly constrained discrete ii problems. ACM Trans. Math. Software 6 594-608.
4. Bloomfield, P. and Steiger, W. L. (1983). Least Absolute Deviations: Theory, Applications, and Algorithms. Birkhauser, Boston.
5. Buchinsky, M. (1994). Changes in US wage structure 1963-87: an application of quantile regression. Econometrica 62 405-458.
6. Buchinsky, M. (1995). Quantile regression, the Box-Cox transformation model and U.S. wage structure 1963-1987. J. Econometrics 65 109-154.
7. Chamberlain, G. (1994). Quantile regression, censoring and the structure of wages. In Advances in Econometrics (C. Sims, ed.). North-Holland, Amsterdam.
8. Chambers, J. M. (1992). Linear models. In Statistical Models in S (J. M. Chambers and T. J. Hastie, eds.) 95-144. Wadsworth, Pacific Grove, CA.
9. Charnes, a., Cooper, W. W. and Ferguson, R. O. (1955). Optimal estimation of executive compensation by linear programming. Management Science 1 138-151.
10. Chaudhuri, P. (1992). Generalized regression quantiles. In Proceedings of the Second Conference on Data Analysis Based on the L1 Norm and Related Methods 169-186. North-Holland, Amsterdam.
11. Chen, S. and Donoho, D. L. (1995). Atomic decomposition by basis pursuit. SIAM J. Sci. Stat. Comp. To appear.
12. Dikin, I. I. (1967). Iterative solution of problems of linear and quadratic programming. Soviet Math. Dokl. 8 674-675.
13. EDGEWORTH, F. Y. (1887). On observations relating to several quantities. Hermathena 6 279-285.
14. EDGEWORTH, F. Y. (1888). On a new method of reducing observations relating to several quantities. Philosophical Magazine 25 184-191.
15. FAN, J. and GIJBELS, I. (1996). Local Polynomial Modelling and Its Applications. Chapman and Hall, London.
16. Fiacco, A. V. and Mccormick, G. P. (1968). Nonlinear Programming: Sequential Unconstrained Minimization Techniques. Wiley, New York.
17. FLOYD, R. W. and Rivest, R. L. (1975). Expected time bounds for selection. Communications of the ACM 18 165-173.
18. FRISCH, R. (1956). La Resolution des problèmes de programme linéaire par la methode du potential logarithmique. Cahiers du Séminaire d’Econometrie 4 7-20.
19. GAUSS, C. F. (1821). Theoria combinationis observationum er-roribus minimis obnoxiae: pars prior. [Translated (1995) by G. W. Stewart as Theory of the Combination of Observations Least Subject to Error. SIAM, Philadelphia.]
20. Gill, P., Murray, W., Saunders, M., Tomlin, T. and Wright, M. (1986). On projected Newton barrier methods for linear programming and an equivalence to Karmarkar’s projective method. Math. Programming 36 183-209.
21. GONZAGA, C. C. (1992). Path-following methods for linear programming. SIAM Rev. 34 167-224.
22. GREEN, P. J. and Silverman, B. W. (1994). Nonparametric Regression and Generalized Linear Models. Chapman and Hall, London.
23. Gutenbrunner, C. and Jureckova, J. (1992). Regression quan-tile and regression rank score process in the linear model and derived statistics. Ann. Statist. 20 305-330.
24. Gutenbrunner, C., Jureckova, J., Koenker, R. and Portnoy, S. (1993). Tests of linear hypotheses based on regression rank scores. J. Nonparametric Statist. 2 307-333.
25. Hall, P. and Sheather, s. (1988). On the distribution of a stu-dentized quantile. J. Roy. Statist. Soc. Ser. B 50 381-391.
26. Karmarkar, N. (1984). A new polynomial time algorithm for linear programming. Combinatorica 4 373-395.
27. Koenker, R. (1994). Confidence intervals for regression quantiles. In Asymptotic Statistics, Proceedings of the Fifth Prague Symposium (P Mandl and M. Huskova, eds.) 349-359. Springer, Heidelberg.
28. Koenker, R. and Bassett, G. (1978). Regression quantiles. Econometrica 46 33-50.
29. Koenker, R. and D’orey, V. (1987). Computing regression quan-tiles. J. Roy. Statist. Soc. Ser. C 36 383-393.
30. Koenker, R. and D’orey, V. (1993). Computing dual regression quantiles and regression rank scores. J. Roy. Statist. Soc. Ser. C 43 410-414.
31. Koenker R., Ng, P. and Portnoy, s. (1994). Quantile smoothing splines. Biometrika 81 673-680.
32. LAPLACE, P.-S. (1789). Sur quelques points du système du monde. Mémoires de l’Académie des Sciences de Paris. (Reprinted in Œvres Completes 11 475-558. Gauthier-Villars, Paris.)
33. Lustig, I. J., Marsden, R. E. and SHANNO, D. F. (1992). On implementing Mehrotra’s predictor-corrector interior-point method for linear programming. SIAM J. Optim. 2 435-449.
34. Lustig, I. J., Marsden, R. E. and Shanno, D. F. (1994). Interior point methods for linear programming: computational state of the art (with discussion). ORSA J. Comput. 6 1-36.
35. Manning, W., Blumberg, L. and Moulton, L. H. (1995). The demand for alcohol: the differential response to price. J. Health Economics 14 123-148.
36. Mehrotra, S. (1992). On the implementation of a primal-dual interior point method. SIAM J. Optim. 2 575-601.
37. Meketon, M. S. (1986). Least absolute value regression. Technical report, Bell Labs, Holmdel, NJ.
38. Mizuno, S., Todd, M. J. and Ye, Y. (1993). On adaptive-step primal dual interior point algorithms for linear programming. Math. Oper. Res. 18 964-981.
39. Oja, H. (1983). Descriptive statistics for multivariate distributions. Statist. Probab. Lett. 1 327-332.
40. Portnoy, S. (1991). Asymptotic behavior of the number of regression quantile breakpoints. SIAM Journal of Scientific and Statistical Computing 12 867-883.
41. Powell, J. L. (1986). Censored regression quantiles. J. Econometrics 32 143-155.
42. Renegar, J. (1988). A polynomial-time algorithm based on Newton’s method for linear programming. Math. Programming 40 59-93.
43. Shamir, R. (1993). Probabilistic analysis in linear programming. Statist. Sci. 8 57-64.
44. Siddiqui, M. (1960). Distribution of quantiles in samples from a bivariate population. J. Res. Nat. Bur. Stand. B 64 145-150.
45. Sonnevend, G., Stoer, J. and Zhao, G. (1991). On the complexity of following the central path of linear programs by linear extrapolation II. Math. Programming 52 527-553.
46. Stigler, S. M. (1984). Boscovich, Simpson and a 1760 manuscript note on fitting a linear relation. Biometrika 71 615-620.
47. Stigler, S. M. (1986). The History of Statistics: Measurement of Uncertainty before 1900. Harvard Univ. Press.
48. Tibshirani, R. (1996). Regression shrinkage and selection via the lasso. J. Roy. Statist. Soc. Ser. C 58 267-288.
49. Vanderbei, R. j., Meketon, M. J. and Freedman, B. A. (1986). A modification of Karmarkar’s linear programming algorithm. Algorithmica 1 395-407.
50. Wagner, H. M. (1959). Linear programming techniques for regression analysis. J. Amer. Statist. Assoc. 54 206-212.
51. Welsh, A. H. (1996). Robust estimation of smooth regression and spread functions and their derivatives. Statist. Sinica 6 347-366.
52. Wright, M. H. (1992). Interior methods for constrained optimization. Acta Numerica 1 341-407.
53. 1-solutions and ℓ∞-solutions of overdetermined linear systems. J. Optim., Theory Appl. 77 323-341.