Regularized regression and density estimation based on optimal transport

Applied Mathematics Research eXpress

Volumn 2012, Issue 2, 2012, Pages 209-253

  Burger, Martin ^a   Franek, Marzena ^a   Schönlieb, Carola Bibiane ^b  

^a UNIVERSITY OF MÜNSTER   (Germany)

^b UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL APPROACH; DATA FIDELITY; DENSITY ESTIMATION; DISCRETE SAMPLE; FUNCTIONALS; NONPARAMETRIC APPROACHES; OPTIMAL TRANSPORT; PROBABILITY DENSITIES; PROBABILITY MEASURES; SELF-SIMILAR SOLUTION; TOTAL VARIATION REGULARIZATION; VARIATIONAL MODELS; VARIATIONAL PROBLEMS; VARIATIONAL REGULARIZATION; WASSERSTEIN METRIC;

IMAGE DENOISING;

PROBABILITY DENSITY FUNCTION;

EID: 84866348492     PISSN: 16871200     EISSN: 16871197     Source Type: Journal    
DOI: 10.1093/amrx/abs007     Document Type: Article

References (66)

1. Ambrosio, L. "Transport Equation and Cauchy Problem for Non-smooth Vector Fields." Calculus of Variations and Nonlinear Partial Differential Equations, 1-41. Lecture Notes in Mathematics. Berlin: Springer, 1927/2008 (2008).
2. Ambrosio, L., L. A. Caffarelli, and Y. Brenier. Optimal Transportation and Applications. Lecture Notes in Mathematics. Berlin: Springer, 2003.
3. Ambrosio, L., N. Fusco, and D. Pallara. Functions of Bounded Variation and Free Discontinuity problems. Oxford Mathematical Monographs. Oxford: Clarendon Press. xviii, 2000.
4. Ambrosio, L., N. Gigli, and G. Savare. Gradient Flows in Metric Spaces and in the Space of Probability Measures. Lectures in Mathematics ETH Zü rich. Basel: Birkhäuser, 2005.
5. Benamou, J. D. and Y. Brenier. "A computational fluid mechanics solution to the Monge-Kantorovich mass transfer problem." Numerische Mathematik 84, no. 3 (2000): 375-93.
6. Benning, M. and M. Burger. "Error estimates for general fidelities." Electronic Transactions on Numerical Analysis 38 (2011): 44-68.
7. Blanchet, A., V. Calvez, and J. A. Carrillo. "Convergence of the mass-transport steepest descent scheme for the sub-critical Patlak-Keller-Segel model." SIAM Journal of Numerical Analysis 46, no. 2 (2008): 691-721.
8. Blundel, R. and A. Duncan. "Kernel regression in empirical microeconomics." Journal of Human Resources, Winter 33, no. 1 (1998): 62-87.
9. Brune, C. "4D imaging in tomography and optical nanoscopy." PhD Thesis, University of Mü nster, July (2010).
10. Burger, M., J. A. Carrillo, and M.-T. Wolfram. "A mixed finite element method for nonlinear diffusion equations." Kinetic and Related Models 3, no. 1 (2010): 59-83.
11. Burger, M. and S. Osher. "Convergence rates of convex variational regularisation." Inverse Problems 20, no. 5 (2004): 1411-21.
12. Burger, M., E. Resmerita, and L. He. "Error estimation for Bregman iterations and inverse scale space methods in image restoration." Computing 81, no. 2-3 (2007): 109-35.
13. Buttazzo, G. and F. Santambrogio. "A model for the optimal planning of an urban area." SIAM Journal of Mathematical Analysis 37, no. 2 (2005): 514-30.
14. Carrillo, J. A., R. J. McCann, and C. Villani. "Kinetic equilibration rates for granular media and related equations: entropy dissipation and mass transportation estimates." Revista Matem'etica Iberoamericana 19, no. 3 (2003): 971-1018.
15. Carrillo, J. A., R. J. McCann, and C. Villani. "Contractions in the 2-Wasserstein length space and thermalization of granular media." Archive for Rational Mechanics and Analysis 179, no. 2 (2006): 217-63.
16. Carrillo, J. A. and J. S. Moll. "Numerical simulation of diffusive and aggregation phenomena in nonlinear continuity equations by evolving diffeomorphisms." SIAM Journal on Scientific Computation 31, no. 6 (2009): 4305-29.
17. Carrillo, J. A. and D. Slepcev. "Example of a displacement convex functional of first order." Calculus of Variations and Partial Differential Equations 36, no. 4 (2009): 547-64.
18. Carrillo, J. A. and G. Toscani. "Wasserstein metric and large-time asymptotics of nonlinear diffusion equations." In Proceedings of the international meeting, Naples, Italy, January, 24-25 2003. Hackensack, NJ: World Scientific (2005): 234-44.
19. Davies, P. L. and A. Kovac. "Densities, spectral densities and modality." Annals of Statistics 32, no. 3 (2004): 1093-136.
20. Davies, P. L., A. Kovac, and M. Meise. "Nonparametric regression, confidence regions and regularisation." Annals of Statistics 37, no. 5B (2009): 2597-625.
21. Denzler, J. and R. J. McCann. "Nonlinear diffusion from a delocalized source: affine selfsimilarity, time reversal, & nonradial focusing geometries." Annales de l 'Institut Henri Poincaŕ e. Analyse Non Lińeaire 25, no. 5 (2008): 865-88.
22. Dü ring, B., D. Matthes, and J.-P. Milisic. "A gradient flow scheme for nonlinear fourth order equations." Discrete and Continuous Dynamical System Series B 14, no. 3 (2010): 935-59.
23. Eggermont, P. P. B. and V. N. LaRiccia. Maximum Penalized Likelihood Estimation. Berlin: Springer, 2001.
24. Egozcue, J. J., A. Barbat, J. A. Canas, J. Miquel, and E. Banda. "A method to estimate intensity occurrence probabilities in low seismic activity regions." Earthquake Engineering & Structural Dynamics 20, no. 1 (2006): 43-60.
25. Epstein, C. L. Introduction to the Mathematics of Medical Imaging, 2nd ed. Philadelphia, PA: SIAM, 2008.
26. Evans, L. C., W. Gangbo, and O. Savin. "Diffeomorphisms and nonlinear heat flows." SIAM Journal on Mathematical Analysis 37, no. 3 (2005): 737-51.
27. Evans, L. C. and R. F. Gariepy. Measure Theory and Fine Properties of Functions. Boca Raton, FL: CRC Press, 1992.
28. Fisher, R. "Theory of statistical estimation." Mathematical Proceedings of the Cambridge Philosophical Society 22, no. 5 (1925): 700-25.
29. Giacomelli, L. and F. Otto. "Variational formulation for the lubrication approximation of the Hele-Shaw flow." Calculus of Variations and Partial Differential Equations 13, no. 3 (2001): 377-403.
30. Gianazza, U., G. Savaŕ e, and G. Toscani. "The Wasserstein gradient flow of the Fisher information." Archive for Rational Mechanics and Analysis 194, no. 1 (2009): 133-220.
31. Glowinski, R. and P. Le Tallec. Augmented Lagrangians and Operator-Splitting Methods in Nonlinear Mechanics, 224-31. Philadelphia, PA: SIAM, 1989.
32. Goldstein, T. and S. Osher. "The split Bregman method for L1 regularized problems." SIAM Journal on Imaging Sciences 2, no. 2 (2009): 323-43.
33. Good, I. J. and R. A. Gaskins. "Nonparametric roughness penalties for probability densities." Biometrika 58, no. 2 (1971): 255-77.
34. Gosse, L. and G. Toscani. "Lagrangian numerical approximations to one-dimensional convolution-diffusion equations." SIAM Journal of Scientific Computing 28, no. 4 (2006): 1203-27.
35. Horowitz, J. and R. L. Karandikar. "Mean rates of convergence of empirical measures in the Wasserstein metric." Journal of Computers and Applied Mathematics 55, no. 3 (1994): 261-73.
36. Jordan, R., D. Kinderlehrer, and F. Otto. "The variational formulation of the Fokker-Planck equation." SIAM Journal of Mathematical Analysis 29, no. 1 (1998): 1-17.
37. Kantorovich, L. V. "On a problem ofMonge." Uspekhi Matematicheskikh Nauk 3 (1948): 225-6.
38. Koenker, R. and I. Mizera. "Density Estimation by Total Variation Regularisation." Advances in Statistical Modeling and Inference, Essays in Honor of Kjell A. Doksum, 613-34. Singapore: World Scientific, 2007.
39. Kooperberg C. and C. J. Stone. "Logspline density estimation with free knots." Computational Statistics and Data Analysis 12 (2002): 327-47.
40. Kullback, S. and R. A. Leibler. "On information and sufficiency." Annals of Mathematical Statistics 22, no. 1 (1951): 79-86.
41. Lasry, J.-M. and P.-L. Lions. "Mean field games." Japanese Journal of Mathematics 2, no. 1 (2007): 229-60.
42. Matthes, D., R. J. McCann, and G. Savaŕ e. "A family of nonlinear fourth order equations of gradient flow type." Communications in Partial Differential Equations 34, no. 11 (2009): 1352-97.
43. McCann, R. J. "A convexity principle for interacting gases." Advances in Mathematics 128, no. 1 (1997): 153-79.
44. Mohler, G., A. Bertozzi, T. Goldstein, and S. Osher. "Fast TV regularisation for 2D maximum penalized likelihood estimation." Journal of Computational and Graphical Statistics 20, no. 2 (2011): 479.
45. Mohler, G. and M. Short. "Geographic profiling from kinetic models of criminal behavior." SIAM Journal of Applied Mathematics 72 (2012): 163-80.
46. Obereder, A., O. Scherzer, and A. Kovac. "Bivariate density estimation using BV regularisation." Computational Statistics and Data Analysis 51, no. 12 (2007): 5622-34.
47. Ogata, Y. "Space-time point process models for earthquake occurrences." Annals of Institute of Statistical Mathematics 50, no. 2 (1998): 379-402.
48. Osher, S., M. Burger, D. Goldfarb, J. Xu, and W. Yin. "An iterative regularisation method for total variation-based image restoration." Multiscale Model Simulation 4, no. 2 (2005): 460-89.
49. Otto, F. "The geometry of dissipative evolution equations: the porous medium equation." Communications in Partial Differential Equations 26, no. 1-2 (2001): 101-74.
50. P̈ oschl, C. "Tikhonov regularisation with general residual term." PhD Thesis, University Innsbruck, 2008.
51. Rachev, S. T. Probability Metrics and the Stability of Stochastic Models. New York: Wiley, 1991.
52. Rudin, L. I., S. J. Osher, and E. Fatemi. "Nonlinear total variation based noise removal algorithms." Physica D 60 (1992): 259-68.
53. Santambrogio, F. "Transport and concentration problems with interaction effects." Journal of Global Optimization 38, no. 1 (2007): 129-41.
54. Santambrogio, F. "Variational problems in transport theory with mass concentration." PhD Thesis, Edizioni della Normale, Birkh ̈ auser, 2007.
55. Sardy, S. and P. Tseng. "Density estimation by total variation penalized likelihood driven by the sparsity-1 information criterion." Scandinavian Journal of Statistics 37, no. 2 (2010): 321-37.
56. Schoenberg, F. P., C. Chang, J. Keeley, J. Pompa, J. Woods, and H. Xu. "A critical assessment of the burning index in Los Angeles county, California." International Journal of Wildland Fire 16, no. 4 (2007): 473-83.
57. Silverman, B. W. "Kernel density estimation using the fast Fourier transform." Statistical Algorithm, AS176, Applied Statistics 31 (1982): 93-9.
58. Silverman, B. W. Density Estimation for Statistics and Data Analysis. London: Chapman and Hall, 1986.
59. Smith, L. M. Keegan, T. Wittman, G. Mohler, and A. Bertozzi. "Improving density estimation by incorporating spatial information." EURASIP J. on Advances in Signal Processing, Article ID 265631, doi:10.1155/2010/265631, Volume 2010, 12 pages, special issue on Advanced Image Processing for Defense and Security Applications (2010).
60. Sturm, K.-T. "Convex functionals of probability measures and nonlinear diffusions on manifolds." Journal de Math'ematiques Pures et Appliqúees 84, no. 2 (2005): 149-68.
61. Sturm, K.-T. and M.-K. von Renesse. "Transport inequalities, gradient estimates, entropy and Ricci curvature." Communications in Pure and Applied Mathematics 58, no. 7 (2005): 923-40.
62. V́ azquez, J. L. "Mathematical theory." The Porous Medium Equation. Oxford Mathematical Monographs. Oxford: The Clarendon Press Oxford University Press, 2007.
63. Villani, C. Topics in Optimal Transportation. Graduate Studies in Mathematics 58. Providence, RI: American Mathematical Society, 2003.
64. Villani, C. Optimal Transport. Old and New. Grundlehren der Mathematischen Wissenschaften 338. Berlin: Springer, 2009.
65. Ẅ achter, A. and L. T. Biegler. "On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming." Mathematical Programming 106, no. 1 (2006): S.25-27.
66. Yachtew, A. "Scale economies in electricity distribution." Journal of Applied Econometrics 15, no. 2 (2000): 187-210.