Data modeling: Visual psychology approach and L1/2 regularization theory

Proceedings of the International Congress of Mathematicians 2010, ICM 2010

Volumn , Issue , 2010, Pages 3151-3184

  Xu, Zongben ^a  

^a XI'AN JIAOTONG UNIVERSITY   (China)

Author keywords

Data modeling; L 1 regularization; L1 2 regularization; Sparse signal recovery; Visual psychology approach

Indexed keywords

FEATURE INTEGRATION; HIERARCHICAL FEATURE EXTRACTION; L 1 REGULARIZATION; L1/2 REGULARIZATION; RECEPTIVE FIELD FUNCTION; REGULARIZATION THEORY; SPARSE SIGNAL RECOVERIES; VISUAL PSYCHOLOGIES;

CLASSIFICATION (OF INFORMATION); DATA STRUCTURES; FEATURE EXTRACTION;

PROBLEM SOLVING;

EID: 84877918421     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (65)

1. J.W. Tukey, The future of data analysis, Ann. Math. Statist. 33(1962) 1-67.
2. D.L. Donoho, High-dimensional data analysis: the curses and blessings of dimensionality, American Math. Society Lecture - Match Challenges of the 21st Century, 2000.
3. D.J. Bartholomew and M. Knott, Latent varianble methods and factor analysis, (2nded,). London: Arnold, 1999.
4. R. Tibshirani, Regression shrinkage and selection via the lasso, J. Royal. Statist. Soc B., 58(1996) 267-288.
5. S.S. Chen, D.L. Donoho and M. A. Saundera, Automic decomposition by basis pursuit, SIAM Journal of Scientific Computing, 20(1998) 33-61.
6. 1 minimization. J. Fourier A, 14(2008) 877-905.
7. J.M. Santos and J. Marqures, Human clustering on bi-dimensional data: an assessment, Techical Report 1, INEB-Instituto de Engenharia Biomedica, 2005.
8. Z.B. Xu, C.Z. Li and J. Sun, Visual clustering: an approach inspired from visual psychology, Submitted to IEEE Trans. Pattern Analysis and Machine Intelligence, 2010.
9. A.P. Witkin, Scale space filtering, Proc. Int'l Joint Conf. Artificial Intelligence, (1983) 1,019-1,022.
10. S. Coren, L.M. Ward, and J.T. Enns, Sensation and Perception, Harcourt Brace College Publishers, 1994.
11. Y. Leung, J.S. Zhang and Z.B. Xu, Clustering by scale-space filtering, IEEE Trans. Pattern Analysis and Machine Intelligence, 22(2000) 1396-1410.
12. S.J. Roberts, Parametric and nonparametric unsupervised clustering analysis, Pattern Recognition, 30(1997) 261-272.
13. L. Laurence, L. Dury and D. P. Vercauteren, Structural identification of local maxima in low-resolution promolecular electron density distributions, J. Phys. Chem. A, 107(2003), 9857-9886.
14. S. Grossberg and E. Mingolla, Neural dynamics of form perception: boundary completion, illusory figures, and neon color spreading, Psychological Review, 92(1985) 173-211.
15. S. E. Palmer, Model theories of gestalt perception, In: Humphreys G W, ed. Understanding Vision. CA: Blackwell, 1992.
16. S. W. Kuffler, Discharge pattern and functional organizatin of the mammalian retina, Journal of Neurophysiology, 16(1953) 37-68.
17. H. B. Barlow, Summation and inhibition in the frog's retina, Journal of Neurophysiology, 119(1953) 69-88.
18. D. H. Huber and T. N. Wiesel, Receptive fields of cells in striate cortex of very young, visually inexperienced kittens, Journal of Neurophysiology, 26(1971) 994-1002.
19. R. A. Young, R. M. Lesperance and W. W. Meyer, The Gaussian derivative model for spatial-temporal vision: I. Cortical model, Spatial Vision, 14(2001) 261-319.
20. D. J. Field and D. J. Tolhurst, The structure and symmetry of simple-cell receptive-field profiles in the cat's visual cortex, Proceedings of the Royal Society of London. Series B, Biological Sciences, 228(1986) 379-400.
21. S.E. Palmer, Model theories of Gestalt perception, in: Humphreys G.W., ed. Understanding Vision, CA:Blackwell, 1992.
22. G. Karypis, E.-H.S. Han and V. Kumar, Chameleon: Hierarchical clustering using dynamic modeling, Computer, 32(1999) 68-75.
23. A. Y. Ng, M. I. Jordan and Y. Weiss, On spectral clustering analysis and algorithm, Advances in Neural Information Processing Systems, 14(2001) 849-856.
24. J.B. Shi and J. Malik, Normalized cuts and image segmentation, IEEE Trans. Pattern Analysis and Machine Intelligence, 22(2000) 888-905.
25. M. T. Ester, H. P. Kriegel, J. Scander and X. W. Wu, DBScan: a density-based algorithm for discovering clusters in large spatial databases with noise, Proceedings of the Second International Conference on Knowledge Discovery and Data Mining, (1996) 226-231.
26. J. M. Santos, J. Marques and L. A. Alexandre, LEGClust - a clustering algorithm based on layered entropic subgraphs, IEEE Trans. Patten Analysis and Machine Intelligence, 30(2008) 62-75.
27. Z.B. Xu, M.W. Dai and D.Y. Meng. A fast heuristic strategy for model selection of support vector machines, IEEE Trans. Systems, Man and Cybernetics, Part B. 39(2009) 1292-1307.
28. D.H. Hubel and T.N. Wiesel, Receptive fields and functional architecture of monkey striate cortex. J. Physiol. London, (1968) 215-243.
29. K. Naka and W. Rushton, S-potentials from luminosity units in the retina of fish, J. Physiology, 185(1996) 587-599.
30. Olzak & Thomas, L.A. Olzak and J.P. Thomas, Neural recoding in human pattern vision: model and mechanisms, Vision Research, 39(1999) 231-256.
31. J.S. Zhang and Y.W. Leung, Improved possibilistic C-Means clustering algorithm, IEEE Trans. Fuzzy System, 12(2004) 209-217.
32. W.E. Vinje and J.L. Gallant, Sparse coding and decorrelation in primary visual cortex during natural vision, Science, 287(2000) 1273-1276.
33. B.A. Olshausen and D.J. Field, Emergence of simple cell receptive field properties by learning a sparse code for natural images, Nature, 381(1996) 607-609.
34. Y. Karklin and M.S. Lewicki. Emergence of complex cell properties by learning to generalize in natural scenes. Nature, 457(2009) 83-86.
35. B.K. Natarajan, Sparse approximate solutions to linear systems, SIAM. J. Comput. 24(1995) 227-234.
36. 1 norm, Geophysics, 44(1979) 39-52.
37. J.F. Claerbout and F. Muir, Robust modeling with erratic data, Geophysics, 38(1973) 826-844.
38. F. Santosa and W. W. Symes, Linear inversion of band-limited reflection seismograms, SIAM J. Sci. Stat. Comput., 7(1986) 1307-1330.
39. D. L. Donoho and P. B. Stark, Uncertainty principles and signal recovery, SIAM J. Appl. Math., 49(1992) 906-931.
40. D. L. Donoho and B. F. Logan, Signal recovery and the large sieve, SIAM J. Appl. Math., 52(1992) 577-591.
41. L. I. Rudin, S. Osher and E. Fatemi, Nonlinear total variation based noise removal algorithms, Phys. D, 60(1992) 259-268.
42. P. Blomgren and T. F. Chan, Color TV: total variation methods for restoration of vector-valued images, IEEE Trans. Image Processing, 7(1998) 304-309.
43. D.L. Donoho and X. Huo, Uncertainty principles and ideal atomic decomposition, IEEE Trans. Information Theory, 47(2001) 2845-2862.
44. P. Zhao and B. Yu, On model selection consistency of Lasso, Journal of Machine Learning Research, 7(2006) 2541-2563.
45. N. Meinshausen and B. Yu, Lasso-type recovery of sparse representations for high-dimensional data, Annals of Statistics, 720(2009) 246-270.
46. 1/2 regularization, Science in China Series F-Information Sciences, 40(2010) 1-11.
47. D.L. Donoho. Neighborly polytopes and the sparse solution of underdetermined systems of linear equations. Technical Report, Statistics Department, Stanford University, 2005.
48. D.L. Donoho. High-dimensional centrosymmetric polytopes with neighborliness proportional to dimension. Discrete and Computational Geometry, 35(2006) 617-652.
49. q (0 < q < 1) regularizations: an experimental study based on a phase diagram, submitted.
50. 1/2 regularization: an iterative half thresholding algorithm, submitted.
51. 1/2 regularization, submitted.
52. q (0 < q ≤ 1)regularization, to appear in Science in China.
53. E.J. Candés, J. Romberg and T. Tao, Signal recovery from incomplete and inaccurate measurements. Comm. Pure Appl. Math., 59(2005) 1207-1223.
54. E.J. Candés, The restricted isometry property and its implications for compressed sensing, Comptas Rendus de l'Acadėmie des Scidence, Serie I, 346(2008) 589-592.
55. S. Foucart and M.J. Lai. Sparsest solutions of underdetermined linear systems via Lq-minimization for 0 < q ≤ 1, Applied and Computational Harmonic Analysis, 26(2009) 395-407.
56. 1/2 regularization, submitted.
57. J. Fan and R. Li, Variable selection via nonconcave penalized likelihood and its oracle properties, Journal of the American Statistical Association, 96(2001) 1348-1360.
58. Z.P. Liang and P.C. Lauterbur, Principles of magnetic resonance imaging: a signal processing perspective, Wiley Blackwell, 1999.
59. E. J. Candés, J. Romberg and T. Tao. Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information. IEEE Trans. Inform. Theory, 52(2004) 489-509.
60. E.J. Candés and T. Tao. Decoding by linear programming, IEEE Trans. Information Theory, 51(2005) 4023-4215.
61. E.J. Candés and J. Romberg, L1-maGIC: recovery of sparse signals via convex programming, Technical Report, Caltech, 2005.
62. B. Efron, T. Haistie, I. Johnstone and R. Tibshirani. Least angle regression. Ann Statist, 32(2004) 407-499.
63. I. M. Defrise and C.D. Mol, An iterative thresholding algorithm for linear inverse problems with a sparsity constraint, Communication on Pure and Applied Mathematics, 11(2004) 1413-1457.
64. T. Blumensath and M.E. Davies, Iterative hard thresholding for compressed sensing, to appear in Applied and Computational Harmonic Analysis, 2009.
65. Z.B. Xu and G.F. Roach, Characteristic inequalities of unformaly convex and uniformaly smooth Banach spaces, J. Math. Anal. Appl. 157(1991) 189-210.