The concentration of fractional distances

IEEE Transactions on Knowledge and Data Engineering

Volumn 19, Issue 7, 2007, Pages 873-886

  François, Damien ^b   Wertz, Vincent ^a,b   Verieysen, Michel ^a,c  

^a IEEE   (Belgium)

^b UNIVERSITÉ CATHOLIQUE DE LOUVAIN   (Belgium)

^c Microelectronics Laboratory   (Belgium)

Author keywords

Distance concentration; Fractional distances; High dimensional data; Nearest neighbor search

Indexed keywords

DISTANCE CONCENTRATION; FRACTIONAL DISTANCES; HIGH-DIMENSIONAL DATA; NEAREST NEIGHBOR SEARCH;

COMPUTATIONAL GEOMETRY; DISTANCE MEASUREMENT; ESTIMATION; METRIC SYSTEM; NUMERICAL METHODS; OPTIMAL SYSTEMS;

DATA REDUCTION;

EID: 34249788454     PISSN: 10414347     EISSN: None     Source Type: Journal    
DOI: 10.1109/TKDE.2007.1037     Document Type: Article

References (52)

1. E. Chavez, G. Navarro, R.A. Baeza-Yates, and J.L. Marroquin, "Searching in Metric Spaces," ACM Computing Surveys, vol. 33, no. 3, pp. 273-321, Sept. 2001.
2. K. Fukunaga, Introduction to Statistical Pattern Recognition, second ed. Academic Press Professional, 1990.
3. A.K. Jain, M.N. Murty, and P.J. Flynn, "Data Clustering: A Review," ACM Computing Surveys, vol. 31, no. 3, pp. 264-323, Sept. 1999.
4. P. Demartines, "Analyse de Donnees par Reseaux de Neurones Auto-OrganiseV PhD dissertation, Institut Nat'l Polytechnique de Grenoble, Grenoble, France, 1994 (in French).
5. K.S. Beyer, J. Goldstein, R. Ramakrishnan, and U. Shaft, "When Is "Nearest Neighbor" Meaningful," Proc. Seventh Int'l Conf. Database Theory, pp. 217-235, Jan. 1999.
6. Y. Tao, J. Sun, and D. Papadias, "Analysis of Predictive Spatio-Temporal Queries," ACM Trans. Database Systems, vol. 28, no. 4, pp. 295-336, Dec. 2003.
7. N. Katayama and S. Satoh, "Distinctiveness-Sensitive Nearest-Neighbor Search for Efficient Similarity Retrieval of Multimedia Information," Proc. 17th Int'l Conf. Data Eng. (ICDE '01), pp. 493-502, Apr. 2001.
8. N. Katayama and S. Satoh, "Similarity Image Retrieval with Significance-Sensitive Nearest-Neighbor Search," Proc. Sixth Int'l Workshop Multimedia Information Systems (MIS '00), pp. 177-186, Oct. 2000.
9. J. Yang, A. Patro, S. Huang, N. Mehta, M.O. Ward, and E.A. Rundensteiner, "Value and Relation Display for Interactive Exploration of High Dimensional Datasets," Proc. IEEE Symp. Information Visualization (InfoVis '04), W.A. Burks, ed., pp. 73-80, Oct. 2004.
10. E. Tuncel, H. Ferhatosmanoglu, and K. Rose, "Vq-Index: An Index Structure for Similarity Searching in Multimedia Databases," Proc. 10th ACM Int'l Conf. Multimedia, pp. 543-552, Dec. 2002.
11. N. Mamoulis, D.W. Cheung, and W. Lian, "Similarity Search in Sets and Categorical Data Using the Signature Tree," Proc. 19th Int'l Conf. Data Eng. (ICDE '03), pp. 75-86, Mar. 2003.
12. P. Ciaccia and M. Patella, "Pac Nearest Neighbor Queries: Approximate and Controlled Search in High-Dimensional and Metric Spaces," Proc. 16th Int'l Conf. Data Eng. (ICDE '01), W.A. Burks, ed., pp. 244-255, Mar. 2000.
13. M. Demirbas and H. Ferhatosmanoglu, "Peer-to-Peer Spatial Queries in Sensor Networks," Proc. Third IEEE Int'l Conf. Peer-to-Peer Computing (P2P '03), pp. 32-39, Sept. 2003.
14. D.S. Johnson, S. Krishnan, J. Chhugania, S. Kumar, and S. Venkatasubramanian, "Compressing Large Boolean Matrices Using Reordering Techniques," Proc. 30th Int'l Conf. Very Large Data Bases (VLDB '04), pp. 13-23, Sept. 2004.
15. K. Chakrabarti and S. Mehrotra, "The Hybrid Tree: An Index Structure for High Dimensional Feature Spaces," Proc. 15th Int'l Conf. Data Eng. (ICDE '99), pp. 440-447, Feb. 1999.
16. K. Chakrabarti and S. Mehrotra, "Local Dimensionality Reduction: A New Approach to Indexing High Dimensional Spaces," Proc. 26th Int'l Conf. Very Large Data Bases (VLDB '00), pp. 89-100, Sept. 2000.
17. T. Liu, A. Moore, A. Gray, and K. Yang, "An Investigation of Practical Approximate Nearest Neighbor Algorithms," Proc. 18th Ann. Conf. Neural Information Processing Systems (NIPS '04), pp. 825-832, Dec. 2004.
18. K.P. Bennett and U. Fayyad Dan Geiger, "Density-Based Indexing for Approximate Nearest-Neighbor Queries," Proc. Fifth ACM SIGKDD Int'l Conf. Knowledge Discovery and Data Mining, pp. 233-243, Aug. 1999.
19. S. Berchtold, C. Böhm, H.V. Jagadish, H.-P. Kriegel, and J. Sander, "Independent Quantization: An Index Compression Technique for High-Dimensional Data Spaces," Proc. 16th Int'l Conf. Data Eng. (ICDE '00), pp. 577-588, Mar. 2000.
20. K.Y. Yip, D.W. Cheung, and M.K. Ng, "A Highly-Usable Projected Clustering Algorithm for Gene Expression Profiles," Proc. Workshop Data Mining in Bioinformatics (BIOKDD '03), pp. 41-48, Aug. 2003.
21. M. Vlachos, D. Gunopulos, and G. Kollios, "Robust Similarity Measures for Mobile Object Trajectories," Proc. 13th Int'l Workshop Database and Expert Systems Applications (DEXA '02), pp. 721-728, Sept. 2002.
22. F. Korn, B.-U. Pagel, and C. Faloutsos, "On the "Dimensionality Curse" and the "Self-Similarity Blessing"," IEEE Trans. Knowledge and Data Eng., vol. 13, no. 1, pp. 96-111, Jan./Feb. 2001.
23. A. Hinneburg, C.C. Aggarwal, and D.A. Keim, "What Is the Nearest Neighbor in High Dimensional Spaces," Proc. 26th Int'l Conf. Very Large Data Bases (VLDB '00), A. El Abbadi, M.L. Brodie, S. Chakravarthy, U. Dayal, N. Kamel, G. Schlageter, and K.-Y. Whang, eds., pp. 506-515, Sept. 2000.
24. C.C. Aggarwal, A. Hinneburg, and D.A. Keim, "On the Surprising Behavior of Distance Metrics in High Dimensional Spaces," Proc. Eighth Int'l Conf. Database Theory, J. Van den Bussche and V. Vianu, eds., pp. 420-434, Jan. 2001
25. C.C. Aggarwal, "Re-Designing Distance Functions and Distance-Based Applications for High Dimensional Data," Proc. ACM Int'l Conf. Management of Data (SIGMOD '01), vol. 30, no. 1, pp. 13-18, Mar. 2001.
26. K. Doherty, R. Adams, and N. Davey, "Non-Euclidean Norms and Data Normalisation," Proc. 12th European Symp. Artificial Neural Networks, M. Verieysen, ed., Apr. 2004.
27. P. Howarth and S.M. Riiger, "Fractional Distance Measures for Content-Based Image Retrieval," Proc. 27th European Conf. Information Retrieval Research (ECIR '05), J.M. Fernandez-Luna and D.E. Losada, eds., pp. 447-456, Mar. 2005
28. H. Jin, B.C. Ooi, H. Shen, C. Yu, and A. Zhou, "An Adaptive and Efficient Dimensionality Reduction Algorithm for High-Dimensional Indexing," Proc. 19th Int'l Conf. Data Eng. (ICDE '03), pp. 87-98, Mar. 2003.
29. C. Elkan, "Using the Triangle Inequality to Accelerate K-Means," Proc. 20th Int'l Conf. Machine Learning (ICML '03), pp. 147-153, Aug. 2003.
30. M. Skala, "Measuring the Difficulty of Distance-Based Indexing," Proc. 12th Int'l Conf. String Processing and Information Retrieval (SPIRE '05), M.P. Consens and G. Navarro, eds., pp. 103-114, Nov. 2005.
31. P. Yianilos, "Excluded Middle Vantage Point Forests for Nearest Neighbor Search," technical report, NEC Research Inst, Jan. 1999, presented at Proc. Sixth Center for Discrete Mathematics and Theoretical Computer Science (DIMACS) Implementation Challenge: Near Neighbor Searches Workshop.
32. S. Berchtold, C. Boehm, B. Braunmueller, D.A. Keim, and H.-P. Kriegel, "Fast Similarity Search in Multimedia Databases," Proc. ACM Int'l Conf. Management of Data (SIGMOD '97), J. Peckham, ed., May 1997.
33. N. Katayama and S. Satoh, "The Sr-Tree: An Index Structure for High-Dimensional Nearest Neighbor Queries," Proc. ACM Int'l Conf. Management of Data (SIGMOD '97), J. Peckham, ed., pp. 369-380, May 1997.
34. S. Berchtold, D.A. Keim, and H.-P. Kriegel, "The X-Tree: An Index Structure for High-Dimensional Data," Proc. 22nd Int'l Conf. Very Large Data Bases (VLDB '96), T.M. Vijayaraman, A.P. Buchmann, C. Mohan, and N.L. Sarda, eds., pp. 28-39, Sept. 1996.
35. K.-I. Lin, H.V. Jagadish, and C. Faloutsos, "The TV-Tree: An Index Structure for High-Dimensional Data," VLDB J., vol. 3, no. 4, pp. 517-542, 1994.
36. P. Indyk and R. Motwani, "Approximate Nearest Neighbors: Towards Removing the Curse of Dimensionality," Proc. 30th Ann. ACM Symp. Theory of Computing, pp. 604-613, May 1998.
37. C. Bohm, S. Berchtold, and D.A. Keim, "Searching in High-Dimensional Spaces: Index Structures for Improving the Performance of Multimedia Databases," ACM Computing Surveys, vol. 33, no. 3, pp. 322-373, Sept. 2001.
38. S. Brin, "Near Neighbor Search in Large Metric Spaces," Proc. 21st Int'l Conf. Very Large Data Bases (VLDB '95), U. Dayal, P.M.D. Gray, and S. Nishio, eds., pp. 574-584, Sept. 1995.
39. S. Berchtold, C. Bohm, D.A. Keim, and H.-P. Kriegel, "A Cost Model for Nearest Neighbor Search in High-Dimensional Data Space," Proc. 16th ACM SIGACT-SIGMOD-SIGART Symp. Principles of Database Systems (PODS '97), pp. 78-86, May 1997.
40. R. Weber, H.-J. Schek, and S. Blott, "A Quantitative Analysis and Performance Study for Similarity-Search Methods in High-Dimensional Spaces," Proc. 24th Int'l Conf. Very Large Data Bases (VLDB '98), A. Gupta, O. Shmueli, and J. Widom, eds., pp. 194-205, Aug. 1998.
41. R. Bellmann, Adaptive Control Processes: A Guided Tour. Princeton Univ. Press, 1961.
42. J.B. Tenenbaum, V. de Silva, and J.C. Langford, "A Global Geometric Framework for Nonlinear Dimensionality Reduction," Science, vol. 290, no. 5500, pp. 2319-2323, Dec. 2000.
43. J.A. Lee, A. Lendasse, and M. Verieysen, "Nonlinear Projection with Curvilinear Distances: Isomap versus Curvilinear Distance Analysis," Neurocomputing, vol. 57, pp. 49-76, 2003.
44. C.L Blake, D.J. Newman, S. Hettich, and C.J. Merz, "UCI Repository of Machine Learning Databases," http://www.ics.uci.edu/~mlearn/ MLRepository.html, 1998.
45. D. Landers and L. Rogge, "Laws of Large Numbers for Pairwise Independent Uniformly Integrable Random Variables," Math. Nachrichten, vol. 130, pp. 189-192, 1987.
46. G. Biau, F. Bunea, and M.H. Wegkamp, "Functional Classification in Hilbert Spaces," IEEE Trans. Information Theory, vol. 51, no. 6, pp. 2163-2172, 2005.
47. D. Francois, V. Wertz, and M. Verieysen, "Non-Euclidean Metrics for Similarity Search in Noisy Datasets," Proc. European Symp. Artificial Neural Networks (ESANN '05), pp. 339-344, 2005.
48. A.J. Jone, A. Stefansson, and N. Koncar, "A Note on the Gamma Test," Neural Computing and Applications, vol. 5, no. 3, pp. 131-133, Sept. 1997.
49. K. Pelckmans, J. De Brabanter, J.A.K. Suykens, and B. De Moor, "The Differogram: Nonparametric Noise Variance Estimation and Its Use for Model Selection," Neurocomputing, vol. 69, no. 1, pp. 100-122, Dec. 2005.
50. M. Powell, "Radial Basis Functions for Multivariate Interpolation: A Review," Algorithms for Approximation, M.G. Cox and J.C. Mason, eds., pp. 143-167, Clarendon Press, 1987
51. Y. Rui, T.S. Huang, M. Ortega, and S. Mehrotra, "Relevance Feedback: A Power Tool in Interactive Content-Based Image Retrieval," IEEE Trans. Circuits and Systems for Video Technology, special issue on segmentation, description, and retrieval of video content, vol. 8, no. 5, pp. 644-655, Sept. 1998.
52. G. Salton and C. Buckley, "Mproving Retrieval Performance by Relevance Feedback," J. Am. Soc. for Information Science, vol. 41, pp. 288-297, June 1990.