Distance metrics for high dimensional nearest neighborhood recovery: Compression and normalization

Information Sciences

Volumn 184, Issue 1, 2012, Pages 92-110

  France, Stephen L ^a   Douglas Carroll, J ^b   Xiong, Hui ^b  

^a UNIVERSITY OF WISCONSIN MILWAUKEE   (United States)

^b RUTGERS BUSINESS SCHOOL   (United States)

Author keywords

Dimensionality; GINI; Latent classes; Minkowski metrics; Nearest neighbors; Normalization

Indexed keywords

DIMENSIONALITY; GINI; LATENT CLASS; MINKOWSKI METRICS; NEAREST NEIGHBORS; NORMALIZATION;

CLUSTERING ALGORITHMS; DATA REDUCTION; RECOVERY;

CLASSIFICATION (OF INFORMATION);

EID: 80055063556     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2011.07.048     Document Type: Article

References (55)

1. A. Abbasi, H. Chen, and A. Salem Sentiment analysis in multiple languages: feature selection for opinion classification in web forums ACM Transactions on Information Systems 26 2008 1 34
2. A. Abbasi, S. France, Z. Zhang, and H. Chen Selecting attributes for sentiment classification using feature relation networks IEEE Transactions on Knowledge and Data Engineering 23 2011 447 462
3. C.C. Aggarwal, Towards systematic design of distance functions for data mining applications, in: Proceedings of SIGKDD 2003, ACM, New York, NY, 2003, pp. 9-18.
4. C.C. Aggarwal, A. Hinneburg, D.A. Keim, On the surprising behavior of distance metrics in high dimensional space, in: Database Theory - ICDT 2001, 2001, pp. 420-434. (Pubitemid 33213340)
5. U. Akkucuk, Nonlinear mapping: Approaches based on optimizing an index of continuity and applying classical metric MDS on revised distances, Ph.D. Dissertation, Rutgers University, Newark, NJ, 2004.
6. U. Akkucuk, and J.D. Carroll PARAMAP vs. Isomap: a comparison of two nonlinear mapping algorithms Journal of Classification 23 2006 221 254 (Pubitemid 44704842)
7. J. Ahn, J.S. Marron, K.M. Muller, and Y. Chi The high-dimension, low-sample-size geometric representation holds under mild conditions Biometrika 94 2007 760 766 (Pubitemid 47384265)
8. R. Bellman Adaptive Control Processes first ed. 1961 Princeton University Press Princeton, NJ
9. K. Beyer, J. Goldstein, R. Ramakrishnan, and U. Shaft When is nearest neighbor meaningful? Lecture Notes in Computer Science: Database Theory - ICDT 1999 1999 Springer Verlag Berlin 217 235
10. D. Boley, M. Gini, R. Goss, E. Han, K. Hastings, G. Karypis, V. Kumar, B. Mobasher, and J. Moore Partitioning-based clustering for web document categorization Decision Support Systems 27 1999 329 341 (Pubitemid 30522907)
11. C.J.C. Burges A tutorial on support vector machines for pattern recognition Data Mining and Knowledge Discovery 2 1998 121 167 (Pubitemid 128695475)
12. L. Candillier, F. Meyer, and F. Fessant Designing specific weighted similarity measures to improve collaborative filtering systems P. Perner, Proceedings of the Industrial Conference on Data Mining (ICDM) 2008 LNCS vol. 5077 2008 Springer Verlag Berlin, Germany 242 255
13. L. Chen, Local multidimensional scaling for nonlinear dimensionality reduction, graph layout, and proximity analysis, Ph.D. Dissertation, University of Pennsylvania, Philadelphia, PA, 2006.
14. L. Chen, and A. Buja Local multidimensional scaling for nonlinear dimension reduction, graph drawing, and proximity analysis Journal of the American Statistical Association 104 2009 209 219
15. G. Corrodo Measurement of inequality and incomes The Economic Journal 31 1921 124 126
16. T. Cover, and P. Hart Nearest neighbour pattern classification IEEE Transactions on Information Theory 13 1967
17. L.J. Cronbach, and G.C. Gleser Assessing similarity between profiles Psychological Bulletin 50 1953 456 473
18. P.M. Dixon, J. Weiner, T. Mitchell-Olds, and R. Woodley Bootstrapping the Gini coefficient of inequality Ecology 68 1987 1548 1551
19. K.A.J. Doherty, R.G. Adams, N. Davey, Non-Euclidean norms and data normalisation, in: ESANN'2004 proceedings - European Symposium on Artificial Neural Networks, Bruges, Belgium, 2004, pp. 181-186.
20. V.A. Epanechnikov Non-parametric estimation of a multivariate probability density Theory of Probability and its Applications 14 1969 153 158
21. M. Fanty, and R. Cole Spoken letter recognition R.P. Lippman, J. Moody, D.S. Touretzky, Advances in Neural Information Processing Systems vol. 3 1990 Morgan Kaufman San Mateo, CA 220 226
22. R.A. Fisher Frequency distribution of the values of the correlation coefficient in samples from an indefinitely large population Biometrika 10 1915 507 521
23. S.L. France, and J.D. Carroll Is The Distance Compression Effect Overstated? Some Theory and Experimentation Proceedings of MLDM 2009 2009 Springer Verlag Berlin 280 294
24. D. Francois, High-dimensional data analysis: from optimal metrics to feature selection, VDM Verlag, Saarbrücken, Germany, 2008.
25. D. Francois, V. Wertz, and M. Verleysen The concentration of fractional distances IEEE Transactions on Knowledge and Data Engineering 19 2007 873 886 (Pubitemid 46853307)
26. M. Grabisch, J. Marichal, R. Mesiar, and E. Pape Aggregation functions: means Information Sciences 181 2011 1 22
27. M. Grabisch, J. Marichal, R. Mesiar, and E. Pape Aggregation functions: construction methods, conjunctive, disjunctive and mixed classes Information Sciences 181 2011 23 43
28. P. Hall, J.S. Marron, and A. Neeman Geometric representation of high dimension, low sample size data Journal of the Royal Statistical Society. Series B (Statistical Methodology) 67 2005 427 444 (Pubitemid 40855293)
29. J. Herlocker, J.A. Konstan, and J. Riedl An empirical analysis of design choices in neighborhood-based collaborative filtering algorithms Information Retrieval 5 2002 287 310
30. W. Hersh, C. Buckley, T. Leone, and D. Hickam OHSUMED: an interactive retrieval evaluation and new large test collection for research W.B. Croft, C.J. van Rijsbergen, Proceedings of the 17th annual international ACM SIGIR Conference on Research and Development in Information Retrieval, Dublin, Ireland 1994 Springer Verlag New York, NY 192 201
31. S.C.H. Hoi, W. Liu, and S-F. Chang Semi-supervised distance metric learning for collaborative image retrieval and clustering ACM Transactions on Multimedia Computing, Communications, and Applications 6 2010 1 26
32. G. Karypis, CLUTO: Software for Clustering High-Dimensional Datasets, http://glaros.dtc.umn.edu/gkhome/views/cluto, 2008 (accessed 8.01.2011).
33. F. Iqbal, H. Binsalleeh, B.C.M. Fung, M. Debbabi, A unified data mining solution for authorship analysis in anonymous textual communications, Information Sciences (2011). doi:10.1016/j.ins.2011.03.006.
34. J. Lattin, J.D. Carroll, and P.E. Green Analyzing Multivariate Data First ed. 2002 Duxbury Press Pacific Grove, CA
35. S.K. Lee, Y.H. Cho, and S.H. Kim Collaborative filtering with ordinal scale-based implicit ratings for mobile music recommendations Information Sciences 180 2010 2142 2155
36. J.B. Lovins Development of a stemming algorithm Mechanical Translation and Computational Linguistics 11 1968 22 31
37. F. Murtagh On ultrametricity, data coding, and computation Journal of Classification 21 2004 167 184 (Pubitemid 40936640)
38. F. Murtagh The remarkable simplicity of very high dimensional data: application of model-based clustering Journal of Classification 26 2009 249 277
39. S.A. Neslin, S. Gupta, W.A. Kamakura, J. Lu, and C.H. Mason Defection detection: measuring and understanding the predictive accuracy of customer churn models Journal of Marketing Research 43 2006 204 211 (Pubitemid 43813052)
40. B. Pang, L. Lee, S. Vaithyanathan, Thumbs up? Sentiment classification using machine learning techniques, in: J. Hajič, Y. Matsumoto, D. Yarowsky, D. Radev (Eds.), Proceedings of the 2002 Conference on Empirical Methods in Natural Language Processing, 2002, pp. 79-86.
41. G. Qian, S. Surul, Y. Gu, and S. Pramanik Similarity between Euclidean and cosine angle distance for nearest neighbor queries H.M. Haddad, A. Omicini, R.L. Wainwright, L.M. Liebrock, Proceedings of the 2004 ACM symposium on Applied Computing 2004 ACM New York, NY 1232 1237
42. B. Sarwar, G. Karypis, J. Konstan, and J. Riedl Item-based collaborative filtering recommendation algorithms V.Y. Shen, N. Saito, M.R. Lyu, M.E. Zurko, Proceedings of the Tenth International World Wide Web Conference (WW10) 2004 ACM New York, NY 285 295
43. H. Scheffé The Analysis of Variance first ed. 1959 John Wiley & Sons New York, NY
44. J.W. Schneider, and P. Borland Matrix comparison, part 1: motivation and important issues for measuring the resemblance between proximity measures or ordination results Journal of the American Society for Information Science and Technology 58 2007 1586 1595 (Pubitemid 47397661)
45. D.W. Scott Multivariate Density Estimation: Theory, Practice, and Visualization first ed. 1992 John Wiley & Sons New York, NY
46. M. Steinbach, G. Karypis, V. Kumar, A comparison of document clustering techniques, KDD-2000 Workshop on Text Mining, 2000, Boston, MA, USA, August 20, 2000 pp. 1-20.
47. A. Strehl, J. Ghosh, R. Mooney, Impact of similarity measures on web-page clustering, in: Proceedings of the 17th National Conference on Artificial Intelligence: Workshop of Artificial Intelligence for Web Search (AAAI 2000), July 30-31 2000, Austin, Texas, USA, AAAI, Cambridge, MA, 2000, pp. 58-64.
48. X. Su, and T.M. Khoshgoftaar A survey of collaborative filtering techniques Advances in Artificial Intelligence 2009 2009 1 19
49. TREC Text REtrieval conference, http://www.trec.nist.gov, 2008 (accessed 3. 01. 2010).
50. M. Verleysen, D. Francois, G. Simon, and V. Wertz On the effects of dimensionality on data analysis with neural networks G. Goos, J. Hartmanis, J.v. Leeuwen, International Work-Conference on Artificial and Natural Neural Networks, IWANN2003 Maó, Menorca, Spain, June 3-6, 2003 Proceedings, Part II 2003 Springer Berlin, Heidelberg 105 112
51. K.Q. Weinberger, and L.K. Saul Distance metric learning for large margin nearest neighbor classification The Journal of Machine Learning Research 10 2009 207 244
52. J. Wiebe, R. Bruce, M. Martin, T. Wilson, and M. Bell Learning subjective language Computational Linguistics 30 2004 277 308 (Pubitemid 41461901)
53. L. Xie, Y.-L. Yang, and Z.-Q. On the effectiveness of subwords for lexical cohesion based story segmentation of Chinese broadcast news Information Sciences 181 2011 2873 2891
54. K.Q. Ye Orthogonal column Latin hypercubes and their application in computer experiments Journal of the American Statistical Association 93 1998 1430 1439 (Pubitemid 128385553)
55. Y. Zhao, and G. Karypis Empirical and theoretical comparisons of selected criterion functions for document clustering Machine Learning 55 2004 311 331