Global optimization in any minkowski metric: A permutation-translation simulated annealing algorithm for multidimensional scaling

Journal of Classification

Volumn 24, Issue 2, 2007, Pages 277-301

  Vera, J Fernando ^a,d   Heiser, Willem J ^b   Murillo, Alex ^c  

^a UNIVERSITY OF GRANADA   (Spain)

^b LEIDEN UNIVERSITY   (Netherlands)

^c UNIVERSIDAD DE COSTA RICA   (Costa Rica)

^d UNIVERSITY OF GRANADA   (Spain)

Author keywords

Alternating algorithm; Attraction rates; Generallized stress; Minkowski metric; Multidimensional scaling; Permutation; Simulated annealing; Translation

Indexed keywords

EID: 36349020951     PISSN: 01764268     EISSN: 14321343     Source Type: Journal    
DOI: 10.1007/s00357-007-0020-1     Document Type: Article

References (46)

1. ALUFFI-PENTINI, F., PARISI, V., and ZIRILLI, F. (1985), "Global Optimization and Stochastic Differential Equations", Journal of Optimization. Theory and Applications, 47, 1-16.
2. ARABIE, P. (1991), "Was Euclid an Unnecessarily Sophisticated Psychologist?", Psychometrika, 56, 567-587.
3. 1 Linear Approximation with Linear Constraints", SIAM Journal of Numerical Analysis, 15, 839-848.
4. BEARDEN, J. N. (2001), "SASCAL: A Simulated. Annealing Algorithm for Multidimensional Scaling", Technical report, The University of Maryland at College Park, Department of Psychology.
5. BORG, I., and GROENEN, P. J. F. (2005), Modern Multidimensional Scaling. Theory and Applications (2nd ed.), Springer Series in Statistics, New York: Springer.
6. BORG, I., and LINGOES, J. (1987), Multidimensional Similarity Structure Analysis, New York: Springer Verlag.
7. BRUSCO, M. J. (2001), "A Simulated Annealing Heuristic for Unidimensional and Multidi-mensional (City-block) Scaling of Symmetric Proximity Matrices", Journal of Classification, 18, 3-33.
8. BURKARD, R., and RENDL, F. (1984), "A Themiodynamically Motivated Simulation Procedure for Combinatorial Optimization Problems", European Journal of Operational Research, 17, 169-174.
9. ČERNY, V. (1985), "Thermodynamical Approach to the Traveling Salesman Problem: an Efficient Simulation Algorithm", Journal of Optimization Theory and Applications, 45, 41-51.
10. DE LEEUW, J.(1977), "Applications of Convex Analysis to Multidimensional Scaling", in Recent Developments in Statistics, eds. J. R. Barra, G. Romier, R Brodeau, and B. van Cutsem, Amsterdam.: North-Holland, pp. 133-145.
11. DE SOETE, G., HUBERT, L. J., and ARABIE, P. (1988), "The Comparative Performance of Simulated Annealing on Two Problems of Combinatorial Data Analysis", in Data Analysis and Informatics (Vol. 5), ed. E. Diday, Amsterdam: North Holland, pp. 489-496.
12. FAIGLE, U., and SCHRADER, R. (1988), "On the Convergence of Stationary Distributions in Simulated Annealing Algorithms", Information Processing Letters, 27, 189-194.
13. FISCHER, W., and MICKO, H. C. (1972), "More About Metrics of Subjective Spaces and Attention Distributions", Journal of Mathematical Psychology, 9, 36-54.
14. FUNK, S. G., HOROWITZ, A. D., LIPSHITZ, R., and YOUNG, F. W. (1974), "The Perceived Structure of American Ethnic Groups: the Use of Multidimensional Scaling in Stereotype Research", Personality and Social Psychology Bulletin, 1, 66-68.
15. GARNER, W. R. (1962), Uncertainty and Structure as Psychological Concepts, New York: Wiley.
16. GREEN, P. E., CARMONE, F. J. J., and SMITH, S. (1989), Multidimensional Scaling. Concepts and Applications, Boston: Allyn and Bacon.
17. GROENEN, P. J. R (1993), The Majorization Approach to Multidimensional Scaling. Some Problems and Extensions, M&T SERIES 26, Leiden: DSWO Press.
18. GROENEN, P. J. F., and HEISER, W. J. (1996), "The Tunneling Method of Global Optimization in Multidimensional Scaling", Psychometrika, 61, 529-550.
19. GROENEN, P. J. F., HEISER, W. J., and MEULMAN, J. J. (1998), "City-block Scaling: Smoothing Strategies for Avoiding Local Minima", in Classification, Data Analysis, and Data Highways, eds. I. Balderjahn, R. Mathar and M. Schader, Berlin: Springer, pp. 46-53.
20. GROENEN, P. J. F., HEISER, W. J., and MEULMAN, J. J. (1999), "Global Optimization in Least-Squares Multidimensional Scaling by Distance Smoothing", Journal of Classification, 16, 225-254.
21. GROENEN, P. J. F., MATHAR, R., and HEISER, W. J. (1995), "The Majorization Approach to Multidimensional Scaling for Minkowski Distances", Journal of Classification, 12, 3-19.
22. HEISER, W. J. (1988), "Multidimensional Scaling with Least Absolute Residuals", in Classification and Related Methods of Data Analysis, ed. H. H. Bock, Amsterdam: Elsevier, pp. 455-462.
23. HEISER, W. J. (1989), "The City-block Model for Three-way Multidimensional Scaling", in Multiway Data Analysis, eds.R. Coppi and S. Bolasco, Amsterdam: Elsevier Science Publishers B. V. (North-Holland), pp. 395-404.
24. HUBERT, L. J., and ARABIE, P. (1986), Unidimensional Scaling and Combinatorial Optimization, in Multidimensional Data Analysis, eds. J. De Leeuw, J. Meulman, W. Heiser and F. Critchley, Leiden, The Netherlands: DSWO Press, pp. 181-196.
25. HUBERT, L. J., and ARABIE, P. (1988), "Relying on Necessary Conditions for Optimization: Unidimensional Scaling and Some Extensions", in Classifications and Related Methods of Data Analysis., ed. H. H. Bock, Amsterdam: Elsevier, pp. 463-472.
26. HUBERT, L., ARABIE, P., and HESSON-MCINNIS, M. (1992), "Multidimensional Scaling in the City-block Metric: a Combinatorial Approach", Journal of Classification, 9, 211-236.
27. KIRKPATRICK, S., GELATT, D., and VECCHI, M. P. (1983), "Optimization by Simulated Annealing", Science, 220, 671-680.
28. KRUSKAL, J. B. (1964a), "Multidimensional Scaling by Optimizing Goodness of Fit to a Nonmetric Hypothesis", Psychometrika, 29, 1-27.
29. KRUSKAL, J. B. (1964b), "Nonmetric Multidimensional Scaling: a Numerical Method", Psychometrika, 29, 28-42.
30. KRUSKAL, J. B., YOUNG, F. W., and SEERY, J. B. (1978), How to Use KYST-2, a Very Flexible Program to Do Multidimensional Scaling and Unfolding, Technical report, Murray Hill, NJ: Bell Labs.
31. LAWSON, C. L., and HANSON, R. J. (1974), Solving Least Squares Problems, Englewood Cliffs, New Jersey: Prentice-Hall.
32. p-distances, a Unifying Approach", in Information Systems and Data Analysis., eds. H. H. Bock, W. Lenski, and M. M. Richter, Berlin-Heidelberg: Springer-Verlag.
33. METROPOLIS, N. A., ROSENBLUTH, M., ROSENBLUTH, A., TELLER, A., and TELLER, E. (1953), "Equation of State Calculations by Fast Computing Machines", Journal of Chemical Physics, 21, 1087-1092.
34. MICKO, H. C., and FISCHER, W. (1970), "The Metric of Multidimensional Psychological Spaces as a Function of the Differential Attention to Subjective Attributes", Journal of Mathematical Psychology, 7, 118-143.
35. 2 Unidimensional Scaling", Journal of Classification, 22, 119-138.
36. PACHELLA, R. G., SOMERS, P., and HARDZINSKI, M. (1981), "A Psychological Approach to Dimensional Integrality", in Auditory and Visual Pattern Recognition, eds. D. Getty, and J. Howard, Hillsdale, NJ: Erlbaum.
37. PLINER, V. (1986), "The Problem of Multidimensional Metric Scaling", Automation and Remote Control, 44, 2, 560-567.
38. ROTHKOPF, E. A. (1957), "A Measure of Stimulus Similarity and Errors in Some Paired Associate Learning", Journal of Experimental Psychology, 53, 94-101.
39. SHEPARD, R. N. (1962), "The Analysis of Proximities: Multidimensional Scaling with an Unknown Distance Function. II", Psychometrika, 27, 219-246.
40. SHEPARD, R. N. (1964), "Attention and the Metric Structure of the Stimulus Space", Journal of Mathematical Psychology, 1, 54-87.
41. SHEPARD, R. N. (1965), "Approximation to Uniform Gradients of Generalization by Monotone Transformation of Scale", in Stimulus Generalization, ed. D. Mostofsky, Stanford: Stanford University Press, pp. 94-110.
42. SHEPARD, R. N. (1969), "Computer Explorations of Psychological Space", paper presented at the Annual Meeting of the America Psycholocial Associations.
43. SHEPARD, R. N. (1974), "Representation of Structure in Similarity Data: Problems and Prospects", Psychometrika, 39, 373-421.
44. TAKANE, Y., YOUNG, F. W., and DE LEEUW, J. (1977), "Nonmetric Individual Differences Multidimensional Scaling: an Alternating Least Squares Method with Optimal Scaling Features", Psychometrika, 42, 7-67.
45. TORGERSON, W. S. (1958), "Multidimensional Scaling of Similarity", Psychometrika, 30, 379-393.
46. WENDER, K. (1971), "A Test of Independence of Dimensions in Multidimensional Scaling", Perception and Psychophysics, 10, 30-32.