Clustering, seriation, and subset extraction of confusion data

Psychological Methods

Volumn 11, Issue 3, 2006, Pages 271-286

  Brusco, Michael J ^a   Steinley, Douglas ^b  

^a FLORIDA STATE UNIVERSITY   (United States)

^b UNIVERSITY OF MISSOURI   (United States)

Author keywords

Cluster analysis; Computer software; Confusion matrix; MATLAB; Seriation; Similarity choice model; Subset selection

Indexed keywords

ARTICLE; CLUSTER ANALYSIS; HUMAN; METHODOLOGY; PSYCHOLOGICAL MODEL; PSYCHOLOGY; STATISTICS;

CLUSTER ANALYSIS; HUMANS; MODELS, PSYCHOLOGICAL; PSYCHOLOGY;

EID: 33748790677     PISSN: 1082989X     EISSN: None     Source Type: Journal    
DOI: 10.1037/1082-989X.11.3.271     Document Type: Article

References (87)

1. Baker, F. B., & Hubert, L. J. (1976). A graph-theoretic approach to goodness of fit in complete-link hierarchical clustering. Journal of the American Statistical Association, 71, 870-878.
2. Bogacz, R., & Cohen, J. D. (2004). Parameterization of connectionist models. Behavior Research Methods, Instruments, & Computers, 36, 732-741.
3. Bowman, V. J., & Colantoni, C. S. (1973). Majority rule under transitivity constraints. Management Science, 19, 1029-1041.
4. Brainard, D. H. (1997). Psychophysics software for use with MATLAB. Spatial Vision, 10, 433-436.
5. Brown, S., & Heathcote, A. (2002). On the use of nonparametric regression in assessing parametric regression models. Journal of Mathematical Psychology, 46, 716-730.
6. Brusco, M. J. (2001). Seriation of asymmetric matrices using integer linear programming. British Journal of Mathematical and Statistical Psychology, 54, 367-375.
7. Brusco, M. J. (2002). Identifying a reordering of rows and columns for multiple proximity matrices using multiobjective programming. Journal of Mathematical Psychology, 46, 731-745.
8. Brusco, M. J. (2003). An enhanced branch-and-bound algorithm for a partitioning problem. British Journal of Mathematical and Statistical Psychology, 56, 83-92.
9. Brusco, M. J. (2004). On the concordance among empirical confusion matrices for visual and tactual letter recognition. Perception & Psychophysics, 66, 392-397.
10. Brusco, M. J., & Cradit, J. D. (2004). Graph coloring, minimum-diameter partitioning, and the analysis of confusion matrices. Journal of Mathematical Psychology, 48, 301-309.
11. Brusco, M. J., & Cradit, J. D. (2005). Bicriterion methods for partitioning dissimilarity matrices. British Journal of Mathematical, and Statistical Psychology, 58, 319-332.
12. Brusco, M. J., & Stahl, S. (2001). Compact integer-programming models for extracting subsets of stimuli from confusion matrices. Psychometrika, 66, 405-420.
13. Brusco, M. J., & Stahl, S. (2005a). Branch-and-bound applications in combinatorial data analysis. New York: Springer.
14. Brusco, M. J., & Stahl, S. (2005b). Optimal leasl squares unidimensional scaling: Improved branch-and-bound procedures and a comparison to dynamic programming. Psychometrika, 70, 253-270.
15. Chenery, H. R., & Watanabe, T. (1958). International comparisons of the structure of production. Econometrica, 26, 487-521.
16. Cheng, K., & Gallistel, C. R. (2005). Shape parameters explain data from spatial transformations: Comment, on Pearce et al. (2004) and Tommasi & Polli (2004). Journal of Experimental Psychology: Animal Behavior Processes, 31, 254-259.
17. Cho, R. Y., Yang, V., & Hallett, P. E. (2000). Reliability and dimensionality of judgments of visually textured materials. Perception & Psychophysics, 62, 735-752.
18. Clarke, F. R. (1957). Constant-ratio rule for confusion matrices in speech communication. Journal of the Acoustical Society of America, 29, 715-720.
19. Coldren, J. T., & Haaf, R. (2000). Asymmetries in infants' attention to the presence or absence of features. Journal of Genetic Psychology, 161, 420-434.
20. Compton, D. L. (2003). The influence of item composition on RAN letter performance in first-grade children. Journal of Special Education, 37, 81-94.
21. Craig, J. C. (1979). A confusion matrix for (actually presented letters. Perception & Psychophysics, 26, 409-411.
22. DeCani, J. S. (1972). A branch and bound algorithm for maximum likelihood paired comparison ranking by linear programming. Biometrika, 59, 131-135.
23. Deming, W. K., & Stephan, F. F. (1940). On a least squares adjustment of a sampled frequency table when the expected marginal totals are known. Annals of Mathematical Statistics, 11, 427-444.
24. Derryberry, D. (1991). The immediate effects of positive and negative feedback signals. Journal of Personality and Social Psychology, 61, 267-278.
25. Fisher, D. F., Monty, R. A., & Glucksberg, S. (1969). Visual confusion matrices: Fact, or artifact? Journal of Psychology, 71, 111-125.
26. Flueck, J. A., & Korsh, J. F. (1974). A branch search algorithm for maximum likelihood paired comparison ranking. Biometrika, 61, 621-626.
27. Gilmore, G. C., Hersh, H., Caramazza, A., & Griffin, J. (1979). Multidimensional letter similarity derived from recognition errors. Perception & Psychophysics, 25, 425-431.
28. Green, P., & Pew, R. W. (1978). Evaluating pictographic symbols: An automotive application. Human Factors, 20, 103-114.
29. Guénoche, A. (1993). Enumération des partitions de diamètre minimum [Enumeration of the partitions of minimum diameter]. Discrete Mathematics, 111, 277-287.
30. Hansen, P., & Delattre, M. (1978). Complete-link cluster analysis by graph coloring. Journal of the American Statistical Association, 73, 397-403.
31. Hansen, P., & Jaumard, B. (1997). Cluster analysis and mathematical programming. Mathematical Programming, 79, 191-215.
32. Heiser, W. J. (1988). Selecting a stimulus set. with prescribed structure from empirical, confusion frequencies. British Journal of Mathematical and Statistical Psychology, 41, 37-51.
33. Henson, R., & Douglas, J. (2005). Test construction for cognitive diagnosis. Applied Psychological Measurement, 29, 262-277.
34. Hettinger, T. P., Gent, J. F., Marks, L. E., & Frank, M. E. (1999). A confusion matrix for the study of taste perception. Perception & Psychophysics. 61, 1510-1521.
35. Hubert, L. (1973). Min and max hierarchical clustering using asymmetric proximity measures. Psychometrika, 38, 63-72.
36. Hubert, L. J. (1974). Some applications of graph theory Lo clustering. Psychometrika, 39, 283-309.
37. Hubert, L. J. (1987). Assignment methods in combinatorial data analysis. New York: Marcel Dekker.
38. Hubert, L., & Arabie, P. (1985). Comparing partitions. Journal of Classification, 2, 193-218.
39. Hubert, L., Arabie, P., & Meulman, J. (1997). Linear and circular unidimensional scaling for symmetric proximity matrices. British Journal of Mathematical and Statistical Psychology, 50, 253-284.
40. Hubert, L., Arabie, P., & Meulman, J. (2001). Combinatorial data analysis: Optimization by dynamic programming. Philadelphia: Society for Industrial and Applied Mathematics.
41. 2 norm: Basic optimization methods using MATLAB. Journal of Classification, 19, 303-328.
42. Hubert, L., Arabie, P., & Meulman, J. (2006). The structural representation of proximity matrices with MATLAB. Philadelphia: Society for Industrial and Applied Mathematics.
43. Hubert, L. J., & Baker, F. B. (1977). The comparison and fitting of given classification schemes. Journal of Mathematical Psychology, 16, 233-253.
44. Hubert, L., & Schultz. J. (1976). Quadratic assignment as a general data analysis strategy. British Journal of Mathematical and Statistical Psychology, 29, 190-241.
45. Hull, A. J. (1973). A letter-digit matrix of auditory confusions. British Journal of Psychology, 64, 579-585.
46. Johnson, K. O., & Phillips, J. R. (1981). Tactile spatial resolution. I. Two-point discrimination, gap detection, grating resolution, and letter recognition. Journal of Neurophysiology, 46, 1177-1191.
47. Johnson, S. C. (1967). Hierarchical clustering schemes. Psychometrika, 32, 241-254.
48. Kikuchi, T., Yamashita, Y., Sagawa, K., & Wake, T. (1979). An analysis of tactile letter confusions. Perception & Psychophysics, 26, 295-301.
49. Kruskal, J. B. (1964). Multidimensional scaling by optimizing goodness-of-fit to a nonmetric hypothesis. Psychometrika, 29, 1-28.
50. Lawler, E. L. (1964). A comment on minimum feedback arc sets. IEEE Transactions on Circuit Theory, 11, 296-297.
51. Lees, M. C., & Neufeld, R. W. J. (1999). Decision-theoretic aspects of stress arousal and coping personality. Journal of Personality and Social Psychology, 77, 185-208.
52. Loomis, J. M. (1974). Tactile letter recognition under different modes of stimulus presentation. Perception & Psychophysics, 16, 401-408.
53. Loomis, J. M. (1982). Analysis of tactile and visual confusion matrices. Perception & Psychophysics, 31, 41-52.
54. Luce, R. D. (1963). Detection and recognition. In R. D. Luce, R. Bush. & E. Galanter (Eds.), Handbook of mathematical psychology (Vol. 1, pp. 103-189). New York: Wiley.
55. Manning, S. K., & Shofner, E. (1991). Similarity ratings and confusability of lipread consonants compared with similarity ratings of auditory and orthographic stimuli. American Journal of Psychology, 104, 587-604.
56. Massaro, D. W., Cohen, M. M., & Gesi, A. T. (1993). Long-term training, transfer, and retention in learning to lipread. Perception & Psychophysics, 53, 549-562.
57. MathWorks. (2002). Using MATLAB (Version 6). Natick, MA: Author.
58. Miller, G. A., & Nicely, P. E. (1955). Analysis of perceptual confusions among some English consonants. Journal of the Acoustical Society of America, 27, 338-352.
59. Milligan, G. W., & Cooper, M. C. (1986). A study of the comparability of external criteria for hierarchical cluster analysis. Multivariate Behavioral Research, 21, 441-458.
60. Miralles, J. L., & Cervera, T. (1995). Voice intelligibility in patients who have undergone laryngectomies. Journal of Speech and Hearing Research, 38, 564-571.
61. Moore, T. G. (1974). Tactile and kinaesthetic aspects of pushbuttons. Applied Ergonomics, 5, 66-71.
62. Morgan, B. J. T., Chambers, S. M., & Morton, J. (1973). Acoustic confusion of digits in memory and recognition. Perception & Psychophysics, 14, 375-383.
63. Phillips, J. R., Johnson, K. O., & Browne, H. M. (1983). A comparison of visual and two modes of tactual letter resolution. Perception & Psychophysics, 34, 243-249.
64. Rich, R. (1971). Constant ratio rule for confusion matrices from short-term memory experiments. British Journal of Psychology, 62, 27-35.
65. Rothkopf, E. Z. (1957). A measure of stimulus similarity and errors in some paired-associate learning tasks. Journal of Experimental Psychology, 53, 94-101.
66. Rouder, J. N. (2001). Absolute identification with simple and complex, stimuli. Psychological Science, 12, 318-322.
67. Rouder, J. N. (2004). Modeling the effects of choice-set size on the processing of letters and words. Psychological Review, 111, 80-93.
68. Shepard, R. N. (1957). Stimulus and response generalization: A stochastic model relating generalization to distance in psychological space. Psychometrika, 22, 325-345.
69. Shepard, R. N., & Arabie, P. (1979). Additive clustering: Representation of similarities as combinations of discrete overlapping properties. Psychological Review, 86, 87-123.
70. Slater, P. (1961). Inconsistencies in a schedule of paired comparisons. Biometrika, 48, 303-312.
71. Smith, J. L., Morgan, C. L., & White, P. II. (2005). Investigating a measure of computer technology domain identification: A tool for understanding gender differences and stereotypes. Educational and Psychological Measurement, 65, 336-355.
72. Steinley, D. (2003). Local optima in K-means clustering: What you don't know may hurt you. Psychological Methods, 8, 294-304.
73. Steinley, D. (2004). Properties of the Hubert-Arabie adjusted Rand index. Psychological Methods, 9, 386-396.
74. Theise, E. S. (1989). Finding a subset of stimulus-response pairs with minimum total confusion: A binary integer programming approach. Human Factors, 31, 291-305.
75. Townsend, J. T. (1971a). Alphabetic confusion: A test of models for individuals. Perception & Psychophysics, 9, 449-454.
76. Townsend, J. T. (1971b). Theoretical analysis of an alphabet, confusion matrix. Perception & Psychophysics, 9, 40-50.
77. Townsend, J. T., & Ashby, F. G. (1982). Experimental test of contemporary mathematical models of visual letter recognition. Journal of Experimental Psychology: Human Perception and Performance, 8, 836-864.
78. Townsend, J. T., & Landon, D. E. (1982). An experimental and theoretical, investigation of the constant-ratio rule and other models of visual letter confusion. Journal of Mathematical Psychology, 25, 119-162.
79. Van der Heijden, A. H. C. (1986). On a selection in vision. Psychological Research, 48, 211-220.
80. Van der Heijden, A. H. C., Malhas, M. S., & Roovaart, B. P. (1984). An empirical interletter confusion matrix for continuous-line capitals. Perception & Psychophysics, 35, 85-88.
81. Van dor Heijden, A. H. C., Schreuder, R., & Wolters, G. (1985). Enhancing single-item recognition accuracy by cueing spatial locations in vision. Quarterly Journal of Experimental Psychology: Human Experimental Psychology. 37(A), 427-434.
82. Van Son, R. J. J. H., & Pols, L. C. W. (1999). Perisegmental speech improves consonant and vowel identification. Speech Communication, 29, 1-22.
83. Vega-Bermudez, F., Johnson, K. O., & Hsiao, S. S. (1991). Human tactile pattern recognition: Active versus passive touch, velocity effects, and patterns of confusion. Journal of Neurophysiology, 65, 531-546.
84. Walker, I., & Milne, S. (2005). Exploring function estimators as an alternative to regression in psychology. Behavior Research Methods, 37, 23-36.
85. Youngentob, S. L., Markert, L. M., Moxell, M. M., & Hornung, D. E. (1990). A method for establishing a five odorant identification confusion matrix task in rats. Physiology and Behavior, 47, 1053-1059.
86. Zielman, B., & Heiser, W. J. (1996). Models for asymmetric proximities. British Journal of Mathematical and Statistical Psychology, 49, 127-146.
87. Zwaga, H. J., & Boersema, T. (1983). Evaluation of a set of graphic symbols. Applied Ergonomics, 14, 43-54.