How to compute reliability estimates and display confidence and tolerance intervals for pattern classifiers using the Bootstrap and 3-way multidimensional scaling (DISTATIS)

NeuroImage

Volumn 45, Issue 1, 2009, Pages 89-95

  Abdi, Hervé ^a   Dunlop, Joseph P ^a   Williams, Lynne J ^b  

^a UNIVERSITY OF TEXAS AT DALLAS   (United States)

^b UNIVERSITY OF WESTERN ONTARIO   (Canada)

Author keywords

Bonferonni correction; Bootstrap resampling; Confidence interval; DISTATIS; Group analysis; Multidimensional scaling (MDS); Pattern classifiers; RV coefficient; Reliability estimation; id k correction; STATIS; Tolerance interval

Indexed keywords

ARTICLE; BOOTSTRAPPING; CONFIDENCE INTERVAL; FUNCTIONAL MAGNETIC RESONANCE IMAGING; IMAGING; MATHEMATICAL COMPUTING; METHODOLOGY; MULTIDIMENSIONAL SCALING; PRIORITY JOURNAL; RELIABILITY; SCORING SYSTEM;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; BRAIN; BRAIN MAPPING; EVOKED POTENTIALS; HUMANS; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; IMAGING, THREE-DIMENSIONAL; MAGNETIC RESONANCE IMAGING; PATTERN RECOGNITION, AUTOMATED; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY;

EID: 60149110530     PISSN: 10538119     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neuroimage.2008.11.008     Document Type: Article

References (36)

1. Abdi H. Metric multidimensional scaling. In: Salkind N. (Ed). Encyclopedia of Measurement and Statistics (2007), Sage, Thousand Oaks, (CA) 598-605
2. V coefficient and congruence coefficient. In: Salkind N. (Ed). Encyclopedia of Measurement and Statistics (2007), Sage, Thousand Oaks, (CA) 849-853
3. Abdi H. Bonferroni and Šidàk corrections for multiple comparisons. In: Salkind N. (Ed). Encyclopedia of Measurement and Statistics (2007), Sage, Thousand Oaks, (CA) 103-107
4. Abdi H. Eigen-decomposition: eigenvalues and eigenvecteurs. In: Salkind N. (Ed). Encyclopedia of Measurement and Statistics (2007), Sage, Thousand Oaks, (CA) 304-308
5. Abdi H. Signal detection theory. In: Salkind N. (Ed). Encyclopedia of Measurement and Statistics (2007), Sage, Thousand Oaks, (CA) 886-889
6. Abdi H. Distance. In: Salkind N. (Ed). Encyclopedia of Measurement and Statistics (2007), Sage, Thousand Oaks, (CA) 280-284
7. Abdi H., and Valentin D. Multiple Factor Analysis. In: Salkind N. (Ed). Encyclopedia of Measurement and Statistics (2007), Sage, Thousand Oaks, (CA) 657-663
8. Abdi H., Valentin D., and Edelman B. Neural Networks (1999), Sage, Newbury Park, (CA, USA)
9. Abdi H., Valentin D., O'Toole A., and Edelman B. DISTATIS: the analysis of multiple distance matrices. Proceedings of the IEEE Computer Society: International Conference on Computer Vision and Pattern Recognition. San Diego, CA, USA (2005) 42-47
10. Abdi H., Valentin D., Chollet S., and Chrea C. Analyzing assessors and products in sorting tasks: DISTATIS, theory and applications. Food Qual. Prefer. 18 (2007) 627-640
11. Bishop C. Pattern Recognition and Machine Learning (2006), Springer, New York
12. Chernick M.R. Bootstrap Methods: A Guide for Practitioners and Researchers (2008), Wiley, New York
13. Cox D.D., and Savoy R.L. Functional magnetic resonance imaging (fMRI) "brain reading:" detecting and classifying distributed patterns of fMRI activity in human visual cortex. NeuroImage 19 (2003) 261-270
14. Duda R.O., Hart P.E., and Stork D.G. Pattern Classification (2001), Wiley-Interscience, New York
15. Efron B., and Tibshirani R.J. An Introduction to the Bootstrap (1993), Chapman and Hall, New York
16. Escofier B., and Pagès J. Multiple factor analysis. Comput. Stat. Data Anal. 18 (1990) 121-140
17. Escoufier Y. Le traitement des variables vectorielles. Biometrics 29 (1973) 751-760
18. Hahn G.J., and Meeker W.Q. Statistical Intervals: A Guide for Practitioners (1991), Wiley-Interscience, New York
19. Hastie T., Tibshirani R., and Friedman J. The Elements of Statistical Learning (2001), Springer, New York
20. Haxby J., Gobbini M., Furey M., Ishai A., Schouten J., and Pietrini P. Distributed and overlapping representation of faces and objects in ventral temporal cortex. Science 293 (2001) 2425-2430
21. Haynes J.D., and Rees G. Decoding mental states from brain activity in humans. Nat. Rev. Neurosci. 7 (2006) 523-534
22. V coefficient. Comput. Stat. Data Anal. 53 (2008) 82-91
23. Kherif F., Poline J.-B., Mériaux S., Benali H., Flandin G., and Brett M. Group analysis in functional neuroimaging: selecting subjects using similarity measures. NeuroImage 20 (2003) 2197-2208
24. Lancaster P., and Tismenestsky M. The Theory of Matrices (1985), Academic Press, Orlando
25. Lazraq A., Hanafi M., Cléroux R., Allaire J., and Lepage Y. Une approache inférentielle pour la validation du compromis de la méthode STATIS. J. Soc. Fr. Stat. 149 (2008) 98-109
26. Norman K., Polyn S., Detre G., and Haxby J. Beyond brain reading: multi-voxel pattern analysis of fMRI data. Trends Cogn. Sci. 10 (2006) 424-430
27. Oliveira M.M., and Mexia J. ANOVA-like analysis of matched series of studies with a common structure. J. Stat. Plan. Inference 137 (2007) 1862-1870
28. Oliveira M.M., and Mexia J. Modelling series of studies with a common structure. Comput. Stat. Data Anal. 51 (2007) 5876-5885
29. O'Toole A., Jiang F., Abdi H., and Haxby J. Partially distributed representations of objects and faces in ventral temporal cortex. J. Cogn. Neurosci. 17 (2005) 580-590
30. O'Toole A., Jiang F., Abdi H., Pénard N., Dunlop J., and Parent M. Theoretical, statistical, and practical perspectives on pattern-based classification approaches to the analysis of functional neuroimaging data. J. Cogn. Neurosci. 19 (2007) 1735-1752
31. V-coefficient. Appl. Stat. 25 (1976) 257-265
32. Shinkareva S., Ombao H., Sutton B., Mohanty A., and Miller G. Classification of functional brain images with a spatio-temporal dissimilarity map. NeuroImage 33 (2006) 63-71
33. Shinkareva, S.V., Mason, R.A., Malave, V.L., Wang, W., Mitchell, T.M., Just, M.A., 2008. Using fMRI brain activation to identify cognitive states associated with perception of tools and dwellings. PLoS ONE 3, e1394. URL http://dx.doi.org/10.1371/journal.pone.0001394.
34. Strother S.C., Anderson J., Hansen L.K., Kjems U., Kustra R., Sidtis J., Frutiger S., Muley S., LaConte S., and Rottenberg D. The quantitative evaluation of functional neuroimaging experiments: the NPAIRS data analysis framework. NeuroImage 15 (2002) 747-771
35. Togerson W. Theory and Methods of Scaling (1958), Wiley, New York
36. Welchew D., Honey G., Sharma T., Robbins T., and Bullmore E. Multidimensional scaling of integrated neurocognitive function and schizophrenia as a disconnexion disorder. NeuroImage 17 (2002) 1227-1239