Variational Bayesian mixed-effects inference for classification studies

NeuroImage

Volumn 76, Issue , 2013, Pages 345-361

  Brodersen, Kay H ^a,b   Daunizeau, Jean ^a,c   Mathys, Christoph ^a   Chumbley, Justin R ^a   Buhmann, Joachim M ^b   Stephan, Klaas E ^a,d  

^a UNIVERSITY OF ZURICH   (Switzerland)

^b ETH ZURICH   (Switzerland)

^c PITIÉ SALPÊTRIÈRE HOSPITAL   (France)

^d UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

Balanced accuracy; Bayesian inference; Fixed effects; Group studies; Normal binomial; Random effects; Variational Bayes

Indexed keywords

ALGORITHM; ANALYTICAL PARAMETERS; ARTICLE; BAYES THEOREM; CLASSIFICATION; CLASSIFIER; ELECTROENCEPHALOGRAM; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; IMAGE ANALYSIS; MONTE CARLO METHOD; MULTIVARIATE ANALYSIS; NEUROIMAGING; PRIORITY JOURNAL; STATISTICAL ANALYSIS;

ALGORITHMS; BAYES THEOREM; BRAIN; BRAIN MAPPING; HUMANS; IMAGE INTERPRETATION, COMPUTER-ASSISTED; MAGNETIC RESONANCE IMAGING; MODELS, NEUROLOGICAL;

EID: 84876306005     PISSN: 10538119     EISSN: 10959572     Source Type: Journal    
DOI: 10.1016/j.neuroimage.2013.03.008     Document Type: Article

References (68)

1. Akbani R., Kwek S., Japkowicz N. Applying support vector machines to imbalanced datasets. Machine Learning: ECML 2004 2004, 39-50.
2. Attias H. A variational Bayesian framework for graphical models. Adv. Neural Inf. Process. Syst. 2000, 12:209-215.
3. Beckmann C.F., Jenkinson M., Smith S.M. General multilevel linear modeling for group analysis in fMRI. Neuroimage 2003, 20:1052-1063.
4. Behrens T.E.J., Woolrich M.W., Walton M.E., Rushworth M.F.S. Learning the value of information in an uncertain world. Nat. Neurosci. 2007, 10:1214-1221.
5. Bishop C.M. Pattern Recognition and Machine Learning 2007, Springer, New York.
6. Bishop C.M., Spiegelhalter D., Winn J. VIBES: a variational inference engine for Bayesian networks. Adv. Neural Inf. Process. Syst. 2002, 15:777-784.
7. Blankertz B., Lemm S., Treder M., Haufe S., Müller K.-R. Single-trial analysis and classification of ERP components-a tutorial. Neuroimage 2011, 15:814-825.
8. Brodersen K.H., Ong C.S., Stephan K.E., Buhmann J.M. The balanced accuracy and its posterior distribution. Proceedings of the 20th International Conference on Pattern Recognition 2010, 3121-3124. IEEE Computer Society.
9. Brodersen K.H., Ong C.S., Stephan K.E., Buhmann J.M. The binormal assumption on precision-recall curves. Proceedings of the 20th International Conference on Pattern Recognition 2010, 4263-4266. IEEE Computer Society.
10. Brodersen K.H., Haiss F., Ong C.S., Jung F., Tittgemeyer M., Buhmann J.M., Weber B., Stephan K.E. Model-based feature construction for multivariate decoding. Neuroimage 2011, 56:601-615.
11. Brodersen K.H., Schofield T.M., Leff A.P., Ong C.S., Lomakina E.I., Buhmann J.M., Stephan K.E. Generative embedding for model-based classification of fMRI data. PLoS Comput. Biol. 2011, 7:e1002079.
12. Brodersen K.H., Mathys C., Chumbley J.R., Daunizeau J., Ong C.S., Buhmann J.M., Stephan K.E. Bayesian mixed-effects inference on classification performance in hierarchical data sets. J. Mach. Learn. Res. 2012, 13:3133-3176.
13. Brodersen K.H., Wiech K., Lomakina E.I., Lin C., Buhmann J.M., Bingel U., Ploner M., Stephan K.E., Tracey I. Decoding the perception of pain from fMRI using multivariate pattern analysis. Neuroimage 2012, 63:1162-1170.
14. Chadwick M.J., Hassabis D., Weiskopf N., Maguire E.A. Decoding individual episodic memory traces in the human hippocampus. Curr. Biol. 2010, 20:544-547.
15. Chang C.-C., Lin C.-J. LIBSVM: a library for support vector machines. ACM Trans. Intell. Syst. Technol. 2011, 2:27:1-27:27.
16. Chawla N.V., Bowyer K.W., Hall L.O., Kegelmeyer W.P. SMOTE: synthetic minority over-sampling technique. J. Artif. Intell. Res. 2002, 16:321-357.
17. Clithero J.A., Smith D.V., Carter R.M., Huettel S.A. Within- and cross-participant classifiers reveal different neural coding of information. Neuroimage 2011, 56:699-708.
18. Cox D.D., Savoy R.L. Functional magnetic resonance imaging (fMRI) "brain reading": detecting and classifying distributed patterns of fMRI activity in human visual cortex. Neuroimage 2003, 19:261-270.
19. Davatzikos C., Resnick S.M., Wu X., Parmpi P., Clark C.M. Individual patient diagnosis of AD and FTD via high-dimensional pattern classification of MRI. Neuroimage 2008, 41:1220-1227.
20. Dixon P. Models of accuracy in repeated-measures designs. J. Mem. Lang. 2008, 59:447-456.
21. Efron B., Morris C. Limiting the risk of Bayes and empirical Bayes estimators-part I: the Bayes case. J. Am. Stat. Assoc. 1971, 807-815.
22. Fox C.W., Roberts S.J. A tutorial on variational Bayesian inference. Artif. Intell. Rev. 2012, 38:85-95.
23. Friston K.J., Penny W. Posterior probability maps and {SPMs}. Neuroimage 2003, 19:1240-1249.
24. Friston K.J., Holmes A.P., Worsley K.J., Poline J.P., Frith C.D., Frackowiak R.S.J. Statistical parametric maps in functional imaging: a general linear approach. Hum. Brain Mapp. 1995, 2:189-210.
25. Friston K.J., Holmes A.P., Worsley K.J. How many subjects constitute a study?. Neuroimage 1999, 10:1-5.
26. Friston K.J., Penny W., Phillips C., Kiebel S., Hinton G., Ashburner J. Classical and Bayesian inference in neuroimaging: theory. Neuroimage 2002, 16:465-483.
27. Friston K.J., Harrison L., Penny W. Dynamic causal modelling. Neuroimage 2003, 19:1273-1302.
28. Friston K.J., Stephan K.E., Lund T.E., Morcom A., Kiebel S. Mixed-effects and fMRI studies. Neuroimage 2005, 24:244-252.
29. Galton F. Regression towards mediocrity in hereditary stature. J. Anthropol. Inst. Great Brit. Ireland 1886, 15:246-263.
30. Gelman A., Carlin J.B., Stern H.S., Rubin D.B. Bayesian Data Analysis 2003, Chapman and Hall/CRC. 2nd ed.
31. Ghahramani Z., Beal M.J. Propagation algorithms for variational Bayesian learning. Adv. Neural Inf. Process. Syst. 2001, 507-513.
32. Goldstein H. Multilevel Statistical Models 2010, Wiley.
33. Gopal S., Yang Y., Bai B., Niculescu-Mizil A. Bayesian models for Large-scale Hierarchical Classification. Adv. Neural Inf. Process. Syst. 2012, 25:2420-2428.
34. Gustafsson M.G., Wallman M., Wickenberg Bolin U., Göransson H., Fryknäs M., Andersson C.R., Isaksson A. Improving Bayesian credibility intervals for classifier error rates using maximum entropy empirical priors. Artif. Intell. Med. 2010, 49:93-104.
35. Harrison S.A., Tong F. Decoding reveals the contents of visual working memory in early visual areas. Nature 2009, 458:632-635.
36. Hassabis D., Chu C., Rees G., Weiskopf N., Molyneux P.D., Maguire E.A. Decoding neuronal ensembles in the human hippocampus. Curr. Biol. 2009, 19:546-554.
37. Haynes J.-D., Rees G. Decoding mental states from brain activity in humans. Nat. Rev. Neurosci. 2006, 7:523-534.
38. Holmes A.P., Friston K.J. Generalisability, random effects and population inference. Fourth Int Conf on Functional Mapping of the Human Brain. Neuroimage 1998, 7:S754.
39. Japkowicz N., Stephen S. The class imbalance problem: a systematic study. Intell. Data Anal. 2002, 6:429-449.
40. Johnson J.D., McDuff S.G.R., Rugg M.D., Norman K.A. Recollection, familiarity, and cortical reinstatement: a multivoxel pattern analysis. Neuron 2009, 63:697-708.
41. Just M.A., Cherkassky V.L., Aryal S., Mitchell T.M. A neurosemantic theory of concrete noun representation based on the underlying brain codes. PLoS One 2010, 5:e8622.
42. Klöppel S., Stonnington C.M., Chu C., Draganski B., Scahill R.I., Rohrer J.D., Fox N.C., Jack C.R., Ashburner J., Frackowiak R.S.J. Automatic classification of MR scans in Alzheimer's disease. Brain 2008, 131:681-689.
43. Klöppel S., Abdulkadir A., Jack C.R., Koutsouleris N., Mourão-Miranda J., Vemuri P. Diagnostic neuroimaging across diseases. Neuroimage 2012, 61:457-463.
44. Knops A., Thirion B., Hubbard E.M., Michel V., Dehaene S. Recruitment of an area involved in eye movements during mental arithmetic. Science 2009, 324:1583-1585.
45. Kohavi R. A study of cross-validation and bootstrap for accuracy estimation and model selection. International Joint Conference on Artificial Intelligence 1995, 1137-1145. Lawrence Erlbaum Associates Ltd.
46. Krajbich I., Camerer C., Ledyard J., Rangel A. Using neural measures of economic value to solve the public goods free-rider problem. Science 2009, 326:596-599.
47. Kriegeskorte N., Goebel R., Bandettini P. Information-based functional brain mapping. Proc. Natl. Acad. Sci. U. S. A. 2006, 103:3863-3868.
48. Langford J. Tutorial on practical prediction theory for classification. J. Mach. Learn. Res. 2005, 6:273-306.
49. Lemm S., Blankertz B., Dickhaus T., Müller K.-R. Introduction to machine learning for brain imaging. Neuroimage 2011, 56:387-399.
50. Leonard T. Bayesian methods for binomial data. Biometrika 1972, 59:581-589.
51. MacKay D.J.C. Ensemble learning and evidence maximization. Proc. NIPS 1995, (Available at: http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.54.4083&rep=rep1&type=pdf [Accessed January 4, 2013]).
52. Marquand A., Howard M., Brammer M., Chu C., Coen S., Mourão-Miranda J. Quantitative prediction of subjective pain intensity from whole-brain fMRI data using Gaussian processes. Neuroimage 2010, 49:2178-2189.
53. Mumford J.A., Nichols T. Simple group fMRI modeling and inference. Neuroimage 2009, 47:1469-1475.
54. Nandy R.R., Cordes D. Novel nonparametric approach to canonical correlation analysis with applications to low CNR functional MRI data. Magn. Reson. Med. 2003, 50:354-365.
55. Norman K.A., Polyn S.M., Detre G.J., Haxby J.V. Beyond mind-reading: multi-voxel pattern analysis of fMRI data. Trends Cogn. Sci. 2006, 10:424-430.
56. Olivetti E., Veeramachaneni S., Nowakowska E. Bayesian hypothesis testing for pattern discrimination in brain decoding. Pattern Recognit. 2012, 45:2075-2084.
57. Penny W.D., Stephan K.E., Mechelli A., Friston K.J. Comparing dynamic causal models. Neuroimage 2004, 22:1157-1172.
58. Pereira F., Botvinick M. Information mapping with pattern classifiers: a comparative study. Neuroimage 2011, 56:476-496.
59. Pereira F., Mitchell T., Botvinick M. Machine learning classifiers and fMRI: a tutorial overview. Neuroimage 2009, 45:S199-S209.
60. Schurger A., Pereira F., Treisman A., Cohen J.D. Reproducibility distinguishes conscious from nonconscious neural representations. Science 2010, 327:97-99.
61. Sitaram R., Weiskopf N., Caria A., Veit R., Erb M., Birbaumer N. fMRI brain-computer interfaces: a tutorial on methods and applications. IEEE Signal Process. Mag. 2008, 25:95-106.
62. Stelzer J., Chen Y., Turner R. Statistical inference and multiple testing correction in classification-based multi-voxel pattern analysis (MVPA): random permutations and cluster size control. Neuroimage 2013, 65:69-82.
63. Stephan K.E., Weiskopf N., Drysdale P.M., Robinson P.A., Friston K.J. Comparing hemodynamic models with DCM. Neuroimage 2007, 38:387-401.
64. Stephan K.E., Penny W.D., Daunizeau J., Moran R.J., Friston K.J. Bayesian model selection for group studies. Neuroimage 2009, 46:1004-1017.
65. Tong F., Pratte M.S. Decoding patterns of human brain activity. Annu. Rev. Psychol. 2012, 63:483-509.
66. Wickenberg-Bolin U., Goransson H., Fryknas M., Gustafsson M., Isaksson A. Improved variance estimation of classification performance via reduction of bias caused by small sample size. BMC Bioinformatics 2006, 7:127.
67. Woolrich M.W., Behrens T.E.J., Beckmann C.F., Jenkinson M., Smith S.M. Multilevel linear modelling for FMRI group analysis using Bayesian inference. Neuroimage 2004, 21:1732-1747.
68. Zhang D., Lee W.S. Learning classifiers without negative examples: A reduction approach. International Conference on Digital, Information Management (ICDIM) 2008.