Adaptive design optimization: A mutual information-based approach to model discrimination in cognitive science

Neural Computation

Volumn 22, Issue 4, 2010, Pages 887-905

  Cavagnaro, Daniel R ^a   Myung, Jay I ^a   Pitt, Mark A ^a   Kujala, Janne V ^b  

^a OHIO STATE UNIVERSITY   (United States)

^b UNIVERSITY OF JYVÄSKYLÄ   (Finland)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; BAYES THEOREM; COGNITION; COMPUTER SIMULATION; HUMAN; METHODOLOGY; NONLINEAR SYSTEM; PERCEPTIVE DISCRIMINATION; PHYSIOLOGY; STATISTICAL MODEL; STATISTICS;

BAYES THEOREM; COGNITION; COMPUTER SIMULATION; DISCRIMINATION (PSYCHOLOGY); HUMANS; MODELS, STATISTICAL; NONLINEAR DYNAMICS; RESEARCH DESIGN;

EID: 77953334192     PISSN: 08997667     EISSN: 1530888X     Source Type: Journal    
DOI: 10.1162/neco.2009.02-09-959     Document Type: Article

References (52)

1. Akaike, H. (1973). Information theory and an extension of the maximum likelihood principle. In B.N. Petrov & F. Caski (Eds.), Proceedings of the Second International Symposium on Information Theory (pp. 267-281). Budapest: Akademiai Kiado.
2. Allen, T., Yu, L., & Schmitz, J. (2003). An experimental design criterion for minimizing meta-model prediction errors applied to die casting process design. Applied Statistics, 52, 103-117.
3. Amzal, B., Bois, F.Y., Parent, E., & Robert, C.P. (2006). Bayesian-optimal design via interacting particle systems. Journal of the American Statistical Association, 101(474), 773-785.
4. Atkinson, A., & Donev, A. (1992). Optimum experimental designs. New York: Oxford University Press.
5. Atkinson, A., & Federov, V. (1975a). The design of experiments for discriminating between two rival models. Biometrika, 62(1), 57-70.
6. Atkinson, A., & Federov, V. (1975b). Optimal design: Experiments for discriminating between several models. Biometrika, 62(2), 289-303.
7. Balasubramanian, V., Larjo, K., & Seth, R. (2008). Experimental design and model selection: The example of exoplanet detection. In P. Gr ̈ unwald, P. Myllym̈aki, I. Tabus, M. Weinberger, & B. Yu (Eds.), Festschrift in Honor of Jorma Rissanen. Tampere: Tampere University Press.
8. Bardsley, W., Wood, R., &Melikhova, E. (1996). Optimal design:Acomputer program to study the best possible spacing of design points for model discrimination. Computers and Chemistry, 20, 145-157.
9. Bernardo, J.M. (1979). Expected information as expected utility. Annals of Statistics, 7(3), 686-690.
10. Box, G., & Hill, W. (1967). Discrimination among mechanisticmodels. Technometrics, 9, 57-71.
11. Brunel, N., & Nadal, J.-P. (1998). Mutual information, Fisher information, and population coding. Neural Computation, 10, 1731-1757.
12. Chaloner, K., & Verdinelli, I. (1995). Bayesian experimental design: A review. Statistical Science, 10(3), 273-304.
13. Cover, T.M., & Thomas, J.A. (1991). Elements of information theory. New York: Wiley.
14. Ding, M., Rosner, G., & M̈ uller, P. (2008). Bayesian optimal design for phase II screening trials. Biometrics, 64, 886-894.
15. Doucet, A., de Freitas, N., & Gordon, N. (2001). Sequential Monte Carlo methods in practice. Berlin: Springer.
16. El-Gamal, M., & Palfrey, T. (1996). Economical experiments: Bayesian efficient experimental design. International Journal of Game Theory, 25, 495-517.
17. Fraser, M.A., &Swinney, H.L. (1986). Independent coordinates for strange attractors from mutual information. Physical Review A, 33(2), 1134-1140.
18. Gelman, A., Carlin, J., Stern, H., & Rubin, D. (2004). Bayesian data analysis. London: Chapman & Hall.
19. Gr̈ unwald, P. (2005). A tutorial introduction to the minimum description length principle. In P. Gr̈ unwald, I.J. Myung, & M.A. Pitt (Eds.), Advances in minimum description length: Theory and applications. Cambridge, MA: MIT Press.
20. Haines, L., Perevozskaya, I., & Rosenberer, W. (2003). Bayesian optimal designs for phase I clinical trials. Biometrics, 59, 591-600.
21. Han, C., & Carlin, B.P. (2001). MCMC methods for computing Bayes factors: A comparative review. Journal of the American Statistical Association, 96, 1122-1132.
22. Haussler, D., & Opper, M. (1997). Mutual information, metric entropy and cumulative relative entropy risk. Annals of Statistics, 25, 2451-2492.
23. Heavens, A., Kitching, T., & Verde, L. (2007). On model selection forecasting, dark energy and modified gravity. Monthly Notices of the Royal Astronomical Society, 380(3), 1029-1035.
24. Hoffman, G., Waslander, S., & Tomlin, C. (2006). Mutual information methods with particle filters for mobile sensor network control. IEEE Conference on Decision and Control. Piscataway, NJ: IEEE Press.
25. Kass, R.E., & Raftery, A.E. (1995). Bayes factors. Journal of the American Statistical Association, 90, 773-795.
26. Kiefer, J. (1959). Optimum experimental designs. Journal of the Royal Statistical Society. Series B (Methodological), 21(2), 272-319.
27. Kirkpatrick, S., Gelatt, C., &Vecchi, M. (1983). Optimization by simulated annealing. Science, 220, 671-680.
28. K̈ uck, H., de Freitas, N., & Doucet, A. (2006). SMC samplers for Bayesian optimal nonlinear design. Nonlinear Statistical Signal Processing Workshop (NSSPW). Available online at http://people.cs.ubc.ca/~nando/papers/smdesign.pdf.
29. Kujala, J.V., &Lukka, T.J. (2006). Bayesian adaptive estimation: The next dimension. Journal of Mathematical Psychology, 50(4), 369-389.
30. Kujala, J.V., Richardson, U., & Lyytinen, H. (in press). A Bayesian-optimal principle for a child-friendly adaptation in learning games. Journal of Mathematical Psychology.
31. Lesmes, L., Jeon, S.-T., Lu, Z.-L., & Dosher, B. (2006). Bayesian adaptive estimation of threshold versus contrast external noise functions: The quick tvc method. Vision Research, 46, 3160-3176.
32. Lewi, J., Butera, R., & Paninski, L. (2009). Sequential optimal design of neurophysiology experiments. Neural Computation, 21, 619-687.
33. Lindley, D.V. (1956). On a measure of the information provided by an experiment. Annals of Mathematical Statistics, 27(4), 986-1005.
34. Loredo, T.J. (2004). Bayesian adaptive exploration. In G.J. Erickson & Y. Zhai (Eds.), Bayesian Inference and Maximum Entropy Methods in Science and Engineering: 23rd International Workshop on Bayesian Inference and Maximum Entropy Methods in Science and Engineering (vol. 707, pp. 330-346). Available online at arXiv:astro-ph/409386v1.
35. Machens, C. (2002). Adaptive sampling by information maximization. Physical Review Letters, 88(22), 2281040.
36. Machens, C., Gollisch, T., Kolesnikova, O., & Herz, A. (2005). Testing the efficiency of sensory coding with optimal stimulus ensembles. Neuron, 47, 447-456.
37. MacKay, D.J.C. (1992). Information-based objective functions for active data selection. Neural Computation, 4(4), 590-604.
38. M̈ uller, P., Berry, D., Grieve, A., Smith, M., & Krams, M. (2007). Simulation-based sequential Bayesian design. Journal of Statistical Planning and Inference, 137, 3140-3150.
39. M̈ uller, P., Sanso, B., & De Iorio, M. (2004). Optimal Bayesian design by inhomogeneous Markov chain simulation. Journal of the American Statistical Association, 99(467), 788-798.
40. Myung, I.J. (2000). The importance of complexity in model selection. Journal of Mathematical Psychology, 44(4), 190-204.
41. Myung, J.I., &Pitt, M. (2009).Optimal experimental design formodel discrimination. Psychological Review, 116, 499-518.
42. Nelson, J. (2005). Finding useful questions: On Bayesian diagnosticity, probability, impact, and information gain. Psychological Review, 112(4), 979-999.
43. Nosofsky, R., & Zaki, S. (2002). Exemplar and prototype models revisited: Response strategies, selective attention and stimulus generalization. Journal of Experimental Psychology, 28, 924-940.
44. Opfer, J., & Siegler, R. (2007). Representational change and children's numerical estimation. Cognitive Psychology, 55, 165-195.
45. Opper, M. (1999). A Bayesian approach to online learning. In D. Saad (Ed.), Online learning in neural networks (pp. 363-377). Cambridge: Cambridge University Press.
46. Paninski, L. (2003). Estimation of entropy and mutual information. Neural Computation, 15, 1191-1253.
47. Paninski, L. (2005). Asymptotic theory of information-theoretic experimental design. Neural Computation, 17, 1480-1507.
48. Rubin, D., Hinton, S., & Wenzel, A. (1999). The precise time course of retention. Journal of Experimental Psychology, 25(5), 1161-1176.
49. Rubin, D., & Wenzel, A. (1996). One hundred years of forgetting: A quantitative description of retention. Psychological Review, 103(4), 734-760.
50. Toyoizumi, T., Pfister, J.-P., Aihara, K., & Gerstner, W. (2005). Generalized Bienenstock-Cooper-Munro rule for spiking neurons that maximizes information transmission. Proceedings of the National Academy of Sciences, 102(14), 5239-5244.
51. Vanpaemel, W., &Storms, G. (2008). In search of abstraction: The varying abstraction model of categorization. Psychonomic Bulletin and Review, 15, 732-749.
52. Wixted, J., & Ebbesen, E. (1991). On the form of forgetting. Psychological Science, 2(6), 409-415.