Sequential optimal design of neurophysiology experiments

Neural Computation

Volumn 21, Issue 3, 2009, Pages 619-687

  Lewi, Jeremy ^a   Butera, Robert ^b   Paninski, Liam ^c  

^a GEORGIA INSTITUTE OF TECHNOLOGY   (United States)

^b GEORGIA INSTITUTE OF TECHNOLOGY   (United States)

^c Och Spine at New York Presbyterian Hospitals   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHM; ANIMAL; ARTICLE; BIOLOGICAL MODEL; COMPUTER SIMULATION; HUMAN; METHODOLOGY; NERVE CELL; NEUROPHYSIOLOGY; NONLINEAR SYSTEM; PHYSIOLOGY; TIME;

ALGORITHMS; ANIMALS; COMPUTER SIMULATION; HUMANS; MODELS, NEUROLOGICAL; NEURONS; NEUROPHYSIOLOGY; NONLINEAR DYNAMICS; RESEARCH DESIGN; TIME FACTORS;

EID: 63249126388     PISSN: 08997667     EISSN: 1530888X     Source Type: Journal    
DOI: 10.1162/neco.2008.08-07-594     Document Type: Article

References (83)

1. Adelson, E., & Bergen, J. (1985). Spatiotemporal energy models for the perception of motion. Journal of the Optical Society of America A-Optics Image Science and Vision, 2(2), 284-299.
2. Ahrens, M., Paninski, L., & Sahani, M. (2008). Inferring input nonlinearities in neural encoding models. Network, 19, 35-67.
3. Bates, R. A., Buck, R. J., Riccomagno, E., & Wynn, H. P. (1996). Experimental design and observation for large systems. Journal of the Royal Statistical Society Series B-Methodological, 58(1), 77-94.
4. Benda, J., Gollisch, T., Machens, C. K., & Herz, A. V. (2007). From response to stimulus: Adaptive sampling in sensory physiology. Current Opinion in Neurobiology, 17(4), 430-436.
5. Berger, J. O. (1985). Statistical decision theory and Bayesian analysis. Berlin: Springer.
6. Berkes, P., & Wiskott, L. (2005). Slow feature analysis yields a rich repertoire of complex cell properties. Journal of Vision, 5, 579-602.
7. Bernardo, J. M. (1979). Expected information as expected utility. Annals of Statistics, 7(3), 686-690.
8. Berry, M., & Meister, M. (1998). Refractoriness and neural precision. Journal of Neuroscience, 18, 2200-2211.
9. Boutilier, C., Dean, T., & Hanks, S. (1999). Decision-theoretic planning: Structural assumptions and computational leverage. Journal of Artificial Intelligence Research, 11, 1-94.
10. Brillinger, D. (1988). Maximum likelihood analysis of spike trains of interacting nerve cells. Biological Cyberkinetics, 59, 189-200.
11. Brillinger, D. (1992). Nerve cell spike train data analysis: A progression of technique. Journal of the American Statistical Association, 87, 260-271.
12. Carlyon, R. P., & Shamma, S. (2003). An account of monaural phase sensitivity. J. Acoust. Soc. Am., 114(1), 333-348.
13. Chaloner, K., & Verdinelli, I. (1995). Bayesian experimental design: A review. Statistical Science, 10(3), 273-304.
14. Chaudhuri, P., & Mykland, P. (1993). Nonlinear experiments: Optimal design and inference based on likelihood. Journal of the American Statistical Association, 88(422), 538-546.
15. Chichilnisky, E. J. (2001). A simple white noise analysis of neuronal light responses. Network-Computation in Neural Systems, 12(2), 199-213.
16. Cohn, D. A. (1994). Neural network exploration using optimal experiment design. In J. D. Cowan, G. Tesauro, & J. Alspector (Eds.), Advances in neural information processing systems, 6 (pp. 679-686). San Francisco: Morgan Kaufmann.
17. Cohn, D. A., Ghahramani, Z., & Jordan, M. I. (1996). Active learning with statistical models. Journal of Artificial Intelligence Research, 4, 129-145.
18. Cottaris, N. P., & De Valois, R. L. (1998). Temporal dynamics of chromatic tuning in macaque primary visual cortex. Nature, 395(6705), 896-900.
19. Cover, T. M., & Thomas, J. A. (1991). Elements of information theory. Hoboken, NJ: Wiley.
20. Dasgupta, S. (2005). Analysis of a greedy active learning strategy. In L. K. Saul, Y. Weiss, & L. Bottou (Eds.), Advances in neural information processing systems, 17 (pp. 337-344). Cambridge, MA: MIT Press.
21. Dayan, P., & Abbot, L. (2001). Theoretical neuroscience. Cambridge, MA: MIT Press.
22. de Boer, E., & de Jongh, H. R. (1978). On cochlear encoding: Potentialities and limitations of the reverse-correlation technique. Journal of the Acoustical Society of America, 63(1), 115-135.
23. deCharms, R. C., Blake, D. T., & Merzenich,M.M. (1998). Optimizing sound features for cortical neurons. Science, 280(5368), 1439-1443.
24. Demmel, J. W. (1997). Applied numerical linear algebra. Philadelphia: SIAM.
25. Depireux, D. A., Simon, J. Z., Klein, D. J., & Shamma, S. A. (2001). Spectro-temporal response field characterization with dynamic ripples in ferret primary auditory cortex. Journal of Neurophysiology, 85, 1220-1234.
26. DiCarlo, J. J., Johnson, K. O., &Hsiao, S. S. (1998). Structure of receptive fields in area 3b of primary somatosensory cortex in the alert monkey. Journal of Neuroscience, 18(7), 2626-2645.
27. Edin, F., Machens, C., Schutze, H., & Herz, A. (2004). Searching for optimal sensory signals: Iterative stimulus reconstruction in closed-loop experiments. Journal of Computational Neuroscience, 17(1), 47-56.
28. Eggermont, J. J. (1993).Wiener and Volterra analyses applied to the auditory system. Hearing Research, 66(2), 177-201.
29. Ergun, A., Barbieri, R., Eden, U. T.,Wilson,M.A., & Brown, E.N. (2007). Construction of point process adaptive filter algorithms for neural systems using sequential Monte Carlo methods. IEEE Transactions on Biomedical Engineering, 54(3), 419-428.
30. Fabian, V. (1978). On asymptotically efficient recursive estimation. Annals of Statistics, 6, 854-866.
31. Fedorov, V. V. (1972). Theory of optimal experiments. Orlando, FL: Academic Press.
32. Foldiak, P. (2001). Stimulus optimisation in primary visual cortex. Neurocomputing, 38-40, 1217-1222.
33. Fortin, C. (2000). A survey of the trust region subproblem within a semidefinite framework. Unpublished doctoral dissertation, University of Waterloo.
34. Gilad-Bachrach, R., Navot, A., & Tishby, N. (2005). Query by committee made real. In Y.Weiss, B. Scḧolkopf, & J. Platt (Eds.), Advances in neural information processing systems, 18 (pp. 443-450). Cambridge, MA: MIT Press.
35. Gollisch, T., Schutze, H., Benda, J., & Herz, A. V. M. (2002). Energy integration describes sound-intensity coding in an insect auditory system. Journal of Neuroscience, 22(23), 10434-10448.
36. Gu, M., & Eisenstat, S. C. (1994). A stable and efficient algorithm for the rank-one modification of the symmetrical eigenproblem. SIAM Journal on Matrix Analysis and Applications, 15(4), 1266-1276.
37. Haberman, S. (1977). Maximum likelihood estimation in exponential response models. Annals of Statistics, 5, 815-841.
38. Henderson, H., & Searle, S. R. (1981). On deriving the inverse of a sum of matrices. SIAM Review, 23, 53-60.
39. Kaelbling, L. P., Littman, M. L., & Moore, A. W. (1996). Reinforcement learning: A survey. Journal of Artificial Intelligence Research, 4, 237-285.
40. Keat, J., Reinagel, P., Reid, R. C., & Meister, M. (2001). Predicting every spike: A model for the responses of visual neurons. Neuron, 30, 803-817.
41. Kontsevich, L., & Tyler, C. (1999). Bayesian adaptive estimation of psychometric slope and threshold. Vision Research, 39, 2729-2737.
42. Lesica, N. A., & Stanley, G. B. (2005). Improved tracking of time-varying encoding properties of visual neurons by extended recursive least-squares. IEEE Trans. on Neural Systems and Rehabilitation Engineering, 13(2), 194-200.
43. Lewi, J., Butera, R., & Paninski, L. (2007). Efficient active learning with generalized linear models. In M. Meila & X. Shen (Eds.), Proceedings of the Eleventh International Workshop on Artificial Intelligence and Statistics. Available online at http://www.stat.umn.edu/~aistat/proceedings/start.htm.
44. Lewicki, M. S. (2002). Efficient coding of natural sounds. Nature Neuroscience, 5(4), 356-363.
45. Li, K. C., & Duan, N. (1989). Regression-analysis under link violation. Annals of Statistics, 17(3), 1009-1052.
46. Linden, J. F., Liu, R. C., Sahani, M., Schreiner, C. E., & Merzenich, M. M. (2003). Spectrotemporal structure of receptive fields in areas AI and AAF of mouse auditory cortex. Journal of Neurophysiology, 90, 2660-2675.
47. Lindley, D. V. (1956). On a measure of the information provided by an experiment. Annals of Mathematical Statistics, 27(4), 986-1005.
48. Machens, C., Gollisch, T., Kolesnikova, O., & Herz, A. (2005). Testing the efficiency of sensory coding with optimal stimulus ensembles. Neuron, 47(3), 447-456.
49. MacKay, D. J. C. (1992). Information-based objective functions for active data selection. Neural Computation, 4(4), 590-604.
50. MacKay, D. (2003). Information theory, inference, and learning algorithms. Cambridge: Cambridge University Press.
51. McCullagh, P., & Nelder, J. (1989). Generalized linear models. London: Chapman and Hall.
52. McLeish, D. L. (1999). Designing the future: A simple algorithm for sequential design of a generalized linear model. Journal of Statistical Planning and Inference, 78(1-2), 205-218.
53. Minka, T. P. (2001). Expectation propagation for approximate Bayesian inference. In Proc. 17th Conf. in Uncertainty in Artificial Intelligence (pp. 362-369). San Francisco: Morgan Kaufmann.
54. Movellan, J. R. (2005). Infomax control as a model of real time behavior: Theory and application to the detection of social contingency (Tech. Rep. 2005-1). San Diego, CA: University of California, San Diego, and Kyoto: ATR.
55. Nelken, I., Prut, Y., Vaadia, E., & Abeles, M. (1994). In search of the best stimulus: An optimization procedure for finding efficient stimuli in the cat auditory cortex. Hearing Research, 72, 237-253.
56. O'Connor, K. N., Petkov, C. I.,& Sutter,M. L. (2005). Adaptive stimulus optimization for auditory cortical neurons. Journal of Neurophysiology, 94(6), 4051-4067.
57. Paninski, L. (2004). Maximum likelihood estimation of cascade point-process neural encoding models. Network: Computation in Neural Systems, 15, 243-262.
58. Paninski, L. (2005). Asymptotic theory of information-theoretic experimental design. Neural Computation, 17(7), 1480-1507.
59. Paninski, L., Pillow, J., & Lewi, J. (2007). Computational neuroscience: Theoretical insights into brain function. Amsterdam: Elsevier.
60. Paninski, L., Shoham, S., Fellows, M. R., Hatsopoulos, N. G., & Donoghue, J. P. (2004). Superlinear population encoding of dynamic hand trajectory in primary motor cortex. Journal of Neuroscience, 24(39), 8551-8561.
61. Patterson, R., Robinson, K., Holdsworth, J., McKeown, D., Zhang, C., & Allerhand, M. (1992). Complex sounds and auditory images. In Auditory Physiology and Perception, Proceedings 9th International Symposium on Hearing (pp. 429-446). Amsterdam: Elsevier.
62. Pillow, J. W., Paninski, L., Uzzell, V. J., Simoncelli, E. P., & Chichilnisky, E. J. (2005). Prediction and decoding of retinal ganglion cell responses with a probabilistic spiking model. J. Neurosci., 25(47), 11003-11013.
63. Ringach, D. L. (2002). Spatial structure and symmetry of simple-cell receptive fields in macaque primary visual cortex. J. Neurophysiol, 88(1), 455-463.
64. Rosenberger, W. F., & Hu, M. X. (2002). On the use of generalized linear models following a sequential design. Statistics and Probability Letters, 56(2), 155-161.
65. Roy, A., Ghosal, S., & Rosenberger, W. F. (in press). Convergence properties of sequential Bayesian D-optimal designs with applications to phase I clinical trials. Journal of Statistical Planning and Inference.
66. Rust, N. C., Mante, V., Simoncelli, E. P., & Movshon, J. A. (2006). How MT cells analyze the motion of visual patterns. Nature Neuroscience, 9(11), 1421-1431.
67. Schein, A. (2005). Active learning for logistic regression. Unpublished doctoral dissertation, University of Pennsylvania.
68. Seeger, M. (2007). Low rank updates for the Cholesky decomposition (Tech. Rep.). Berkeley: University of California.
69. Seeger, M., Gerwinn, S., & Bethge, M. (2007). Bayesian inference for sparse generalized linear models. In Machine Learning: ECML 2007. Berlin: Springer.
70. Seeger, M., Steinke, F., & Tsuda, K. (2007). Bayesian inference and optimal design in the sparse linear model. In Proc. 11th International Workshop on Artificial Intelligence and Statistics. N.P.: Society for Artificial Intelligence and Statistics.
71. Sharia, T. (2007). Recursive parameter estimation: Asymptotic expansion (Tech. Rep.) London: University of London.
72. Simoncelli, E., Paninski, L., Pillow, J., & Schwartz, O. (2004). Characterization of neural responses with stochastic stimuli. In M. Gazzaniga (Ed.), The cognitive neurosciences. (3rd ed.). Cambridge, MA: MIT Press.
73. Smith, E. C., & Lewicki, M. S. (2006). Efficient auditory coding. Nature, 439(7079), 978-982.
74. Theunissen, F. E., David, S. V., Singh, N. C., Hsu, A., Vinje, W. E., & Gallant, J. L. (2001). Estimating spatio-temporal receptive fields of auditory and visual neurons from their responses to natural stimuli. Network-Computation in Neural Systems, 12(3), 289-316.
75. Todorov, E. (2006). Bayesian brain. Cambridge, MA: MIT Press.
76. Truccolo, W., Eden, U. T., Fellows, M. R., Donoghue, J. P., & Brown, E. N. (2005). A point process framework for relating neural spiking activity to spiking history, neural ensemble, and extrinsic covariate effects. Journal of Neurophysiology, 93(2), 1074-1089.
77. van der Vaart, A. (1998). Asymptotic statistics. Cambridge: Cambridge University Press.
78. Warmuth, M. K., Liao, J., Ratsch, G., Mathieson, M., Putta, S., & Lemmen, C. (2003). Active learning with support vector machines in the drug discovery process. Journal of Chemical Information and Computer Sciences, 43(2), 667-673.
79. Watson, A., & Pelli, D. (1983). Quest: A Bayesian adaptive psychophysical method. Perception and Psychophysics, 33, 113-120.
80. Wedderburn, R. (1976). On the existence and uniqueness of the maximum likelihood estimator for certain generalized linear models. Biometrika, 63, 27-32.
81. Wu, C. F. J. (1985). Asymptotic inference from sequential design in a nonlinear situation. Biometrika, 72(3), 553-558.
82. Wu, M. C. K., David, S. V., & Gallant, J. L. (2006). Complete functional characterization of sensory neurons by system identification. Annual Review of Neuroscience, 29, 477-505.
83. Zhang, K., & erson, M., & Young, E. (2004). Saddle-point property of nonlinear sensory response. In Proceedings, Computational and Systems Neuroscience Meeting. Available online at http://cosyne.org/c/5/5a/COSYNE04 Abstracts.pdf.