A developmental approach to machine learning?

Frontiers in Psychology

Volumn 8, Issue DEC, 2017, Pages

  Smith, Linda B ^a   Slone, Lauren K ^a  

^a INDIANA UNIVERSITY   (United States)

Author keywords

Active vision; Development; Egocentric vision; Natural environment; Object recognition

Indexed keywords

EID: 85036621104     PISSN: None     EISSN: 16641078     Source Type: Journal    
DOI: 10.3389/fpsyg.2017.02124     Document Type: Article

References (83)

1. Agrawal, P., Nair, A. V., Abbeel, P., Malik, J., and Levine, S. (2016). "Learning to poke by poking: experiential learning of intuitive physics," in Advances in Neural Information Processing Systems, eds S. Becker, S. Thrun, and K. Obermayer (Cambridge, MA: MIT Press), 5074-5082
2. Ahissar, M., and Hochstein, S. (1997). Task difficulty and the specificity of perceptual learning. Nature 387, 401-406. doi: 10.1038/387401a0
3. Augustine, E., Jones, S. S., Smith, L. B., and Longfield, E. (2015). Relations among early object recognition skills: objects and letters. J. Cogn. Dev. 16, 221-235. doi: 10.1080/15248372.2013.815620
4. Bambach, S., Crandall, D. J., Smith, L. B., and Yu, C. (2017). "An egocentric perspective on active vision and visual object learning in toddlers," in Proceedings of the Seventh Joint IEEE Conference on Development and Learning and on Epigenetic Robotics, Lisbon
5. Bengio, Y., Louradour, J., Collobert, R., and Weston, J. (2009). "Curriculum learning," in Proceedings of the 26th Annual International Conference on Machine Learning (New York, NY: ACM), 41-48. doi: 10.1145/1553374.1553380
6. Bloom, P. (2000). How Children Learn the Meanings of Words. Cambridge, MA: The MIT Press
7. Byrge, L., Sporns, O., and Smith, L. B. (2014). Developmental process emerges from extended brain-body-behavior networks. Trends Cogn. Sci. 18, 395-403. doi: 10.1016/j.tics.2014.04.010
8. Cadieu, C. F., Hong, H., Yamins, D. L., Pinto, N., Ardila, D., Solomon, E. A., et al. (2014). Deep neural networks rival the representation of primate IT cortex for core visual object recognition. PLOS Comput. Biol. 10:e1003963. doi: 10.1371/journal.pcbi.1003963
9. Clerkin, E. M., Hart, E., Rehg, J. M., Yu, C., and Smith, L. B. (2017). Real-world visual statistics and infants' first-learned object names. Philos. Trans. R. Soc. B 372:20160055. doi: 10.1098/rstb.2016.0055
10. Collisson, B. A., Grela, B., Spaulding, T., Rueckl, J. G., and Magnuson, J. S. (2015). Individual differences in the shape bias in preschool children with specific language impairment and typical language development: theoretical and clinical implications. Dev. Sci. 18, 373-388. doi: 10.1111/desc.12219
11. Elman, J. L. (1993). Learning and development in neural networks: the importance of starting small. Cognition 48, 71-99. doi: 10.1016/0010-0277(93)90058-4
12. Farzin, F., Rivera, S. M., and Whitney, D. (2010). Spatial resolution of conscious visual perception in infants. Psychol. Sci. 21, 1502-1509. doi: 10.1177/0956797610382787
13. Fathi, A., Ren, X., and Rehg, J. M. (2011). "Learning to recognize objects in egocentric activities," in Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (Piscataway, NJ: IEEE), 3281-3288. doi: 10.1109/CVPR.2011.5995444
14. Fausey, C. M., Jayaraman, S., and Smith, L. B. (2016). From faces to hands: changing visual input in the first two years. Cognition 152, 101-107. doi: 10.1016/j.cognition.2016.03.005
15. Fenson, L., Dale, P. S., Reznick, J. S., Bates, E., Thal, D. J., Pethick, S. J., et al. (1994). Variability in early communicative development. Monogr. Soc. Res. Child Dev. 59, 1-173. doi: 10.2307/1166093
16. Földiák, P. (1991). Learning invariance from transformation sequences. Neural Comput. 3, 194-200. doi: 10.1162/neco.1991.3.2.194
17. Foulsham, T., Walker, E., and Kingstone, A. (2011). The where, what and when of gaze allocation in the lab and the natural environment. Vision Res. 51, 1920-1931. doi: 10.1016/j.visres.2011.07.002
18. Gauthier, I., Skudlarski, P., Gore, J. C., and Anderson, A. W. (2000). Expertise for cars and birds recruits brain areas involved in face recognition. Nat. Neurosci. 3, 191-197. doi: 10.1038/72140
19. Gauthier, I., and Tarr, M. J. (2016). Visual object recognition: do we (finally) know more now than we did? Annu. Rev. Vis. Sci. 2, 377-396. doi: 10.1146/annurev-vision-111815-114621
20. Gershkoff-Stowe, L., and Smith, L. B. (2004). Shape and the first hundred nouns. Child Dev. 75, 1098-1114. doi: 10.1111/j.1467-8624.2004.00728.x
21. Gregor, K., Danihelka, I., Graves, A., Rezende, D. J., and Wierstra, D. (2015). DRAW: a recurrent neural network for image generation. arxiv.1502.04623
22. Halberda, J., Mazzoccoi, M. M., and Feigenson, L. (2008). Individual differences in non-verbal number acuity correlate with maths achievement. Nature 455, 665-668. doi: 10.1038/nature07246
23. Hochstein, S., and Ahissar, M. (2002). View from the top: hierarchies and reverse hierarchies in the visual system. Neuron 36, 791-804. doi: 10.1016/S0896-6273(02)01091-7
24. Houthooft, R., Chen, X., Duan, Y., Schulman, J., De Turck, F., and Abbeel, P. (2016). Curiosity-driven exploration in deep reinforcement learning via bayesian neural networks. arxiv.1605.09674
25. James, K. H., Jones, S. S., Smith, L. B., and Swain, S. N. (2014a). Young children's self-generated object views and object recognition. J. Cogn. Dev. 15, 393-401. doi: 10.1080/15248372.2012.749481
26. James, K. H., Jones, S. S., Swain, S., Pereira, A., and Smith, L. B. (2014b). Some views are better than others: evidence for a visual bias in object views self-generated by toddlers. Dev. Sci. 17, 338-351. doi: 10.1111/desc.12124
27. Jayaraman, S., Fausey, C. M., and Smith, L. B. (2015). The faces in infant-perspective scenes change over the first year of life. PLOS ONE 10:e0123780. doi: 10.1371/journal.pone.0123780
28. Jayaraman, S., Fausey, C. M., and Smith, L. B. (2017). Why are faces denser in the visual experiences of younger than older infants? Dev. Psychol. 53, 38-49. doi: 10.1037/dev0000230
29. Jones, S. S. (2003). Late talkers show no shape bias in a novel name extension task. Dev. Sci. 6, 477-483. doi: 10.1111/1467-7687.00304
30. Jones, S. S., and Smith, L. B. (2005). Object name learning and object perception: a deficit in late talkers. J. Child Lang. 32, 223-240. doi: 10.1017/S0305000904006646
31. Kidd, C., and Hayden, B. Y. (2015). The psychology and neuroscience of curiosity. Neuron 88, 449-460. doi: 10.1016/j.neuron.2015.09.010
32. Kourtzi, Z., and DiCarlo, J. J. (2006). Learning and neural plasticity in visual object recognition. Curr. Opin. Neurobiol. 16, 152-158. doi: 10.1016/j.conb.2006.03.012
33. Kovack-Lesh, K. A., McMurray, B., and Oakes, L. M. (2014). Four-month-old infants' visual investigation of cats and dogs: relations with pet experience and attentional strategy. Dev. Psychol. 50, 402-413. doi: 10.1037/a0033195
34. Kriegeskorte, N. (2015). Deep neural networks: a new framework for modeling biological vision and brain information processing. Annu. Rev. Vis. Sci. 1, 417-446. doi: 10.1146/annurev-vision-082114-035447
35. Krueger, K. A., and Dayan, P. (2009). Flexible shaping: how learning in small steps helps. Cognition 110, 380-394. doi: 10.1016/j.cognition.2008.11.014
36. Landau, B., Smith, L. B., and Jones, S. S. (1988). The importance of shape in early lexical learning. Cogn. Dev. 3, 299-321. doi: 10.1037/xlm0000476
37. LeBarton, E. S., and Iverson, J. M. (2013). Fine motor skill predicts expressive language in infant siblings of children with autism. Dev. Sci. 16, 815-827. doi: 10.1111/desc.12069
38. Li, N., and DiCarlo, J. J. (2008). Unsupervised natural experience rapidly alters invariant object representation in visual cortex. Science 321, 1502-1507. doi: 10.1126/science.1160028
39. Liu, W., Humayun, A., Tay, C. C., Smith, L. B., Rehg, J. M., and Song, L. (2017). "Iterative machine teaching," in Proceedings of the International Conference on Machine Learning (ICML) New York, NY
40. MacNamara, J. (1982). Names for Things: A Study of Child Language. Cambridge, MA: MIT Press
41. Malt, B. C., and Majid, A. (2013). How thought is mapped into words. Wiley Interdiscip. Rev. Cogn. Sci. 4, 583-597. doi: 10.1002/wcs.1251
42. Marblestone, A., Wayne, G., and Kording, K. (2016). Towards an integration of deep learning and neuroscience. 10:94. doi: 10.3389/fncom.2016.00094
43. Maurer, D., Mondloch, C. J., and Lewis, T. L. (2007). Sleeper effects. Dev. Sci. 10, 40-47. doi: 10.1111/j.1467-7687.2007.00562.x
44. Mervis, C. B., Mervis, C. A., Johnson, K. E., and Bertrand, J. (1992). Studying early lexical development: the value of the systematic diary method. Adv. Infancy Res. 7, 291-378
45. Mnih, V., Heess, N., and Graves, A. (2014). "Recurrent models of visual attention," in Proceedings of the Advances in Neural Information Processing Systems (NIPS), La Jolla, CA, 2204-2212
46. Möhring, W., and Frick, A. (2013). Touching up mental rotation: effects of manual experience on 6-month-old infants' mental object rotation. Child Dev. 84, 1554-1565. doi: 10.1111/cdev.12065
47. Mondloch, C. J., Le Grand, R., and Maurer, D. (2002). Configural face processing develops more slowly than featural face processing. Perception 31, 553-566. doi: 10.1068/p3339
48. Oudeyer, P. Y. (2004). "Intelligent adaptive curiosity: a source of self-development," in Proceedings of the Fourth International Workshop on Epigenetic Robotics Lund University Cognitive Studies, eds L. Berthouze, H. Kozima, C. G. Prince, G. Sandini, G. Stojanov, G. Metta, et al. (Lund: LUCS), 117
49. Pereira, A. F., James, K. H., Jones, S. S., and Smith, L. B. (2010). Early biases and developmental changes in self-generated object views. J. Vis. 10, 22-22. doi: 10.1167/10.11.22
50. Perry, L. K., Samuelson, L. K., Malloy, L. M., and Schiffer, R. N. (2010). Learn locally, think globally: exemplar variability supports higher-order generalization and word learning. Psychol. Sci. 21, 1894-1902. doi: 10.1177/0956797610389189
51. Pinker, S., and Prince, A. (1988). On language and connectionism: analysis of a parallel distributed processing model of language acquisition. Cognition 28, 73-193. doi: 10.1016/0010-0277(88)90032-7
52. Potrzeba, E. R., Fein, D., and Naigles, L. (2015). Investigating the shape bias in typically developing children and children with autism spectrum disorders. Front. Psychol. 6:446. doi: 10.3389/fpsyg.2015.00446
53. Ritter, S., Barrett, D. G., Santoro, A., and Botvinick, M. M. (2017). Cognitive psychology for deep neural networks: a shape bias case study. arxiv.1706.08606
54. Rochat, P. (1992). Self-sitting and reaching in 5-to 8-month-old infants: the impact of posture and its development on early eye-hand coordination. J. Mot. Behav. 24, 210-220. doi: 10.1080/00222895.1992.9941616
55. Rosch, E., Mervis, C. B., Gray, W. D., Johnson, D. M., and Boyes-Braem, P. (1976). Basic objects in natural categories. Cogn. Psychol. 8, 382-439. doi: 10.1016/0010-0285(76)90013-X
56. Ruff, H. A. (1984). Infants' manipulative exploration of objects: effects of age and object characteristics. Dev. Psychol. 20, 9-20. doi: 10.1037/0012-1649.20.1.9
57. Rumelhart, D. E., and McClelland, J. L. (1986). "On learning the past tenses of English verbs," in Parallel Distributed Processing: Explorations in the Microstructure of Cognition: Psychological and Biological Models, Vol. 2, eds J. L. McClelland and D. E. Rumelhart PDP Research Group (Cambridge, MA: Bradford Books/MIT Press)
58. Salakhutdinov, R., Torralba, A., and Tenenbaum, J. (2011). "Learning to share visual appearance for multiclass object detection," in Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (Piscataway, NJ: IEEE), 1481-1488. doi: 10.1109/CVPR.2011.5995720
59. Samuelson, L. K. (2002). Statistical regularities in vocabulary guide language acquisition in connectionist models and 15-20-month-olds. Dev. Psychol. 38, 1016-1037. doi: 10.1037/0012-1649.38.6.1016
60. Samuelson, L. K., and Smith, L. B. (2005). They call it like they see it: spontaneous naming and attention to shape. Dev. Sci. 8, 182-198. doi: 10.1111/j.1467-7687.2005.00405.x
61. Schank, R. C. (1972). Conceptual dependency: a theory of natural language understanding. Cogn. Psychol. 3, 552-631. doi: 10.1016/0010-0285(72)90022-9
62. Silver, D., Huang, A., Maddison, C. J., Guez, A., Sifre, L., Van Den Driessche, G., et al. (2016). Mastering the game of Go with deep neural networks and tree search. Nature 529, 484-489. doi: 10.1038/nature16961
63. Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arxiv.1409.1556
64. Smith, L. B. (2003). Learning to recognize objects. Psychol. Sci. 14, 244-250. doi: 10.1111/1467-9280.03439
65. Smith, L. B. (2005). Action alters shape categories. Cogn. Sci. 29, 665-679. doi: 10.1207/s15516709cog0000_13
66. Smith, L. B. (2013). It's all connected: pathways in visual object recognition and early noun learning. Am. Psychol. 68, 618-629. doi: 10.1037/a0034185
67. Smith, L. B., Jones, S. S., Landau, B., Gershkoff-Stowe, L., and Samuelson, L. (2002). Object name learning provides on-the-job training for attention. Psychol. Sci. 13, 13-19. doi: 10.1111/1467-9280.00403
68. Smith, L. B., Yu, C., and Pereira, A. F. (2011). Not your mother's view: the dynamics of toddler visual experience. Dev. Sci. 14, 9-17. doi: 10.1111/j.1467-7687.2009.00947.x
69. Smith, L. B., Yu, C., Yoshida, H., and Fausey, C. M. (2015). Contributions of head-mounted cameras to studying the visual environments of infants and young children. J. Cogn. Dev. 16, 407-419. doi: 10.1080/15248372.2014.933430
70. Soska, K. C., Adolph, K. E., and Johnson, S. P. (2010). Systems in development: motor skill acquisition facilitates three-dimensional object completion. Dev. Psychol. 46, 129-138. doi: 10.1037/a0014618
71. Street, S. Y., James, K. H., Jones, S. S., and Smith, L. B. (2011). Vision for action in toddlers: the posting task. Child Dev. 82, 2083-2094. doi: 10.1111/j.1467-8624.2011.01655.x
72. Tek, S., Jaffery, G., Fein, D., and Naigles, L. R. (2008). Do children with autism spectrum disorders show a shape bias in word learning? Autism Res. 1, 208-222. doi: 10.1002/aur.38
73. Wiskott, L., and Sejnowski, T. J. (2002). Slow feature analysis: unsupervised learning of invariances. Neural Comput. 14, 715-770. doi: 10.1162/089976602317318938
74. Wood, J. N. (2013). Newborn chickens generate invariant object representations at the onset of visual object experience. Proc. Natl. Acad. Sci. U.S.A. 110, 14000-14005. doi: 10.1073/pnas.1308246110
75. Wood, J. N. (2015). Characterizing the information content of a newly hatched chick's first visual object representation. Dev. Sci. 18, 194-205. doi: 10.1111/desc.12198
76. Wood, J. N. (2016). A smoothness constraint on the development of object recognition. Cognition 153, 140-145. doi: 10.1016/j.cognition.2016.04.013
77. Wood, J. N., Prasad, A., Goldman, J. G., and Wood, S. M. (2016). Enhanced learning of natural visual sequences in newborn chicks. Anim. Cogn. 19, 835-845. doi: 10.1007/s10071-016-0982-5
78. Wood, J. N., and Wood, S. M. (2016). The development of newborn object recognition in fast and slow visual worlds. Proc. R. Soc. B 283:20160166. doi: 10.1098/rspb.2016.0166
79. Yamins, D. L., and DiCarlo, J. J. (2016). Eight open questions in the computational modeling of higher sensory cortex. Curr. Opin. Neurobiol. 37, 114-120. doi: 10.1016/j.conb.2016.02.001
80. Yee, M., Jones, S. S., and Smith, L. B. (2012). Changes in visual object recognition precede the shape bias in early noun learning. Front. Psychol. 3:533. doi: 10.3389/fpsyg.2012.00533
81. Yoshida, H., and Smith, L. B. (2005). Linguistic cues enhance the learning of perceptual cues. Psychol. Sci. 16, 90-95. doi: 10.1111/j.0956-7976.2005.00787.x
82. Yu, C., and Smith, L. B. (2012). Embodied attention and word learning by toddlers. Cognition 125, 244-262. doi: 10.1016/j.cognition.2012.06.016
83. Zorzi, M., Testolin, A., and Stoianov, I. P. (2013). Modeling language and cognition with deep unsupervised learning: a tutorial overview. Front. Psychol. 4:515. doi: 10.3389/fpsyg.2013.00515