Methodological considerations for investigating the microdynamics of social interaction development

IEEE Transactions on Autonomous Mental Development

Volumn 5, Issue 3, 2013, Pages 258-270

  De Barbaro, K ^a   Johnson, C M ^a   Forster, D ^a   Deak, G O ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Cognitive ethnography; development; infancy; methodology; parenting; sequential analysis; social interaction; systems theory

Indexed keywords

COGNITIVE ETHNOGRAPHIES; DEVELOPMENT; INFANCY; METHODOLOGY; PARENTING; SEQUENTIAL ANALYSIS; SOCIAL INTERACTIONS;

ARTIFICIAL INTELLIGENCE; SOFTWARE ENGINEERING; SYSTEM THEORY;

SOCIAL SCIENCES;

EID: 84884517603     PISSN: 19430604     EISSN: None     Source Type: Journal    
DOI: 10.1109/TAMD.2013.2276611     Document Type: Article

References (93)

1. L. Adamson and R. Bakeman, "The development of shared attention during infancy," Annal. Child Develop., vol. 8, pp. 1-41, 1991.
2. L. B. Adamson and R. Bakeman, "Mothers' communicative acts: changes during infancy," Infant Behav. Develop., vol. 7, no. 4, pp. 467-478, 1984.
3. K. E. Adolph, S. R. Robinson, J. W. Young, and F. Gill-Alvarez, "What is the shape of developmental change," Psychol. Rev., vol. 115, no. 3, p. 527, 2008.
4. G. Aston-Jones and J. D. Cohen, "An integrative theory of locus coeruleus-norepinephrine function: Adaptive gain and optimal performance," Annu. Rev. Neurosci., vol. 28, no. 1, pp. 403-450, 2005. (Pubitemid 41098911)
5. R. Bakeman and J. Gottman, Observing Interaction: An introduction to sequential analysis. Cambridge, U.K.: Cambridge Univ. Press, 1997.
6. R. Bakeman and V. Quera, Analyzing Interaction: Sequential analysis with SDIS and GSEQ. Cambridge, U.K.: Cambridge Univ. Press, 1995.
7. R. Bakeman and V. Quera, Sequential Analysis and Observational Methods for the Behavioral Sciences. Cambridge, U.K.: Cambridge Univ. Press, 2011.
8. R. Bakeman, V. Quera, D. McArthur, and B. F. Robinson, "Detecting sequential patterns and determining their reliability with fallible observers," Psychol. Methods, vol. 2, no. 4, pp. 357-370, 1997. (Pubitemid 127453677)
9. M. S. Bartlett, J. C. Hager, P. Ekman, and T. J. Sejnowski, "Measuring facial expressions by computer image analysis," Psychophysiology, vol. 36, no. 2, pp. 253-263, 1999. (Pubitemid 29130001)
10. D. S. Bennett, M. Bendersky, andM. Lewis, "Does the organization of emotional expression change over time Facial expressivity from 4 to 12 mos," Infancy, vol. 8, no. 2, pp. 167-187, 2005. (Pubitemid 41701137)
11. R. Bigsby, W. Coster, B. M. Lester, and M. R. Peucker, "Motor behavioral cues of term and preterm infants at 3 mos," Infant Behav. Develop., vol. 19, no. 3, pp. 295-307, 1996. (Pubitemid 126399358)
12. T. B. Brazelton, B. Koslowski, and M. Main, "The origins of reciprocity: The early mother-infant interaction," in The Effect of the Infant on its Caregiver. New York, NY, USA: Wiley, 1974, pp. 49-76.
13. J. T. Cacioppo, L. G. Tassinary, and G. Berntson, Handbook of Psychophysiology. Cambridge, U.K.: Cambridge Univ. Press, 2007.
14. J. J. Campos, D. I. Anderson, M. A. Barbu-Roth, E. M. Hubbard, M. J. Hertenstein, and D. Witherington, "Travel broadens the mind," Infancy, vol. 1, no. 2, pp. 149-219, 2000.
15. H. Choi, C. Yu, L. Smith, and O. Sporns, "From Data Streams to Information Flow: Information Exchange in Child-Parent Interaction Experiment and Data Preprocessing," presented at the 33nd Annu. Conf. Cogn. Sci. Soc., .
16. M. W. Clearfield, "Learning to walk changes infants' social interactions," Infant Behav. Develop., vol. 34, no. 1, pp. 15-25, 2011.
17. J. Cohen, "A coefficient of agreement for nominal scales," Edu. Psychol. Measur., vol. 20, no. 1, pp. 37-46, 1960.
18. J. Cohn and E. Tronick, "Mother-infant face-to-face interaction: The sequence of dyadic states at 3, 6, and 9 mos," Develop. Psychol., vol. 23, no. 1, p. 68, 1987.
19. J. F. Cohn and E. Z. Tronick, "Mother-infant face-to-face interaction: Influence is bidirectional and unrelated to periodic cycles in either partner's behavior," Develop. Psychol., vol. 24, no. 3, p. 386, 1988.
20. M. Cole, Cultural psychology: A once and future discipline. Boston, MA, USA: Harvard Univ. Press, 1996.
21. J. Danly, J. A. Acuña, and G. O. Deák, "Infant attention-following at home: a longitudinal study from 4-9 mos," presented at the Int. Conf. Develop. Learn., Shanghai, China, 2009.
22. K. de Barbaro, A. Chiba, and G. O. Deák, "Micro-analysis of infant looking in a naturalistic social setting: insights from biologically based models of attention," Develop. Sci., vol. 14, no. 5, pp. 1150-1160, 2011.
23. K. de Barbaro, C. M. Johnson, and G. O. Deák, "Twelve-mo "Social Revolution" Emerges from Mother-Infant Sensory-Motor Coordination: A Longitudinal Investigation," Human Develop., 2013.
24. K. de Barbaro, C. M. Johnson, D. Forster, and G. Deák, Infant Sensory-Motor Decoupling Contributes To 12 mo Social "Revolution": A Longitudinal Investigation Of Mother-Infant-Object Interactions, submitted for publication.
25. G. O. Deák, A. Krasno, J. Triesch, J. Lewis, and L. Sepeta, "Watch the hands: Infants learn to follow gaze by seeing adults manipulate objects," Develop. Sci., to be published.
26. G. O. Deák, T. A. Walden, M. Yale Kaiser, and A. Lewis, "Driven from distraction: How infants respond to parents' attempts to elicit and re-direct their attention," Infant Behav. Develop., vol. 31, no. 1, pp. 34-50, 2008.
27. P. Ekman and E. L. Rosenberg, What the face reveals: Basic and applied studies of spontaneous expression using the Facial Action Coding System (FACS). London, U.K.: Oxford Univ. Press, 1997.
28. J. Elman, "Development: It's about time," Develop. Sci., vol. 6, no. 4, pp. 430-433, 2003. (Pubitemid 37052816)
29. R. Feldman, R. Magori-Cohen, G. Galili, M. Singer, and Y. Louzoun, "Mother and infant coordinate heart rhythms through episodes of interaction synchrony," Infant Behav. Develop., vol. 34, no. 4, pp. 569-577, 2011.
30. T. M. Field, "Infant gaze aversion and heart rate during face-to-face interactions," Infant Behav. Develop., vol. 4, pp. 307-315, 1981. (Pubitemid 12131995)
31. J. Fleiss, Statistical measures for rates and proportions. Hoboken, NJ, USA: Wiley, 1981.
32. A. Fogel, "Movement and communication in human infancy: The social dynamics of development," Human Movement Sci., vol. 11, no. 4, pp. 387-423, 1992.
33. A. Fogel, Developing Through Relationships. Chicago, IL, USA: Univ. Chicago Press, 1993.
34. A. Fogel and E. Thelen, "Development of early expressive and communicative action: Reinterpreting the evidence from a dynamic systems perspective," Develop. Psychol., vol. 23, no. 6, p. 747, 1987.
35. D. Forster, "Consort turnovers as distributed cognition in Olive baboons: A distributed approach to mind," Cogn. Animal, pp. 163-171, 2002.
36. D. Forster and P. F. Rodriguez, "Social Complexity and Distributed Cognition in Olive Baboons (Papio anubis): Adding System Dynamics to Analysis of Interaction Data," Aquatic Mammals, vol. 32, no. 4, pp. 528-543, 2006.
37. A. Fouse, N. Weibel, E. Hutchins, and J. D. Hollan, "Chronoviz: A system for supporting navigation of time-coded data," presented at the 2011 Annu. Conf. Extended Abstracts Human Factors Comput.Syst., 2011.
38. J. M. Franchak, K. S. Kretch, K. C. Soska, and K. E. Adolph, "Head Mounted Eye Tracking: A New Method to Describe Infant Looking," Child Develop., 2011.
39. D. Fricker, H. Zhang, and C. Yu, "Sequential pattern mining of multimodal data streams in dyadic interactions," presented at the 2011 IEEE Int. Conf. Develop. Learn., 2011.
40. E. J. Gibson, "Exploratory behavior in the development of perceiving, acting, and the acquiring of knowledge," Annu. Rev. Psychol., vol. 39, no. 1, pp. 1-42, 1988.
41. A. Gnisci, R. Bakeman, and V. Quera, "Blending qualitative and quantitative analyses in observing interaction: Misunderstandings, applications and proposals," Int. J. Mult. Res. Approaches, vol. 2, no. 1, pp. 15-30, 2008.
42. L. J. Gogate, L. E. Bahrick, and J. D. Watson, "A study of multimodal motherese: The role of temporal synchrony between verbal labels and gestures," Child Develop., vol. 71, no. 4, pp. 878-894, 2003.
43. M. H. Goldstein and J. A. Schwade, "Social feedback to infants' babbling facilitates rapid phonological learning," Psychol. Sci., vol. 19, no. 5, p. 515, 2008.
44. C. Goodwin, "The co-operative, transformative organization of human action and knowledge," J. Pragmatics, 2012.
45. J. Gottman, Time-Series Analysis: A Comprehensive Introduction for Social Scientists. Cambridge, U.K.: Cambridge Univ. Press, 1981.
46. J. Gottman and A. Roy, Sequential Analysis: A Guide for Behavioral Researchers. Cambridge, U.K.: Cambridge Univ. Press, 1990.
47. C. M. Hoehner, L. K. Brennan Ramirez,M. B. Elliott, S. L. Handy, and R. C. Brownson, "Perceived and objective environmental measures and physical activity among urban adults,"Amer. J. Prev.Med., vol. 28, no. 2, pp. 105-116, 2005. (Pubitemid 40203433)
48. H. C. Hsu and A. Fogel, "Stability and Transitions in Mother-Infant Face-to-Face Communication During the First 6 mos: A Microhistorical Approach," Devel. Psychol., vol. 39, no. 6, p. 1061, 2003.
49. E. Hutchins, Cognition in the Wild. Cambridge, MA, USA: MIT Press, 1995.
50. E. Hutchins, "Distributed Cognition," Int. Encyclopedia Soc. Behav. Sci., pp. 2068-2072, 2001.
51. E. Hutchins and C. M. Johnson, "Modeling the emergence of language as an embodied collective cognitive activity," Topics Cogn. Sci., vol. 1, no. 3, pp. 523-546, 2009.
52. J. Jaffe, D. N. Stern, and J. C. Peery, ""Conversational" coupling of gaze behavior in prelinguistic human development," J. Psycholinguist Res., vol. 2, no. 4, pp. 321-329, 1973.
53. C. M. Johnson, "Distributed primate cognition: A review," Animal Cogn., vol. 3, no. 4, pp. 167-183, 2001.
54. C. M. Johnson, "The micro-ethology of social attention: 'Brightness' in bonobos.," Folia Primatologica, vol. 75, no. S1, p. 175, 2004.
55. C. M. Johnson, "Observing Cognitive Complexity in Primates and Cetaceans," Int. J. Comparative Psychol., vol. 23, pp. 587-624, 2010.
56. C. M. Johnson andM. R. Karin-D Arcy, "Social attention in nonhuman primates: A behavioral review," Aquatic Mammals, vol. 32, no. 4, p. 423, 2006.
57. K. Kaye and A. Fogel, "The temporal structure of face-to-face communication between mothers and infants," Develop. Psychol., vol. 16, no. 5, p. 454, 1980.
58. J. Kelso, Dynamic Patterns: The Self Organization of Brain and Behaviour. Cambridge, MA, USA: MIT Press, 1995.
59. B. J. King, The Dynamic Dance: Nonvocal Communication in African Great Apes. Boston, MA, USA: Harvard Univ. Press, 2004.
60. T. Leventhal and J. Brooks-Gunn, "The neighborhoods they live in: The effects of neighborhood residence on child and adolescent outcomes," Psychol. Bulletin, vol. 126, no. 2, p. 309, 2000.
61. Y. Liao, S. Makeig, Z. Acar, and G. Deák, "EEG imaging of toddlers during "live" dyadic turn-taking: Mu-Rhythm modulation and source clusters in natural action observation and execution," presented at the Human Brain Mapping, Beijing, China.
62. G. Littlewort, J.Whitehill, T.Wu, I. Fasel, M. Frank, J. Movellan, and M. Bartlett, "The computer expression recognition toolbox (CERT)," presented at the 2011 IEEE Int. Conf. Automatic Face Gesture Recognit. Workshops (FG 2011), 2011.
63. S. Makeig, K. Gramann, T.-P. Jung, T. J. Sejnowski, and H. Poizner, "Linking brain, mind and behavior," Int. J. Psychophysiol., vol. 73, no. 2, pp. 95-100, 2009.
64. D. S. Messinger, M. H. Mahoor, S.-M. Chow, and J. F. Cohn, "Automated measurement of facial expression in infant-mother interaction: A pilot study," Infancy, vol. 14, no. 3, pp. 285-305, 2009.
65. A. Noë, Action in Perception. Cambridge,MA, USA: theMIT Press, 2004.
66. D. O. Olgun, P. A. Gloor, and A. S. Pentland, "Capturing individual and group behavior with wearable sensors," presented at the AAAI Spring Symp. Human Behav. Model., 2009.
67. H. Oster, D. Hegley, and L. Nagel, "Adult judgments and fine-grained analysis of infant facial expressions: Testing the validity of a priori coding formulas," Develop. Psychol., vol. 28, pp. 1115-1115, 1992.
68. S. Oyama, The Ontogeny of Information: Developmental Systems and Evolution. Durham, NC, USA: Duke Univ. press, 1985/2000.
69. J. A. Pineda, "The functional significance of mu rhythms: Translating "seeing" and "hearing" into "doing", " Brain Res. Rev., vol. 50, no. 1, pp. 57-68, 2005. (Pubitemid 41607515)
70. R. L. Repetti, "Short-termand long-term processes linking job stressors to father-child interaction," Social Develop., vol. 3, no. 1, pp. 1-15, 1994.
71. B. Rogoff and J. Lave, Everyday Cognition: Its Development in Social Context. Boston, MA, USA: Harvard Univ. Press, 1984.
72. R. S. Siegler, Emerging Minds: The Process of Change in Children's Thinking. London, U.K.: Oxford Univ. Press, 1996.
73. L. Smith and E. Thelen, "Development as a dynamic system," Trends Cogn. Sci., vol. 7, no. 8, pp. 343-348, 2003. (Pubitemid 36952415)
74. L. B. Smith, C. Yu, and A. F. Pereira, "Not your mother's view: The dynamics of toddler visual experience," Develop. Sci., vol. 14, no. 1, pp. 9-17, 2011, 10.1111/j.1467-7687.2009.00947.x.
75. K. C. Soska, K. E. Adolph, and S. P. Johnson, "Systems in development: Motor skill acquisition facilitates three-dimensional object completion," Develop. Psychol., vol. 46, no. 1, p. 129, 2010.
76. J. P. Spencer and S. Perone, "Defending qualitative change: The view from dynamical systems theory," Child Develop., vol. 79, no. 6, pp. 1639-1647, 2008.
77. T. Striano and P. Rochat, "Developmental link between dyadic and triadic social competence in infancy," Brit. J. Develop. Psychol., vol. 17, no. 4, pp. 551-562, 1999.
78. S. Strumand D. Forster, "Nonmaterial artifacts: A distributed approach to mind," in Proc. In the mind's eye: Multidisciplinary Approaches to the Evol. of Human Cogn. I: International Monographs in Prehistory, Ann Arbor, MI, USA, 2001, pp. 63-82.
79. S. Strum, D. Forster, and E.Hutchins,"Why Machiavellian intelligence may not be Machiavellian," Machiavellian Intell. II: Extensions Evaluations, pp. 50-85, 1997.
80. L. A. Suchman, Plans and situated actions: The problem of humanmachine communication. Cambridge, U.K.: Cambridge Univ. Press, 1987.
81. E. Thelen, "Rhythmical behavior in infancy: An ethological perspective," Develop. Psychol., vol. 17, no. 3, p. 237, 1981.
82. E. Thelen,D. Corbetta,K. Kamm, J. P. Spencer, K. Schneider, and R. F. Zernicke, "The transition to reaching: Mapping intention and intrinsic dynamics," Child Develop., vol. 64, no. 4, pp. 1058-1098, 1993.
83. E. Thelen and L. B. Smith, A Dynamic Systems Approach to theDevelopment of Cognition and Action. Cambridge, MA, USA: MIT Press, 1994.
84. L.L. S. Vygotsky, Mind in Society: The Development of Higher Psychological Processes. Cambridge, MA, USA: Harvard Univ. Press., 1978.
85. M. K. Weinberg and E. Z. Tronick, "Beyond the face: An empirical study of infant affective configurations of facial, vocal, gestural, and regulatory behaviors," Child Develop., vol. 65, no. 5, pp. 1503-1515, 1994.
86. P.Wittenburg, H. Brugman, A. Russel, A. Klassmann, and H. Sloetjes, "ELAN: a professional framework for multimodality research," presented at the LREC, .
87. D.Wood, J. S. Bruner, and G. Ross, "The Role of Tutoring in Problem Solving," J. Child Psychol. Psychiatry, vol. 17, no. 2, pp. 89-100, 1976.
88. J. J. Wood and R. L. Repetti, "What gets dad involved A longitudinal study of change in parental child caregiving involvement," J. Family Psychol., vol. 18, no. 1, pp. 237-249, 2004. (Pubitemid 38389722)
89. C. Yu, L. B. Smith, and A.F. Pereira, ". In grounding word learning in multimodal sensorimotor interaction," in Proc. 30th Annu. Conf. Cogn. Sci. Soc., 2008, pp. 1017-1022.
90. C. Yu, L. B. Smith, H. Shen, A. F. Pereira, and T. Smith, "Active information selection: Visual attention through the hands," IEEE Trans. Autonom. Mental Develop., vol. 1, no. 2, pp. 141-151, Aug. 2009.
91. C. Yu, T. G. Smith, S. Hidaka,M. Scheutz, and L. B. Smith, "A datadriven paradigm to understand multimodal communication in humanhuman and human-robot interaction," Adv. Intell. Data Anal., vol. IX, pp. 232-244, 2010, Springer.
92. C. Yu, D. Yurovsky, and T. L. Xu, "Visual data mining: An exploratory approach to analyzing temporal patterns of eye movements," Infancy, vol. 17, no. 1, pp. 33-60, 2012.
93. P. Zukow-Goldring and M. A. Arbib, "Affordances, effectivities, and assisted imitation: Caregivers and the directing of attention," Neurocomputing, vol. 70, no. 13-15, pp. 2181-2193, 2007. (Pubitemid 46825366)