The construct of psychophysiological reactivity: Statistical and psychometric issues

Developmental Review

Volumn 33, Issue 1, 2013, Pages 29-57

  Burt, Keith B ^a   Obradović, Jelena ^b  

^a UNIVERSITY OF VERMONT   (United States)

^b STANFORD UNIVERSITY   (United States)

Author keywords

Difference score; Latent variable modeling; Measurement of change; Psychophysiology; Reactivity; Residual score

Indexed keywords

EID: 84875122787     PISSN: 02732297     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.dr.2012.10.002     Document Type: Review

References (131)

1. Alink L.R.A., van IJzendoorn M.H., Bakermans-Kranenburg M.J., Mesman J., Juffer F., Koot H.M. Cortisol and externalizing behavior in children and adolescents: Mixed meta-analytic evidence for the inverse relation of basal cortisol and cortisol reactivity with externalizing behavior. Developmental Psychobiology 2008, 50(5):427-450.
2. Alkon A., Goldstein L.H., Smider N., Essex M.J., Kupfer D.J., Boyce W.T. Developmental and contextual influences on autonomic reactivity in young children. Developmental Psychobiology 2003, 42:64-78.
3. Bauer A., Quas J.A., Boyce W.T. Associations between physiological reactivity and children's behavior: Advantages of a multisystem approach. Journal of Developmental and Behavioral Pediatrics 2002, 23:102.
4. Beauchaine T.P. Vagal tone, development, and Gray's motivational theory: Toward an integrated model of autonomic nervous system functioning in psychopathology. Development and Psychopathology 2001, 13:183-214.
5. Beauchaine T.P., Gatzke-Kopp L., Mead H.K. Polyvagal theory and developmental psychopathology: Emotion dysregulation and conduct problems from preschool to adolescence. Biological Psychology 2007, 74:174-184.
6. Belsky J., Pluess M. Beyond diathesis-stress: Differential susceptibility to environmental influences. Psychological Bulletin 2009, 136(6):885-908.
7. Bergman L.R., Magnusson D. A person-oriented approach in research on developmental psychopathology. Development and Psychopathology 1997, 9:291-319.
8. Berntson G.G., Cacioppo J.T., Quigley K.S. Autonomic determinism: The modes of autonomic control, the doctrine of autonomic space, and the laws of autonomic constraint. Psychological Review 1991, 98(4):459-487.
9. Berntson, G. G., Quigley, K. S., & Lozano, D. (2007). Cardiovascular psychophysiology. Handbook of psychophysiology (3rd ed., pp. 182-210). Cambridge.
10. Berntson G.G., Uchino B.N., Cacioppo J.T. Origins of baseline variance and the Law of Initial Values. Psychophysiology 1994, 31:204-210.
11. Blomqvist N. On the relation between change and initial value. Journal of the American Statistical Association 1977, 72:746-749.
12. Booth A., Granger D.A., Shirtcliff E.A. Gender- and age-related differences in the association between social relationship quality and trait levels of salivary cortisol. Journal of Research on Adolescence 2008, 18(2):239-260.
13. Boyce W.T., Ellis B.J. Biological sensitivity to context: I. An evolutionary-developmental theory of the origins and functions of stress reactivity. Development and Psychopathology 2005, 17:271-301.
14. Brooker R.J., Buss K.A. Dynamic measures of RSA predict distress and regulation in toddlers. Developmental Psychobiology 2010, 52:372-382.
15. Brown T.A. Confirmatory factor analysis for applied research 2006, Guilford, New York.
16. Brown, A., Croudace, T., & Heron, J. (2011). Longitudinal data modelling [PowerPoint slides]. http://www.psychometrics.cam.ac.uk/uploads/documents/ESRC_RDI_April2011/ Part%201%20Change%20and%20Autoregressive.pdf.
17. Bush N.R., Alkon A., Obradović J., Stamperdahl J., Boyce W.T. Differentiating challenge reactivity from psychomotor activity in studies of children's psychophysiology: Considerations for theory and measurement. Journal of Experimental Child Psychology 2011, 110:62-79.
18. Buss K.A., Goldsmith H.H., Davidson R.J. Cardiac reactivity is associated with changes in negative emotion in 24-month-olds. Developmental Psychobiology 2005, 46:118-132.
19. Byrne B.M., Shavelson R.J., Muthén B. Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance. Psychological Bulletin 1989, 105:456-466.
20. Cacioppo J.T., Tassinary L.G. Inferring psychological significance from physiological signals. American Psychologist 1990, 45(1):16-28.
21. Calkins S.D., Graziano P.A., Keane S.P. Cardiac vagal regulation differentiates among children at risk for behavior problems. Biological Psychology 2007, 74:144-153.
22. Cohen J., Cohen P., West S.G., Aiken L.S. Applied multiple regression/correlation analysis for the behavioral sciences 2003, Lawrence Erlbaum Associates, Mahwah, NJ. 3rd ed.
23. Collins L.M., Lanza S.T. Latent class and latent transition analysis 2010, Wiley, Hoboken, NJ.
24. Cribbie R.A., Jamieson J. Structural equation models and the regression bias for measuring correlates of change. Educational and Psychological Measurement 2000, 60:893-907.
25. Cribbie R.A., Jamieson J. Decreases in posttest variance and the measurement of change. Methods of Psychological Research 2004, 9:37-55.
26. Cronbach L.J. Coefficient alpha and the internal structure of tests. Psychometrika 1951, 16(3):297-334.
27. Cronbach L.J., Furby L. How should we measure "change" -Or should we?. Psychological Bulletin 1970, 74(1):68-80.
28. Curran P.J. Have multilevel models been structural equation models all along?. Multivariate Behavioral Research 2003, 38(4):529-569.
29. Curtis W.J., Cicchetti D. Moving research on resilience into the 21st century: Theoretical and methodological considerations in examining the biological contributors to resilience. Development and Psychopathology 2003, 15:773-810.
30. Davey A. The trait-state distinction and its dialectic balance. New methods for the analysis of change 2001, 265-269. American Psychological Association, Washington, DC. L.M. Collins, A.G. Sayer (Eds.).
31. Del Giudice M., Ellis B.J., Shirtcliff E.A. The adaptive calibration model of stress responsivity. Neuroscience & Biobehavioral Reviews 2011, 35:1562-1592.
32. Del Giudice M., Hinnant J.B., Ellis B.J., El-Sheikh M. Adaptive patterns of stress responsivity: A preliminary investigation. Developmental Psychology 2012, 48(3):775-790.
33. Dickerson S.S., Kemeny M.E. Acute stressors and cortisol responses: A theoretical integration and synthesis of laboratory research. Psychological Bulletin 2004, 130:355-391.
34. Edwards J.R. Regression analysis as an alternative to difference scores. Journal of Management 1994, 20(3):683-689.
35. Edwards J.R. Ten difference score myths. Organizational Research Methods 2001, 4(3):265-287.
36. El-Sheikh M., Whitson S.A. Longitudinal relations between marital conflict and child adjustment: Vagal regulation as a protective factor. Journal of Family Psychology 2006, 20(1):30-39.
37. Farrell A.D. Structural equation modeling with longitudinal data: Strategies for examining group differences and reciprocal relationships. Journal of Consulting and Clinical Psychology 1994, 62(3):477-487.
38. Ferrer E., Balluerka N., Widaman K.F. Factorial invariance and the specification of second-order latent growth models. Methodology 2008, 4(1):22-36.
39. Foerster F. On the problems of initial-value-dependencies and measurement of change. Journal of Psychophysiology 1995, 9:324-341.
40. Furedy J.J., Sher H. The law of initial values: Differentiated testing as an empirical generalization versus enshrinement as a methodological rule. Psychophysiology 1989, 26:120-122.
41. Gavin W.J., Davies P.L. Obtaining reliable psychophysiological data with child participants: Methodological considerations. Developmental psychophysiology: Theory, systems, and methods 2008, 424-448. Cambridge University Press, Cambridge. L.A. Schmidt, S.J. Segalowitz (Eds.).
42. Geenen R., van de Vijver F.J.R. A simple test of the Law of Initial Values. Psychophysiology 1993, 30:525-530.
43. Gordis E.B., Granger D.A., Susman E.J., Trickett P.K. Asymmetry between salivary cortisol and α-amylase reactivity to stress: Relation to aggressive behavior in adolescents. Psychoneuroendocrinology 2006, 31:976-987.
44. Grimm K.J. Multivariate longitudinal methods for studying developmental relationships between depression and academic achievement. International Journal of Behavioral Development 2007, 31(4):328-339.
45. Gupta J.K., Srivastava A.B.L., Sharma K.K. On the optimum predictive potential of change measure. Journal of Experimental Education 1988, 56(3):124-128.
46. Hagemann D., Naumann E., Thayer J.F., Bartussek D. Does resting electroencephalograph asymmetry reflect a trait? An application of latent state-trait theory. Journal of Personality and Social Psychology 2002, 82(4):619-641.
47. Hauser-Cram P., Krauss M.W. Measuring change in children and families. Journal of Early Intervention 1991, 15(3):288-297.
48. Heath H.A., Oken D. The quantification of "response" to experimental stimuli. Psychosomatic Medicine 1965, 27(5):457-471.
49. Hinnant J.B., El-Sheikh M. Children's externalizing and internalizing symptoms over time: The role of individual differences in patterns of RSA responding. Journal of Abnormal Child Psychology 2009, 37:1049-1061.
50. Hord D.J., Johnson L.C., Lubin A. Differential effect of the Law of Initial Value (LIV) on autonomic variables. Psychophysiology 1964, 1(1):79-87.
51. Jamieson J. The law of initial values: Five factors or two?. International Journal of Psychophysiology 1993, 14:233-239.
52. Jamieson J. Correlates of reactivity: Problems with regression based methods. International Journal of Psychophysiology 1994, 17:73-78.
53. Jamieson J. Measurement of change and the Law of Initial Values: A computer simulation study. Educational and Psychological Measurement 1995, 55:38-46.
54. Jamieson J. Dealing with baseline differences: Two principles and two dilemmas. International Journal of Psychophysiology 1999, 31:155-161.
55. Jamieson J., Howk S. The law of initial values: A four factor theory. International Journal of Psychophysiology 1992, 12:53-61.
56. Jin P. Toward a reconceptualization of the Law of Initial Value. Psychological Bulletin 1992, 111(1):176-184.
57. Kamarck T.W. Recent developments in the study of cardiovascular reactivity: Contributions from psychometric theory and social psychology. Psychophysiology 1992, 29(5):491-503.
58. Kamarck T.W., Jennings J.R., Manuck S.B. Psychometric applications in the assessment of cardiovascular reactivity. Homeostasis 1993, 34:229-243.
59. Kamarck T.W., Lovallo W.R. Cardiovascular reactivity to psychological challenge: Conceptual and measurement considerations. Psychosomatic Medicine 2003, 65:9-21.
60. Kelsey R.M., Ornduff S.R., Alpert B.S. Reliability of cardiovascular reactivity to stress: Internal consistency. Psychophysiology 2007, 44:216-225.
61. Kenny D.A., Zautra A. The trait-state models for longitudinal data. New methods for the analysis of change 2001, 243-263. American Psychological Association, Washington, DC. L.M. Collins, A.G. Sayer (Eds.).
62. Kertes D.A., van Dulmen M. Latent state trait modeling of children's cortisol at two points of the diurnal cycle. Psychoneuroendocrinology 2012, 37(2):249-255.
63. Kestler L.P., Lewis M. Cortisol response to inoculation in 4-year-old children. Psychoneuroendocrinology 2009, 34:743-751.
64. King D.W., King L.A., McArdle J.J., Shalev A.Y., Doron-LaMarca S. Sequential temporal dependencies in associations between symptoms of depression and posttraumatic stress disorder: An application of bivariate latent difference score structural equation modeling. Multivariate Behavioral Research 2009, 44:437-464.
65. Kline R.B. Principles and practices of structural equation modeling 2010, Guilford, New York. 3rd ed.
66. Kristjansson S.D., Kircher J.C., Webb A.K. Multilevel models for repeated measures designs in psychophysiology: An introduction to growth curve modeling. Psychophysiology 2007, 44:728-736.
67. Lacey J.I. The evaluation of autonomic responses: Toward a general solution. Annals of the New York Academy of Sciences 1956, 67:125-163.
68. Laird R.D., Weems C.F. The equivalence of regression models using difference scores and models using separate scores for each informant: Implications for the study of informant discrepancies. Psychological Assessment 2011, 23(2):388-397.
69. Linn R.L., Slinde J.A. The determination of the significance of changes between pre- and posttesting periods. Review of Educational Research 1977, 47(1):121-150.
70. Little T., Bovaird J., Slegers D. Methods of the analysis of change. Handbook of personality development 2005, Erlbaum, Mahwah, NJ. D. Mroczek, T. Little (Eds.).
71. Little T.D., Bovaird J.A., Widaman K.F. On the merits of orthogonalizing powered and product terms: Implications for modeling interactions among latent variables. Structural Equation Modeling 2006, 13(4):497-519.
72. Llabre M.M., Spitzer S.B., Saab P.G., Ironson G.H., Schneiderman N. The reliability and specificity of delta versus residualized change as measures of cardiovascular reactivity to behavioral challenges. Psychophysiology 1991, 28:701-711.
73. Llabre M.M., Spitzer S.B., Saab P.G., Schneiderman N. Piecewise latent growth curve modeling of systolic blood pressure reactivity and recovery from the cold pressor test. Psychophysiology 2001, 38:951-960.
74. Long J.D. Longitudinal data analysis for the behavioral sciences using R 2012, Sage, Thousand Oaks, CA.
75. Lord F.M. The measurement of growth. Educational and Psychological Measurement 1956, 16:421-437.
76. Lord F.M. A paradox in the interpretation of group comparisons. Psychological Bulletin 1967, 68:304-305.
77. Lord F.M. Elementary models for measuring change. Problems in measuring change 1963, University of Wisconsin Press, Madison, WI. C.W. Harris (Ed.).
78. Lubke G.H., Muthén B. Investigating population heterogeneity with factor mixture models. Psychological Methods 2005, 10(1):21-39.
79. MacCallum R.C., Browne M.W., Sugawara H.M. Power analysis and determination of sample size for covariance structure modeling. Psychological Methods 1996, 1(2):130-149.
80. MacCallum R.C., Wegener D.T., Uchino B.N., Fabrigar L.R. The problem of equivalent models in applications of covariance structure analysis. Psychological Bulletin 1993, 114(1):185-199.
81. Malmstrom E.J. The effect of prestimulus variability on physiological reactivity scores. Psychophysiology 1968, 5(2):149-165.
82. Manuck S.B., Kasprowicz A.L., Muldoon M.F. Behaviorally-evoked cardiovascular reactivity and hypertension: Conceptual issues and potential associations. Annals of Behavioral Medicine 1990, 12(1):17-29.
83. Marsh H.W., Wen Z., Hau K.-T. Structural equation models of latent interaction and quadratic effects. Structural equation modeling: A second course 2006, 225-265. IAP, Greenwich, CT. G.R. Hancock, R.O. Mueller (Eds.).
84. May K., Hittner J.B. Reliability and validity of gain scores considered graphically. Perceptual and Motor Skills 2010, 111(2):399-406.
85. McArdle J.J. Latent variable modeling of differences and changes with longitudinal data. Annual Review of Psychology 2009, 60:577-605.
86. McArdle J.J. A latent difference score approach to longitudinal dynamic structural equation analyses. Structural equation modeling: Present and future 2001, 342-380. Scientific Software International, Lincolnwood, IL. R. Cudeck, S. du Toit, D. Sorbom (Eds.).
87. McArdle J.J., Hamagami F. Latent difference score structural models for linear dynamic analyses with incomplete data. New methods for the analysis of change 2001, 139-175. American Psychological Association, Washington, DC. L.M. Collins, A.G. Sayer (Eds.).
88. McCutcheon A.L. Latent class analysis 1987, Sage, Newbury Park, CA.
89. McDonald R.P., Ho M.-H.R. Principles and practice in reporting structural equation analyses. Psychological Methods 2002, 7(1):64-82.
90. McLachlan G., Peel D. Finite mixture models 2000, Wiley, New York.
91. Meredith W., Tisak J. Latent curve analysis. Psychometrika 1990, 55(1):107-122.
92. Miller A., Long J. Psychophysiology principles, pointers, and pitfalls. Developmental psychophysiology: Theory, systems, and methods 2008, 367-423. Cambridge University Press, Cambridge. L.A. Schmidt, S.J. Segalowitz (Eds.).
93. Muthén, L. K., & Muthén, B. O. (1998-2010). Mplus user's guide (6th ed.). Los Angeles, CA: Muthén & Muthén.
94. Muthén L.K., Muthén B.O. How to use a Monte Carlo study to decide on sample size and determine power. Structural Equation Modeling 2002, 9(4):599-620.
95. Nagin D.S. Group-based modeling of development 2005, Harvard University Press, Cambridge, MA.
96. Obradović J. How can the study of physiological reactivity contribute to our understanding of adversity and resilience processes in development?. Development and Psychopathology 2012, 24:371-387.
97. Obradović J., Boyce W.T. The role of stress reactivity for child development: Indices, correlates and future directions. The Cambridge handbook of environment in human development 2012, 655-681. Cambridge University Press, New York. L.C. Mayes, M. Lewis (Eds.).
98. Obradović J., Bush N.R., Stamperdahl J., Adler N.E., Boyce W.T. Biological sensitivity to context: The interactive effects of stress reactivity and family adversity on socioemotional behavior and school readiness. Child Development 2010, 81(1):270-289.
99. Obradović J., Pardini D.A., Long J.D., Loeber R. Measuring interpersonal callousness in boys from childhood to adolescence: An examination of longitudinal invariance and temporal stability. Journal of Clinical Child and Adolescent Psychology 2007, 36(3):276-292.
100. Oldham P.D. A note of the analysis of repeated measurements of the same subjects. Journal of Chronic Diseases 1962, 15:969-977.
101. Overall J.E., Woodward J.A. Unreliability of difference scores: A paradox for measurement of change. Psychological Bulletin 1975, 82(1):85-86.
102. Overall J.E., Woodward J.A. Reassertion of the paradoxical power of tests of significance based on unreliable difference scores. Psychological Bulletin 1976, 83(5):776-777.
103. Porges S.W. The polyvagal theory: Phylogenetic substrates of a social nervous system. International Journal of Psychophysiology 2001, 42:123-146.
104. Porges S.W. The polyvagal perspective. Biological Psychology 2007, 74:116-143.
105. Preacher K.J., Wichman A.L., MacCallum R.C., Briggs N.E. Latent growth curve modeling 2008, Sage, Los Angeles.
106. Quigley K.S., Stifter C.A. A comparative validation of sympathetic reactivity in children and adults. Psychophysiology 2006, 43:357-365.
107. Raykov T. Structural models for studying correlates and predictors of change. Australian Journal of Psychology 1992, 44(2):101-112.
108. Reise S.P., Widaman K.F., Pugh R.H. Confirmatory factor analysis and item response theory: Two approaches for exploring measurement invariance. Psychological Bulletin 1993, 114:552-566.
109. Rodgers J.L. The epistemology of mathematical and statistical modeling: A quiet methodological revolution. American Psychologist 2010, 65(1):1-12.
110. Rogosa D.R., Brandt D., Zimowski M. A growth curve approach to the measurement of change. Psychological Bulletin 1982, 92(3):726-748.
111. Rogosa D.R. Myths about longitudinal research. Methodological issues in aging research 1988, 171-210. Springer, New York. K.W. Schaie, R.T. Campbell, W. Meredith, S.C. Rawlings (Eds.).
112. Rogosa D.R., Willet J.B. Demonstrating the reliability of the difference score in the measurement of change. Journal of Educational Measurement 1983, 20:335-343.
113. Roisman G.I. The psychophysiology of adult attachment relationships: Autonomic reactivity in marital and premarital interactions. Developmental Psychology 2007, 43(1):39-53.
114. Salomon K., Matthews K.A., Allen M.T. Patterns of sympathetic and parasympathetic reactivity in a sample of children and adolescents. Psychophysiology 2000, 37:842-849.
115. Schafer J.L., Graham J.W. Missing data: Our view of the state of the art. Psychological Methods 2002, 7(2):147-177.
116. Scher H., Furedy J.J., Heslegrave R.J. Individual differences in phasic cardiac reactivity to psychological stress and the Law of Initial Value. Psychophysiology 1985, 22:345-348.
117. Shirtcliff E.A., Granger D.A., Booth A., Johnson D. Low salivary cortisol levels and externalizing behavior problems in youth. Development and Psychopathology 2005, 17:167-184.
118. Sober E. Parsimony. The philosophy of science: An encyclopedia 2006, Vol. 2:531-538. Routledge, New York.
119. Stemmler G. Implicit measurement models in methods for scoring physiological reactivity. Journal of Psychophysiology 1987, 1(2):113-125.
120. Stemmler G. Methodological considerations in the psychophysiological study of emotion. Handbook of affective sciences 2003, 225-255. Oxford University Press, New York. R.J. Davidson, K.R. Scherer, H.H. Goldsmith (Eds.).
121. Steyer R., Schmitt M., Eid M. Latent state-trait theory and research in personality and individual differences. European Journal of Personality 1999, 13:389-408.
122. Tu Y.-K., Gilthorpe M.S. Revisiting the relation between change and initial value: A review and evaluation. Statistics in Medicine 2007, 26:443-457.
123. Van Ryzin M.J., Chatham M., Kryzer E., Kertes D.A., Gunnar M.R. Identifying atypical cortisol patterns in young children: The benefits of group-based trajectory modeling. Psychoneuroendocrinology 2009, 34:50-61.
124. Vandenberg R.J., Lance C.E. A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations. Organizational Research Methods 2000, 3:4-70.
125. Wilder J. The "law of initial values," a neglected biological law and its significance for research and practice (Translated from Zeitschrift fur die gesamte Neurologie und Psychiatric, 137, 317-338). Psychophysiology 1931, 38-46. Dowden, Hutchinson, & Ross, Stroudsburg, PA. S.W. Porges, M.G.H. Coles (Eds.).
126. Williams R.H., Zimmerman D.W., Mazzagatti R.D. Large sample estimates of the reliability of simple, residualized, and base-free gain scores. Journal of Experimental Education 1987, 55(2):116-118.
127. Williams R.H., Zimmerman D.W., Rich J.H., Steed J.L. An empirical study of the relative error magnitude in three measures of change. Journal of Experimental Education 1984, 53(1):55-57.
128. Wilson A.C., Lengua L.J., Tininenko J., Taylor A., Trancik A. Physiological profiles during delay of gratification: Associations with emotionality, self-regulation, and adjustment problems. Journal of Applied Developmental Psychology 2009, 30:780-790.
129. Zimmerman D.W. The reliability of difference scores in samples and populations and samples. Journal of Educational Measurement 2009, 46(1):19-42.
130. Zimmerman D.W., Williams R.H. Gain scores in research can be highly reliable. Journal of Educational Measurement 1982, 19:149-154.
131. Zimmerman D.W., Williams R.H., Zumbo B.D. Reliability of measurement and power of significance tests based on differences. Applied Psychological Measurement 1993, 17(1):1-9.