A monte carlo simulation study of the reliability of intraindividual variability

Psychology and Aging

Volumn 27, Issue 3, 2012, Pages 560-576

  Estabrook, Ryne ^a   Grimm, Kevin J ^b   Bowles, Ryan P ^c  

^a VIRGINIA COMMONWEALTH UNIVERSITY   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c MICHIGAN STATE UNIVERSITY   (United States)

Author keywords

Individual differences; Intraindividual variability; ISD; Reliability

Indexed keywords

ARTICLE; CONTROLLED STUDY; INDIVIDUAL STANDARD DEVIATION; INDIVIDUALITY; INTRAINDIVIDUAL VARIABILITY; MATHEMATICAL PARAMETERS; MONTE CARLO METHOD; RELIABILITY; SECONDARY ANALYSIS; SENSITIVITY ANALYSIS; COMPUTER SIMULATION; HUMAN; REPRODUCIBILITY;

COMPUTER SIMULATION; HUMANS; INDIVIDUALITY; MONTE CARLO METHOD; REPRODUCIBILITY OF RESULTS;

EID: 84868258212     PISSN: 08827974     EISSN: 19391498     Source Type: Journal    
DOI: 10.1037/a0026669     Document Type: Article

References (54)

1. Allaire, J. C. & Marsiske, M. (2005). Intraindividual variability may not always indicate vulnerability in elders' cognitive performance. Psychology and Aging, 20, 390-401. doi:10.1037/0882-7974.20.3.390
2. Anstey, K. J. (1999). Sensorimotor variables and forced expiratory volume as correlates of speed, accuracy and variability in reaction time performance in late adulthood. Aging, Neuropsychology, and Cognition, 6, 84-95. doi:10.1076/anec.6.2.84.786
3. Anstey, K. J. (2004). Within-person variability as a dynamics measure of late-life development: New methodologies and future directions. Gerontology, 50, 4, 255-258. doi:10.1159/000078355
4. Baltes, P. B. & Nesselroade, J. R. (1979). History and rationale of longitudinal research. In J. R. Nesselroade & P. B. Baltes (Eds.), Longitudinal research in the study of behavior and development (pp. 1-39). New York, NY: Academic Press.
5. Berdie, R. F. (1969). Consistency and generalizability of intraindividual variability. Journal of Applied Psychology, 53, 35-41.
6. Bielak, A. A. M., Hultsch, D. F., Strauss, E., MacDonald, S. W. S., & Hunter, M. (2010a). Intraindividual variability is related to cognitive change in older adults: Evidence of within-person coupling. Psychology and Aging, 25, 3, 575-586. doi:10.1037/a0019503
7. Bielak, A. A. M., Hultsch, D. F., Strauss, E., MacDonald, S. W. S., & Hunter, M. (2010b). Intraindividual variability in reaction time predicts cognitive outcomes 5 years later. Neuropsychology, Online first publication.
8. Blanchard-Fields, F. (Ed.). (2009). Intraindividual variability and aging. Psychology and Aging [Special Issue]. 24, 775-1006.
9. Boker, S. M., Deboeck, P. R., Edler, C., & Keel, P. K. (2010). Generalized local linear approximation of derivatives from time series. In S.-M. Chow & E. Ferrar (Eds), Statistical methods for modeling human dynamics: An interdisciplinary dialogue (pp. 179-212). Boca Raton, FL: Taylor & Francis.
10. Bowles, R. P. (2009). Using intratask change item response models for the assessment of intraindividual variability. In S. M. Chow, E. Ferrer, & F. Hsieh (Eds.), Statistical methods for modeling human dynamics: An interdisciplinary dialogue. Mahwah, NJ: Erlbaum.
11. Chow, S-M., Hamaker, E. L., Fujita, F., & Boker, S. M. (2009). Representing time-varying cyclic dynamics using multiple-subject state-space models. British Journal of Mathematical and Statistical Psychology, 62, 683-712. doi:10.1348/000711008X384080
12. Cohen, J., Cohen, P., West, S. G., & Aiken, L. (2003). Applied multiple regression/correlation for the behavioral sciences (3rd ed.). Mahwah, NJ: Erlbaum.
13. Deary, I. J. & Der, G. (2005). Reaction time, age, and cognitive ability: Longitudinal findings from age 16 to 63 years in representative population samples. Aging, Neuropsychology and Cognition, 12, 187-215. doi:10.1080/13825580590969235
14. Deboeck, P. R. (2010). Estimating dynamical systems: Estimation hints from Sir Ronald A. Fisher. Multivariate Behavioral Research, 45, 4, 725-745. doi:10.1080/00273171.2010.498294
15. Efron, B. & Tibshirani, R. (1993). An Introduction to the Bootstrap. Boca Raton, FL: Chapman & Hall.
16. Eid, M. & Diener, E. (1999). Intraindividual variability in affect: Reliability, validity, and personality correlates. Journal of Personality and Social Psychology, 76, 662-676. doi:10.1037/0022-3514.76.4.662
17. Eizenman, D., Nesselroade, J. R., Featherman, D., & Rowe, J. (1997). Intraindividual variability in perceived control in an older sample: The MacArthur successful aging studies. Psychology and Aging, 12, 489- 502. doi:10.1037/0882-7974.12.3.489
18. Fiske, D. W. & Rice, L. (1955). Intra-individual response variability. Psychological Bulletin, 57, 217-250. doi:10.1037/h0045276
19. Fleeson, W. (2001). Toward a structure- and process-integrated view of personality: Traits as density distributions of states. Journal of Personality and Social Psychology, 80, 1011-1027. doi:10.1037/0022- 3514.80.6.1011
20. Fox, N. & Porges, S. (1985). The relation between neonatal heart period patterns and developmental outcome. Child Development, 56, 28-37. doi:10.2307/1130170
21. Fuentes, K., Hunter, M. A., Strauss, E., & Hultsch, D. F. (2001). Intraindividual variability in cognitive performance in persons with chronic fatigue syndrome. The Clinical Neuropsychologist, 15, 210-227. doi: 10.1076/clin.15.2.210.1896
22. Gerstorf, D., Siedlecki, K. L., Tucker-Drob, E. M., & Salthouse, T. A. (2009). Within-person variability in state anxiety across adulthood: Magnitude and associations with between-person characteristics. International Journal of Behavioral Development, 33, 55-64. doi:10.1177/ 0165025408098013
23. Haldane, J. B. S. (1955). The measurement of variation. Evolution, 9, 484. doi:10.2307/2405484
24. Hale, S., Myerson, J., & Smith, G. A. (1988). Age, variability, and speed: Between-subjects diversity. Psychology and Aging, 3, 407-410. doi: 10.1037/0882-7974.3.4.407
25. Hultsch, D. F., McDonald, S. W. S., Hunter, M. A., Levy-Bencheton, J., & Strauss, E. (2000). Intraindividual variability in cognitive performance in older adults: Comparison of adults with mild dementia, adults with arthritis, and healthy adults. Neuropsychology, 14, 588 -598. doi: 10.1037/0894-4105.14.4.588
26. Jensen, A. R. (1992). The importance of intraindividual variation in reaction time. Personality and Individual Differences, 13, 869-881. doi: 10.1016/0191-8869(92)90004-9
27. Lecert, T., Ghisletta, P., & Jouffray, C. (2004). Intraindividual variability and level of performance in four visuo-spatial working memory tasks. Swiss Journal of Psychology, 63, 261-272. doi:10.1024/1421- 0185.63.4.261
28. Li, S. C., Aggen, S. H., Nesselroade, J. R., & Baltes, P. B. (2001). Short-term fluctuations in elderly people's sensorimotor functioning predict text and spatial memory performance: The MacArthur successful aging studies. Gerontology, 47, 100-116. doi:10.1159/000052782
29. Licht, C. M. M., de Geus, E. J. C., Zitman, F. G., Hoogendijk, W. J. G., van Dyck, R., & Penninx, B. W. J. H. (2009). Association between major depressive disorder and heart rate variability in the Netherlands study of depression and anxiety (NESDA). Archive of General Psychiatry, 65, 12, 1358-1367. doi:10.1001/archpsyc.65.12.1358
30. MacDonald, S. W. S., Hultsch, D. F., & Dixon, R. A. (2003). Performance variability is related to change in cognition: Evidence from the Victoria Longitudinal Study. Psychology and Aging, 18, 510-523. doi:10.1037/ 0882-7974.18.3.510
31. MacDonald, S. W. S., Nyberg, L., Sandblom, J., Fischer, H., & Bäckman, L. (2008). Increased response-time variability is associated with reduced inferior parietal activation during episodic recognition in aging. Journal of Cognitive Neuroscience, 20, 5, 779 -786. doi:10.1162/ jocn.2008.20502
32. MacDonalds, S. W. S., Nyberg, L., & Bäckman, L. (2006). Intra-individual variability in behavior: Links to brain structure, neurotransmission and neuronal activity. Trends in Neurosciences, 29, 8, 474 - 480. doi: 10.1016/j.tins.2006.06.011
33. Marcotte, T. D., Roberts, D., Rosenthal, T. J., Heaton, R. K., Bentley, H., Grant, I., & the HRNC Group (2003). Test-retest reliability of standard deviation of lane position as assessed on a PC-based driving simulator [Abstract]. In Proceedings of the second international driving symposium on human factors in driver assessment, training, and vehicle design (pp. 199-200). Iowa City, IA: Human Factors Research Program, University of Iowa.
34. McArdle, J. J., Ferrer-Caja, E., Hamagami, F., & Woodcock, R. W. (2002). Comparative longitudinal structural analyses of the growth and decline of multiple intellectual abilities over the life-span. Developmental Psychology, 38, 115-142. doi:10.1037/0012-1649.38.1.115
35. Moran, L. J., & Mefferd, R. B. Jr. (1959). Repetitive psychometric measures. Psychological Reports, 5, 269-275.
36. Nesselroade, J. R. & Ram, N. (2004). Studying intraindividual variability: What we have learned that will help us understand lives in context. Research in Human Development, 1, 1-2, 9-29.
37. Nesselroade, J. R. (1991). The warp and the woof of the developmental fabric. In Visions of aesthetics, the environment & development: The legacy of Joachim F. Wohlwill (pp. 213-240). Hillsdale, NJ: Erlbaum, Inc.
38. R Development Core Team (2010). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. ISBN 3-900051-07-0, URL http://www.R-project.org
39. Ram, N., Rabbitt, P., Stollery, B., & Nesselroade, J. R. (2005). Cognitive performance inconsistency: Intraindividual change and variability. Psychology and Aging, 20, 623-633. doi:10.1037/0882-7974.20.4.623
40. Rentrop, M., Rodewald, K., Roth, A., Simon, J., Walther, S., Fielder, P.,. . Kaiser, S. (2010). Intra-individual variability in high-functioning patients with schizophrenia. Psychiatry Research, 178, 1, 27-32. doi: 10.1016/j.psychres.2010.04.009
41. Richman, J. S. & Moorman, J. R. (2000). Physiological time-series analysis using approximate entropy and sample entropy. American Journal of Physiology- Heart and Circulatory Physiology, 278, H2039-H2049.
42. Salthouse, T. A. & Berish, D. E. (2005). Correlates of within-person (across-occasion) variability in reaction time. Neuropsychology, 19, 77-87. doi:10.1037/0894-4105.19.1.77
43. Salthouse, T. A. (2007). Implications of within-person variability in cognitive and neuropsychological functioning for the interpretation of change. Neuropsychology, 21, 401- 411. doi:10.1037/0894-4105.21.4.401
44. Sankaran, M. (1963) Approximations to the non-central chi-square distribution Biometrika, 50, 199-204, doi:10.1093/biomet/50.1-2.199
45. Schmiedek, F., Lovden, M., & Lindenberger, U. (2009). On the relation of mean reaction time and intraindividual reaction time variability. Psychology and Aging, 24, 841-857. doi:10.1037/a0017799
46. Schmiedek, F. (2006, April). The dark side of the mean. Paper presented at the 11th Cognitive Aging Conference, Atlanta, GA.
47. Schretlen, D. J., Munro, C. A., Anthony, J. C., & Pearlson, G. D. (2003). Examining the range of normal intraindividual variability in neuropsychological test performance. Journal of the International Neuropsychological Society, 9, 864-870. doi:10.1017/S1355617703960061
48. Siegler, R. S. (1994). Cognitive variability: A key to understanding cognitive development. Current Directions in Psychological Science, 3, 1-5. doi:10.1111/1467-8721.ep10769817
49. Siegler, R. S. (2002). Variability and infant development. Infant Behavior & Development, 25, 550-557. doi:10.1016/S0163-6383(02)00150-9
50. Thorndike, R. L. (1949). Personnel selection: Test and measurement techniques. New York, NY: Wiley.
51. Vickery, C. D., Sepehri, A., Evans. C. C., & Lee, J. E. (2008). The association of level and stability of self-esteem and depressive symptoms in the acute inpatient stroke rehabilitation setting. Rehabilitation Psychology, 53, 2, 171-179. doi:10.1037/0090-5550.53.2.171
52. Wang, L. (2011). Investigating reliabilities of intra-individual variability indicators. Manuscript submitted for publication.
53. Wilkinson R. T. & Allison, S. (1989). Age and simple reaction time: Decade differences for 5,325 subjects. Journals of Gerontology, 44, 29-35.
54. Wright, B. D. & Stone, M. H. (1979). Best test design. Chicago, IL: MESA Press.