The psychometric paradox of practice effects due to retesting: Measurement invariance and stable ability estimates in the face of observed score changes

Intelligence

Volumn 33, Issue 5, 2005, Pages 535-549

  Reeve, Charlie L ^a   Lam, Holly ^b  

^a UNIVERSITY OF NORTH CAROLINA AT CHARLOTTE   (United States)

^b PURDUE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 23844447691     PISSN: 01602896     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.intell.2005.05.003     Document Type: Article

References (51)

1. P.L. Ackerman Predicting individual differences in complex skill acquisition: Dynamics of ability determinants Journal of Applied Psychology 77 1992 598-614
2. A. Anastasi Coaching, test sophistication and developed abilities American Psychologist 36 1981 1086-1093
3. J.L. Arbuckle & W. Wothke Amos 4.0 user's guide 1996 SmallWaters Corporation Chicago, IL
4. R.P. Bagozzi & J.R. Edwards A general approach for representing constructs in organizational research Organizational Research Methods 1 1998 45-87
5. R.P. Bagozzi & Y. Yi On the evaluation of structural equation models Journal of the Academy of Marketing Science 16 1988 74-94
6. P.M. Bentler Comparative fit indexes in structural models Psychological Bulletin 107 1990 238-246
7. K.A. Bollen Structural equations with latent variables 1989 John Wiley New York
8. D.C. Briggs The effect of admissions test preparation: Evidence from NELS-88 Chance 14 2001 10-18
9. M.W. Browne & R. Cudeck Alternative ways of assessing model fit Sociological Methods and Research 21 1992 230-258
10. J.B. Carroll Human cognitive abilities: A survey of factor - analytic studies 1993 Cambridge University Press New York, NY
11. R.B. Cattell The measurement of adult intelligence Psychological Bulletin 40 1943 153-193
12. A. Diamantopoulos & J.A. Siguaw Introducing LISREL 2000 Sage Publications Thousand Oaks, CA
13. G. Donaldson Letter to the editor Journal of Gerontology 36 1981 634-636
14. J.C. Flanagan J.T. Dailey M.F. Shaycoft W.A. Gorham D.B. Orr & I. Goldberg Design for a study of American youth 1962 Houghton Mifflin Boston
15. E.A. Fleishman & W.E. Hempel The relation between abilities and improvement with practice in a visual discrimination reaction task Journal of Experimental Psychology 49 1955 301-312
16. L.S. Gottfredson Why g matters: The complexity of everyday life Intelligence 24 1997 79-132
17. J.-E. Gustafsson & G. Balke General and specific abilities as predictors of school achievement Multivariate Behavioral Research 28 1993 407-434
18. J.-E. Gustafsson & R.E. Snow Ability profiles In R.F. Dillon (Ed.) Handbook on testing 1997 Greenwood Press Westport, CT 107-135
19. J.P. Hausknecht C.O. Trevor & J.L. Farr Retaking ability tests in a selection setting: Implications for practice effects, training performance, and turnover Journal of Applied Psychology 87 2002 243-254
20. J.L. Horn & J.J. McArdle A practical and theoretical guide to measurement invariance in aging research Experimental Aging Research 18 1992 117-144
21. J.L. Horn & J. Noll Human cognitive capabilities: Gf-Gc theory In D.P. Flanagan J.L. Genshaft & P.L. Harrison (Eds.) Contemporary intellectual assessment: Theories, tests, and issues 1997 Guilford Press New York 53-90
22. L. Hu & P.M. Bentler Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecification Psychological Methods 3 1998 424-453
23. A.R. Jensen The g factor: The science of mental ability 1998 Praeger Westport,CT
24. A.R. Jensen & L.-J. Weng What is a good g? Intelligence 18 1994 231-258
25. R. Kanfer & P.L. Ackerman Motivation and cognitive abilities: An integrative/aptitude-treatment interaction approach to skill acquisition Journal of Applied Psychology 74 1989 657-690
26. J.A. Kulik C.C. Kulik & R.L. Bangert Effects of practice on aptitude and achievement test scores American Educational Research Journal 21 1984 435-447
27. R.S. Landis D.J. Beal & P.E. Tesluk A comparison of approaches to forming composite measures in structural equation models Organizational Research Methods 3 2000 186-207
28. M.W. Lipsey & D.B. Wilson The efficacy of psychological, educational, and behavioral treatment: Confirmation from meta-analysis American Psychologist 48 1993 1181-1209
29. D. Lubinski Scientific and social significance of assessing individual differences: "Sinking shafts at a few critical points" Annual Review of Psychology 51 2000 405-444
30. R. MacCallum Commentary on quantitative methods in I-O research The Industrial-Organizational Psychologist 35 1998 19-30
31. H.W. Marsh J.R. Balla & K.-T. Hau An evaluation of incremental fit indices: A clarification of mathematical and empirical properties In G.A. Marcoulides & R.E. Schumacker (Eds.) Advanced structural equation modeling: Issues and techniques 1996 Lawrence Erlbaum Associates Mahwah, NJ 315-353
32. K.S. McGrew Analysis of the major intelligence batteries according to a proposed comprehensive Gf-Gc framework In D.P. Flanagan J.L. Genshaft & P. Harrison (Eds.) Contemporary intelligence assessment: Theories, tests, and issues 1997 Guilford Press New York 151-179
33. G.J. Medsker L.J. Williams & P.J. Holahan A review of current practices for evaluating causal models in organizational behavior and human resources management research Journal of Management 20 1994 439-464
34. S. Messick The controversy over coaching: Issues of effectiveness and equity In B.F. Green (Ed.) New directions for testing and measurement: Issues in testing, coaching, disclosure, and ethnic bias, no. 11 1981 Jossey-Bass San Francisco, CA
35. J. Nijenhuis O.F. Voskuijl & N.B. Schijve Practice and coaching on IQ tests: Quite a lot of g International Journal of Selection and Assessment 9 2001 302-308
36. R.E. Ployhart & F.L. Oswald Applications of mean and covariance structure analysis: Integrating correlational and experimental approaches Organizational Research Methods 7 2004 27-65
37. M.D. Reckase Test construction in the 1990s: Recent approaches every psychologist should know Psychological Assessment 8 1996 354-359
38. M.J. Ree J.A. Earles & M.S. Teachout Predicting job performance: Not much more than g Journal of Applied Psychology 79 1994 518-524
39. W.W. Ruch & S.W. Stang Employee aptitude survey examiner's manual 2nd Ed. 1994 Psychological Services Inc. Glendale, CA
40. W.W. Ruch S.W. Stang R.H. McKillip & D.A. Dye Employee aptitude survey technical manual 2nd Ed. 2001 Psychological Services Inc. Glendale, CA
41. P.R. Sackett L.R. Burris & A.M. Ryan Coaching and practice effects in personnel selection In C.L. Cooper & I.T. Robertson (Eds.) International review of industrial and organizational psychology 1989 Wiley New York 145-183
42. K.W. Schaie S.L. Willis C. Hertzog & J.E. Schulenberg Effects of cognitive training on primary mental ability structure Psychology and Aging 2 1987 233-242
43. F.L. Schmidt & J.E. Hunter Theory testing and measurement error Intelligence 27 1999 183-198
44. C. Spearman The abilities of man: Their nature and measurement 1927 Macmillan New York
45. H.H. Spitz The raising of intelligence: A selected history of attempts to raise retarded intelligence 1986 Erlbaum Hillsdale, NJ
46. J.H. Steiger & J.M. Lind Statistically based tests for the number of common factors Paper presented at the Annual Meeting of the Psychometric Society, Iowa City, IA 1980
47. L.R. Tucker & C. Lewis A reliability coefficient for maximum likelihood Psychometrika 38 1973 1-10
48. R.J. Vandenberg & C.E. Lance A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research Organizational Research Methods 3 2000 4-70
49. J.K. Wheeler Practical implications of selection retesters on testing development and policy Practitioner forum presented at the 19th Annual conference of the Society for Industrial and Organizational Psychology, Chicago, IL 2004
50. K.F. Widaman & S.P. Riese Exploring the measurement invariance of psychological instruments: Applications in the substance use domain In K.J. Bryant M. Windle & S.G. West (Eds.) The science of prevention: Methodological advances from alcohol and substance abuse research 1997 American Psychological Association Washington, DC 281-324
51. E.J. Williams The comparison of regression variables Journal of the Royal Statistical Society, Series B 21 1959 396-399