Retest effects on identical and parallel forms in certification and licensure testing

Personnel Psychology

Volumn 60, Issue 2, 2007, Pages 367-396

  Raymond, Mark R ^a,b   Neustel, Sandra ^a   Anderson, Dan ^a  

^a American Registry of Radiologic Technologists ^*  (United States)

^b ARRT   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 34547148855     PISSN: 00315826     EISSN: 17446570     Source Type: Journal    
DOI: 10.1111/j.1744-6570.2007.00077.x     Document Type: Article

References (60)

1. Allalouf A, Ben-Shakhar G 1998). The effect of coaching on the predictive validity of scholastic aptitude tests. Journal of Educational Measurement, 35, 31 47.
2. American Educational Research Association, American Psychological Association, & National Council on Measurement in Education 1999). Standards for educational and psychological testing. Washington, DC : American Educational Research Association.
3. Bobko, P. (2001). Correlation and regression: Applications for industrial/organizational psychology and management (2nd ed Thousand Oaks, CA : Sage.
4. Boulet JR, McKinley DW, Whelan GP, Hambleton RK 2003). The effect of task exposure on repeat candidate scores in a high-stakes standardized patient assessment. Teaching and Learning in Medicine, 15, 227 232.
5. Brennan RL 2002). Generalizability theory. New York : Springer-Verlag.
6. Chan J, McDermott KB, Roediger HL 2006). Retrieval-induced facilitation: Initially nontested material can benefit from prior testing of related material. Journal of Experimental Psychology: General, 135, 553 571.
7. Cohen J 1994). The world is round (p <.05). American Psychologist, 49, 997 1003.
8. Cook TD, Campbell DT 1979). Quasi-experimentation: Design and analysis issues for field settings. Chicago, IL : Rand McNally.
9. Curr W, Gourlay N 1960). The effect of practice on performance in scholastic tests. British Journal of Educational Psychology, 30, 155 167.
10. Dalessandro SP, Mcleod LD 1999). The Validity of Law School Admission test scores for repeaters: A replication (LSAT Technical Report 98-05). Newton, PA : Law School Admissions Council.
11. Doctor's cheating forces test changes 2005, May 29). Philadelphia Enquirer, p. B4.
12. Donlon TF, Angoff WH 1971). The scholastic aptitude test. In Angoff WH (Ed The College Board Admissions Testing Program: A technical report on research and development activities relating to the Scholastic Aptitude Test and Achievement Test. New York : College Entrance Examination Board.
13. Downing SM 2006). Selected-response item formats in test development. In Downing SM, Haladyna TM (Eds Handbook of test development (pp. 287 301). Mahwah, NJ : Erlbaum.
14. Friedman H 1987). Repeat examinations in introductory statistics courses. Teaching of Psychology, 14, 20 23.
15. Geving AM, Webb S, Davis B 2005). Opportunities for repeat testing: Practice doesn't always make perfect. Applied H.R.M. Research, 10 (2 47 55.
16. Greene EB 1941). Measurement of human behavior. New York : Odyssey Press.
17. Guion RM 1976). Recruiting, selection, and job placement. In Dunnette MD (Ed Handbook of industrial and organizational psychology (pp. 777 828). Chicago : Rand McNally.
18. Haladyna TM, Downing SM 2004). Construct-irrelevant variance in high-stakes testing. Educational Measurement: Issues and Practice, 23, 17 27.
19. Hambleton RK, Swaminathan H 1985). Item response theory: Principles and applications. Boston : Kluwer-Nijhoff.
20. Hausknecht JP Trevor CO, Farr JL 2002). Retaking ability tests in a selection setting: Implications for practice effects, training performance, and turnover. Journal of Applied Psychology, 87, 243 254.
21. Hausknecht JP, Halbert JA, Di Paolo NT, Moriarty Gerrard MO 2007). Retesting in selection: A meta-analysis of practice effects for tests of cognitive ability. Journal of Applied Psychology, 92, 373 385.
22. Higgs AC, Papper EM, Carr LS 2000). Integrating selection with other organizational processes and systems. In Kehoe JF (Ed Managing selection in changing organizations (pp. 73 122). San Francisco : Jossey-Bass.
23. Holland P 2002). Two measures of change in the gaps between the CDFs of test score distributions. Journal of Educational and Behavioral Statistics, 27, 3 17.
24. Kane MT 1982). The validity of licensure examinations. American Psychologist, 37, 911 918.
25. Kane MT 1992). An argument-based approach to validity. Psychological Bulletin, 112, 527 535.
26. Kane MT 2004). Certification testing as an illustration of argument-based validation. Measurement, 2, 135 170.
27. Kaufman AL 1994). Practice effects. In Sternberg R (Ed Encyclopedia of human intelligence (vol. 2, pp. 828 833). New York : Macmillan.
28. Kingston N, Turner N 1984). Analysis of score change patterns of examinees repeating the Graduate Record Examination (ETS Research Report 84-22). Princeton, NJ : Educational Testing Service.
29. Kolen MJ, Brennan RL 2004). Test equating, scaling, and linking: Methods and practices. New York : Springer-Verlag.
30. Krumboltz JD, Christal RE 1960). Short-term practice effects on tests of spatial aptitude. Personnel and Guidance Journal, 38, 385 391.
31. Kulik JA, Kulik CC, Bangert RL 1984). Effects of practice on aptitude and achievement test scores. American Educational Research Journal, 21, 435 447.
32. Lievens F, Buyse T, Sackett PR 2005). Retesting effects in operational selection settings: Development and test of a framework. Personnel Psychology, 58, 981 1007.
33. Lord FM 1980). Applications of item response theory to practical testing problems. Mahwah, NJ : Erlbaum.
34. Mehrens WA, Kaminski J 1989). Methods for improving standardized test scores: Fruitful, fruitless, or fraudulent? Educational Measurement: Issues and Practice, 8, 14 22.
35. Messick S 1989). Validity. In Linn RL (Ed Educational measurement (pp. 13 103). New York : American Council on Education and Macmillan.
36. Millman J 1989). If at first you don't succeed: Setting passing scores when more than one attempt is permitted. Educational Researcher, 18, 5 9.
37. Netley C, Rachman S, Turner RK 1965). The effect of practice on performance in reading attainment tests. British Journal of Educational Psychology, 35, 1 8.
38. National Conference of Examiners for Engineering and Surveying 1999). Fundamentals of Engineering (FE) examinations: Morning session specifications. Clemson, SC : Author.
39. Parshall CG, Houghton PDB, Kromrey JD 1995). Equating error and statistical bias in small sample linear equating. Journal of Educational Measurement, 32, 37 54.
40. Powers DE 1986). Relations of test item characteristics to test preparation/test practice effects: A quantitative summary. Psychological Bulletin 100, 67 77.
41. Raymond MR 2001). Job analysis and the specification of content for licensure and certification examinations. Applied Measurement in Education, 14, 369 415.
42. Raymond MR, Neustel S 2006). Determining the content of credentialing examinations. In Downing SM, Haladyna TM (Eds Handbook of test development (pp. 181 223). Mahwah, NJ : Erlbaum.
43. Richards JM Jr., Taylor CW, Price PB, Jacobsen TL 1965). An investigation of the criterion problem for one group of medical specialists. Journal of Applied Psychology, 49, 79 90.
44. Roediger HL, Karpicke JD 2006). The power of testing memory: Basic research and implications for educational practice. Perspectives on Psychological Science, 1, 181 210.
45. Rogers JL, Howard KI, Vessey JT 1993). Using significance tests to evaluate equivalence between two experimental groups. Psychological Bulletin, 113, 553 565.
46. Sackett PR, Yang H 2000). Correction for range restriction: An expanded typology. Journal of Applied Psychology, 85, 112 118.
47. Sackett PR, Burris LR, Ryan AM 1989). Coaching and practice effects in personnel selection. In Cooper C, Robertson I Eds International review of industrial and organizational psychology (pp. 145 183). New York : Wiley.
48. Seaman MA, Serlin RC 1998). Equivalence confidence intervals for two-group comparisons of means. Psychological Methods, 3, 403 411.
49. Shimberg B 1981). Testing for licensure and certification. American Psychologist, 36, 1138 1146.
50. Skaggs G 2005). Accuracy of random groups equating with very small samples. Journal of Educational Measurement, 42, 309 330.
51. Society for Industrial and Organizational Psychology 2003). Principles for the validation and use of personnel selection procedures (4th Ed). Bowling Green, OH : Author.
52. Stanley JC 1971). Reliability. In Thorndike RL (Ed Educational measurement (pp. 356 442). Washington, DC : American Council on Education.
53. Stillwell LA, Thornton AE, Pashley PJ 2002). The validity of Law School Admission Test Scores for repeaters: 1997 through 2000 entering law school classes LSAT Technical Report 02-02). Newton, PA : Law School Admissions Council.
54. Tippins NT 2002). Issues in implementing large-scale selection programs. In Hedge JW, Pulakos ED (Eds Implementing organizational interventions (pp. 232 269). San Francisco : Jossey-Bass.
55. Tryon WW 2001). Evaluating statistical difference, equivalence, and indeterminacy using inferential confidence intervals: An integrated alternative method of conducting null hypothesis statistical tests. Psychological Methods, 6, 371 386.
56. Uniform Guidelines on Employee Selection Procedures 1978). Federal Register, 43, 38296 38309.
57. Vale CD 2006). Computerized item banking. In Downing SM, Haladyna TM (Eds Handbook of test development (pp. 261 285). Mahwah, NJ : Erlbaum.
58. Wendt A, Harris L 2004). National Council licensure examination for registered nurses. Chicago : National Council of State Boards of Nursing.
59. Wightman LF 1990). The validity of Law School Admission Test scores for repeaters: A replication (LSAC Research Report 90-02). Newton, PA : Law School Admissions Council.
60. Wing H 1980). Practice effects with traditional mental test items. Applied Psychological Measurement, 2 (4 141 155.