Same-form retest effects on credentialing examinations

Educational Measurement: Issues and Practice

Volumn 28, Issue 2, 2009, Pages 19-27

  Raymond, Mark R ^a,b   Neustel, Sandra ^a,c   Anderson, Dan ^a,d  

^a American Registry of Radiologic Technologists ^*  (United States)

^b NATIONAL BOARD OF MEDICAL EXAMINERS   (United States)

^c National Board of Examiners in Optometry   (United States)

^d American Registry of Radiologic Technologists   (United States)

Author keywords

Certification testing; Practice effects; Retest effects

Indexed keywords

EID: 66849109405     PISSN: 07311745     EISSN: 17453992     Source Type: Journal    
DOI: 10.1111/j.1745-3992.2009.00144.x     Document Type: Article

References (44)

1. American Educational Research Association, American Psychological Association, & National Council on Measurement in Education (1999). Standards for educational and psychological testing. Washington, DC : American Educational Research Association.
2. Boulet, J. R., McKinley, D. W., Whelan, G. P., Hambleton, R. K. (2003). The effect of task exposure on repeat candidate scores in a high-stakes standardized patient assessment. Teaching and Learning in Medicine, 15, 227 232. (Pubitemid 37414471)
3. Butler, A. C., Karpicke, J. D., Roediger III., H. L. (2007). The effect of type and timing of feedback on learning from multiple-choice tests. Journal of Experimental Psychology: Applied, 13, 273 281.
4. Chan, J., McDermott, K. B., Roediger, H. L. (2006). Retrieval-induced facilitation: Initially nontested material can benefit from prior testing of related material. Journal of Experimental Psychology: General, 135, 553 571.
5. Cohen, J. (1994). The world is round (p <.05). American Psychologist, 49, 997 1003.
6. Curr, W., Gourlay, N. (1960). The effect of practice on performance in scholastic tests. British Journal of Educational Psychology, 30, 155 167.
7. Davey, T., Nering, M. (2002). Controlling item exposure and maintaining item security. In C. Mills et al Eds. Computer-based testing (pp. 165 191). Mahwah, NJ : Lawrence Erlbaum Assoc.
8. Doctor's cheating forces test changes (2005, May 29). Philadelphia Enquirer, p. B04.
9. Downing, S. M. (2006). Selected-response item formats in test development. In S. M. Downing & T. M. Haladyna (Eds. Handbook of test development (pp. 287 301). Mahwah, NJ : Lawrence Erlbaum Associates.
10. Geving, A. M., Webb, S., Davis, B. (2005). Opportunities for repeat testing: Practice doesn't always make perfect. Applied H.R.M. Research, 10, 47 55.
11. Goldstein, H., Healy, M. J. R. (1995). The graphical presentation of a collection of means. Journal of the Royal Statistical Society, 158A (Part 1 175 177.
12. Greene, E. B. (1941). Measurement of human behavior. New York : The Odyssey Press.
13. Hambleton, R. K., Swaminathan, H. (1985). Item response theory: Principles and applications. Boston : Kluwer-Nijhoff.
14. Hausknecht, J. P., Halpert, J. A., Di Paolo, N. T., Moriarty, N. T., Gerrard, M. O. (2007). Retesting in selection: A meta-analysis of practice effects for tests of cognitive ability. Journal of Applied Psychology, 92, 373 385.
15. Hausknecht, J. P., Trevor, C. O., Farr, J. L. (2002). Retaking ability tests in a selection setting: Implications for practice effects, training performance, and turnover. Journal of Applied Psychology, 87, 243 254.
16. Holland, P. (2002). Two measures of change in the gaps between the CDFs of test score distributions. Journal of Educational and Behavioral Statistics, 27, 3 17.
17. Jenkins, J. J. (1978). Four points to remember: A tetrahedral model of memory experiments. In L. S. Cermak & F. I. M. Craik (Eds. Levels of processing and human memory. Hillsdale, NJ : Lawrence Erlbaum Associates.
18. Kingston, N., Turner, N. (1984). Analysis of score change patterns of examinees repeating the Graduate Record Examination (ETS Research Report 84-22). Princeton, NJ : Educational Testing Service.
19. Kolen, M. J., Brennan, R. L. (2004). Test equating, scaling, and linking: Methods and practices. New York : Springer-Verlag.
20. Krumboltz, J. D., Christal, R. E. (1960). Short-term practice effects on tests of spatial aptitude. Personnel and Guidance Journal, 38, 385 391.
21. Kulik, J. A., Kulik, C. C., Bangert, R. L. (1984). Effects of practice on aptitude and achievement test scores. American Educational Research Journal, 21, 435 447.
22. Lievens, F., Buyse, T., Sackett, P. R. (2005). Retesting effects in operational selection settings: Development and test of a framework. Personnel Psychology, 58, 981 1007.
23. Lord, F. M. (1980). Applications of item response theory to practical testing problems. Mahwah, NJ : Lawrence Erlbaum Associates.
24. Mehrens, W. A., Kaminski, J. (1989). Methods for improving standardized test scores: Fruitful, fruitless, or fraudulent Educational Measurement: Issues and Practice, 8 (1 14 22.
25. Messick, S. (1989). Validity. In R. L. Linn (Ed. Educational measurement (pp. 13 103). New York : American Council on Education and Macmillan.
26. Millman, J. (1989). If at first you don't succeed: Setting passing scores when more than one attempt is permitted. Educational Researcher, 18 (6 5 9.
27. Netley, C., Rachman, S., Turner, R. K. (1965). The effect of practice on performance in reading attainment tests. British Journal of Educational Psychology, 35, 1 8.
28. Parshall, C. G., Houghton, P. D. B., Kromrey, J. D. (1995). Equating error and statistical bias in small sample linear equating. Journal of Educational Measurement, 32, 37 54.
29. Powers, D. E. (1986). Relations of test item characteristics to test preparation/test practice effects: A quantitative summary. Psychological Bulletin, 100, 67 77.
30. Raymond, M. R., Neustel, S., Anderson, D. (2007). Retest effects on identical and parallel forms in certification and licensure testing. Personnel Psychology, 60, 367 396.
31. Roediger, H. L., Karpicke, J. D. (2006). The power of testing memory: Basic research and implications for educational practice. Perspectives on Psychological Science, 1, 181 210.
32. Rogers, J. L., Howard, K. I., Vessey, J. T. (1993) Using significance tests to evaluate equivalence between two experimental groups. Psychological Bulletin, 113, 553 565.
33. Seaman, M. A., Serlin, R. C. (1998) Equivalence confidence intervals for two-group comparisons of means. Psychological Methods, 3, 403 411. (Pubitemid 128459634)
34. Skaggs, G. (2005). Accuracy of random groups equating with very small samples. Journal of Educational Measurement, 42, 309 330.
35. Society for Industrial and Organizational Psychology (2003). Principles for the validation and use of personnel selection procedures (4th ed.). College Park, MD : Author.
36. Stanley, J. C. (1971). Reliability. In R. L. Thorndike (Ed. Educational measurement (pp. 232 269). Washington, DC : American Council on Education.
37. Tryon, W. W. (2001) Evaluating statistical difference, equivalence, and indeterminacy using inferential confidence intervals: An integrated alternative method of conducting null hypothesis statistical tests. Psychological Methods, 6, 371 386. (Pubitemid 33599065)
38. Uniform Guidelines on Employee Selection Procedures (1978). Federal Register, 43 (166 38296 38309.
39. Vale, C. D. (2006). Computerized item banking. In S. M. Downing & T. M. Haladyna (Eds. Handbook of test development (pp. 261 285). Mahwah, NJ : Lawrence Erlbaum Associates.
40. Wendt, A., Harris, L. (2004) National Council Licensure Examination for Registered Nurses. Chicago : National Council of State Boards of Nursing.
41. Westlake, W. J. (1976). Symmetrical confidence intervals for bioequivalence trials. Biometrics, 32, 741 744. (Pubitemid 8002276)
42. Wing, H. (1980). Practice effects with traditional mental test items. Applied Psychological Measurement, 2, 141 155.
43. Woodworth, R. R. (1938). Experimental psychology. New York : Holt, Rinehart, & Winston.
44. Wright, B. D., Stone, M. H. (1979). Best test design. Chicago : University of Chicago MESA Press.