A practical guide to practice analysis for credentialing examinations

Educational Measurement: Issues and Practice

Volumn 21, Issue 3, 2002, Pages 25-37

  Raymond, Mark R ^a  

^a American Registry of Radiologic Technologists   (United States)

Author keywords

Credentialing; Job analysis; Practice analysis; Validity

Indexed keywords

EID: 85012816373     PISSN: 07311745     EISSN: 17453992     Source Type: Journal    
DOI: 10.1111/j.1745-3992.2002.tb00097.x     Document Type: Article

References (66)

1. American Board of Physical Medicine and Rehabilitation. (1998, December) The SCI medicine exam outline: A closer look. Diplomate News. Rochester, MN: Author.
2. American College Testing. (1991) Results of the job analysis and content validity study for certified professional secretaries. Kansas City, MO: International Association of Administrative Professionals.
3. American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (1999) Standards for educational and psychological testing. Washington, DC: American Educational Research Association.
4. American Registry of Radiologic Technologists. (1996) Job analysis and content specifications for quality management. St. Paul, MN: Author.
5. Bloom, B. S. (Ed.). (1956) Taxonomy of educational objectives, handbook 1: The cognitive domain. New York: McKay.
6. Chornick, N. L., Yocum, C. J., &Jacobsen, J. (1995) Job analysis: Newly licensed practical/vocational nurses. Chicago: National Council on Measurement in Education.
7. Cizek, G. J., Webb, L. C., &Kalohn, J. C. (1995) The use of cognitive taxonomies in licensure and certification test development: Reasonable or customary Evaluation and the Health Professionals, 18, 77–91.
8. Colliver, J. A., Markwell, S. J., Vu, N. V., &Barrows, H. S. (1990) Case specificity of standardized patient examinations. Evaluation & the Health Professions, 13, 252–261.
9. Cooke, N. J. (1999) Knowledge elicitation. In F. T. Durso, R. S. Nickerson, R. W. Schvaneveldt, S. F. Dumais, &M. T. H. Chi, (Eds.), Handbook of Applied Cognition (pp. 479–509). New York: John Wiley & Sons.
10. Cranny, C. J., &Doherty, M. E. (1988) Importance ratings in job analysis: Note on the misinterpretation of factor analysis. Journal of Applied Psychology, 73, 320–322.
11. D'Costa, A. (1986) The validity of credentialing examinations. Evaluation and the Health Professions, 9, 137–169.
12. Equal Employment Opportunity Commission, Civil Service Commission, Department of Labor, & Department of Justice. (1978) Adoption by four agencies of uniform guidelines of employee selection procedures. Federal Register, 43(166), 38290–38315.
13. Fine, S. (1986) Job analysis. In R. A. Berk, (Ed.), Performance assessment: Methods and applications (pp. 53–81). Baltimore, MD: Johns Hopkins University Press.
14. Flanagan, J. C. (1954) The critical incident technique. Psychological Bulletin, 51, 327–358.
15. Fleishman, E. A., &Quaintance, M. K. (1984) Taxonomies of human performance: The description of human tasks. New York: Academic Press.
16. Gael, S. (1988) The job analysis handbook for business, industry, and government (vols. 1 & 2). New York: Wiley & Sons.
17. Green, S. B., &Stutzman, T. (1986) An evaluation of methods to select respondents to a structured job analysis questionnaires. Personnel Psychology, 39, 543–564.
18. Harvey, R. J. (1991) Job analysis. In M. Dunnette & L. Hough, (Eds.), Handbook of industrial & organizational psychology (2nd ed., vol. 2, pp. 71–163). Palo Alto, CA: Consulting Psychologists Press.
19. Jacobs, A. M., Fivars, G., Edwards, D. S., &Fitzpatrick, R. (1978) Critical requirements for safe/effective nursing practice. Washington, DC: American Nurses' Association.
20. Kane, M. T. (1982) The validity of licensure examinations. American psychologist, 37, 911–918.
21. Kane, M. T. (1997) Model-based practice analysis and test specifications. Applied Measurement in Education, 10, 5–18.
22. Kane, M. T., Kingsbury, C. Colton, D., &Estes, C. (1986) A study of nursing practice and role delineation and job analysis of entry-level performance of registered nurses. Chicago: National Council of State Boards of Nursing.
23. Kane, M. T., Kingsbury, C., Colton, D., &Estes, C. (1989) Combining data on criticality and frequency in developing plans for licensure and certification examinations. Journal of Educational Measurement, 26, 17–27.
24. Knapp, J., &Knapp, L. (1995) Practice analysis: Building the foundation for validity. In J. C. Impara, (Ed.), Licensure testing: Purposes, procedures, and practices (pp. 93–116). Lincoln, NE: Buros Institute of Mental Measurements.
25. Kuehn, P. A., Stallings, W. M., &Holland, C. L. (1990) Court-defined job analysis requirements for validation of teacher certification tests. Educational Measurement: Issues & Practice, 9(4), 21–24.
26. LaDuca, A. (1980) The structure of competence in the health professions. Evaluation and the Health Professions, 3, 253–288.
27. LaDuca, A. (1994) Validation of professional licensure examinations: Professions theory, test design, and construct validity. Evaluation and the Health Professions, 17, 178–197.
28. LaDuca, A., Downing, S., &Henzel, T. (1995) Test development: Systematic item writing and test construction. In J. C. Impara, (Ed.), Licensure testing: Purposes, procedures, and practices (pp. 117–148). Lincoln, NE: Buros Institute of Mental Measurements.
29. Landy, F. J. (1988) Selection procedure development and usage. In S. Gael, (Ed.) The job analysis handbook for business, industry, and government (vols. 1 & 2, pp. 271–287). New York: Wiley & Sons.
30. Levine, E. L., Ash, R A., &Bennett, N. (1980) Exploratory comparative study of four job analysis methods. Journal of Applied Psychology, 65, 524–535.
31. Levine, H. G., McGuire, C., Miller, G. E., &Larson, C. (1968) The orthopaedic training study: Final report. Chicago: University of Illinois, Center for the Study of Medical Education.
32. McCloskey, J. C., &Bulechek, G. M. (Eds.). (1992) Nursing interventions classification. St. Louis, MO: Mosby-Year Book.
33. McCormick, E. J., Jeanneret, P. R., &Mecham, R. C. (1972) A study of job characteristics and job dimensions as based on the Position Analysis Questionnaire. Journal of Applied Psychology, 56, 347–368.
34. Millman, J., &Greene, J. (1989) The specification and development of tests of achievement and ability. In R. L. Linn, (Ed.), Educational measurement (3rd ed., pp. 335–366). New York: Macmillan.
35. Morgeson, F. P., &Campion, M. A. (1997) Social and cognitive sources of potential inaccuracy in job analysis. Journal of Applied Psychology, 82, 627–655.
36. National Conference of Examiners for Engineering and Surveying. (1999a) Fundamentals of Engineering (FE) examinations: Morning session specifications. Clemson, SC: Author.
37. National Conference of Examiners for Engineering and Surveying. (1999b) PE examination formats: Principles and practice of engineering examinations. Clemson, SC: Author.
38. National Council of Architectural Registration Boards. (2001) Architecture practice analysis study: Executive summary. Washington, DC: Author.
39. National Council of Architectural Registration Boards. (2002) ARE guidelines. Washington, DC: Author.
40. Nelson, D. (1994) Job analysis for licensure and certification exams: Science or politics. Educational Measurement: Issues & Practice, 13 (4), 29–35.
41. Newman, L. S., Slaughter, R. C., &Taranath, S. N. (1999, April) The selection and use of rating scales in task surveys: A review of current job analysis practice. Paper presented at the annual meeting of the National Council on Measurement in Education, Montreal, Canada.
42. Osterlind, S. J. (1998) Constructing test items: Multiple choice, constructed response, performance, and other formats. Boston: Kluwer Academic Publishers.
43. Perkins, D. N. & Salomon, G. (1989) Are cognitive skills context-bound Educational Researcher, 18(1), 16–25.
44. Popham, W. J. (1984) Specifying the domain of content or behaviors. In R. A. Berk, (Ed.), A guide to criterion-referenced test construction. Baltimore, MD: Johns Hopkins University Press.
45. Raymond, M. R. (1989) Applications of multidimensional scaling to research in the health professions. Evaluation and the Health Professions, 12, 379–408.
46. Raymond, M. R. (1996) Establishing weights for test plans for licensure and certification examinations. Applied Measurement in Education, 9, 237–256.
47. Raymond, M. R. (2001) Job analysis and the specification of content for licensure and certification examinations. Applied Measurement in Education, 14, 369–415.
48. Raymond, M. R. (2002, April) The influence of rating scale format on rater errors in practice analysis surveys. Paper presented at the annual meeting of the American Educational Research Association, New Orleans, LA.
49. Raymond, M. R., Buckwalter, J. A., &Steyers, C. M. (1989, March) Investigating the structure of orthopedic practice using multidimensional scaling analysis. Paper presented at the annual meeting of the American Educational Research Association, San Francisco, CA.
50. Rodgers, J. L. (1988) Structural models of the American Psychological Association in 1986: A taxonomy for reorganization. American Psychologist, 43, 372–382.
51. Rosenfeld, M., Shimberg, B., &Thornton, R. F. (1983) Job analysis of licensed psychologists in the United States and Canada. Princeton, NJ: Educational Testing Service.
52. Sanchez, J. I., &Fraser, S. L. (1992) On the choice of scales for task analysis. Journal Of Applied Psychology, 77, 545–553.
53. Sanchez, J. I., &Levine, E. L. (1989) Determining important tasks within jobs: A policy-capturing approach. Journal of Applied Psychology, 74, 336–342.
54. Schaefer, L., Raymond, M. R., &White A. S. (1992) A comparison of two methods for structuring performance domains. Applied Measurement in Education, 5, 321–335.
55. Schiffman, S. S., Reynolds, M. L., &Young, F. W. (1981) Introduction to multidimensional scaling: theory methods and applications. New York: Academic Press.
56. Schmeiser, C. B., &Estes, C. A. (1986, April) Translating task analysis results into test specifications: clarity or confusion Paper presented at the annual meeting of the National Council on Measurement in Education, San Francisco, CA.
57. Seddon, G. M. (1978) The properties of Bloom's taxonomy of educational objectives for the cognitive domain. Review of Educational Research, 48, 302–323.
58. Shimberg, B. (1981) Testing for licensure and certification. American Psychologist, 36, 1138–1146.
59. Shimberg, B. (1990) Social considerations in the validation of licensing and certification examinations. Educational Measurement: Issues and Practice, 9(4), 11–14.
60. Slaughter, R. C., &Newman, L. S. (1999, April) Developing test specifications from job analysis data. Paper presented at the annual meeting of the National Council on Measurement in Education, Montreal, Canada.
61. Smith, I. L., &Hambleton, R. K. (1990) Content validity studies of licensing examinations. Educational Measurement: Issues & Practice, 9(4), 7–10.
62. Smith, J. E., &Hakel, M. D. (1979) Convergence among data sources, response bias, and reliability and validity of a structured job analysis questionnaire. Personnel Psychology, 32, 677–692.
63. Society for Industrial and Organizational Psychology. (1987) Principles for the validation and use of personnel selection procedures (3rd ed.). College Park, MD: Author.
64. Spray, J. A., &Huang, C. (2000) Obtaining test blueprints weights from job analysis surveys. Journal of Educational Measurement, 37, 187–201.
65. Thompson, D. E., &Thompson, T. A. (1982) Court standards for job analysis in test validation. Personnel Psychology, 35, 865–874.
66. Zaglaniczny, K. L. (1993) Council on certification professional practice analysis. Journal of the American Association of Nurse Anesthetists, 61, 241–255.