Instrument development tools and activities for measure validation using rasch models: Part I-instrument development tools

Journal of Applied Measurement

Volumn 8, Issue 1, 2007, Pages 97-123

  Wolfe, Edward W ^a   Smith Jr , Everett V ^b  

^a VIRGINIA POLYTECHNIC INSTITUTE AND STATE UNIVERSITY   (United States)

^b UNIVERSITY OF ILLINOIS AT CHICAGO   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; CULTURAL ANTHROPOLOGY; EDUCATION; HUMAN; METHODOLOGY; PSYCHOLOGICAL MODEL; PSYCHOLOGY; VALIDATION STUDY;

CULTURE; EDUCATIONAL MEASUREMENT; HUMANS; MODELS, PSYCHOLOGICAL; PSYCHOLOGY;

EID: 34247269147     PISSN: 15297713     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (84)

1. Abedi, J. (2006). Language issues in item development. In S. M. Downing and T. M. Haladyna (Eds.), Handbook of test development (pp. 377-398). Mahwah, NJ: Lawrence Erlbaum.
2. Adams, R. J., Wilson, M., and Wang, W. C. (1997). The multidimensional random coefficients multinomial logit model. Applied Psychological Measurement, 21, 1-23.
3. Ahlawat, K. S. (1985). On the negative valence items in self-report measures. The Journal of General Psychology, 112, 89-99.
4. Aiken, L. R. (1983). Number of response categories and statistics on a teacher rating scale. Educational and Psychological Measurement, 43, 387-401.
5. American Educational Research Association. (1955). Technical recommendations for achievement tests. Washington, DC: Author.
6. American Educational Research Association, American Psychological Association, and National Council on Measurement in Education. (1999). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.
7. American Psychological Association. (1966). Standards for educational and psychological tests and manuals. Washington, DC: Author.
8. American Psychological Association, American Educational Research Association, and National Council on Measurement in Education. (1954). Technical recommendations for psychological tests and diagnostic techniques. Psychological Bulletin, 51(Supplement).
9. Andrich, D. (1978). A rating formulation for ordered response categories. Psychometrika, 43, 561-573.
10. Andrich, D. (1989). A probabilistic IRT model for unfolding preference data. Applied Psychological Measurement, 13, 193-216.
11. Berry, J. W., and Sam, D. (1996). Acculturation and adaptation. In J. W. Berry, M. H. Segall, and C. Kagitcibasi (Eds.), Handbook of cross-cultural psychology: Social behavior and applications (Vol. 3, pp. 291-326). Boston: Allyn and Bacon.
12. Bishop, G. F. (1987). Experiments with the middle response alternative in survey questions. Public Opinion Quarterly, 51, 220-232.
13. Bock, R. D. (1972). Estimating item parameters and latent ability when responses are scores in two or more nominal categories. Psychometrika, 37, 29-51.
14. Briggs, D. C., and Wilson, M. (2003). An introduction to multidimensional measurement using Rasch models. Journal of Applied Measurement, 4, 87-100.
15. Campbell, D. T., and Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56, 81-105.
16. Chang, L. (1995). Connotatively inconsistent test items. Applied Measurement in Education, 8, 199-209.
17. Cizek, G. J. (2001). Setting performance standards: Concepts, methods, and perspectives. Mahwah, NJ: Lawrence Erlbaum.
18. Cizek, G. J. (2006). Standard setting. In S. M. Downing and T. M. Haladyna (Eds.), Handbook of test development (pp. 225-258). Mahwah, NJ: Lawrence Erlbaum.
19. Clauser, B. E. (2000). Recurrent issues and recent advances in scoring performance assessments. Applied Psychological Measurement, 24, 310-324.
20. Crocker, L. (1997). Assessing content representativeness of performance assessment exercises. Applied Measurement in Education, 10, 83-95.
21. nd ed., pp. 443-507). Washington, DC: American Council on Education.
22. De Boeck, P., and Wilson, M. (2004). Explanatory item response models: A generalized linear and nonlinear approach. New York: Springer-Verlag.
23. Dixon, P. N, Bobo, M., and Stevick, R. A. (1984). Response differences and preferences for all-category-defined and end-defined Likert formats. Educational and Psychological Measurement, 44, 61-66.
24. Downing, S. M. (2005). The effects of violating standard item writing principles on tests andstudents: The consequences of using flawed test items on achievement examinations in medical education. Advances in Health Sciences Education, 10, 133-143.
25. Downing, S. M., and Haladyna, T. M. (1997). Test item development: Validity evidence from quality assurance procedures. Applied Measurement in Education, 10, 61-82.
26. Downing, S. M., and Haladyna, T. M. (Eds.). (2006). Handbook of test development. Mahwah, NJ: Lawrence Erlbaum.
27. Educational Testing Service. (2000). ETS Standards for quality and fairness. Princeton, NJ: Author.
28. Embretson (Whitely), S. E. (1983). Construct validity: Construct representation versus nomothetic span. Psychological Bulletin, 93, 179-197.
29. Embretson, S. E., and Reise, S. P. (2000). Item response theory for psychologists. Mahwah, NJ: Lawrence Erlbaum.
30. Fischer, G. H., and Molenaar, I. W. (1995). Rasch models: Foundations, recent developments, and applications. New York: Springer-Verlag.
31. Frederiksen, N., Mislevy, R. J., and Bejar, I. (Eds.). (1993). Test theory for a new generation of tests. Hillsdale, NJ: Lawrence Erlbaum.
32. rd ed.). Mahwah, NJ: Lawrence Erlbaum.
33. Haladyna, T. M., Downing, S. M., and Rodriguez, M. C. (2002). A review of multiple-choice item-writing guidelines for classroom assessment. Applied Measurement in Education, 15, 309-334.
34. Hambleton, R. K., and Swaminathan, H. (1985). Item response theory: Principles and applications. Boston: Kluwer-Nijhoff.
35. Hickey, D. T., Kindfield, A. C. H., Horwtiz, P., and Christie, M. A. (2003). Integrating curriculum, instruction, assessment, and evaluation in a technology-supported genetics environment. American Educational Research Journal, 40, 495-538.
36. Hickey, D. T., Wolfe, E. W., and Kindfield, A. C. H. (2000). Assessing learning in a technologysupported learning environment: Evidential and conseqential validity issues. Educational Assessment, 6, 155-196.
37. Hsu, P. C. (2005). The multidimensional Chinese acculturation measure (MCAM): A validation study. (Doctoral Dissertation, Michigan State University, 2005). Dissertation Abstracts International, 66, 207.
38. Kalton, G., Roberts, J., and Holt, D. (1980). The effects of offering a middle response option with opinion questions. The Statistician, 29, 65-78.
39. Kane, M. T. (2001). Current concerns in validity theory. Journal of Educational Measurement, 38, 319-342.
40. Kim, B. S. K., Brenner, B. R., Liang, C. T. H., and Asay, P. A. (2003). A qualitative study of adaptation experiences of 1.5-generation Asian Americans. Cultural Diversity and Ethnic Minority Psychology, 9, 156-170.
41. Klockars, A. J., and Yamagishi, M. (1988). The influence of labels and positions in rating scales. Journal of Educational Measurement, 25, 85-96.
42. Lam, T. C. M., and Klockars, A. J. (1982). Anchor point effects on the equivalence of questionnaire items. Journal of Educational Measurement, 19, 317-322.
43. Lam, T. C. M., and Stevens, J. J. (1994). Effects of content polarization, item wording, and rating scale width on rating response. Applied Measurement in Education, 7, 141-158.
44. Linacre, J. M. (1994). Many-facet Rasch measurement. Chicago: MESA Press.
45. Linacre, J. M. (2007). Rasch analysis of rank-ordered data. In E. V. Smith, Jr. and R. M. Smith (Eds.), Rasch measurement: Advanced and specialized applications (pp. 1-14). Maple Grove, MN: JAM Press.
46. Lopez, W. A. (1995). Rating scales and shared meaning. Rasch Measurement Transactions, 9, 434.
47. Lord, F. M., and Novick, M. R. (1968). Statistical theories of mental test scores. Reading, MA: Addison-Wesley.
48. Marin, G. (1992). Issues in the measurement of acculturation among Hispanics. In K. F. Geisinger (Ed.), Psychological testing of Hispanics (pp. 235-251). Washington, DC: American Psychological Association.
49. Marsh, H. W. (1996). Positive and negative global self-esteem: A substantively meaningful distinction or artifactors? Journal of Personality and Social Psychology, 70, 810-819.
50. Masters, G. N. (1982). A Rasch model for partial credit scoring. Psychometrika, 47(2), 149-174.
51. Medical Outcomes Trust Scientific Advisory Committee. (1995). Instrument review criteria. Medical Outcomes Trust Bulletin, 1-4.
52. Melnick, S. A., and Gable, R. K. (1990). The use of negative item stems: A cautionary note. Educational Research Quarterly, 14, 31-36.
53. Merbitz, C., Morris, J., and Grip, J. C. (1989). Ordinal scales and foundations of misinference. Archives of Physical Medicine and Rehabilitation, 70, 308-312.
54. Messick, S. (1981). Constructs and their vicis-situdes in educational and psychological research. Psychological Bulletin, 89, 575-588.
55. rd ed., pp. 13-103). New York: Macmillan.
56. Messick, S. (1995). Validity of psychological assessment: Validation of inferences from persons' responses and performances as scientific inquiry into score meaning. American Psychologist, 50, 741-749.
57. rd ed., pp. 335-366). New York: Macmillan.
58. Mok, M. M. C. (2004). Validation of scores from self-learning scales for primary students using tue-score and Rasch measurement methods. Journal of Applied Measurement, 5, 258-286.
59. Muraki, E. (1992). A generalized partial credit model: Application of an EM algorithm. Applied Psychological Measurement, 17, 351-363.
60. Narayan, S., and Krosnick, J. A. (1996). Education moderates some response effects in attitude measurement. Public Opinion Quarterly, 60, 58-88.
61. Newstead, S. E., and Collis, J. M. (1987). Context and the interpretation of quantifiers of frequency. Ergonomics, 30, 1447-1462.
62. Norris, S. P. (1990). Effects of eliciting verbal reports of thinking on critical thinking test performance. Journal of Educational Measurement, 27, 41-58.
63. O'Neill, T. R. (2007). Using paired comparisons to create the semantic construct of frequency. In E. V. Smith, Jr. and R. M. Smith (Eds.), Rasch measurement: Advanced and specialized applications (pp. 15-53). Maple Grove, MN: JAM Press.
64. Presser, S., and Schuman, H. (1980). The measurement of a middle position in attitude surveys. Public Opinion Quarterly, 44, 70-86.
65. Rasch, G. (1960). Probabilistic models for some intelligence and attainment tests. Copenhagen, Denmark: Danish Institute for Educational Research. (Expanded edition, 1980. Chicago: University of Chicago Press.)
66. Rost, J. (1990). Rasch models in latent classes: An integration of two approaches to item analysis. Applied Psychological Measurement, 14, 271-282.
67. Samejima, F. (1969). Estimation of latent ability using a response pattern of graded scores. Psychometrika Monograph, 17.
68. Samejima, F. (1972). A general model for free-response data. Psychometrika Monograph Supplement, 37(1, Pt. 2), 68.
69. Sandoval, J. (1977). The measurement of hyperactive syndrome in children. Review of Educational Research, 47, 293-318.
70. Sandoval, J. (1981). Format effects in two teacher rating scales of hyperactivity. Journal of Abnormal Child Psychology, 9, 203-218.
71. rd ed., pp. 263-331). New York: Macmillan.
72. Spector, P. E., van Katwyk, P. T., Brannick, M. T., and Chen, P. Y. (1997). When two factors don't reflect two constructs: How item characteristics can produce artifactual factors. Journal of Management, 23, 659-677.
73. van der Linden, W. J., and Hambleton, R. K. (Eds.). (1997). Handbook of modern item response theory. New York: Springer.
74. Viger, S. G., Wolfe, E. W., Dozier, H., and Machtmes, K. (2006). Validation of a questionnaire used to assess safety and professionalism among arborists. Journal of Applied Measurement, 7, 292-306.
75. Wagner-Menghin, M. M. (2007). The mixed-Rasch model: An example for analyzing the meaning of response latencies in a personality questionnaire In E. V. Smith, Jr. and R. M. Smith (Eds.), Rasch measurement: Advanced and specialized applications (pp. 102-119). Maple Grove, MN: JAM Press.
76. Wilson, M. (2005). Constructing measures: An item response modeling approach. Mahwah, NJ: Lawrence Erlbaum.
77. Wolfe, E. W., Hickey, D. T., and Kindfield, A. H. C. (in press). An application of the multidimensional random coefficients multinomial logit model to evaluating cognitive models of reasoning in genetics. In M. Garner, W. Fisher, G. Engelhard and M. Wilson (Eds.), Advances in Rasch Measurement (Vol. 1). Maple Grove, MN: JAM Press.
78. Wolfe, E. W., Ray, L. M., and Harris, D. C. (2004). A Rasch analysis of three measures of teacher perception generated from the school and staffing survey. Educational and Psychological Measurement, 64, 842-860.
79. Wolfe, E. W., Viger, S. G., Jarvinen, D. W., and Linksman, J. (in press). Validation of scores from a measure of teachers' efficacy toward standards-aligned classroom assessment. Educational and Psychological Measurement.
80. Wright, B. D., and Linacre, J. M. (1989). Observations are always ordinal; measurements, however, must be interval. Archives of Physical Medicine and Rehabilitation, 70, 857-860.
81. Wright, B. D., and Masters, G. N. (1982). Rating scale analysis. Chicago: MESA Press.
82. Wright, B. D., and Stone, M. H. (1979). Best test design. Chicago: MESA Press.
83. Yamaguchi, J. (1997). Positive versus negative wording. Rasch Measurement Transactions, 11, 567.
84. Zieky, M. (2006). Fairness review in assessment. In S. M. Downing and T. M. Haladyna (Eds.), Handbook of test development (pp. 359-376). Mahwah, NJ: Lawrence Erlbaum.