A randomized experiment to compare conventional, computerized, and computerized adaptive administration of ordinal polytomous attitude items

Applied Psychological Measurement

Volumn 29, Issue 3, 2005, Pages 159-183

  Hol, A Michiel ^a   Vorst, Harrie C M ^a   Mellenbergh, Gideon J ^a  

^a UNIVERSITY OF AMSTERDAM   (Netherlands)

Author keywords

Adaptive testing; Attitude measurement; Computer assisted testing; Item response theory; Likert scales; Statistical validity; Test administration

Indexed keywords

EID: 18144401320     PISSN: 01466216     EISSN: None     Source Type: Journal    
DOI: 10.1177/0146621604271268     Document Type: Article

References (33)

1. Andrich, D. (1978). Application of a psychometric rating model to ordered categories which are scored with successive integers. Applied Psychological Measurement, 2, 581-594.
2. Baek, S. G. (1995). Computerized adaptive attitude testing using the partial credit model. Dissertation Abstracts International - A, 55(7-A), 1922. Abstract retrieved March 10, 2003, from Psychlnfo database.
3. Balasubramanian, S. K., & Kamakura, W. A. (1989). Measuring consumer attitudes toward the market-place with tailored interviews. Journal of Marketing Research, 26, 311-326.
4. Bock, R. D., & Lieberman, M. (1970). Fitting a response model for n dichotomously scored items. Psychometrika, 35, 179-197.
5. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum.
6. Dodd, B. G., De Ayala, R. J., & Koch, W. R. (1995). Computerized adaptive testing with polytomous items. Applied Psychological Measurement, 19, 5-22.
7. Dodd, B. G., Koch, W. R., & De Ayala, R. J. (1989). Operational characteristics of adaptive testing procedures using the graded response model. Applied Psychological Measurement, 13, 129-143.
8. Drasgow, F., & Buchanan, J. B. (Eds.). (1999). Innovations in computerized assessment. Mahwah, NJ: Lawrence Erlbaum.
9. Embretson, S. E., & Reise, S. P. (2000). Item response theory for psychologists. Mahwah, NJ: Lawrence Erlbaum.
10. Everitt, B. S. (1977). The analysis of contingency tables. New York: John Wiley.
11. Finger, M. S., & Ones, D. S. (1999). Psychometric equivalence of the computer and booklet forms of the MMPI: A meta-analysis. Psychological Assessment, 11, 58-66.
12. Gibbons, J. D. (1985). Nonparametric statistical inference. New York: Marcel Dekker.
13. Hochberg, Y. (1988). A sharper Bonferroni procedure for multiple tests of significance. Biometrika, 75, 800-802.
14. Hoi, A. M., Vorst, H. C. M., & Mellenbergh, G. J. (2001). Toepassing van een computergestuurde adaptieve testprocedure op persoonlijkheidsdata [Application of a computerized adaptive test procedure on personality data]. Nederlands Tijdschrift Voor de Psychologie, 56, 119-133.
15. Koch, W. R., Dodd, B. G., & Fitzpatrick, S. J. (1990). Computerized adaptive measurements of attitudes. Measurement and Evaluation in Counseling and Development, 23, 20-30.
16. Masters, G. N. (1982). A Rasch model for partial credit scoring. Psychometrika, 47, 149-174.
17. McCoach, D. B. (2002). A validation study of the school attitude assessment survey. Measurement and Evaluation in Counseling and Development, 35, 66-77.
18. McCoach, D. B., & Siegle, D. (2003). The School Attitude Assessment Survey-Revised: A new instrument to identify academically able students who underachieve. Educational and Psychological Measurement, 63, 414-429.
19. Mead, A. D., & Drasgow, F. (1993). Equivalence of computerized and paper-and-pencil cognitive ability tests: A meta-analysis. Psychological Bulletin, 114, 449-458.
20. Meijer, R. R., & Nering, M. L. (1999). Computerized adaptive testing: Overview and introduction. Applied Psychological Measurement, 23, 187-194.
21. Mellenbergh, G. J. (1995). Conceptual notes on models for discrete polytomous item responses. Applied Psychological Measurement, 19,91-100.
22. Reise, S. P., & Henson, J. M. (2000). Computerization and adaptive administration of the NEO PI-R. Assessment, 7, 347-364.
23. Samejima, F. (1969). Estimation of latent trait ability using a response pattern of graded scores. Psychometrika Monograph, no. 17.
24. Samejima, F. (1997). Graded response model. In W. J. van der Linden & R. K. Hambleton (Eds.), Handbook of modern item response theory (pp. 85-100). New York: Springer-Verlag.
25. Singh, J., Howell, R. D., & Rhoads, G. K. (1990). Adaptive designs for Likert-type data: An approach for implementing marketing research. Journal of Marketing Research, 27, 304-321.
26. Stevens, J. (1996). Applied multivariate statistics for the social sciences. Mahwah, NJ: Lawrence Erlbaum.
27. Thissen, D. (1991). Multilog 6.0 user's guide. Chicago: Scientific Software.
28. Tutz, G. (1990). Sequential item response models with an ordered response. British Journal of Mathematical and Statistical Psychology, 43, 39-55.
29. Vorst, H. C. M. (2000). Schoolvragenlijst [School Attitude Questionnaire]. Lisse, the Netherlands: Swets & Zeitlinger.
30. Waller, N. G. (1999). Searching for structure in the MMPI. In S. E. Embretson & S. L. Hershberger (Eds.), The new rules of measurement; What every psychologist and educator should know (pp. 185-217). Mahwah, NJ: Lawrence Erlbaum.
31. Waller, N. G., & Reise, S. P. (1989). Computerized adaptive personality assessment: An illustration with the Absorption Scale. Journal of Personality and Social Psychology, 57, 1051-1058.
32. Wicherts, J. M. (2002). Meetequivalentie tussen pen & papier en computerafname van vragenlijsten: Alexithymie, sociale wenselijkheid en angst [Measurement equivalence of paper-and-pencil and computerized administration of questionnaires: Alexithymia, social desirability, and anxiety]. Unpublished master's thesis, University of Amsterdam.
33. Zwick, R. (1985). Nonparametric one-way multivariate analysis of variance: A computational approach based on the Pillai-Bartlett trace. Psychological Bulletin, 97, 148-152.