Effects of changed item order: A cautionary note to practitioners on jumping to computerized adaptive testing for personality assessment

International Journal of Selection and Assessment

Volumn 16, Issue 3, 2008, Pages 249-257

  Ortner, Tuulia M ^a  

^a FREIE UNIVERSITÄT BERLIN   (Germany)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 49749125229     PISSN: 0965075X     EISSN: 14682389     Source Type: Journal    
DOI: 10.1111/j.1468-2389.2008.00431.x     Document Type: Article

References (46)

1. Andersen, E.B. (1973) A Goodness of Fit Test for the Rasch Model. Psychometrika, 38, 123 140.
2. Anderson, J. (1983) The Architecture of Cognition. Cambridge, MA : Harvard University Press.
3. Ben-Porath, Y.S., Slutske, W.S. Butcher, J.N. (1989) A Real-Data Simulation of Computerized Adaptive Administration of the MMPI. Psychological Assessment, 1, 18 22.
4. Bower, G., Black, J. Turner, T. (1979) Scripts in Comprehension and Memory. Cognitive Psychology, 11, 177 220.
5. Bransford, J. Johnson, M. (1972) Contextual Prerequisites for Understanding: Some investigations of comprehension and recall. Journal of Verbal Learning and Verbal Behavior, 11, 717 726.
6. Brennan, R.L. (1992) The Context of Context Effects. Applied Measurement in Education, 5, 3, 225 264.
7. Brugger, C. Teach and Test (TNT), software, Vienna, unpublished.
8. Costa, P.T., Jr. McCrae, R.R. (1992) The NEO-PI-R: The revised NEO personality inventory manual. Odessa, FL : Psychological Assessment Resources.
9. Eysenck, H.-J. (1995) The Eysenck Personality Profiler and Eysenck's Theory of Personality. London : Corporated Assessment Network Ltd.
10. Eysenck, H.-J., Wilson, C.D. Jackson, C.J. (1998) Eysenck Personality Profiler (EPP-D). Frankfurt/M. : Swets.
11. Fazio, R.H. (1990) A Practical Guide to the Use of Response Latency in Social Psychological Research. In : Hendrick, C. Clark, M.S. (eds), Research Methods in Personality and Social Psychology. Thousand Oaks, CA : Sage, pp. 74 97.
12. Fischer, G.H. Molenaar, I.W. (1995) Rasch Models. New York : Springer.
13. Fischer, G.H. Ponocny-Seliger, E. (1998) LPCM-Win. Structural Rasch Modeling. Handbook of the Usage of LPCM-Win 1.0. Groningen : ProGamma.
14. Gough, H.G. (1975) California Psychological Inventory Manual. Palo Alto, CA : Consulting Psychologists Press.
15. Hathaway, S.R. McKinley, H.U. (1943) The Minnesota Multiphasic Personality Inventory. Minneapolis, MN : University of Minnesota Press.
16. Hornke, L.F. (1993) Mögliche Einspareffekte beim computergestützten Testen [Possible Savings in Computerized Adaptive Testing]. Diagnostica, 39, 109 119.
17. Johnson, E. Tversky, A. (1983) Affect, Generalization, and the Perception of Risk. Journal of Personality and Social Psychology, 45, 20 31.
18. Kamakura, W.A. Balasubramanian, S.K. (1989) Tailored Interviewing: An application of item response theory for personality measurement. Journal of Personality Assessment, 53, 502 519.
19. Krampen, G. (1993) Effekte von Bewerbungsinstruktionen und Subskalenextraktion in der Fragebogendiagnostik [Effects of Job Application Briefing and Extraction of Subscales in the Assessment with Questionnaires]. Diagnostica, 39, 97 108.
20. Krampen, G., Hense, H. Schneider, J.F. (1992) Reliabilität und Validität von Fragebogenskalen bei Standardreihenfolge versus inhaltshomogener Blockbildung ihrer Items [Reliability and Validity of Questionnaire Scales in Conventional Order Versus Content Homogenous Blocking of Items]. Zeitschrift für experimentelle und angewandte Psychologie, 39, 229 248.
21. Kubinger, K.D. (2001) Psychologische Diagnostik: Standortbestimmung und Perspektive [Psychological Assessment: Present position and perspective]. In : Silbereisen, R.K. Frey, D. (eds), Perspektiven der Psychologie. Weinheim : PVU, pp. 157 173.
22. Lord, F.M. (1980) Applications of Item Response Theory to Practical Testing Problems. Hillsdale, NJ : Lawrence Erlbaum.
23. Moosbrugger, H., Fischbach, A. Schermelleh-Engel, K. (1998) Zur Konstruktvalidität des EPP-D [About Construct Validity of the EPP-D]. In : Eysenck, H.-J., Wilson, C.D. Jackson, C.J. (eds), Eysenck Personality Profiler (EPP-D). Frankfurt : Swets Test Service, pp. 89 118.
24. Ortner, T.M. (2004) On Changing the Position of Items in Personality Questionnaires: Analysing effects of item sequence using IRT. Psychology Science, 47, 4, 59 69.
25. Perfahl, B.B. (1998) Eine testtheoretische Analyse des neuen EPP-D. [A test-theoretical analysis of the new EPP-D]. Unpublished Diploma Thesis. Vienna: University of Vienna.
26. Rasch, G. (1960) Probabilistic Models for Some Intelligence and Attainment Tests. Copenhagen : Nielsen & Lydiche.
27. Rasch, G. (1977) On Specific Objectivity: An attempt at formalising the request for generality and validity of scientific statements. Danish Yearbook of Philosophy, 14, 58 94.
28. Rost, D.-H. Hoberg, K. (1997) Itempositionsveränderungen in Persönlichkeitsfragebogen: Methodischer Kunstfehler oder tolerierbare Praxis? [Change of Item Positions in Personality Questionnaires: Methodical malpractice or tolerable practice?]. Diagnostica, 43, 2, 97 112.
29. Rost, J. (2002) When Personality Questionnaires Fail to be Unidimensional. Psychologische Beiträge, 44, 108 125.
30. Schriesheim, C.A., Kopelman, R.E. Solomon, E. (1989) The Effect of Grouped Versus Randomized Questionnaire Format on Scale Reliability and Validity: A three-study investigation. Educational and Psychological Measurement, 49, 487 508.
31. Schwarz, N. Wyer, R. (1985) Effects of Rank Ordering Stimuli on Magnitude Ratings of These and Other Stimuli. Journal of Experimental Social Psychology, 21, 30 46.
32. Simms, L.J. Clark, L.A. (2005) Validation of a Computerized Adaptive Version of the Schedule for Nonadaptive and Adaptive Personality (SNAP). Psychological Assessment, 17, 1, 28 43.
33. Strack, F., Schwartz, N. Gschneidinger, E. (1985) Happiness and Reminiscing: The role of time perspective, affect, and mode of thinking. Journal of Personality and Social Psychology, 49, 1460 1469.
34. Thissen, D. Mislevy, R.J. (2000) Computerized Adaptive Testing: A primer. In : Wainer, H. (ed.), Testing Algorithms. New Jersey : Lawrence Erlbaum Associates, pp. 101 133.
35. Tourangeau, R. (1984) Cognitive Science and Survey Methods. In : Jabine, T., Straf, M., Tanur, J. Tourangeau, R. (eds), Cognitive Aspects of Survey Methodology: Building a bridge between disciplines. Washington, DC : National Academy Press, pp. 73 100.
36. Tourangeau, R. Rasinski, K.A. (1988) Cognitive Processes Underlying Context Effects in Attitude Measurement. Psychological Bulletin, 103, 299 314.
37. Trope, Y. (1986) Identification and Inferential Processes in Dispositional Attribution. Psychological Review, 93, 239 257.
38. Van der Linden, W.J. Glas, C.A.W. (eds) 2000) Computerized Adaptive Testing: Theory and practice. St Paul, MN : Assessment Systems Corporation.
39. Wainer, H. (2000) Introduction and History. In : Wainer, H. (ed.), Computerized Adaptive Testing: A primer. Hillsdale, NJ : Lawrence Erlbaum Associates, pp. 1 21.
40. Wainer, H., Dorans, N.J., Flaugher, R., Green, B.F., Mislevy, R.J., Steinberg, L. Thissen, D. (1990) Computerized Adaptive Testing: A primer. Hillsdale, NJ : Lawrence Erlbaum Associates.
41. Wainer, H. Eignor, D. (2000) Caveats, Pitfalls, and Unexpected Consequences of Implementing Large Scale Computerized Testing. In : Wainer, H. (ed.), Computerized Adaptive Testing: A primer. Hillsdale, NJ : Lawrence Erlbaum Associates, pp. 271 299.
42. Waller, N.G. Reise, S.P. (1989) Computerized Adaptive Personality Assessment: An illustration with the absorption scale. Journal of Personality and Social Psychology, 57, 1051 1058.
43. Warm, T.A. (1989) Weighted Likelihood Estimation of Ability in the Item Response Theory. Psychometrika, 54, 427 450.
44. Weiss, D.J. (1982) Improving Measurement Quality and Efficiency with Adaptive Testing. Applied Psychological Measurement, 6, 473 492.
45. Weiss, D.J. (1983) New Horizons in Testing: Latent trait test theory and computerized adaptive testing. New York : Academic.
46. Weiss, D.J. Kingsbury, G.G. (1984) Application of Computerized Adaptive Testing to Educational Problems. Journal of Educational Measurement, 21, 361 375.