Exploring item order in anxiety-related constructs: Practical impacts of serial position

Practical Assessment, Research and Evaluation

Volumn 17, Issue 7, 2012, Pages 1-15

  Nicholas Carleton, R ^a   Thibodeau, Michel A ^a   Osborne, Jason W ^b   Asmundson, Gordon J G ^a  

^a UNIVERSITY OF REGINA   (Canada)

^b OLD DOMINION UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84877152268     PISSN: None     EISSN: 15317714     Source Type: Journal    
DOI: None     Document Type: Article

References (87)

1. American Psychiatric Association. (2000). Diagnostic and statistical manual of mental disorders (4th ed., text revision ed.). Washington, DC: Author.
2. Asmundson, G. J. G. (1999). Anxiety sensitivity and chronic pain: Empirical findings, clinical implications, and future directions. In S. Taylor (Ed.), Anxiety sensitivity: Theory, research and treatment of the fear of anxiety (pp. 269-285). New Jersey: Erlbaum.
3. Beck, A. T., Ward, C. H., Mendelson, M., Mock, J., & Erbaugh, J. (1961). An inventory for measuring depression. Archives of General Psychiatry, 4, 561-571.
4. Boelen, P. A., & Carleton, R. N. (2012). Intolerance of uncertainty, hypochondriacal concerns, OCD, and worry. Journal of Nervous and Mental Disease, 300, 208-213.
5. Boelen, P. A., & Reijntjes, A. (2009). Intolerance of uncertainty and social anxiety. Journal of Anxiety Disorders, 23, 130-135. doi: 10.1016/j.janxdis.2008.04.007
6. Browne, M. W., & Cudeck, R. (1989). Single sample cross-validation indices for covariance structures. Multivariate Behavioral Research, 24, 445-455. doi: 10.1207/s15327906mbr2404_4
7. Browne, M. W., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. A. Bollen & J. S. Long (Eds.), Testing structural equation models. Newbury Park, CA: Sage Publications Inc.
8. Byrne, B. (2001). Structural equation modeling with AMOS: Basic concepts, applications, and programming. Mahwah, NJ: Erlbaum.
9. Byrne, B. (2004). Testing for multigroup invariance using amos graphics: A road less traveled. Structural Equation Modeling, 11, 272-300. doi: 10.1207/s15328007sem1102_8
10. Carleton, R. N., Abrams, M. P., Asmundson, G. J. G., Antony, M. M., & McCabe, R. E. (2009). Pain-related anxiety and anxiety sensitivity across anxiety and depressive disorders. Journal of Anxiety Disorders, 23, 791-798.
11. Carleton, R. N., Abrams, M. P., Kachur, S. S., & Asmundson, G. J. G. (2009). Waddell's symptoms as correlates of vulnerabilities associated with fear-anxiety-avoidance models of pain: Pain-related anxiety, catastrophic thinking, perceived disability, and treatment outcome. Journal of Occupational Rehabilitation, 19, 364-374.
12. Carleton, R. N., & Asmundson, G. J. G. (2009). The multidimensionality of fear of pain: Construct independence for the Fear of Pain Questionnaire-short form and the Pain Anxiety Symptoms Scale-20. The Journal of Pain, 10, 29-37.
13. Carleton, R. N., Asmundson, G. J. G., & Taylor, S. (2005). Fear of physical harm: Factor structure and psychometric properties of the injury/illness sensitivity index. Journal of Psychopathology and Behavioral Assessment, 27, 235-241.
14. Carleton, R. N., Collimore, K. C., & Asmundson, G. J. G. (2007). Social anxiety and fear of negative evaluation: Construct validity of the BFNE-II. Journal of Anxiety Disorders, 21, 131-141. doi: S0887-6185(06)00047-8 [pii] 10.1016/j.janxdis.2006.03.010
15. Carleton, R. N., Collimore, K. C., & Asmundson, G. J. G. (2010). It's not just the judgements, it's that I don't know: Intolerance of uncertainty as a predictor of social anxiety.. Journal of Anxiety Disorders, 24, 189-195. doi: 10.1016/j.janxdis.2009.10.007
16. Carleton, R. N., Collimore, K. C., Asmundson, G. J. G., McCabe, R. E., Rowa, K., & Antony, M. M. (2009). Refining and validating the Social Interaction Anxiety Scale and the Social Phobia Scale. Depression and Anxiety, 26, E71-81.
17. Carleton, R. N., Collimore, K. C., McCabe, R. E., & Antony, M. M. (2011). Addressing revisions to the brief fear of negative evaluation scale: Measuring fear of negative evaluation across anxiety and mood disorders. Journal of Anxiety Disorders, 25, 822-828. doi: 10.1016/j.janxdis.2011.04.002
18. Carleton, R. N., Gosselin, P., & Asmundson, G. J. G. (2010). The Intolerance of Uncertainty Index: Replication and extension with an english sample. Psychological Assessment, 22, 396-406. doi: 10.1037/a0019230
19. Carleton, R. N., McCreary, D. R., Norton, P. J., & Asmundson, G. J. G. (2006). Brief Fear of Negative Evaluation Scale-revised. Depression and Anxiety, 23, 297-303. doi: 10.1002/da.20142
20. Carleton, R. N., Norton, M. A., & Asmundson, G. J. G. (2007). Fearing the unknown: A short version of the Intolerance of Uncertainty Scale. Journal of Anxiety Disorders, 21, 105-117. doi: S0887-6185(06)00051-X [pii]10.1016/j.janxdis.2006.03.014
21. Carleton, R. N., Park, I., & Asmundson, G. J. G. (2006). The Illness/Injury Sensitivity Index: An examination of construct validity. Depression and Anxiety, 23, 340-346. doi: 10.1002/da.20138
22. Carleton, R. N., Sharpe, D., & Asmundson, G. J. G. (2007). Anxiety sensitivity and intolerance of uncertainty: Requisites of the fundamental fears? Behaviour Research and Therapy, 45, 2307-2316. doi: S0005-7967(07)00095-2 [pii]10.1016/j.brat.2007.04.006
23. Carleton, R. N., Weeks, J. W., Howell, A. N., Asmundson, G. J. G., Antony, M. M., & McCabe, R. E. (2012). Assessing the latent structure of the intolerance of uncertainty construct: An initial taxometric analysis. Journal of Anxiety Disorders, 26, 150-157.
24. Cohen, J. (1988). Statistical power analysis for the behavioral sciences. (2nd ed.). Mawah, NJ: Erlbaum.
25. Curran, P. J., West, S. G., & Finch, J. F. (1996). The robustness of test statistics to nonnormality and specification error in confirmatory factor analysis. Psychological Methods, 1, 16-29.
26. Dahl, J., Wilson, K. G., & Nilsson, A. (2004). Acceptanc and commitment therapy and the treatment of persons at risk for long-term disability resulting from stress and painsymptoms: A preliminary randomized trial. Behavior Therapy, 35, 785-801.
27. Dahlstrom, W. G., Brooks, J. D., & Peterson, C. D. (1990). The Beck Depression Inventory: Item order and the impact of response sets. Journal of Personality Assessment, 55, 224-233.
28. DeMoranville, C. W., Bienstock, C. C., & Judson, K. (2008). Using question order for predictive service quality measures. The Journal of Services Marketing, 22, 255-262.
29. Dorans, N. J., & Kulick, E. (1986). Demonstrating the utility of the standardization approach to assessing unexpected differential item performance on the scholastic aptitude-test. Journal of Educational Measurement, 23, 355-368.
30. Dugas, M. J., & Robichaud, M. (2007). Cognitive-behavioral treatment for generalized anxiety disorder: From science to practice. New York, NY: Routledge.
31. Embretson, S. E., & Reise, S. P. (2000). Item response theory for psychologists. Mahwah, N.J.: L. Erlbaum Associates.
32. Epley, N., & Gilovich, T. (2010). Anchoring unbound. Journal of Consumer Psychology, 20, 20-24. doi: DOI 10.1016/j.jcps.2009.12.005
33. Fedoroff, I. C., Taylor, S., Asmundson, G. J. G., & Koch, W. J. (2000). Cognitive factors in traumatic stress reactions: Predicting PTSD symptoms from anxiety sensitivity and beliefs about harmful events. Behavioural and Cognitive Psychotherapy, 28, 5-15.
34. Feldt, L. S., Woodruff, D. J., & Salih, F. A. (1987). Statistical-inference for coefficient-alpha. Applied Psychological Measurement, 11, 93-103.
35. Freeston, M., Rhéaume, J., Letarte, H., Dugas, M. J., & Ladouceur, R. (1994). Why do people worry? Personality and Individual Differences, 17, 791-802. doi: 10.1016/0191-8869(94)90048-5
36. Gosselin, P., Ladouceur, R., Evers, A., Laverdiere, A., Routhier, S., & Tremblay-Picard, M. (2008). Evaluation of intolerance of uncertainty: Development and validation of a new self-report measure. Journal of Anxiety Disorders, 22, 1427-1439. doi: 10.1016/j.janxdis.2008.02.005
37. Hamilton, J. C., & Shuminsky, T. R. (1990). Self-awareness mediates the relationship between serial position and item reliability. Journal of Personality and Social Psychology, 59, 1301-1307.
38. Hidalgo, M. D., & Lopez-Pina, J. A. (2004). Differential item functioning detection and effect size: A comparison between logistic regression and mantel-haenszel procedures. Educational and Psychological Measurement, 64, 903-915. doi: Doi 10.1177/0013164403261769
39. Holland, P. W., & Thayer, D. T. (1988). Differential item functioning and the mantel-haenszel procedure. In H. Wainer & H. I. Braun (Eds.), Test validity, 129-145. Hillsdale, NJ: Lawrence Erlbaum Associates.
40. Hu, L., & Bentler, P. M. (1999). Fit indices in covariance structure modeling: Sensitivity to underparameterized model mis-specification. Psychological Methods, 3, 424-453.
41. Khawaja, N. G., & Yu, L., N. H. (2010). A comparison of the 27-item and 12-item Intolerance of Uncertainty Scales. Clinical Psychologist, 14, 97-106. doi: Doi 10.1080/13284207.2010.502542
42. Knowles, E. S. (1988). Item context effects on personality-scales - measuring changes the measure. Journal of Personality and Social Psychology, 55, 312-320.
43. Knowles, E. S., & Byers, B. (1996). Reliability shifts in measurement reactivity: Driven by content engagement or self-engagement? Journal of Personality and Social Psychology, 70, 1080-1090.
44. Kori, S. H., Miller, R. P., & Todd, D. D. (1990). Kinesiophobia: A new view of chronic pain behavior. Pain Management, 3, 35-43.
45. Kornblith, S. J., Greenwald, D. P., Michelson, L., & Kazdin, A. E. (1984). Measuring the effects of demand characteristics on the Beck Depression Inventory responses of college students. Journal of Psychopathology and Behavioral Assessment, 6, 45-49.
46. Krosnick, J. A., & Presser, S. (2010). Question and questionnaire design. In P. V. Marsden & J. D. Wright (Eds.), Handbook of survey research (pp. 263-314). Bingley, UK: Emerald Group Publishing Limited.
47. Lam, T. C. M., Green, K. E., & Bordignon, C. (2002). Effects of item grouping and position of the "don't know"option on questionnaire response. Field Methods, 14, 418-432. doi: 10.1177/152582202237730
48. Lei, M., & Lomax, R. G. (2005). The effect of varying degrees of nonormality in structural equation modeling. Structural Equation Modeling, 12, 1-27. doi: 10.1207/s15328007sem1201_1
49. Marsden, P. V., & Wright, J. D. (2010). Handbook of survey research. Bingley, UK: Emerald Group Publishing Limited.
50. McEvoy P.M., Mahoney A.E.J., Achieving certainty about the structure of intolerance of uncertainty in a treatment-seeking sample with anxiety and depression, Journal of Anxiety Disorders, (2011) 25, 112-122, doi: 10.1016/j.janxdis.2010.08.010
51. Monahan P.O., McHorney C.A., Stump T.E., Perkins A.J., Odds ratio, delta, ETS classification, and standardization measures of dif magnitude for binary logistic regression, Journal of Educational and Behavioral Statistics, 2007, 32, 92-109, doi: 10.3102/1076998606298035
52. Neely, D. L., Springston, F. J., & McCann, S. J. (1994). Does item order affect performance on multiplechoice exams? Teaching of Psychology, 21, 44-45.
53. Nevitt J., Hancock G.R., Performance of bootstrapping approaches to model test statistics and parameter standard error estimation in structural equation modeling, Structural Equation Modeling, 2001, 8, 353-377, doi: 10.1207/S15328007SEM0803_2
54. Olatunji B.O., Williams N.L., Sawchuk C.N., Lohr J.M., Disgust, anxiety and fainting symptoms associated with blood-injection-injury fears: A structural model, Journal of Anxiety Disorders, 2006, 20, 23-41, doi: 10.1016/j.janxdis.2004.11.009
55. Reiss S., Expectancy model of fear, anxiety, and panic, Clinical Psychology Review, 1991, 141-153, doi: 10.1016/0272-7358(91)90092-911
56. Reiss, S., & McNally, R. J. (1985). The expectancy model of fear. In S. Reiss & R. R. Bootzin (Eds.), Theoretical issues in behaviour therapy (pp. 107-121). New York, NY: Academic Press.
57. Roelofs, J., Peters, M. L., Fassaert, T., & Vlaeyen, J. W. S. (2005). The role of fear of movement and injury in selective attentional processing in patients with chronic low back pain: A dot-probe evaluation. The Journal of Pain, 6, 294-300.
58. Rossi, P. H., Wright, J. D., & Anderson, A. B. (1983). Handbook of survey research. New York, NY: Academic Press.
59. Schuman, H., & Presser, S. (1996). Questions and answers in attitude survey. London: Sage Publications Inc.
60. Schwarz, N. (1995). What respondents learn from questionnaires: The survey interview and the logic of conversation. International Statistical Review, 63, 153-168.
61. Sexton K.A., Norton P.J., Walker J.R., Norton G.R., Hierarchical model of generalized and specific vulnerabilities in anxiety, Cognitive Behaviour Therapy, 2003, 32, 82-94, doi: 10.1080/16506070302321
62. Spielberger, C. D., Gorsuch, R. L., Luschene, R. E., Vagg, P. R., & Jacobs, G. A. (1983). Manual for the State-Trait Anxiety Inventory. Palo Alto, CA: Consulting Psychologists Press.
63. Steinberg, L. (1994). Context and serial-order effects in personality measurement - limits on the generality of measuring changes the measure. Journal of Personality and Social Psychology, 66, 341-349.
64. Strack, F., & Mussweiler, T. (1997). Explaining the enigmatic anchoring effect: Mechanisms of selective accessibility. Journal of Personality and Social Psychology, 73, 437-446.
65. Tabachnick, B. G., & Fidell, L. S. (2007). Using multivariat statistics (5th ed.). Boston, MA: Allyn and Bacon.
66. Taylor S., The structure of fundamental fears, Journal of Behavior Therapy and Experimental Psychiatry, 1993, 24, 289-299, doi: 10.1016/0005-7916(93)90053-Y
67. Taylor, S. (2004). Anxiety sensitivity and its implications for understanding and treating ptsd. In S. Taylor (Ed.), Advances in the treatment of posttraumatic stress disorder: Cognitive-behavioral perspectives (pp. 57-66). New York, NY: Springer Publishing Company.
68. Taylor, S. (Ed.). (1999). Anxiety sensitivity: Theory, research, and treatment of the fear of anxiety. Mahwah, NJ: Erlbaum.
69. Taylor, S., Asmundson, G. J. G., Carleton, R. N., & Brundin, P. (2007). Acute posttraumatic stress symptoms and depression after exposure to the 2005 Saskatchewan centennial air show disaster: Prevalence and predictors. American Journal of Disaster Medicine, 2, 217-230.
70. Taylor, S., Koch, W. J., McNally, R. J., & Crockett, D. J. (1992). Conceptualizations of anxiety sensitivity. Psychological Assessment, 4, 245-250.
71. Taylor, S., Koch, W. J., Woody, S., & McLean, P. (1996). Anxiety sensitivity and depression: How are they related? Journal of Abnormal Psychology, 105, 474-479.
72. Taylor S., Zvolensky M.J., Cox B.J., Deacon B., Heimberg R.G., Ledley D.R., Cardenas S.J., Robust dimensions of anxiety sensitivity: Development and initial validation of the Anxiety Sensitivity Index-3, Psychological Assessment, 2007, 19, 176-188, doi: 2007-07953-002 [pii]10.1037/1040-3590.19.2.176
73. Tourangeau, R., & Rasinski, K. A. (1988). Cognitive-processes underlying context effects in attitude measurement. Psychological Bulletin, 103, 299-314.
74. Tourangeau, R., Rips, L. J., & Rasinski, K. A. (2000). The psychology of survey response. New York, NY: Cambridge University Press.
75. Turk, C. L., Heimberg, R. G., & Hope, D. A. (2001). Social anxiety disorder. In D. H. Barlow (Ed.), Clinical handbook of psychological disorders: A step-by-step treatment manual (3rd ed.) (pp. 114-153). New York, NY: Guilford Press.
76. Turk, C. L., Lerner, J., Heimberg, R. G., & Rapee, R. M. (2001). An integrated cognitive-behavioral model of social anxiety. In S. G. Hofmann & P. M. DiBartolo (Eds.), From social anxiety to social phobia: Multiple perspectives (pp. 281-303). Needham Heights, MA: Allyn & Bacon.
77. Turner, S. M., McCanna, M., & Beidel, D. C. (1987). Validity of the social avoidance and distress and fear of negative evaluation scales. Behaviour Research and Therapy, 25, 113-115.
78. Vancleef, L. M., Peters, M. L., Roelofs, J., & Asmundson, G. J. G. (2006). Do fundamental fears differentially contribute to pain-related fear and pain catastrophizing? An evaluation of the sensitivity index. European Journal of Pain, 10, 527-536.
79. Vlaeyen J.W.S., Kole-Snijders A.M., Boeren R.G., van Eek H., Fear of movement/(re)injury in chronic low back pain and its relation to behavioral performance, Pain, 1995, 62, 363-372, doi: 030439599400279N [pii]
80. Wainer, H., & Kiely, G. L. (1987). Item clusters and computerized adaptive testing: A case for testlets. Journal of Educational Measurement, 24, 185-201.
81. Watson, D., & Friend, R. (1969). Measurement of social-evaluative anxiety. Journal of Consulting and Clinical Psychology, 33, 448-457.
82. Watt, M. C., O'Connor, R., Stewart, S., Moon, E., & Terry, L. (2008). Specificity of childhood learning experiences related to anxiety sensitivity and illness/injury sensitivity: Implications for health anxiety and pain. Journal of Cognitive Psychotherapy, 22, 128-142.
83. Weeks J.W., Carleton R.N., Asmundson G.J.G., McCabe R.E., Antony M.M., Social anxiety disorder carved at its joints: Evidence for the taxonicity of social anxiety disorder, Journal of Anxiety Disorder, 2010, 24, 734-742, doi: 10.1016/j.janxdis.2010.05.006
84. Weeks, J. W., Heimberg, R. G., Fresco, D. M., Hart, T. A., Turk, C. L., Schneier, F. R., & Liebowitz, M. R. (2005). Empirical validation and psychometric evaluation of the Brief Fear of Negative Evaluation scale in patients with social anxiety disorder. Psychological Assessment, 17, 179-190.
85. Zinbarg, R. E., Barlow, D. H., & Brown, T. A. (1997). Hierarchical structure and general factor saturation of the Anxiety Sensitivity Index. Psychological Assessment, 9, 277-284.
86. Zumbo, B. D. (2007). Three generations of differential item functioning (DIF) analyses: Considering where it has been, where it is now, and where it is going. Language Assessment Quarterly, 4, 223-233.
87. Zwick, R., & Thayer, D. T. (1996). Evaluating the magnitude of differential item functioning in polytomous items. Journal of Educational and Behavioral Statistics, 21, 187-201.