The ABC's of suicide risk assessment: Applying a tripartite approach to individual evaluations

PLoS ONE

Volumn 10, Issue 6, 2015, Pages

  Harris, Keith M ^a   Syu, Jia Jia ^a   Lello, Owen D ^b   Chew, Y L Eileen ^c   Willcox, Christopher H ^d,e   Ho, Roger H M ^e  

^a UNIVERSITY OF QUEENSLAND   (Australia)

^b UNIVERSITY OF NEWCASTLE   (Australia)

^c Research and Development Dept   (Singapore)

^d Hunter New England Mental Health   (Australia)

^e NATIONAL UNIVERSITY OF SINGAPORE   (Singapore)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; AFFECT BEHAVIOR COGNITION THEORY; AGED; ARTICLE; BEHAVIOR ASSESSMENT; CLASSICAL TEST THEORY; CONSTRUCT VALIDITY; CONVERGENT VALIDITY; FACTORIAL ANALYSIS; FEMALE; HUMAN; ITEM RESPONSE THEORY; MAJOR CLINICAL STUDY; MALE; NORMAL HUMAN; PREDICTIVE VALIDITY; RELIABILITY; RISK ASSESSMENT; SELF REPORT; SUICIDAL AFFECT BEHAVIOR COGNITION SCALE; SUICIDAL BEHAVIOR; SUICIDAL BEHAVIORS QUESTIONNAIRE REVISED; SUICIDAL IDEATION; SUICIDE; THEORY; UNIVERSITY STUDENT; ADOLESCENT; MIDDLE AGED; PROCEDURES; PROSPECTIVE STUDY; PSYCHOLOGY; QUESTIONNAIRE; YOUNG ADULT;

ADOLESCENT; ADULT; AGED; FEMALE; HUMANS; MALE; MIDDLE AGED; PROSPECTIVE STUDIES; RISK ASSESSMENT; SUICIDE; SURVEYS AND QUESTIONNAIRES; YOUNG ADULT;

EID: 84931274961     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0127442     Document Type: Article

References (114)

1. World Health Organization. The global burden of disease: 2004 update. Geneva, Switzerland: WHO Press; 2008.
2. Borschmann R, Hogg J, Phillips R, Moran P. Measuring self-harm in adults: A systematic review. European Psychiatry. 2012; 27(3):176-80. doi: 10.1016/j.eurpsy.2011.04.005 PMID: 21696926
3. Olfson M, Marcus SC, Bridge JA. Focusing suicide prevention on periods of high risk. Journal of the American Medical Association. 2014; 311(11):1107-8. doi: 10.1001/jama.2014.501 PMID: 24515285
4. Hobart JC, Cano SJ, Zajicek JP, Thompson AJ. Rating scales as outcome measures for clinical trials in neurology: Problems, solutions, and recommendations. Lancet Neurol. 2007; 6(12):1094-105. doi: 10.1016/S1474-4422(07)70290-9 PMID: 18031706
5. DeVellis RF. Scale development: Theory and applications. 3rd ed. Bickman L, Rog DJ, editors. Los Angeles, CA: Sage; 2012.
6. Groth-Marnat G. Handbook of psychological assessment. 5th ed. Hoboken, NJ: John Wiley & Sons; 2009.
7. Jobes DA, Nelson KN, Peterson EM, Pentiuc D, Downing V, Francini K, et al. Describing suicidality: An investigation of qualitative SSF responses. Suicide and Life-Threatening Behavior. 2004; 34(2):99-112. doi: 10.1521/suli.34.2.99.32788 PMID: 15191267
8. Michel K, Maltsberger JT, Jobes DA, Leenaars AA, Orbach I, Stadler K, et al. Discovering the truth in attempted suicide. American Journal of Psychotherapy. 2002; 56(3):424-37. PMID: 12400207
9. Eagly AH, Chaiken S. The psychology of attitudes. Fort Worth, TX: Harcourt, Brace, Jovanovich; 1993.
10. Patry MW, Magaletta PR. Measuring suicidality using the Personality Assessment Inventory: A convergent validity study with federal inmates. Assessment. 2015; 22(1):36-45. doi: 10.1177/1073191114539381 PMID: 24947983
11. Kral MJ, Sakinofsky I. Clinical model for suicide risk assessment. Death Studies. 1994; 18(4):311-26.
12. Granello D. The process of suicide risk assessment: Twelve core principles. Journal of Counseling and Development. 2010; 88(3):363-70.
13. Patterson WM, Dohn HH, Bird J, Patterson GA. Evaluation of suicidal patients: The SAD PERSONS scale. Psychosomatics. 1983; 24(4):343-5, 8. PMID: 6867245
14. Cooper J, Kapur N, Dunning J, Guthrie E, Appleby L, Mackway-Jones K. A clinical tool for assessing risk after self-harm. Annals of Emergency Medicine. 2006; 48(4):459-66. doi: 10.1016/j.annemergmed.2006.07.944 PMID: 16997684
15. Hatcher S. The Manchester self harm rule had good sensitivity but poor specificity for predicting repeat self harm or suicide: Commentary. Evidence-Based Medicine. 2007; 12(3):89. doi: 10.1136/ebm.12.3.89 PMID: 17537897
16. Saunders K, Brand F, Lascelles K, Hawton K. The sad truth about the SADPERSONS scale: An evaluation of its clinical utility in self-harm patients. Emergency Medicine Journal. 2013. doi: 10.1136/emermed-2013-202781
17. Jobes DA, Jacoby AM, Cimbolic P, Hustead LAT. Assessment and treatment of suicidal clients in a university counseling center. Journal of Counseling Psychology. 1997; 44(4):368-77.
18. Shneidman ES. Anodyne psychotherapy for suicide: A psychological view of suicide. Clinical Neuropsychiatry: Journal of Treatment Evaluation. 2005; 2(1):7-12.
19. Beck AT, Brown G, Berchick RJ, Stewart BL, et al. Relationship between hopelessness and ultimate suicide: A replication with psychiatric outpatients. American Journal of Psychiatry. 1990; 147(2):190-5. PMID: 2278535
20. Baumeister RF. Suicide as escape from self. Psychological Review. 1990; 97(1):90-113. PMID: 2408091
21. Range LM, Knott EC. Twenty suicide assessment instruments: Evaluation and recommendations. Death Studies. 1997; 21(1):25-58. doi: 10.1080/074811897202128 PMID: 10169713
22. Corona CD, Jobes DA, Nielsen AC, Pedersen CM, Jennings KW, Lento RM, et al. Assessing and treating different suicidal states in a Danish outpatient sample. Archives of Suicide Research. 2013; 17(3):302-12. doi: 10.1080/13811118.2013.777002 PMID: 23889578
23. Kovacs M, Beck AT. The wish to die and the wish to live in attempted suicides. Journal of Clinical Psychology. 1977; 33(2):361-5. PMID: 870525
24. Baca-Garcia E, Perez-Rodriguez MM, Oquendo MA, Keyes KM, Hasin DS, Grant BF, et al. Estimating risk for suicide attempt: Are we asking the right questions?: Passive suicidal ideation as a marker for suicidal behavior. Journal of Affective Disorders. 2011; 134(1-3):327-32. doi: 10.1016/j.jad.2011.06.026
25. Beck AT, Kovacs M, Weissman A. Hopelessness and suicidal behavior: An overview. Journal of the American Medical Association. 1975; 234(11):1146-9. PMID: 1242427
26. Yaseen ZS, Fisher K, Morales E, Galynker II. Love and suicide: The structure of the Affective Intensity Rating Scale (AIRS) and its relation to suicidal behavior. PLoS ONE. 2012; 7(8). doi: 10.1371/journal.pone.0044069
27. Beck AT, Kovacs M, Weissman A. Assessment of suicidal intention: The Scale for Suicide Ideation. Journal of Consulting and Clinical Psychology. 1979; 47(2):343-52. PMID: 469082
28. Jobes DA. Managing suicidal risk: A collaborative approach. New York, NY: Guilford Press; 2006.
29. Horwitz AG, Czyz EK, King CA. Predicting future suicide attempts among adolescent and emerging adult psychiatric emergency patients. J Clin Child Adolesc Psychol. 2014. doi: 10.1080/15374416.2014.910789
30. Tran T, Luo W, Phung D, Harvey R, Berk M, Kennedy RL, et al. Risk stratification using data from electronic medical records better predicts suicide risks than clinician assessments. BMC Psychiatry. 2014; 14(1). doi: 10.1186/1471-244X-14-76
31. Bilén K, Ottosson C, Castrén M, Ponzer S, Ursing C, Ranta P, et al. Deliberate self-harm patients in the emergency department: Factors associated with repeated self-harm among 1524 patients. Emergency Medicine Journal. 2011; 28(12):1019-25. doi: 10.1136/emj.2010.102616 PMID: 21076053
32. Harriss L, Hawton K, Zahl D. Value of measuring suicidal intent in the assessment of people attending hospital following self-poisoning or self-injury. British Journal of Psychiatry. 2005; 186(1):60-6.
33. Suokas J, Suominen K, Isometsaè E, Ostamo A, Loènnqvist J. Long-term risk factors for suicide mortality after attempted suicide - Findings of a 14-year follow-up study. Acta Psychiatrica Scandinavica. 2001; 104(2):117-21. doi: 10.1034/j.1600-0447.2001.00243.x PMID: 11473505
34. Osman A, Bagge CL, Gutierrez PM, Konick LC, Kopper BA, Barrios FX. The Suicidal Behaviors Questionnaire-Revised (SBQ-R): Validation with clinical and nonclinical samples. Assessment. 2001; 8(4):443-54. PMID: 11785588
35. Beck RW, Morris JB, Beck AT. Cross-validation of the Suicidal Intent Scale. Psychological Reports. 1974; 34(2):445-6. PMID: 4820501
36. Kovacs M, Beck AT, Weissman A. The communication of suicidal intent: A reexamination. Archives of General Psychiatry. 1976; 33(2):198-201. PMID: 1252096
37. Misson H, Mathieu F, Jollant F, Yon L, Guillaume S, Parmentier C, et al. Factor analyses of the Suicidal Intent Scale (SIS) and the Risk-Rescue Rating Scale (RRRS): Toward the identification of homogeneous subgroups of suicidal behaviors. Journal of Affective Disorders. 2010; 121(1-2):80-7. doi: 10.1016/j.jad.2009.05.012 PMID: 19903574
38. Zhou XM, Jia SH. Suicidal communication signifies suicidal intent in Chinese completed suicides. Social Psychiatry and Psychiatric Epidemiology. 2012; 47(11):1845-54. doi: 10.1007/s00127-012-0488-7 PMID: 22366911
39. Nock MK, Holmberg EB, Photos VI, Michel BD. Self-Injurious Thoughts and Behaviors Interview: Development, reliability, and validity in an adolescent sample. Psychological Assessment. 2007; 19(3):309-17. PMID: 17845122
40. Winters NC, Myers K, Proud L. Ten-year review of rating scales. III: Scales assessing suicidality, cognitive style, and self-esteem. Journal of the American Academy of Child and Adolescent Psychiatry. 2002; 41(10):1150-81. doi: 10.1097/00004583-200210000-00006 PMID: 12364838
41. Shneidman ES. The suicidal mind. New York: Oxford University Press; 1996.
42. Brown GK, Beck AT, Steer RA, Grisham JR. Risk factors for suicide in psychiatric outpatients: A 20-year prospective study. Journal of Consulting and Clinical Psychology. 2000; 68(3):371-7. PMID: 10883553
43. Institute of Medicine. CNS clinical trials: Suicidality and data collection: Workshop summary. Academies TN, editor. Washington, DC: National Academies Press; 2010. PMID: 21452454
44. Meyer RE, Salzman C, Youngstrom EA, Clayton PJ, Goodwin FK, Mann JJ, et al. Suicidality and risk of suicide - Definition, drug safety concerns, and a necessary target for drug development: A consensus statement. Journal of Clinical Psychiatry. 2010; 71(8):e1-e21. doi: 10.4088/JCP.10cs06070blu PMID: 20797373
45. Beck AT, Steer RA, Brown GK. Manual for the Beck Depression Inventory-II. San Antonio, TX: Psychological Corporation; 1996.
46. Kroenke K, Spitzer RL, Williams JBW. The PHQ-9: Validity of a brief depression severity measure. Journal of General Internal Medicine. 2001; 16(9):606-13. doi: 10.1046/j.1525-1497.2001.016009606.x PMID: 11556941
47. Gardner DG, Cummings LL, Dunham RB, Pierce JL. Single-item versus multiple-item measurement scales: An empirical comparison. Educational and Psychological Measurement. 1998; 58(6):898-915.
48. Ostini R, Nering ML. Polytomous item response theory models. Thousand Oaks, CA: Sage; 2006.
49. Cox A, Pant H, Gilson AN, Rodriguez JL, Young KR, Kwon S, et al. Effects of augmenting response options on MMPI-2 RC scale psychometrics. Journal of Personality Assessment. 2012; 94(6):613-9. doi: 10.1080/00223891.2012.700464 PMID: 22809101
50. MacCallum RC, Zhang S, Preacher KJ, Rucker DD. On the practice of dichotomization of quantitative variables. Psychological Methods. 2002; 7(1):19-40. doi: 10.1037//1082-989X.7.1.19 PMID: 11928888
51. Lozano LM, García-Cueto E, Muñiz J. Effect of the number of response categories on the reliability and validity of rating scales. Methodology. 2008; 4(2):73-9. doi: 10.1027/1614-2241.4.2.73
52. Hofmans J, Theuns P, Mairesse O. Impact of the number of response categories on linearity and sensitivity of self-anchoring scales: A functional measurement approach. Methodology. 2007; 3(4):160-9. doi: 10.1027/1614-2241.3.4.160
53. Embretson SE, Reise SP. Item response theory for psychologists. Mahwah, NJ: Lawrence Erlbaum Assoc.; 2000.
54. Ware JE, Gander B. The SF-36 health survey: Development and use in mental health research and the IQOLA project. International Journal of Mental Health. 1994; 23:49-73.
55. Osterlin SJ, Everson HT. Differential item functioning. 2nd ed. London: SAGE Publications; 2009.
56. Kalibatseva Z, Leong FTL, Ham EH. A symptom profile of depression among Asian Americans: Is there evidence for differential item functioning of depressive symptoms? Psychological Medicine. 2014; 44(12):2567-78. doi: 10.1017/S0033291714000130 PMID: 25055174
57. Kim Y, Pilkonis PA, Frank E, Thase ME, Reynolds CF. Differential functioning of the Beck Depression Inventory in late-life patients: Use of item response theory. Psychology and Aging. 2002; 17(3):379-91. doi: 10.1037//0882-7974.17.3.379 PMID: 12243380
58. Muehlenkamp JJ, Gutierrez PM, Osman A, Barrios FX. Validation of the Positive and Negative Suicide Ideation (PANSI) Inventory in a diverse sample of young adults. Journal of Clinical Psychology. 2005; 61(4):431-45. doi: 10.1002/jclp.20051 PMID: 15503303
59. Zieky M. Fairness review in assessment. In: Downing SM, Haladyna TM, editors. Handbook of test development. Mahwah, NJ: Lawrence Erlbaum Associates; 2006. p. 359-76.
60. Thornton LK, Harris KM, Baker AL, Johnson M, Kay-Lambkin FJ. Recruiting for addiction research via Facebook. Drug and Alcohol Review. in press.
61. Linehan MM, Nielsen SL. Assessment of suicide ideation and parasuicide: Hopelessness and social desirability. Journal of Consulting and Clinical Psychology. 1981; 49(5):773-5. doi: 10.1037//0022-006x.49.5.773 PMID: 7287996
62. Tourangeau R, Yan T. Sensitive questions in surveys. Psychological Bulletin. 2007; 133(5):859-83. doi: 10.1037/0033-2909.133.5.859 PMID: 17723033
63. Joinson AN. Self-disclosure in computer-mediated communication: The role of self-awareness and visual anonymity. European Journal of Social Psychology. 2001; 31(2):177-92.
64. Joinson AN, Woodley A, Reips U-D. Personalization, authentication and self-disclosure in self-administered Internet surveys. Computers in Human Behavior. 2007; 23(1):275-85.
65. Harris KM. Life vs. death: The suicidal mind online. In: Aboujaoude E, Starcevic V, editors. Mental health in the digital age: Grave dangers, great promise. New York, NY: Oxford University Press; 2015. p. 135-51.
66. Harris KM, McLean JP, Sheffield J. Suicidal and online: How do online behaviors inform us of this high-risk population? Death Studies. 2014; 38(6):387-94. doi: 10.1080/07481187.2013.768313 PMID: 24666145
67. American Psychiatric Association. Practice guideline for the assessment and treatment of patients with suicidal behaviors. Behaviors WGoS, editor. Arlington, VA: American Psychiatric Publishing; 2010 2003.
68. New Zealand Guidelines Group, Ministry of Health. The assessment and management of people at risk of suicide: For emergency departments and mental health service acute assessment settings. Wellington, NZ: Ministry of Health; 2003.
69. Beck AT, Brown GK, Steer RA, Dahlsgaard KK, Grisham JR. Suicide ideation at its worst point: A predictor of eventual suicide in psychiatric outpatients. Suicide and Life-Threatening Behavior. 1999; 29(1):1-9. PMID: 10322616
70. BMJ Publishing Group Limited. Suicide risk management: Diagnostic tests 2013 [cited 2014 October1]. Available from: http://bestpractice.bmj.com/best-practice/monograph/1016/diagnosis/tests.html.
71. Chehil S, Kutcher SP. Suicide risk management: A manual for health professionals. 2nd ed. Chichester, UK: Wiley-Blackwell; 2012.
72. SAMHSA-HRSA Center for Integrated Health Solutions. Suicide prevention: Screening tools: Substance Abuse and Mental Health Services Administration; 2015 [cited 2015 January 20]. Available from: http://www.integration.samhsa.gov/clinical-practice/suicide-prevention.
73. Posner K, Brown GK, Stanley B, Brent DA, Yershova KV, Oquendo MA, et al. The Columbia-suicide severity rating scale: Initial validity and internal consistency findings from three multisite studies with adolescents and adults. American Journal of Psychiatry. 2011; 168(12):1266-77. doi: 10.1176/appi.ajp.2011.10111704 PMID: 22193671
74. Posner K, Brent D, Lucas C, Gould M, Stanley B, Brown G, et al. Columbia-Suicide Severity Rating Scale (C-SSRS). New York, NY: 2009.
75. Mundt JC, Greist JH, Jefferson JW, Federico M, Mann JJ, Posner K. Prediction of suicidal behavior in clinical research by lifetime suicidal ideation and behavior ascertained by the electronic columbia-suicide severity rating scale. Journal of Clinical Psychiatry. 2013; 74(9):887-93. doi: 10.4088/JCP.13m08398 PMID: 24107762
76. Reynolds WM. Psychometric characteristics of the Adult Suicidal Ideation Questionnaire in college students. Journal of Personality Assessment. 1991; 56(2):289-307. PMID: 2056423
77. Gutierrez PM, Osman A, Kopper BA, Barrios FX. Appropriateness of the multi-attitude suicide tendency scale for non-White individuals. Assessment. 2004; 11(1):73-84. doi: 10.1177/1073191103261041 PMID: 14994956
78. Linehan MM. Suicidal Behaviors Questionnaire (SBQ) Seattle, WA: Behavioral Research & Therapy Clinics, University of Washington; 1981 [cited 2015 January 20]. Available from: http://www.wbma.cc/Scales/Suicidal-Beh-Quest-pre-assessment.pdf.
79. Jobes DA. The collaborative assessment and management of suicidality (CAMS): An evolving evidence-based clinical approach to suicidal risk. Suicide and Life-Threatening Behavior. 2012; 42(6):640-53. doi: 10.1111/j.1943-278X.2012.00119.x PMID: 22971238
80. Radloff LS. The CES-D scale. Applied Psychological Measurement. 1977; 1(3):385-401.
81. Andresen EM, Malmgren JA, Carter WB, Patrick DL. Screening for depression in well older adults: Evaluation of a short form of the CES-D. American Journal of Preventive Medicine. 1994; 10(2):77-84. PMID: 8037935
82. Antony MM, Bieling PJ, Cox BJ, Enns MW, Swinson RP. Psychometric properties of the 42-item and 21-item versions of the Depression Anxiety Stress Scales in clinical groups and a community sample. Psychological Assessment. 1998; 10(2):176-81.
83. Beck AT, Steer RA. Beck Hopelessness Scale manual New York: Psychological Corp.; 1988.
84. Russell DW. UCLA Loneliness Scale (Version 3): Reliability, validity, and factor structure. Journal of Personality Assessment. 1996; 66(1):20-40. doi: 10.1207/s15327752jpa6601-2 PMID: 8576833
85. Zimet GD, Dahlem NW, Zimet SG, Farley GK. The Multidimensional Scale of Perceived Social Support. Journal of Personality Assessment. 1988; 52(1):30-41.
86. Diener E, Emmons RA, Larsen RJ, Griffin S. The Satisfaction With Life Scale. Journal of Personality Assessment. 1985; 49(1):71-5. PMID: 16367493
87. Zheng L, Goldberg LR, Zheng Y, Zhao Y, Tang Y, Liu L. Reliability and concurrent validation of the IPIP Big-Five factor markers in China: Consistencies in factor structure between Internet-obtained heterosexual and homosexual samples. Personality and Individual Differences. 2008; 45(7):649-54. PMID: 20383283
88. Topić MK, Kovačević MP, Mlačić B. Relations of the Big-Five personality dimensions to autodestructive behavior in clinical and non-clinical adolescent populations. Croatian Medical Journal. 2012; 53(5):450-60. doi: 10.3325/cmj.2012.53.460 PMID: 23100207
89. Tabachnick BG, Fidell LS. Using multivariate statistics. 5th ed. Boston: Pearson Education; 2007.
90. de Ayala RJ. The theory and practice of item response theory. New York: Guilford Press; 2009.
91. Reise SP, Yu J. Parameter recovery in the graded response model using MULTILOG. J Educ Meas. 1990; 27:133-44. doi: 10.1111/j.1745-3984.1990.tb00738.x
92. Rizopoulos D. ltm: An R package for latent variable modelling and item response theory analyses. Journal of Statistical Software. 2006; 17(5):1-25.
93. Kumagai R. A new method for estimating differential item functioning (DIF) for multiple groups and polytomous items: Development of index K and the computer program "EasyDIF". Japanese Journal of Psychology. 2012; 83(1):35-43. PMID: 22715537
94. Nunnally JC, Bernstein IH. Psychometric theory. 3rd ed. New York, NY: McGraw-Hill; 1994.
95. Streiner DL. Starting at the beginning: An introduction to coefficient alpha and internal consistency. Journal of Personality Assessment. 2003; 80(1):99-103. doi: 10.1207/S15327752JPA8001-18 PMID: 12584072
96. Zinbarg RE, Revelle W, Yovel I, Li W. Cronbach's α, Revelle's β and McDonald's ω H: Their relations with each other and two alternative conceptualizations of reliability. Psychometrika. 2005; 70(1):123-33. doi: 10.1007/s11336-003-0974-7
97. Costello AB, Osborne JW. Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Practical Assessment, Research & Evaluation. 2005; 10(7):173-8.
98. Henson RK, Roberts JK. Use of exploratory factor analysis in published research: Common errors and some comment on improved practice. Educational and Psychological Measurement. 2006; 66(3):393-416. doi: 10.1177/0013164405282485
99. Campbell DT, Fiske DW. Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin. 1959; 56(2):81-105. doi: 10.1037/h0046016 PMID: 13634291
100. Strauss ME, Smith GT. Construct validity: Advances in theory and methodology. Annual Review of Clinical Psychology2009. p. 1-25. doi: 10.1146/annurev.clinpsy.032408.153639 PMID: 19086835
101. Beckerman H, Roebroeck ME, Lankhorst GJ, Becher JG, Bezemer PD, Verbeek ALM. Smallest real difference, a link between reproducibility and responsiveness. Quality of Life Research. 2001; 10(7):571-8. doi: 10.1023/A:1013138911638 PMID: 11822790
102. MacCallum RC, Widaman KF, Zhang S, Hong S. Sample size in factor analysis. Psychological Methods. 1999; 4(1):84-99. doi: 10.1037/1082-989X.4.1.84
103. Harris KM, McLean JP, Sheffield J, Jobes D. The internal suicide debate hypothesis: Exploring the life versus death struggle. Suicide and Life-Threatening Behavior. 2010; 40(2):191-2. doi: 10.1521/suli.2010.40.2.181. PubMed Central PMCID: PMC20465353.
104. Lam TCM, Kolic M. Effects of semantic incompatibility on rating response. Applied Psychological Measurement. 2008; 32(3):248-60. doi: 10.1177/0146621607301094
105. Comrey AL, Lee HB. A first course in factor analysis. Hillsdale, NJ: Erlbaum; 1992.
106. MacCallum RC, Widaman KF, Preacher KJ, Hong S. Sample size in factor analysis: The role of model error. Multivariate Behavioral Research. 2001; 36(4):611-37.
107. Goldberg LR, Velicer WF. Principles of exploratory factor analysis. In: Strack S, editor. Differentiating normal and abnormal personality. 2nd ed. New York: Springer; 2006. p. 209-37.
108. Clark LA, Watson D. Constructing validity: Basic issues in objective scale development. Psychological Assessment. 1995; 7(3):309-19. doi: 10.1037/1040-3590.7.3.309
109. Yu MN. Item response theory. Taipei, Taiwan: Psychological Publishing Co.; 2009.
110. Roussos LA, Stout WF. Simulation studies of the effects of small sample size and studied item parameters on SIBTEST and Mantel-Haenszel Type I error performance. J Educ Meas. 1996; 33(2):215-30.
111. Jobes DA, Mann RE. Reasons for living versus reasons for dying: Examining the internal debate of suicide. Suicide and Life-Threatening Behavior. 1999; 29(2):97-104. PMID: 10407963
112. O'Connor SS, Jobes DA, Yeargin MK, Fitzgerald ME, Rodríguez VM, Conrad AK, et al. A cross-sectional investigation of the suicidal spectrum: Typologies of suicidality based on ambivalence about living and dying. Comprehensive Psychiatry. 2012; 53(5):461-7. doi: 10.1016/j.comppsych.2011.09.007 PMID: 22104555
113. Nader IW, Niederkrotenthaler T, Schild AHE, Koller I, Tran US, Kapusta ND, et al. Development of a scale to assess knowledge about suicide postvention using item response theory. Suicide and Life-Threatening Behavior. 2013; 43(2):174-84. doi: 10.1111/sltb.12006 PMID: 23301518
114. Hatcher S, Pimentel A. Do patients and clinicians differ in their assessment of suicidal intent after self-harm using the same suicide questionnaire scale? International Emergency Nursing. 2013; 21(4):236-9. doi: 10.1016/j.ienj.2012.11.003 PMID: 23298814