Recommendations for reporting the results of studies of instrument and scale development and testing

Journal of Advanced Nursing

Volumn 70, Issue 9, 2014, Pages 1970-1979

  Streiner, David L ^a,b   Kottner, Jan ^c  

^a UNIVERSITY OF TORONTO   (Canada)

^b MCMASTER UNIVERSITY   (Canada)

^c CHARITÉ UNIVERSITÄTSMEDIZIN BERLIN   (Germany)

Author keywords

Diagnostic tests; Instrument development; Nursing assessment; Psychometric testing; Research methods; Statistics

Indexed keywords

HEALTH SERVICES RESEARCH; SAMPLE SIZE; STATISTICAL ANALYSIS;

DATA INTERPRETATION, STATISTICAL; HEALTH SERVICES RESEARCH; SAMPLE SIZE;

EID: 84905675432     PISSN: 03092402     EISSN: 13652648     Source Type: Journal    
DOI: 10.1111/jan.12402     Document Type: Article

References (63)

1. Altman D.G., Machin D., Bryant T. & Gardner S. (2000) Statistics with Confidence: Confidence Intervals and Statistical Guidelines, 2nd edn. Wiley, Oxford.
2. Altman D.G., Schulz K.F., Moher D., Egger M., Davidoff F., Elbourne D., Gøtzsche P.C., Lang T. & CONSORT Group (2001) The revised CONSORT statement for reporting randomized trials: explanation and elaboration. Annals of Internal Medicine 134(8), 663-694.
3. Altman D.G., Vergouwe Y., Royston P. & Moons K.G. (2009) Prognosis and prognostic research: validating a prognostic model. British Medical Journal 28(338), b605.
4. American Educational Research Association, American Psychological Association, National Council on Measurement in Education (1999) The Standards for Educational and Psychological Testing. AERA Publications, Washington, DC.
5. American Psychological Association (2010) Publication Manual of the American Psychological Association, 6th edn. Author, Washington, DC.
6. Apgar V. (1953) A proposal for a new method of evaluation of the newborn infant. Current Researches in Anesthesia and Analgesia 32(4), 260-267.
7. Balzer K., Kremer L., Junghans A., Halfens R.J., Dassen T. & Kottner J. (2013) What patient characteristics guide nurses' clinical judgement on pressure ulcer risk? A mixed methods study. International Journal of Nursing Studies (Epub ahead of print). doi: 10.1016/j.ijnurstu.2013.09.005.
8. Barrera M. (1986) Distinctions between social support concepts, measures and models. American Journal of Community Psychology 14(4), 413-445.
9. Bossuyt P.M., Reitsma J.B., Bruns D.E., Gatsonis C.A., Glasziou P.P., Irwig L.M., Lijmer J.G., Moher D., Rennie D. & de Vet H.C.W. (2003) Toward complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative. British Medical Journal 326, 41-44. doi: http://dx.doi.org/10.1136/bmj.326.7379.41.
10. Cicchetti D.V. (1999) Sample size requirements for increasing the precision of reliability estimates: problems and proposed solutions. Journal of Clinical and Experimental Neuropsychology 21(4), 567-570.
11. Cicchetti D.V. (2001) The precision of reliability and validity estimates re-visited: distinguishing between clinical and statistical significance of sample size requirements. Journal of Clinical and Experimental Neuropsychology 23(5), 695-700.
12. Cohen J. (1960) A coefficient of agreement for nominal scales. Educational and Psychological Measurement 20(1), 37-46.
13. Cohen J. (1968) Weighted kappa: nominal scale agreement with provision for scaled disagreement or partial credit. Psychological Bulletin 70(4), 213-220.
14. COnsensus-based Standards for the selection of health Measurement Instruments (2012) COSMIN checklist manual. Retrieved from http://www.cosmin.nl/the-cosmin-checklist_8_5.html on January 2014.
15. Cortina J.M. (1993) What is coefficient alpha? An examination of theory and applications. Journal of Applied Psychology 78(1), 98-104.
16. Cronbach L.J. (1951) Coefficient alpha and the internal structure of tests. Psychometrika 16(3), 297-334.
17. Devins G.M., Dion R., Pelletier L.G., Shapiro C.M., Abbey S., Raiz L.R., Binik Y.M., McGowen P., Kuttner N.G., Beanlands H. & Edworthy S.M. (2001) Structure of lifestyle disruptions in chronic disease: a confirmatory factor analysis of the Illness Intrusiveness Ratings Scale. Medical Care 39(10), 1097-1104.
18. Dolan P. (1997) Modeling valuations for EuroQol health states. Medical Care 35(11), 1095-1108.
19. Donner A. & Eliasziw M. (1987) Sample size requirements for reliability studies. Statistics in Medicine 6(4), 441-448.
20. Embretson S.E. & Reise S.P. (2000) Item Response Theory. Lawrence Erlbaum Associates, Mahwah, NJ.
21. Faul F., Erdfelder E., Lang A.-G. & Buchner A. (2007) G*Power 3: a flexible statistical power analysis program for the social, behavioral and biomedical sciences. Behavior Research Methods 39(2), 175-191.
22. Feldt L.S. & Ankenmann R.D. (1999) Determining sample size for a test of the equality of alpha coefficients when the number of part-tests is small. Psychological Methods 4(4), 366-377.
23. Fleiss J.L. & Cohen J. (1973) The equivalence of weighted kappa and the intraclass correlation coefficient as measures of reliability. Educational and Psychological Measurement 33(3), 613-619.
24. Francis C.Y., Morris J. & Whorwell P.J. (1997) The irritable bowel severity scoring system: a simple method of monitoring irritable bowel syndrome and its progress. Alimentary Pharmacology & Therapeutics 11(2), 395-402.
25. Goldman B.A. & Mitchell D.F. (2008) Directory of Unpublished Experimental Measures. American Psychological Association, Washington, DC.
26. Gronlund N.E. & Linn R.L. (1990) Measurement and Evaluation in Teaching, 6th edn. Macmillan, New York.
27. Guilford J.P. (1956) Psychometric Methods, 2nd edn. McGraw Hill, New York.
28. Hays R.D. & Hadorn D. (1992) Responsiveness to change: an aspect of validity, not a separate dimension. Quality of Life Research 1(1), 73-75.
29. ICMJE (n.d.) Publishing and editorial issues related to publication in biomedical journals: Obligation to register clinical trials. Retrieved from http://www.icmje.org/publishing_10.register.html on December 2013.
30. Kehinde J.O. (2009) Instruments for measuring fall risk in older adults living in long-term care facilities: an integrative review. Journal of Gerontological Nursing 35(10), 46-55.
31. Kells M., Davidson K., Hitchko L., O'Neil K., Schubert-Bob P. & McCabe M. (2013) Examining supervised meals in patients with restrictive eating disorders. Applied Nursing Research 26(2), 76-79.
32. Kline P. (1986) A Handbook of Test Construction. Methuen, London.
33. Kottner J. & Balzer K. (2010) Do pressure ulcer risk assessment scales improve clinical practice? Journal of Multidisciplinary Healthcare 3, 103-111.
34. Kottner J. & Streiner D.L. (2010) Internal consistency and Cronbach's alpha: a comment on Beeckman et al. (2010). International Journal of Nursing Studies 47(7), 926-928.
35. Kottner J., Audigé L., Brorson S., Donner A., Gajewski B.J., Hrøbjartsson A., Roberts C., Shoukri M. & Streiner D.L. (2011) Guidelines for reporting reliability and agreement studies (GRRAS) were proposed. Journal of Clinical Epidemiology 64(1), 96-106.
36. Kottner J., Hauss A., Schlüer A.B. & Dassen T. (2013) Validation and clinical impact of paediatric pressure ulcer risk assessment scales: a systematic review. International Journal of Nursing Studies 50(6), 807-818.
37. Lawshe C.H. (1975) A quantitative approach to content validity. Personnel Psychology 28(4), 563-575.
38. Lijmer J.G. & Bossuyt P.M. (2009) Various randomized designs can be used to evaluate medical tests. Journal of Clinical Epidemiology 62(4), 364-373.
39. Lynn M.R. (1986) Determination and quantification of content validity. Nursing Research 35(6), 362-365.
40. Martino R., Silver F.L., Teasdell R.W., Bayley M.T., Nicholson G., Streiner D.L. & Diamant N.E. (2009) The Toronto Bedside Swallowing Screening Test (TOR-BSSTC): development and validation of a dysphagia screening tool for patients with stroke. Stroke 40(2), 555-561.
41. Meyer G.J. (2003) Guidelines for reporting information in studies of diagnostic accuracy: the STARD initiative. Journal of Personality Assessment 81(3), 191-193.
42. Meyer G., Köpke S., Haastert B. & Mühlhauser I. (2009) Comparison of a fall risk assessment tool with nurses' judgement alone: a cluster-randomised controlled trial. Age and Ageing 38(4), 417-423.
43. Norman G.R. & Streiner D.L. (2014) Biostatistics: The Bare Essentials, 4th edn. PMPH USA, Shelton, CT.
44. Patrick D.L. & Chiang Y.-P. (2000) Measurement of health outcomes in treatment effectiveness evaluations: conceptual and methodological challenges. Medical Care 38(Suppl II), S14-S25.
45. Polit D.F. & Beck C.T. (2008) Nursing Research, 8th edn. Lippincott Williams & Wilkins, Philadelphia, PA.
46. Reitsma J.B., Rutjes A.W., Khan K.S., Coomarasamy A. & Bossuyt P.M. (2009) A review of solutions for diagnostic accuracy studies with an imperfect or missing reference standard. Journal of Clinical Epidemiology 62(8), 797-806.
47. Ronen G.M., Rosenbaum P.L., Law M. & Streiner D.L. (1999) Health-related quality of life in childhood epilepsy: the results of children's participation in identifying the components. Developmental Medicine and Child Neurology 41(8), 554-559.
48. Sawatzky J.-A.V., Christie S. & Singal R.K. (2013) Exploring outcomes of a nurse practitioner-managed cardiac surgery follow-up intervention: a randomized trial. Journal of Advanced Nursing 69(9), 2076-2087.
49. Schünemann H.J., Oxman A.D., Brozek J., Glasziou P., Jaeschke R., Vist G.E., Williams J.W., Kunz R., Craig J., Montori V.M., Bossuyt P., Guyatt G.H. & GRADE Working Group (2008) Grading quality of evidence and strength of recommendations for diagnostic tests and strategies. British Medical Journal 336(7653), 1106-1110.
50. Shrout P.E. & Fleiss J.L. (1979) Intraclass correlations: uses in assessing rater reliability. Psychological Bulletin 86(2), 420-428.
51. Stenton C. (2008) The MRC breathlessness scale. Occupational Medicine 58(3), 226-227.
52. Steyerberg E.W., Moons K.G., van der Windt D.A., Hayden J.A., Perel P., Schroter S., Riley D., Hemingway H., Altman D.G. & PROGRESS Group (2013) Prognosis Research Strategy (PROGRESS) 3: prognostic model research. PLoS Medicine 10(2), e1001381.
53. Stice E., Telch C.F. & Rizvi S.L. (2000) Development and validation of the Eating Disorder Diagnostic Scale: a brief self-report measure of anorexia, bulimia and binge-eating disorder. Psychological Assessment 12(2), 123-131.
54. Stinson J.N., Stevens B.J., Feldman B.M., Streiner D.L., McGrath P.J., Dupuis A., Gill N. & Petroz G.C. (2008) Construct validity of a multidimensional electronic pain diary for adolescents with arthritis. Pain 136(3), 281-292.
55. Streiner D.L. (2013) Ethical issues in measurement studies. In Life Quality Outcomes in Young People with Neurological and Developmental Conditions (Ronen G.M. & Rosenbaum P.L., eds), Mac Keith Press, London, pp. 249-261.
56. Streiner D.L. (2014) Measurement. In Health Research Methods: A Canadian Perspective (Bassil K. & Zabkiewicz D., eds), Oxford University Press, Oxford, pp. 119-142.
57. Streiner D.L. & Norman G.R. (2006) 'Precision' and 'accuracy': two terms that are neither. Journal of Clinical Epidemiology 59(4), 327-330.
58. Streiner D.L. & Norman G.R. (2014) Health Measurement Scales: A Practical Guide to their Development and Use, 5th edn. Oxford University Press, Oxford.
59. Uchino B.N. (2009) Understanding the links between social support and physical health: a life-span perspective with emphasis on the separability of perceived and received support. Perspectives on Psychological Science 4(3), 236-255.
60. de Villiers M.R., de Villiers P.J. & Kent A.P. (2005) The Delphi technique in health sciences education research. Medical Teacher 27(7), 639-643.
61. Walter S.D., Eliasziw M. & Donner A. (1998) Sample size and optimal designs for reliability studies. Statistics in Medicine 17(1), 101-110.
62. Wang J. & Wang X. (2012) Structural Equation Modeling: Applications using Mplus. Wiley, Chichester.
63. Wilkinson L. & the Task Force on Statistical Inference (1999) Statistical methods in psychology journals: guidelines and explanations. American Psychologist 54(8), 594-604.