Development of an appraisal tool to evaluate strength of an instrument or outcome measure

Nurse Researcher

Volumn 20, Issue 2, 2012, Pages 13-19

  Leung, Kat ^a   Trevena, Lyndal ^a,b   Waters, Donna ^b  

^a UNIVERSITY OF SYDNEY   (Australia)

^b UNIVERSITY OF SYDNEY   (Australia)

Author keywords

Appraisal tool; Psychometric grading framework; Psychometric strength; Quantitative evaluation tool; Validity

Indexed keywords

ARTICLE; OUTCOME ASSESSMENT; PRACTICE GUIDELINE; PSYCHOMETRY;

GUIDELINES AS TOPIC; OUTCOME ASSESSMENT (HEALTH CARE); PSYCHOMETRICS;

MLCS; MLOWN;

EID: 84873183696     PISSN: 13515578     EISSN: 20478992     Source Type: Trade Journal    
DOI: 10.7748/nr2012.11.20.2.13.c9436     Document Type: Article

References (34)

1. Agree Collaboration (2003) Development and validation of an international appraisal instrument for assessing the quality of clinical practice guidelines: the AGREE project. Quality and Safety in Health Care. 12, 1, 18-23.
2. Barton MB, Miller T, Wolff T et al. (2007) How to Read the New Recommendation Statement: Methods Update from the US Preventive Services Task Force. Annals of Internal Medicine. 147, 2, 123-127.
3. Chernick L, Pusic M, Liu H et al. (2010) A pediatrics-based instrument for assessing resident education in evidence-based practice. Academics Pediatrics. 10, 4, 260-265.
4. Cicchetti DV, Sparrow SA (1981) Developing criteria for establishing interrater reliability of specific items: applications to assessment of adaptive behaviour. American Journal of Mental Deficiency. 86, 2, 127-137.
5. Cohen J (1968) Weighted kappa: nominal scale agreement with provision for scaled disagreement or partial credit. Psychological Bulletin. 70, 4, 213-220.
6. Cohen J (1988) Statistical Power Analysis For The Behavioural Sciences. Second edition. Lawrence Erlbaum Associates, Hillsdale NJ.
7. Fleiss JL (1971) Measuring nominal scale agreement among many raters. Psychological Bulletin. 76, 5, 378-382.
8. Fleiss JK (1981) Statistical Methods For Rates and Proportion. Second edition. John Wiley, New York NY.
9. Gardner IA, Greiner M (2006) Receiver-operating characteristic curves and likelihood ratios: improvements over traditional methods for the evaluation and application of veterinary clinical pathology tests. Veterinary Clinical Pathology. 35, 1, 8-17.
10. Gerrish K, Ashworth P, Lacey A et al. (2007) Factors influencing the development of evidence-based practice: a research tool. Journal of Advanced Nursing. 57, 3, 328-338.
11. Goodwin LD, Goodwin WL (1991) Focus on psychometrics: estimating construct validity. Research in Nursing and Health. 14, 3, 235-243.
12. Greenhalgh J, Long AF, Brettle AJ et al. (1998) Reviewing and selecting outcome measures for use in routine practice. Journal of Evaluation in Clinical Practice. 4, 4, 339-350.
13. Guyatt GH, Oxman AD, Vist GE et al. (2008) GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. British Medical Journal. 336, 7650, 924-926.
14. Haynes SN, Richard DCS, Kubany ES (1995) Content validity in psychological assessment: a functional approach to concepts and methods. Psychological Assessment. 7, 3, 238-247.
15. Jaeschke R, Guyatt GH, Sackett DL (1994) Users' guides to the medical literature. III. How to use an article about a diagnose test. B. What are the results and will they help me in caring for my patients? The Evidence-Based Medicine Working Group. Journal of American Medication Association. 271, 9, 703-707.
16. Jerosch-Herold C (2005) An evidence-based approach to choosing outcome measures: a checklist for the critical appraisal of validity, reliability and responsiveness studies. British Journal of Occupational Therapy. 68, 8, 347-353.
17. Johnston JM, Leung GM, Fielding R et al. (2003) The development and validation of a knowledge, attitude and behaviour questionnaire to assess undergraduate evidence-based practice teaching and learning. Medical Education. 37, 11, 992-1000.
18. Kaiser HF (1974) An index of factorial simplicity. Psychometrika. 39, 1, 31-36.
19. Kaiser HF, Caffrey J (1965) Alpha factor analysis. Psychometrika. 30, 1, 1-14.
20. Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics. 33, 1, 159-174.
21. McDowell I (2006) Measuring Health: A Guide To Rating Scales and Questionnaires. Third edition. Oxford University Press, New York NY.
22. McSherry R, Artley A, Holloran J (2006) Research awareness: an important factor for evidence-based practice? Worldviews on Evidence-Based Nursing. 3, 3, 103-105.
23. Munroe D, Duffy P, Fisher C (2008) Research for practice: nurse knowledge, skills, and attitudes related to evidence-based practice: before and after organizational supports. Medsurg Nursing. 17, 1, 55-60.
24. National Health and Medical Research Council (NHMRC) (2008) NHMRC Additional Levels of Evidence and Grades For Recommendations For Developers of Guidelines: Stage 2 Consultation (Early 2008-End June 2009). Canberra NSW.
25. Norman GR, Streiner DL (2000) Biostatistics: The Bare Essentials. Second edition. BC Decker, Hamilton ON.
26. Nunnally JC, Bernstein IH (1994) Psychometric Theory. Third edition. McGraw-Hill, New York NY.
27. Oxman AD, Guyatt GH (1991) Validation of an index of the quality of review articles. Journal of Clinical Epidemiology. 44, 11, 1271-1278.
28. Polit DF, Tatano Beck C, Owen SV (2007) Focus on research methods: is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Research in Nursing and Health. 30, 4, 459-467.
29. Sapsford R (2007) Survey Research. Second edition. Sage Publications, London.
30. Scottish Intercollegiate Guidelines Network (SIGN) (2008) SIGN 50: A Guideline Developer's Handbook. http://tinyurl.com/signac2 (Last accessed: September 21 2012.).
31. Streiner DL, Norman GR (2003) Health Measurement Scales: A Practical Guide To Their Development and Use. Third edition. Oxford University Press, Oxford.
32. Swets JA (1988) Measuring the accuracy of diagnostic systems. Science. 240, 4857, 1285-1293.
33. Upton D, Upton P (2005) Nurses' attitudes to evidence-based practice: impact of a national policy. British Journal of Nursing. 14, 5, 284-288.
34. Upton D, Upton P (2006) Development of an evidence-based practice questionnaire for nurses. Journal of Advanced Nursing. 53, 4, 454-458.