Grading gems: Appraising the quality of research for social work and social care

British Journal of Social Work

Volumn 37, Issue 2, 2007, Pages 335-354

  Taylor, Brian J ^a   Dempster, Martin ^b   Donnelly, Michael ^b  

^a UNIVERSITY OF ULSTER   (United Kingdom)

^b QUEEN'S UNIVERSITY BELFAST   (United Kingdom)

Author keywords

Appraisal of research; Evidence based practice; Systematic review

Indexed keywords

EID: 33947164800     PISSN: 00453102     EISSN: 1468263X     Source Type: Journal    
DOI: 10.1093/bjsw/bch361     Document Type: Article

References (98)

1. Abrahams, M. A., Capitman, J., Leutz, W. and Macko, P. (1989) 'Variations in care planning practice in the social/HMO: An exploratory study', The Gerontologist, 29(6), pp. 725-36.
2. AHRQ (2002) Systems to Rate the Strength of Scientific Evidence, Summary Evidence Report/Technology Assessment No.47, US Department of Health and Human Services: Agency for Healthcare Research and Quality, available online at: www.ahrq.gov.
3. Ainsworth, F. and Hansen, P. (2002) 'Evidence-based social work: A reachable goal?', Social Work and Social Services Review, 10(2), pp. 35-48.
4. Austin, C. D. and Seidl, F. W. (1981) 'Validating professional judgement in a home care agency', Health and Social Work, 6(1), pp. 50-6.
5. Barbour, R. S. and Barbour, M. (2003) 'Evaluating and synthesizing qualitative research: The need to develop a distinctive approach', Journal of Evaluation in Clinical Practice, 9(2), pp. 179-86.
6. Bilsker, D. and Goldner, E. (2000) 'Teaching evidence-based practice in mental health', Research on Social Work Practice, 10(5), 664-9.
7. BMJ (British Medical Journal) (2003) Editors' Checklists: Critical Appraisal Questions, available online at: http://bmj.com/advice/checklists.shtml (accessed 1 November 2004).
8. Burns, N. (1989) 'Standards for qualitative research',Nursing Science Quarterly, 2(1), pp. 44-52.
9. Campbell, D. T. and Stanley, J. C. (1966) Experimental and Quasi-experimental Designs for Research, Chicago, Rand McNally.
10. Campbell Collaboration (2005) (for reviews of the effectiveness of interventions in social welfare, education and criminal justice), available online at: http://www.campbellcollaboration.org (accessed 21 June 2005).
11. CASP (Critical Appraisal Skills Programme) (2002) Appraisal Tools, available online at:http://www.phru.nhs.uk/casp/appraisa.htm (accessed 1 November 2004).
12. Chalmers, T. C., Smith, H. J. R., Blackburn, B., Silverman, B., Schroeder, B., Reitman, D. and Ambroz, A. (1981) 'A method for assessing the quality of a randomised control trial', Controlled Clinical Trials, 2(1), pp. 31-49.
13. Cochrane, A. L. (1973) Effectiveness and Efficiency: Random Reflections on Health Services, London, Nuffield Provincial Hospitals Trust.
14. Cochrane Collaboration (2005) (for reviews of the effectiveness of interventions in health and social care), available online at: http://www.cochrane.org (accessed 21 June 2005).
15. Corbin, J. and Strauss, A. (1990) 'Grounded theory research: Procedures, canons, and evaluation criteria', Qualitative Sociology, 13(1), pp. 3-21.
16. CRD (National Health Service Centre for Reviews and Dissemination) (2005), available online at: http://www.york.ac.uk/inst/crd (accessed 21 June 2005).
17. Davies, H. T. O., Nutley, S. M. and Smith, P. C. (2000) What Works? Evidence-Based Policy and Practice in Public Services, Bristol, The Policy Press.
18. Degenholtz, H., Kane, R., Kane, R. and Finch, M. D. (1999) 'Long-term care case managers' out-of-home placement decisions: An application of hierarchical logistic regression', Research in Aging, 21(2), pp. 240-74.
19. Dempster, M. (2003) 'Systematic review', in Miller, R. and Brewer, J. (eds), The A to Z of Social Research, London, Sage.
20. Department of Health (1998) Modernising Social Services, Cm 4169, London, The Stationery Office.
21. DHSSPS (2001) Best Practice-Best Care: A Framework for Setting Standards, Delivering Services and Improving Monitoring and Regulation in the HPSS: A Consultation Paper, Belfast, Department of Health, Social Services and Public Safety.
22. Dickersin, K. and Berlin, J. A. (1992) 'Meta-analysis: State-of-the-science', Epidemiologic Reviews, 14, pp. 154-76.
23. Drisko, J. W. (1997) 'Strengthening qualitative studies and reports: Standards to promote academic integrity', Journal of Social Work Education, 33(1), pp. 185-97.
24. Dubler, N. N. (1988) 'Improving the discharge planning process: Distinguishing between coercion and choice', The Gerontologist, 28(Suppl.), pp. 76-81.
25. Elliott, R., Fischer, C. T. and Rennie, D. L. (1999) 'Evolving guidelines for publication of qualitative research studies in psychology and related fields', British Journal of Clinical Psychology, 38(3), pp. 215-29.
26. EPPI (Evidence for Policy and Practice Information and Co-ordinating Centre) (2005), available online at: http://eppi.ioe.ac.uk/EPPIWeb (accessed 21 June 2005).
27. French, D. G. (1952) An Approach to Measuring Results in Social Work, New York, Columbia University Press.
28. Gentry, J. W., Kennedy, P. F. and Macintosh, G. (1995) 'Marketing implications of the expected role of physicians in family decisions concerning the institutionalization of the elderly', Psychology and Marketing, 12(7), pp. 647-62.
29. Giacomini, M. K. and Cook, D. J. (2000a) 'Users' guides to the medical literature: XXIII. Qualitative research in health care A - Are the results of the study valid?', Journal of the American Medical Association, 284(3), p. 357.
30. Giacomini, M. K. and Cook, D. J. (2000b) 'Users' guides to the medical literature: XXIII. Qualitative research in health care B - What are the results and how do they help me care for my patients?', Journal of the American Medical Association, 284(4), p. 478.
31. Glasziou, P., Vandenbroucke, J. and Chalmers, I. (2004) 'Assessing the quality of research', British Medical Journal, 328(7430), pp. 39-41.
32. Globerman, J. (1993) 'Teaching critical appraisal of the social work literature', Journal of Teaching in Social Work, 7(2), pp. 63-79.
33. Grade Working Group (2004) 'Grading quality of evidence and strength of recommendations', British Medical Journal, 328, 1490.
34. Greenhalgh, T. and Taylor, R. (1997) 'How to read a paper: Papers that go beyond numbers (qualitative research)', British Medical Journal, 315(7109), pp. 740-3.
35. Harden, A. (2004) 'A review of tools for assessing the quality of qualitative studies: Implications for systematic reviews', paper presented at the XII Cochrane Colloquium, Ottawa, Canada, 1-6 October 2004.
36. Hennessy, C. H. (1987) 'Risks and resources: Service allocation decisions in a consolidated model of long term-care', Journal of Applied Gerontology, 6(2), pp. 139-55.
37. Hennessy, C. H. (1989) 'Autonomy and risk: The role of client wishes in community-based long-term care', The Gerontologist, 29(5), pp. 633-9.
38. Hennessy, C. H. (1993) 'Modeling case management decision-making in a consolidated long-term care program', The Gerontologist, 33(3), pp. 333-41.
39. Higgins, K. and Pinkerton, J. (1998) 'Literature reviewing: Towards a more rigorous approach', in Iwaniek, D. and Pinkerton, J. (eds), Making Research Work: Promoting Child Care Policy and Practice, Chichester, Wiley.
40. Hunter, S., Brace, S. and Buckley, G. (1993) 'The inter-disciplinary assessment of older people at entry into long-term institutional care: Lessons for the new community care arrangements', Research, Policy and Planning, 11(1 and 2), pp. 2-9.
41. Kane, R. A., Degenholtz, H. B. and Kane, R. L. (1999) 'Adding values: An experiment in systematic attention to values and preferences of community long-term care clients', Journal of Gerontology: Social Sciences, 54b(2), pp. S109-19.
42. Kaufman, S. R. (1995) 'Decision making, responsibility, and advocacy in geriatric medicine: Physician dilemmas with elderly in the community', The Gerontologist, 35(4), pp. 481-8.
43. Khan, K. S., ter Riet, G., Popay, J., Nixon, J. and Kleijnen, J. (2004) 'Stage II Conducting the Review - Phase 5: Study Quality Assessment', in Centre for Reviews and Dissemination, Undertaking Systematic Reviews of Research on Effectiveness: CRD's Guidance for those Carrying Out or Commissioning Reviews Report Number 4 (2nd Edition), York, CRD.
44. Kirk, J. and Miller, M. C. (1986) Reliability and Validity in Qualitative Research, London, Sage Publications.
45. Lagergren, M. (1995) 'Determining the appropriate level of care', Scandinavian Journal of Social Medicine, 23(3), pp. 209-15.
46. Lagergren, M. and Johansson, P. A. (1998) 'Are there differences in standard of care for the elderly? A comparative study of assistance decisions in Stockholm', Scandinavian Journal of Social Welfare, 7(4), pp. 340-9.
47. Long, A. and Godfrey, M. (2004) 'An evaluation tool to assess the quality of qualitative research studies', International Journal of Social Research Methodology, 7(2), pp. 181-96.
48. Macdonald, G. (2001) Effective Interventions for Child Abuse and Neglect: An Evidence-based Approach to Planning and Evaluating Interventions, Chichester, John Wiley and Sons Ltd.
49. Macdonald, G. M. and Sheldon, B. (1992) 'Contemporary studies of the effectiveness of social work', British Journal of Social Work, 22(6), pp. 615-43.
50. MacDonald, G. and Sheldon, B. (1998) 'Changing one's mind: The final frontier?', Issues in Social Work Education, 18(1), pp. 3-25.
51. Mackay, R. and Lishman, J. (1991) 'Assessment for residential care for old people in the north of Scotland', Practice, 5(4), pp. 249-64.
52. Mastrian, K. G. (2001) 'Differing perceptions in defining safe independent living for elders', Nursing Outlook, 49(5), pp. 231-7.
53. Mastrian, K. G. and Dellasega, C. (1996) 'Helping families with long-term care decisions', Caring Magazine, 15(2), pp. 68-9 and 71-2.
54. Mays, N. and Pope, C. (1995) 'Qualitative research: Rigour and qualitative research', British Medical Journal, 311, pp. 109-12.
55. Mays, N. and Pope, C. (2000) 'Assessing quality in qualitative research', British Medical Journal, 320, pp. 50-2.
56. McAlister, F. A., Staus, S. E., Guyatt, G. H. and Haynes, R. B. (2000) 'Users' guides to the medical literature: XX. Integrating research evidence with the care of the individual patient', Journal of the American Medical Association, 283(21), pp. 2829-36.
57. McKeganey, N., MacPherson, I. and Hunter, D. J. (1988) 'How "they" decide: Exploring professional decision-making', Research, Policy and Planning, 6(1), pp. 15-19.
58. McKeganey, N. P. (1991) 'The role of clinicians in residential home assessments', Social Policy and Administration, 25(2), pp. 149-59.
59. Meade, M. O. and Richardson, W. S. (1997) 'Selecting and appraising studies for a systematic review', Annals of Internal Medicine, 127(7), pp. 531-7.
60. Muecke, M. (1994) 'On the evaluation of ethnographies', in Morse J. M. (ed.), Critical Issues in Qualitative Research Methods, Thousand Oaks, CA, Sage Publications.
61. Murphy, E., Dingwall, R., Greatbatch, D., Parker, S. and Watson, P. (1998) 'Qualitative research methods in health technology assessment: A review of the literature', Health Technology Assessment, 2(16).
62. Needham, G. (2000) 'Research and practice: Making a difference', in Gomm, R. and Davies, C. (eds), Using Evidence in Health and Social Care, London, Sage Publications and The Open University.
63. NICE (National Institute for Clinical Excellence) (2005), available online at: http://www.nice.org.uk (accessed 21 June 2005).
64. Pawson, R., Boaz, A., Grayson, L., Long, A. and Barnes, C. (2003) Knowledge Review No 3: Types and Quality of Knowledge in Social Care, London, Social Care Institute for Excellence.
65. Peabody, J. W., Locke, J., Glassman, P., Dresselhaus, T. R. and Lee, M. (2000) 'Comparison of vignettes, standardized patients, and chart abstraction: A prospective validation study of 3 methods for measuring quality', Journal of the American Medical Association, 283(13), pp. 1715-22.
66. Petitti, D. B. (1994) Meta-Analysis, Decision Analysis, and Cost-Effectiveness Analysis, Oxford, Oxford University Press.
67. Pluye, P., Grad, R., Dunikowski, L. and Stephenson, R. (2004) 'A challenging mixed literature review experience', paper presented at the XII Cochrane Colloquium, Ottawa, Canada, 1-6 October 2004.
68. Prager, E. (1986) 'Bureaucracy's impact on decision making in long-term care', Health and Social Work, 11(4), pp. 275-85.
69. Pritchard, C. (2002a) 'The extremes of child abuse: A macro approach to measuring effective prevention', in Smith, D. (ed.), Social Work and Evidence-Based Practice, London and Philadelphia, Jessica Kingsley.
70. Pritchard, C. (2002b) 'Effective social work: A micro approach-reducing truancy, delinquency and school exclusions', in Smith, D. (ed.), Social Work and Evidence-Based Practice, London and Philadelphia, Jessica Kingsley.
71. Reid, W. J. and Hanrahan, P. (1980) 'The effectiveness of social work: Recent evidence', in Goldberg, E. M. and Connelly, N. (eds), Evaluative Research in Social Care, London, Heineman.
72. Sackett, D. L., Rosenberg, W. M., Gray, J. A., Haynes, R. B. and Richardson, W. S. (1996) 'Evidence based medicine: What it is and what it isn't', British Medical Journal, 312(7023), pp. 71-2.
73. Sandelowski, M. and Barroso, J. (2002) 'Reading qualitative studies', International Journal of Qualitative Method, 1(1), article 5.
74. Sanderson, I. (2000) 'Evaluation in complex policy systems', Evaluation, 6(4), pp. 433-54.
75. Sanderson, I. (2002) 'Evaluation policy learning and evidence-based policy making', Public Administration, 80(1), pp. 1-22.
76. Schneider, R. L. and Kropf, N. P. (1996) 'The admission process in nursing homes: A clinical model for ethical decision-making', Journal of Long-Term Home Health Care, 15(3), pp. 39-46.
77. SCIE (Social Care Institute for Excellence) (2005), available online at: http://www.scie.org.uk (accessed 21 June 2005).
78. Seccombe, K., Ryan, R. and Austin, C. D. (1987) 'Care planning: Case managers' assessment of elders' welfare and caregivers' capacity', Family Relations, 36(2), pp. 171-5.
79. Seidl, F. W. (1991) 'Foreword', in Gibbs, L. E. (ed.), Scientific Reasoning for Social Workers: Bridging the Gap Between Research and Practice, New York, Macmillan.
80. Sheldon, B. (1986) 'Social work effectiveness experiments: Review and implications', British Journal of Social Work, 16(2), pp. 223-42.
81. Sheldon, B. (1987) 'Implementing findings from social work effectiveness research', British Journal of Social Work, 17(6), pp. 573-86.
82. Sheldon, B. (2001) 'The validity of Evidence Based Practice in Social Work: A reply to Stephen Webb', British Journal of Social Work, 31, pp. 801-09.
83. Sheldon, B. and Chilvers, R. (2000) Evidence Based Social Care: A Study of Prospects and Problems, Lyme Regis, Russell House Publishing.
84. Smith, B., O'Malley, S. and Lawson, J. (1993) 'The costs and experiences of caring for sick and disabled geriatric patients: Australian observations', Australian Journal of Public Health, 17(2), pp. 131-4.
85. Spencer, L., Ritchie, J., Lewis, J. and Dillon, L. (2003) Quality in Qualitative Evaluation: A Framework for Assessing Research Evidence, London, Cabinet Office.
86. Spittlehouse, C., Acton, M. and Enock, K. (2000) 'Introducing critical appraisal skills training in UK social services: Another link between health and social care', Journal of Interprofessional Care, 14(4), pp. 397-404.
87. Stevenson, O. (1971) 'Knowledge for social work', British Journal of Social Work, 1(2), pp. 225-37.
88. Taylor, B. J. (2003) 'Literature searching', in Miller, R. and Brewer, J. (eds), The A to Z of Social Research, London, Sage.
89. Taylor, B. J. (in press) 'Factorial surveys: Using vignettes to study professional judgement', British Journal of Social Work.
90. Taylor, B. J. and Devine, T. (1993) Assessing Needs and Planning Care in Social Work, Hampshire, Ashgate.
91. Taylor, B. J., Dempster, M. and Donnelly, M. (2003) 'Hidden gems: Systematically searching electronic databases for research publications for social work and social care', British Journal of Social Work,33(4) , pp. 423-39.
92. Thompson, N. (2000) Theory and Practice in Human Services, Buckingham, Open University Press.
93. Trinder, L. (2000) 'Evidence-based practice in social work and probation', in Trinder, L. and Reynolds, S. (eds), Evidence-Based Practice: A Critical Appraisal, Oxford, Blackwell Science.
94. Walter, I., Nutley, S., Percy-Smith, J., McNeish, D. and Frost, S. (2004) Knowledge Review 7: Improving the Use of Research in Social Care Practice, London, Social Care Institute for Excellence.
95. Webb, S. (2002) 'Evidence based practice and decision analysis in social work: An implementation model', Journal of Social Work, 2(1), pp. 45-63.
96. Webb, S. and Webb, B. (1932) Methods of Social Study, Cambridge, London School of Economics and Political Science and Cambridge University Press.
97. Webb, S. A. (2001) 'Some considerations on the validity of evidence-based practice in social work', British Journal of Social Work, 31, pp. 57-79.
98. Wortman, P. M. (1994) 'Judging research quality', in Cooper, H. and Hedges, L. V. (eds), The Handbook of Research, New York, Russell Sage Foundation.