Revision of a method quality rating scale for single-case experimental designs and n-of-1 trials: The 15-item Risk of Bias in N-of-1 Trials (RoBiNT) Scale

Neuropsychological Rehabilitation

Volumn 23, Issue 5, 2013, Pages 619-638

  Tate, Robyn L ^a,b   Perdices, Michael ^c,d   Rosenkoetter, Ulrike ^a   Wakim, Donna ^a   Godbee, Kali ^a   Togher, Leanne ^d   McDonald, Skye ^e  

^a UNIVERSITY OF SYDNEY   (Australia)

^b ROYAL REHABILITATION CENTRE SYDNEY   (Australia)

^c ROYAL NORTH SHORE HOSPITAL   (Australia)

^d UNIVERSITY OF SYDNEY   (Australia)

^e UNIVERSITY OF NEW SOUTH WALES   (Australia)

Author keywords

Evidence based medicine; Internal validity; Methodology; n of 1 trial; Risk of bias; Single case experimental design

Indexed keywords

ARTICLE; HUMAN; METHODOLOGY; PSYCHOMETRY; RANDOMIZED CONTROLLED TRIAL (TOPIC); STATISTICAL ANALYSIS; STATISTICAL BIAS;

BIAS (EPIDEMIOLOGY); DATA INTERPRETATION, STATISTICAL; HUMANS; PSYCHOMETRICS; RANDOMIZED CONTROLLED TRIALS AS TOPIC; RESEARCH DESIGN;

EID: 84884900525     PISSN: 09602011     EISSN: 14640694     Source Type: Journal    
DOI: 10.1080/09602011.2013.824383     Document Type: Article

References (48)

1. Anastasi, A., and, Urbina, S. 1997. Psychological Testing, 7, Upper Saddle River, NJ: Prentice-Hall International Inc.
2. Backman, C. L., and, Harris, S. R. 1999. Case studies, single-subject research, and n of 1 randomized trials: Comparisons and contrasts. American Journal of Physical Medicine and Rehabilitation, 78: 170-176. (doi:10.1097/00002060-199903000-00022) (Pubitemid 29135766)
3. nd, Boston: Allyn and Bacon.
4. Barlow, D. H., Nock, M. K, and, Hersen, M. 2009. Single case experimental designs: Strategies for studying behavior for change, 3, Boston: Pearson/Allyn and Bacon.
5. Beeson, P. M., and, Robey, R. R. 2006. Evaluating single-subject treatment research: Lessons learned from the aphasia literature. Neuropsychology Review, 16: 161-169. (doi:10.1007/s11065-006-9013-7) (Pubitemid 46020539)
6. Borrelli, B. 2011. The assessment, monitoring, and enhancement of treatment fidelity in public health clinical trials. Journal of Public Health Dentistry, 71: S52-S63. (doi:10.1111/j.1752-7325.2011.00233.x)
7. Borrelli, B., Sepinwall, D., Ernst, D., Bellg, A. J., Czajkowski, S., Breger, R., and,. Orwig, D. 2005. A new tool to assess treatment fidelity and evaluation of treatment fidelity across 10 years of health behavior research. Journal of Consulting and Clinical Psychology, 73 (5): 852-860. (doi:10.1037/0022-006X.73.5.852) (Pubitemid 41643235)
8. Boutron, I., Guittet, L., Estellat, C., Moher, D., Hróbjartsson, A., and, Ravaud, P. 2007. Reporting methods of blinding in randomized trials assessing nonpharmacological treatments. PLoS Medicine, 4 (2): 370-380. (doi:10.1371/journal.pmed.0040061)
9. Boutron, I., Tubach, F., Giraudeau, B., and, Ravaud, P. 2004. Blinding was judged more difficult to achieve and maintain in nonpharmacologic than pharmacologic trials. Journal of Clinical Epidemiology, 57: 543-550. (doi:10.1016/j.jclinepi.2003.12.010) (Pubitemid 38891491)
10. Cicchetti, D. V. 1994. Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychological Assessment, 6: 284-290. (doi:10.1037/1040-3590.6.4.284)
11. Cicchetti, D. V. (2001). The precision of reliability and validity estimates re-visited: Distinguishing between clinical and statistical significance of sample size requirements. Journal of Clinical and Experimental Neuropsychology, 23 (5), 695-700. (Pubitemid 34074702)
12. Edgington, E. S. 1987. Randomized single-subject experiments and statistical tests. Journal of Counseling Psychology, 34 (4): 437-442. (doi:10.1037/0022-0167.34.4.437)
13. Gast, D. L. 2010. Single subject research methodology in behavioural sciences, New York, NY: Routledge.
14. Glasziou, P., Meats, E., Heneghan, C., and, Sheppherd, S. 2008. What is missing from descriptions of treatment in trials and reviews. British Medical Journal, 336: 1472-1474. (doi:10.1136/bmj.39590.732037.47)
15. Guyatt, G., Jaeschke, R., and, McGinn, T. 2002. " N of 1 randomized controlled trials ". In User's guides to the medical literature, Edited by: Guyatt, G., Rennie, D., Meade, M. O. and Cook, D. J. 179-192. New York, NY: McGrawHill Medical and American Medical Association.
16. Guyatt, G. H., Keller, J. L., Jaeschke, R., Rosenbloom, D., Adachi, J. D., and, Newhouse, M. T. 1990. The n-of-1 randomised controlled trial: Clinical usefulness. Our three-year experience. Annals of Internal Medicine, 112: 293-299. (doi:10.7326/0003-4819-112-4-293) (Pubitemid 20055354)
17. Guyatt, G., Sackett, D., Adachi, J., Roberts, R., Chong, J., Rosenbloom, D., and, Keller, J. 1988. A clinician's guide for conducting randomized trials in individual patients. Canadian Medical Association Journal, 139: 497-503.
18. Guyatt, G., Sackett, D., Taylor, D. W., Chong, J., Roberts, R., and, Pugsley, S. 1986. Determining optimal therapy-randomised trials in individual patients. New England Journal of Medicine, 314 (14): 889-892. (doi:10.1056/NEJM198604033141406) (Pubitemid 16126117)
19. Hersen, M., and, Barlow, D. H. 1976. Single case experimental designs: Strategies for studying behaviour change, New York, NY: Pergamon.
20. Higgins, J. P. T., Altman, D. G., and, Sterne, J. A. C. 2011. " Assessing risk of bias in included studies ". In Cochrane handbook for systematic reviews of interventions Edited by: Higgins, J. P. T. and Green, S. Version 5.1.0 (updated March 2011). The Cochrane Collaboration. Available from http://www.cochrane-handbook.org
21. Horner, R. H., Carr, E. C., Halle, J., McGee, G., Odom, S., and, Wolery, M. 2005. The use of single-subject research to identify evidence-based practice in special education. Exceptional Children, 71 (2): 165-179. (Pubitemid 40273033)
22. Howick, J., Chalmers, I., Glasziou, P., Greenhaigh, T., Heneghan, C., Liberati, A., and,. Thornton, H. 2011. The 2011 Oxford CEBM Evidence Table (Introductory Document), Oxford: Oxford Centre for Evidence-Based Medicine. Available from: http://www.cebm.net/index.aspxo=5653
23. Johnston, B. C., and, Mills, E. 2004. n-of-1 randomized controlled trials: An opportunity for complementary and alternative medicine evaluation. Journal of Alternative and Complementary Medicine, 10 (6): 979-984. (doi:10.1089/acm.2004.10.979) (Pubitemid 40180004)
24. Kazdin, A. E. 1982. Single case research designs: Methods for clinical and applied settings, New York, NY: Oxford University Press.
25. nd, New York, NY: Oxford University Press.
26. Keller, J. L., Guyatt, G. H., Roberts, R. S., Adachi, J. D., and, Rosenbloom, D. 1988. An N of 1 service: Applying the scientific method in clinical practice. Scandinavian Journal of Gastroenterology (Suppl.), 147: 22-29. (doi:10.3109/00365528809099154)
27. Kratochwill, T. R., Hitchcock, J., Horner, R. H., Levin, J. R., Odom, S. L., Rindskopf, D. M., and, Shadish, W. R. 2010. " Single-case designs technical documentation ". What Works Clearinghouse website: http://ies.ed.gov/ncee/wwc/pdf/wwc-scd.pdf
28. Kratochwill, T. R., Hitchcock, J., Horner, R. H., Levin, J. R., Odom, S. L., Rindskopf, D. M., and, Shadish, W. R. 2013. Single-case intervention research design standards. Remedial and Special Education, 34 (1): 26-38. (doi:10.1177/0741932512452794)
29. Kratochwill, T. R., and, Levin, J. R. 2010. Enhancing the scientific credibility of single-case intervention research: Randomization to the rescue. Psychological Methods, 15 (2): 124-144. (doi:10.1037/a0017736)
30. Lane, K., Wolery, M., Reichow, B., and, Rogers, L. 2007. Describing baseline conditions: Suggestions for study reports. Journal of Behavioral Education, 16: 224-234. (doi:10.1007/s10864-006-9036-4)
31. Maher, C. G., Sherrington, C., Herbert, R. D., Moseley, A. M., and, Elkins, M. 2003. Reliability of the PEDro scale for rating quality of RCTs. Physical Therapy, 83: 713-721. (Pubitemid 37238882)
32. Maggin, D. M., Chafouleas, S. M., Goddard, K. M., and, Johnson, A. H. 2011. A systematic evaluation of token economies as a classroom management tool for students with challenging behaviour. Journal of School Psychology, 49: 529-554. (doi:10.1016/j.jsp.2011.05.001)
33. McDougall, D. M. 2013. Applying single-case design innovations to research in sport and exercise psychology. Journal of Applied Sport Psychology, 25: 33-45. (doi:10.1080/10413200.2012.720640)
34. Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gøtzsch, P. C., Devereaux, P. J., and,. Altman, D. G. 2010. CONSORT 2010 explanation and elaboration: Updated guidelines for reporting parallel group randomised trials. Journal of Clinical Epidemiology, 63 (8): e1-e37. (doi:10.1016/j.jclinepi.2010. 03.004)
35. Perdices, M., and, Tate, R. L. 2009. Single-subject designs as a tool for evidence-based clinical practice: Are they unrecognised and undervalued. Neuropsychological Rehabilitation, 19 (6): 904-927. (doi:10.1080/ 09602010903040691)
36. Peterson, L., Homer, A. L., and, Wonderlich, S. A. 1982. The integrity of independent variables in behaviour analysis. Journal of Applied Behavior Analysis, 15: 477-492. (doi:10.1901/jaba.1982.15-477)
37. Schlosser, R. W., and, Braun, U. 1994. Efficacy of AAC interventions: Methodologic issues in evaluating behaviour change, generalization, and effects. AAC Augmentative and Alternative Communication, 10: 207-223. (doi:10.1080/07434619412331276920)
38. Shadish, W. R., and, Sullivan, K. J. 2011. Characteristics of single-case designs used to assess intervention effects in 2008. Behavior Research Methods, 43 (4): 971-980. (doi:10.3758/s13428-011-0111-y)
39. Shea, B. J., Hamel, C., Wells, G. A., Bouter, L. M., Kristjansson, E., Grimshaw, J., and,. Boers, M. 2009. AMSTAR is a reliable and valid measurement tool to assess the methodological quality of systematic reviews. Journal of Clinical Epidemiology, 62 (10): 1013-1020. (doi:10.1016/j.jclinepi.2008.10.009)
40. Stokes, T. F., and, Baer, D. M. 1977. An implicit technology of generalization. Journal of Applied Behavior Analysis, 10: 349-367. (doi:10.1901/jaba.1977.10-349)
41. Tate, R. L., McDonald, S., Perdices, M., Togher, L., Godbee, K., Cassel, A.,. Rosenkoetter, U. (2010). Single-case experimental designs and n-of-1 trials in rehabilitation research: How good is the research in acquired brain impairment Paper presented at the mid-year meeting of the International Neuropsychological Society, Krakow, Poland; abstract in Journal of the International Neuropsychological Society, 16 (Supplement 2), 23.
42. Tate, R. L., McDonald, S., Perdices, M., Togher, L., Schultz, R., and, Savage, S. 2008. Rating the methodological quality of single-subject designs and n-of-1 trials: Introducing the Single-case Experimental Design (SCED) Scale. Neuropsychological Rehabilitation, 18 (4): 385-401. (doi:10.1080/ 09602010802009201) (Pubitemid 351896818)
43. Tate, R. L., Perdices, M., McDonald, S., Togher, L., Moseley, A., Winders, K., and,. Smith, K. 2004. Development of a database of rehabilitation therapies for the psychological consequences of acquired brain impairment. Neuropsychological Rehabilitation, 15 (5): 517-534. (doi:10.1080/ 09602010343000182) (Pubitemid 40018354)
44. Tate, R. " The Single-Case Reporting guideline ". In BEhavioural interventions (SCRIBE): Explanation and elaboration. in preparation
45. Wilson, B. A. 2011. "Cutting edge" developments in neuropsychological rehabilitation and possible future directions. Brain Impairment, 12 (1): 33-42. (doi:10.1375/brim.12.1.33)
46. Wolery, M. 2013. A commentary: Single-case design technical document of the What Works Clearinghouse. Remedial and Special Education, 34 (1): 39-43. (doi:10.1177/0741932512468038)
47. Wolery, M., Dunlap, G., and, Ledford, J. R. 2011. Single-case experimental methods. Suggestions for reporting. Journal of Early Intervention, 33 (2): 103-109. (doi:10.1177/1053815111418235)
48. Wolery, M., and, Ezel, H. K. 1993. Subject descriptions and single-subject research. Journal of Learning Disabilities, 26 (10): 642-647. (doi:10.1177/002221949302601001)