Automating Risk of Bias Assessment for Clinical Trials

IEEE Journal of Biomedical and Health Informatics

Volumn 19, Issue 4, 2015, Pages 1406-1412

  Marshall, Iain J ^a   Kuiper, Joel ^b   Wallace, Byron C ^c  

^a KING'S COLLEGE LONDON   (United Kingdom)

^b Vortext Systems   (United Kingdom)

^c UNIVERSITY OF TEXAS AT AUSTIN   (United States)

Author keywords

Evidence based medicine; health informatics; machine learning; natural language processing

Indexed keywords

DECISION MAKING; HEALTH CARE; LEARNING SYSTEMS; LINGUISTICS; MACHINE LEARNING; MEDICAL APPLICATIONS; MEDICAL INFORMATICS; MEDICINE; NATURAL LANGUAGE PROCESSING SYSTEMS;

BIOMEDICAL LITERATURE; COCHRANE DATABASE; EVIDENCE- BASED DECISIONS; EVIDENCE-BASED MEDICINE; MACHINE LEARNING APPROACHES; NATURAL LANGUAGE PROCESSING; SYSTEMATIC REVIEW; TEXT FRAGMENTS;

RISK ASSESSMENT;

CLINICAL TRIAL (TOPIC); HUMAN; MEDICAL INFORMATICS; NATURAL LANGUAGE PROCESSING; PROCEDURES; RISK ASSESSMENT; STATISTICAL BIAS;

BIAS (EPIDEMIOLOGY); CLINICAL TRIALS AS TOPIC; HUMANS; MEDICAL INFORMATICS; NATURAL LANGUAGE PROCESSING; RISK ASSESSMENT;

EID: 84938270226     PISSN: 21682194     EISSN: 21682208     Source Type: Journal    
DOI: 10.1109/JBHI.2015.2431314     Document Type: Article

References (44)

1. C. D. Mulrow, D. J. Cook, and F. Davidoff, "Systematic reviews: Critical links in the great chain of evidence, " Ann. Internal Med., vol. 126, no. 5, pp. 389-391, Mar. 1997.
2. J. Higgins, D. Altman, P. Gotzsche, P. Juni, D. Moher, A. Oxman, J. Savovic, K. Schulz, L. Weeks, and J. Sterne, "The Cochrane Collaboration's tool for assessing risk of bias in randomised trials, " BMJ, vol. 343, p. d5928, 2011.
3. A. R. Jadad, R. A. Moore, D. Carroll, C. Jenkinson, D. J. Reynolds, D. J. Gavaghan, and H. J. McQuay, "Assessing the quality of reports of randomized clinical trials: Is blinding necessary?, " Controlled Clinical Trials, vol. 17, no. 1, pp. 1-12, Feb. 1996.
4. J. Savovi?c, H. Jones, D. Altman, R. Harris, P. Jni, J. Pildal, B. Als-Nielsen, E. Balk, C. Gluud, L. Gluud, J. Ioannidis, K. Schulz, R. Beynon, N. Welton, L. Wood, D. Moher, J. Deeks, and J. Sterne, "Influence of reported study design characteristics on intervention effect estimates from randomised controlled trials: combined analysis of meta-epidemiological studies, " Health Technol. Assessment (Winchester, England), vol. 16, no. 35, pp. 1-82, Sep. 2012.
5. D. Tovey, R. Marshall, Bazian Ltd., S. Hopewell, and T. Rader, "Fit for purpose: Centralising updating support for high-priority Cochrane reviews, " The Cochrane Collaboration, report available at http://editorial-unit. cochrane. org/fit-purpose-centralised-updatingsupport-high-priority-cochrane-reviews, Nat. Inst. Health Res. Evaluation, Trials, Studies Coordinating Centre, Tech. Rep., Jul. 2011.
6. Cochrane Collaboration. (2014). The Cochrane database of systematic reviews [Online]. Available: http://www. thecochranelibrary. com
7. G. Valkenhoef, T. Tervonen, B. Brock, and H. Hillege, "Deficiencies in the transfer and availability of clinical trials evidence: A review of existing systems and standards, " BMC Med. Inform. Decision Making, vol. 12, no. 1, art. no. 95, 2012.
8. K. G. Shojania, M. Sampson, M. T. Ansari et al., Updating Systematic Reviews. Rockville (MD): Agency for Healthcare Research and Quality (US); 2007 Sep. (Technical Reviews, No. 16.) Available from: http://www. ncbi. nlm. nih. gov/books/NBK44099/
9. H. Bastian, P. Glasziou, and I. Chalmers, "Seventy-five trials and eleven systematic reviews a day: How will we ever keep up?, " PLoS Med., vol. 7, no. 9, art. no. e1000326, 2010.
10. B. Wallace, I. Dahabreh, C. Schmid, J. Lau, and T. Trikalinos, "Modernizing the systematic review process to inform comparative effectiveness: Tools and methods, " J. Comparative Effectiveness Res., vol. 2, no. 3, pp. 273-282, 2013.
11. I. Chalmers, M. B. Bracken, B. Djulbegovic, S. Garattini, J. Grant, A. Metin Glmezoglu, D. W. Howells, J. P A Ioannidis, and S. Oliver, "How toincrease value and reduce waste when research priorities are set, " Lancet, vol. 383, no. 9912, pp. 156-165, Jan. 2014.
12. J. Elliott, I. Sim, J. Thomas, N. Owens, G. Dooley, J. Riis, B. Wallace, J. Thomas, A. Noel-Storr, G. Rada, C. Struthers, T. Howe, H. MacLehose, L. Brandt, I. Kunnamo, and C. Mavergames, "Cochranetech: Technology and the future of systematic reviews, " Cochrane Database Syst. Rev., vol. 9, p. ED000091, 2014.
13. I. Marshall, J. Kuiper, and B. Wallace, "Automating risk of bias assessment for clinical trials, " in Proc. ACM Conf. Bioinform. Comput. Biol. Biomed., 2014.
14. M. Mintz, S. Bills, R. Snow, and D. Jurafsky, "Distant supervision for relation extraction without labeled data, " in Proc. Joint Conf. Annu. Meeting ACL Int. Joint Conf. Natural Lang. Process. AFNLP, 2009, pp. 1003-1011.
15. A. Cohen, W. Hersh, K. Peterson, and P.-Y. Yen, "Reducing workload in systematic review preparation using automated citation classification, " J. Amer. Med. Inform. Assoc., vol. 13, no. 2, pp. 206-219, Mar. 2006.
16. T. Bekhuis and D. Demner-Fushman, "Towards automating the initial screening phase of a systematic review, " Studies Health Technol. Inform., vol. 160, pp. 146-150, 2010.
17. B. C. Wallace, K. Small, C. E. Brodley, and T. A. Trikalinos, "Active learning for biomedical citation screening, " in Proc. 16th ACM SIGKDD Int. Conf. Knowl. Discovery Data Mining, pp. 173-181, 2010.
18. B. C. Wallace, K. Small, C. E. Brodley, J. Lau, and T. A. Trikalinos, "Deploying an interactive machine learning system in an evidence-based practice center: Abstrackr, " in Proc. ACM SIGHIT Int. Health Inform. Symp., pp. 819-824, 2011.
19. A. M. Cohen and W. R. Hersh, "A survey of current work in biomedical text mining, " Briefings Bioinform., vol. 6, pp. 57-71, 2005.
20. B. de Bruijn, S. Carini, S. Kiritchenko, J. Martin, and I. Sim, "Automated information extraction of key trial design elements from clinical trial publications, " in Proc. AMIA Annu. Symp., 2008, pp. 141-145.
21. F. Boudin, J. Y. Nie, J. C. Bartlett, R. Grad, P. Pluye, and M. Dawes, "Combining classifiers for robust PICO element detection, " BMC Med. Inform. Decision Making, vol. 10, art. no. 29, 2010.
22. S. Kiritchenko, B. de Bruijn, S. Carini, J. Martin, and I. Sim, "ExaCT: Automatic extraction of clinical trial characteristics from journal publications, " BMC Med. Inform. Decision Making, vol. 10, art. no. 56, 2010.
23. S. Kim, D. Martinez, L. Cavedon, and L. Yencken, "Automatic classification of sentences to support evidence based medicine, " BMC Bioinform., Issue 12, (Supp. 2), art. no. S5, 2011.
24. R. Summerscales, S. Argamon, S. Bai, J. Huperff, and A. Schwartzff, "Automatic summarization of results from clinical trials, " in Proc. Bioinform. Biomed., 2011, pp. 372-377.
25. R. Summerscales, "Automatic summarization of clinical abstracts for evidence-based medicine, " Ph. D. dissertation, The Department of Computer Science, Illinois Inst. Technol., Chicago, IL, USA, 2013.
26. I. Shemilt, A. Simon, G. J. Hollands, T. M. Marteau, D. Ogilvie, A. OMara-Eves, M. P. Kelly, and J. Thomas, "Pinpointing needles in giant haystacks: Use of text mining to reduce impractical screening workload in extremely large scoping reviews, " Res. Synthesis Methods, vol. 5, no. 1, pp. 31-49, 2014.
27. Y. Jin, R. T. McDonald, K. Lerman, M. A. Mandel, S. Carroll, M. Y. Liberman, F. C. Pereira, R. S. Winters, and P. S. White, "Automated recognition of malignancy mentions in biomedical literature, " BMC Bioinform., vol. 7, no. 1, p. 492, 2006.
28. S. Kulick, A. Bies, M. Liberman, M. Mandel, R. McDonald, M. Palmer, A. Schein, L. Ungar, S. Winters, and P. White, "Integrated annotation for biomedical information extraction, " in Proc. Human Lang. Technol. /North Amer. Assoc. Comput. Linguistics, 2004, pp. 61-68.
29. X. Ling, J. Jiang, X. He, Q. Mei, C. Zhai, and B. Schatz, "Generating gene summaries from biomedical literature: A study of semi-structured summarization, " Inform. Proc. Manage., vol. 43, no. 6, pp. 1777-1791, 2007.
30. X. Ling, Q. Mei, C. Zhai, and B. Schatz, "Mining multi-faceted overviews of arbitrary topics in a text collection, " in Proc. ACM SIGKDD Int. Conf. Knowl. Discovery Data Mining, 2008, pp. 497-505.
31. A. M. Cohen and W. R. Hersh, "A survey of current work in biomedical text mining, " Briefings Bioinform., vol. 6, no. 1, pp. 57-71, 2005.
32. S. Hopewell, I. Boutron, D. G. Altman, and P. Ravaud, "Incorporation of assessments of risk of bias of primary studies in systematic reviews of randomised trials: A cross-sectional study, " BMJ Open, vol. 3, no. 8, art. no. e003342, 2013.
33. T. Nguyen and A. Moschitti, "End-to-end relation extraction using distant supervision from external semantic repositories, " in Proc. Annu. Meeting Assoc. Comput. Linguistics: Human Lang. Technol., 2011, pp. 277-282.
34. V. Vapnik, The Nature of Statistical Learning Theory, New York, NY, USA: Springer, 2013.
35. L. Hartling, M. Ospina, and Y. Liang, "Risk of bias versus quality assessment of randomised controlled trials: Cross sectional study, " BMJ, vol. 339, art. no. b4012, 2009.
36. B. Liu and L. Zhang, "A survey of opinion mining and sentiment analysis, " in Mining Text Data. New York, NY, USA: Springer, 2012, pp. 415-463.
37. B. Pang, B. Pang, L. Lee, and L. Lee, "Opinion mining and sentiment analysis, " Found. Trends Inform. Retrieval, vol. 2, pp. 1-135, 2008.
38. I. Titov and R. McDonald, "A joint model of text and aspect ratings for sentiment summarization, " in Proc. Assoc. Comput. Linguistics, 2008, p. 61801.
39. S. Brody and N. Elhadad, "An unsupervised aspect-sentiment model for online reviews, " in Proc. Annu. Conf. North Amer. Chapter Assoc. Comput. Linguistics, 2010, pp. 804-812.
40. H. Daumé III, A. Kumar, andA. Saha, "Frustratingly easy semi-supervised domain adaptation, " in Proc. Workshop Domain Adaptation Natural Lang. Process., 2010, pp. 53-59.
41. S. Ip, N. Hadar, S. Keefe, C. Parkin, R. Iovin, E. M. Balk, and J. Lau, "A web-based archive of systematic review data, " Syst. Rev., vol. 1, no. 21, p. 15, 2012.
42. J. Kuiper, I. Marshall, B. Wallace, and M. Swertz, "Spá: A web-based viewer for text mining in evidence based medicine, " in Machine Learning and Knowledge Discovery in Databases. New York, NY, USA: Springer, 2014, pp. 452-455.
43. B. Wallace, K. Small, C. Brodley, J. Lau, and T. Trikalinos, "Deploying an interactive machine learning system in an evidence-based practice center: Abstrackr, " in Proc. 2nd ACM SIGHIT Int. Health Inform. Symp., 2012, pp. 819-824.
44. G. van Valkenhoef and J. Kuiper, "Crowdsourcing a comprehensive clinical trial repository, " in Proc. AAAI Workshop Modern Artif. Intell. Health Anal., 2014.