Automated confidence ranked classification of randomized controlled trial articles: An aid to evidence-based medicine

Journal of the American Medical Informatics Association

Volumn 22, Issue 3, 2015, Pages 707-717

  Cohen, Aaron M ^a   Smalheiser, Neil R ^b   McDonagh, Marian S ^a   Yu, Clement ^c   Adams, Clive E ^d   Davis, John M ^b   Yu, Philip S ^c  

^a OREGON HEALTH AND SCIENCE UNIVERSITY   (United States)

^b UNIVERSITY OF ILLINOIS AT CHICAGO   (United States)

^c 1120 Science and Engineering Offices   (United States)

^d UNIVERSITY OF NOTTINGHAM   (United Kingdom)

Author keywords

Evidence based medicine; Information retrieval; Natural language processing; Randomized controlled trials as topic; Support vector machines; Systematic reviews

Indexed keywords

ARTICLE; AUTOMATION; CLASSIFICATION; CLASSIFICATION ALGORITHM; CLASSIFIER; EVIDENCE BASED MEDICINE; HUMAN; INFORMATION RETRIEVAL; MACHINE LEARNING; MEASUREMENT ACCURACY; MEDICAL LITERATURE; MEDICAL SUBJECT HEADINGS; MEDLINE; NATURAL LANGUAGE PROCESSING; PREDICTION; PUBLICATION; RANDOMIZED CONTROLLED TRIAL (TOPIC); SUPPORT VECTOR MACHINE; ARTIFICIAL INTELLIGENCE; LITERATURE; PROCEDURES; RECEIVER OPERATING CHARACTERISTIC;

ARTIFICIAL INTELLIGENCE; EVIDENCE-BASED MEDICINE; HUMANS; INFORMATION STORAGE AND RETRIEVAL; MEDLINE; RANDOMIZED CONTROLLED TRIALS AS TOPIC; REVIEW LITERATURE AS TOPIC; ROC CURVE; SUPPORT VECTOR MACHINE;

EID: 84940368805     PISSN: 10675027     EISSN: 1527974X     Source Type: Journal    
DOI: 10.1093/jamia/ocu025     Document Type: Article

References (44)

1. Sackett DL, Rosenberg WM, Gray JA, Haynes RB, Richardson WS. Evidence based medicine: what it is and what it isn't. BMJ. 1996;312(7023):71-72.
2. Haynes RB. What kind of evidence is it that evidence-based medicine advocates want health care providers and consumers to pay attention to? BMC Health Serv Res. 2002; 2(1):3.
3. Wieland LS, Robinson KA, Dickersin K. Understanding why evidence from randomised clinical trials may not be retrieved from Medline: comparison of indexed and non-indexed records. BMJ. 2012;344:d7501.
4. Edinger T, Cohen AM. A large-scale analysis of the reasons given for excluding articles that are retrieved by literature search during systematic review. AMIA Annu Symp Proc. 2013;2013:379-387.
5. Cohen AM, Adams CE, Davis JM, et al. Evidence-based medicine, the essential role of systematic reviews, and the need for automated text mining tools. Proceedings of the 1st ACM International Health Informatics Symposium November, 2010; Arlington, Virginia USA. 2010:376-380.
6. Harker J, Kleijnen J. What is a rapid review? A methodological exploration of rapid reviews in Health Technology Assessments. Int J Evid Based Healthc. 2012;10(4): 397-410.
7. Khangura S, Konnyu K, Cushman R, Grimshaw J, Moher D. Evidence summaries: the evolution of a rapid review approach. Syst Rev. 2012;1:10.
8. Cohen AM. Optimizing feature representation for automated systematic review work prioritization. AMIA Annu Symp Proc. 2008;2008:121-125.
9. Tsertsvadze A, Maglione M, Chou R, et al. Updating Comparative Effectiveness Reviews: Current Efforts in AHRQ's Effective Health Care Program. Methods Guide for Effectiveness and Comparative Effectiveness Reviews [Internet]. Rockville (MD): Agency for Healthcare Research and Quality (US); 2008 [cited February 3, 2014]. http:// www.ncbi.nlm.nih.gov/books/NBK66066/. Accessed February 3, 2014.
10. McDonagh MS, Jonas DE, Gartlehner G, et al. Methods for the drug effectiveness review project. BMC Med Res Methodol. 2012;12:140.
11. Funk ME, Reid CA. Indexing consistency in MEDLINE. Bull Med Libr Assoc. 1983;71(2):176-183.
12. Joachims T. Text categorization with support vector machines: learning with many relevant features. In: Proceedings of the 10th European Conference on Machine Learning, April, 1998; Chemnitz, Germany. 1998;137-142.
13. Fan RE, Chang KW, Hsieh CJ, Wang XR, Lin CJ. LIBLINEAR: A library for large linear classification. J Mach Learn Res. 2008;9:1871-1874.
14. Rüping S. A simple method for estimating conditional probabilities for svms. Technical Report/Universität Dortmund, SFB 475 Komplexitätsreduktion in Multivariaten Datenstrukturen; 2004.
15. Cohen AM. An effective general purpose approach for automated biomedical document classification. AMIA Annu Symp Proc. 2006;2006:161-165.
16. Fayyad U, Irani K. Multi-interval discretization of continuous-valued attributes for classification learning. Proceedings of the Thirteenth International Joint Conference on Artificial Intelligence, San Francisco, CA: Morgan Kaufmann 1993;1022-1027.
17. Gurusamy KS, Davidson C, Gluud C, Davidson BR. Early versus delayed laparoscopic cholecystectomy for people with acute cholecystitis. Cochrane Database Syst Rev. 2013;6: CD005440.
18. Rösner S, Hackl-Herrwerth A, Leucht S, Vecchi S, Srisurapanont M, Soyka M. Opioid antagonists for alcohol dependence. Cochrane Database Syst Rev. 2010;(12): CD001867.
19. Anderson K, Norman RJ, Middleton P. Preconception lifestyle advice for people with subfertility. Cochrane Database Syst Rev. 2010;(4):CD008189.
20. Worthington HV, Clarkson JE, Bryan G, et al. Interventions for preventing oral mucositis for patients with cancer receiving treatment. Cochrane Database Syst Rev. 2011;(4): CD000978.
21. Robinson KA, Dickersin K. Development of a highly sensitive search strategy for the retrieval of reports of controlled trials using PubMed. Int J Epidemiol. 2002;31(1): 150-153.
22. Haynes RB, Wilczynski N. Finding the gold in MEDLINE: clinical queries. ACP J Club. 2005;142(1):A8-A9.
23. Wilczynski NL, McKibbon KA, Walter SD, Garg AX, Haynes RB. MEDLINE clinical queries are robust when searching in recent publishing years. J Am Med Inform Assoc [Internet]. September 27, 2012 [cited February 11, 2013]. http:// jamia.bmj.com/content/early/2012/09/26/amiajnl-2012-001075. Accessed January 5, 2015.
24. Cohen AM, Ambert K, McDonagh M. Studying the potential impact of automated document classification on scheduling a systematic review update. BMC Med Inform Decis Mak. 2012;12(1): 33.
25. Cohen AM, Hersh WR, Peterson K, Yen PY. Reducing workload in systematic review preparation using automated citation classification. J Am Med Inf Assoc. 2006;13(2): 206-219.
26. Cohen AM, Ambert K, McDonagh M. A prospective evaluation of an automated classification system to support evidence-based medicine and systematic review. AMIA Annu Symp Proc. 2010;2010:121-125.
27. Frunza O, Inkpen D, Matwin S, Klement W, O'Blenis P. Exploiting the systematic review protocol for classification of medical abstracts. Artif Intell Med. 2011; 51(1):17-25.
28. Matwin S, Kouznetsov A, Inkpen D, Frunza O, O'Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. J Am Med Inf Assoc. 2010; 17(4):446-453.
29. Aphinyanaphongs Y, Statnikov A, Aliferis CF. A comparison of citation metrics to machine learning filters for the identification of high quality MEDLINE documents. J Am Med Inf Assoc. 2006;13(4):446-455.
30. Aphinyanaphongs Y, Tsamardinos I, Statnikov A, Hardin D, Aliferis CF. Text categorization models for high-quality article retrieval in internal medicine. J Am Med Inf Assoc. 2005;12(2):207-216.
31. Demner-Fushman D, Seckman C, Fisher C, et al. A prototype system to support evidence-based practice. AMIA Annu Symp Proc. 2008;151-155.
32. Kilicoglu H, Demner-Fushman D, Rindflesch TC, Wilczynski NL, Haynes RB. Towards automatic recognition of scientifically rigorous clinical research evidence. J Am Med Inf Assoc. 2009;16(1):25-31.
33. Bekhuis T, Demner-Fushman D. Screening nonrandomized studies for medical systematic reviews: a comparative study of classifiers. Artif Intell Med. 2012;55(3):197-207.
34. Bekhuis T, Tseytlin E, Mitchell KJ, Demner-Fushman D. Feature engineering and a proposed decision-support system for systematic reviewers of medical evidence. PLoS ONE. 2014;9(1):e86277.
35. Agarwal S, Yu H. Automatically classifying sentences in full-text biomedical articles into Introduction, Methods, Results and Discussion. Bioinformatics. 2009;25(23): 3174-3180.
36. Chung GY. Sentence retrieval for abstracts of randomized controlled trials. BMC Med Inform Decis Mak. 2009;9(1):10.
37. Fiszman M, Demner-Fushman D, Kilicoglu H, Rindflesch TC. Automatic summarization of MEDLINE citations for evidence-based medical treatment: a topic-oriented evaluation. J Biomed Inf [Internet]. 2008. http://www.ncbi.nlm. nih.gov/entrez/query.fcgi?cmd1/4Retrieve&db1/4PubMed& dopt1/4Citation&list_uids1/419022398.
38. Blake C, Pratt W. Collaborative information synthesis II: recommendations for information systems to support synthesis activities. J Am Soc Inf Sci Technol. 2006;57(14): 1888-1895.
39. Moher D, Tsertsvadze A, Tricco AC, et al. When and how to update systematic reviews. Cochrane Database Syst Rev. 2008; (1):MR000023.
40. Sampson M, Shojania KG, McGowan J, et al. Surveillance search techniques identified the need to update systematic reviews. J Clin Epidemiol. 2008;61(8):755-762.
41. Cooke A, Smith D, Booth A. Beyond PICO The SPIDER Tool for Qualitative Evidence Synthesis. Qual Health Res. 2012; 22(10):1435-1443.
42. Smalheiser NR, Lin C, Jia L, et al. Design and implementation of meta, a meta search engine for biomedical literature retrieval intended for systematic reviewers. Health Inf Sci Syst. 2014;2(1): 1.
43. Jiang Y, Lin C, Meng W, Yu C, Cohen AM, Smalheiser NR. Rule-based deduplication of article records from bibliographic databases. Database. 2014;2014:bat086.
44. Shao W, Adams CE, Cohen AM, et al. Aggregator: a machine learning approach to identifying MEDLINE articles that derive from the same underlying clinical trial. Methods. 2014 http://www.sciencedirect.com/science/article/pii/ S1046202314003661.