The Ontology of Clinical Research (OCRe): An informatics foundation for the science of clinical research

Journal of Biomedical Informatics

Volumn 52, Issue , 2014, Pages 78-91

  Sim, Ida ^a   Tu, Samson W ^b   Carini, Simona ^a   Lehmann, Harold P ^c   Pollock, Brad H ^d   Peleg, Mor ^e   Wittkowski, Knut M ^f  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b STANFORD UNIVERSITY SCHOOL OF MEDICINE   (United States)

^c JOHNS HOPKINS UNIVERSITY   (United States)

^d UNIVERSITY OF TEXAS HEALTH SCIENCE CENTER AT SAN ANTONIO   (United States)

^e UNIVERSITY OF HAIFA   (Israel)

^f ROCKEFELLER UNIVERSITY   (United States)

Author keywords

Clinical research; Clinical research informatics; Eligibility criteria; Evidence based medicine; Ontology; Trial registration

Indexed keywords

DESIGN; INFORMATICS; LIFE CYCLE; ONTOLOGY; RHENIUM COMPOUNDS; SEMANTICS;

ABSTRACT REPRESENTATION; CLINICAL RESEARCH INFORMATICS; CLINICAL STUDY; DESIGN AND ANALYSIS; ELIGIBILITY CRITERION; EVIDENCE-BASED MEDICINE; OPERATIONAL PROCESS; TRIAL REGISTRATION;

CLINICAL RESEARCH;

HEMOGLOBIN A1C; HIGH DENSITY LIPOPROTEIN; LOW DENSITY LIPOPROTEIN; VITAMIN D;

ARTICLE; BONE MARROW TOXICITY; CEREBROVASCULAR ACCIDENT; CLINICAL RESEARCH; EVIDENCE BASED MEDICINE; FOLLOW UP; HEALTH CARE; HEART INFARCTION; HYPERLIPIDEMIA; INFORMATION SCIENCE; STATISTICAL CONCEPTS; VITAMIN SUPPLEMENTATION; BIOLOGICAL ONTOLOGY; BIOLOGY; HUMAN; MEDICAL INFORMATICS; MEDICAL RESEARCH; THEORETICAL MODEL;

BIOLOGICAL ONTOLOGIES; BIOMEDICAL RESEARCH; COMPUTATIONAL BIOLOGY; EVIDENCE-BASED MEDICINE; HUMANS; MEDICAL INFORMATICS; MODELS, THEORETICAL;

EID: 84919604769     PISSN: 15320464     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jbi.2013.11.002     Document Type: Article

References (101)

1. Clinical Research Informatics|AMIA. [Accessed: 7/5/2013]. http://www.amia.org/applications-informatics/clinical-research-informatics.
2. Fridsma D.B., Evans J., Hastak S., Mead C.N. The BRIDG project: a technical report. JAMIA 2008, 15:130-137.
3. BRIDG. [Accessed: 7/5/2013]. http://www.bridgmodel.org/.
4. Megan Kong Y., Dahlke C., Xiang Q., Qian Y., Karp D., Scheuermann R.H. Toward an ontology-based framework for clinical research databases. J Biomed Inform 2011, 44:48-58.
5. CDISC. [Accessed: 7/5/2013]. http://www.cdisc.org/.
6. Sim I., Carini S., Tu S., Wynden R., Pollock B.H., Mollah S.A., et al. The human studies database project: federating human studies design data using the ontology of clinical research, AMIA. Summits Transl Sci Proc 2010, 2010:51-55.
7. Sim I., Carini S., Tu S.W., Detwiler L.T., Brinkley J., Mollah S.A., et al. Ontology-based federated data access to human studies information AMIA. Annu Symp Proc 2012, 2012:856-865.
8. Katzan I.L., Rudick R.A. Time to integrate clinical and research informatics. Sci Transl Med 2012, 4:162fs41.
9. Friedman C.P., Wong A.K., Blumenthal D. Achieving a nationwide learning health system. Sci Transl Med 2010, 2:57cm29.
10. Olsen L., Aisner D., McGinnis J.M. The learning healthcare system: workshop summary 2007, National Academies Press, Washington, D.C.
11. Richardson W.S., Wilson M.C., Nishikawa J., Hayward R.S. The well-built clinical question: a key to evidence-based decisions. ACP J Club 1995, 123. A12-3.
12. Brian Haynes R. Forming research questions. Clinical epidemiology: how to do clinical practice research 2006, 496. Lippincott Williams & Wilkins, Philadelphia. R. Brian Haynes, D.L. Sackett, G. Guyatt, P. Tugwell (Eds.).
13. PICO Linguist. [Accessed: 7/4/2013]. http://babelmesh.nlm.nih.gov/pico.php.
14. M. Hernandez, S.M. Falconer, M. Storey, S. Carini, I. Sim, Synchronized tag clouds for exploring semi-structured clinical trial data, In Proceedings of the 2008 conference of the center for advanced studies on collaborative research: meeting of minds. Ontario, Canada (2008) 42-56.
15. Brian R. Haynes, Forming research questions. J Clin Epidemiol 2006, 59:881-886.
16. PubMed Clinical Queries. [Accessed: 7/5/2013]. http://www.ncbi.nlm.nih.gov/pubmed/clinical?term=vitamind#clincat=Therapy,Narrow.
17. Hartling L., Bond K., Santaguida P.L., Viswanathan M., Dryden D.M. Testing a tool for the classification of study designs in systematic reviews of interventions and exposures showed moderate reliability and low accuracy. J Clin Epidemiol 2011, 64:861-871.
18. Bekhuis T., Demner-Fushman D., Crowley R.S. Comparative effectiveness research designs: an analysis of terms and coverage in Medical Subject Headings (MeSH) and Emtree. J Med Libr Assoc 2013, 101:92-100.
19. Rohrig B., du Prel J.B., Wachtlin D., Blettner M. Types of study in medical research: part 3 of a series on evaluation of scientific publications. Dtsch Arztebl Int 2009, 106:262-268.
20. Grimes D.A., Schulz K.F. An overview of clinical research: the lay of the land. Lancet 2002, 359:57-61.
21. What study designs should be included in an EPOC reviews and what should they be called. [Accessed: 7/4/2013]. http://epocoslo.cochrane.org/sites/epocoslo.cochrane.org/files/uploads/WhatstudydesignsshouldbeincludedinanEPOCreviewsandwhatshouldtheybecalled.pdf.
22. Carini S., Pollock B.H., Lehmann H.P., Bakken S., Barbour E.M., Gabriel D., et al. Development and evaluation of a study design typology for human research AMIA. Annu Symp Proc 2009, 2009:81-85.
23. Evidence-Based Medicine Working Group, Evidence-based medicine. A new approach to teaching the practice of medicine, JAMA. 268 (1992) 2420-2425.
24. Sim I., Olasov B., Carini S. An ontology of randomized controlled trials for evidence-based practice: content specification and evaluation using the competency decomposition method. J Biomed Inform 2004, 37:108-119.
25. Dechartres A., Charles P., Hopewell S., Ravaud P., Altman D.G. Reviews assessing the quality or the reporting of randomized controlled trials are increasing over time but raised questions about how quality is assessed. J Clin Epidemiol 2011, 64:136-144.
26. Assessing the Risk of Bias of Nonrandomized Studies of Interventions or Exposures: Further Development of the RTI Item Bank - Abstract - Draft|AHRQ Effective Health Care Program. [Accessed: 7/7/2013]. http://effectivehealthcare.ahrq.gov/index.cfm/search-for-guides-reviews-and-reports/?productid=956&pageaction=displayproduct.
27. Greenland S., O'Rourke K. On the bias produced by quality scores in meta-analysis, and a hierarchical view of proposed solutions. Biostatistics (Oxford, England) 2001, 2:463-471.
28. G. Guyatt, D. Rennie, M.O. Meade, D.J. Cook, Users' Guides to the Medical Literature: A Manual for Evidence-Based Clinical, Practice. 2nd ed.
29. Statistics notes|BMJ. [Accessed: 7/4/2013]. http://www.bmj.com/bmj-series/statistics-notes.
30. J. Higgins, S. Green, Cochrane Handbook for Systematic Reviews of Interventions [updated March 2011]. Version 5.1.0 ed., The Cochrane Collaboration, 2011.
31. CEBM > EBM Tools > Critical Appraisal > Overview. [Accessed: 7/5/2013]. http://www.cebm.net/index.aspx?o=1157.
32. H.P. Lehmann, Bayesian computer-based approach to the physician's use of the clinical research literature (1992).
33. Rennels G.D., Shortliffe E.H., Stockdale F.E., Miller P.L. A computational model of reasoning from the clinical literature. Comput Methods Prog Biomed 1987, 24:139-149.
34. CDISC SDTM. [Accessed: 7/5/2013]. http://www.cdisc.org/sdtm.
35. C. Stuart, JAMA feature: Most clinical trials fail to add meaningful evidence, (2012) September 21, 2012-May 1, 2012.
36. Altman D.G. The scandal of poor medical research. BMJ 1994, 308:283-284.
37. Martinson B.C., Anderson M.S., de Vries R. Scientists behaving badly. Nature 2005, 435:737-738.
38. Bruno R., Mercier F., Claret L. Model-based drug development in oncology: what/'s next?. Clin Pharmacol Ther 2013, 93:303-305.
39. A. van Herick, Schuetz, Alperin, Bullano, Balu, S. Gandhi, The impact of initial statin treatment decisions on cardiovascular outcomes in clinical care settings: estimates using the Archimedes Model, ClinicoEconomics and Outcomes, Research. (2012) 337.
40. Nammuni K., Pickering C., Modgil S., Montgomery A., Hammond P., Wyatt J.C., et al. Design-a-trial: a rule-based decision support system for clinical trial design. Knowledge-Based Syst 2004, 17:121-129.
41. Richesson R.L., Andrews J.E. Clinical research informatics 2012, Springer.
42. J. Ross, S. Tu, S. Carini, I. Sim, Analysis of eligibility criteria complexity in clinical trials, AMIA. Summits Transl.Sci.Proc. 2010 (2010) 46-50.
43. Weng C., Wu X., Luo Z., Boland M.R., Theodoratos D., Johnson S.B. EliXR: an approach to eligibility criteria extraction and representation. J Am Med Inform Assoc 2011, 18(Suppl 1). i116-24.
44. Cuggia M., Besana P., Glasspool D. Comparing semi-automatic systems for recruitment of patients to clinical trials. Int J Med Inf 2011, 80:371-388.
45. WMA Declaration of Helsinki - Ethical Principles for Medical Research Involving Human Subjects. [Accessed: 7/5/2013]. http://www.wma.net/en/30publications/10policies/b3/.
46. Williams R.J., Tse T., Harlan W.R., Zarin D.A. Registration of observational studies: is it time?. CMAJ 2010, 182:1638-1642.
47. Godlee F. Clinical trial data for all drugs in current use. BMJ 2012, 345.
48. Trials | Instructions for Authors. [Accessed: 7/6/2013]. http://www.trialsjournal.com/authors/instructions.
49. Annals of Internal Medicine | Information For Authors | Research/Publication Ethics. [Accessed: 7/4/2013]. http://annals.org/public/authorsinfo.aspx#research-publication-ethics.
50. Eichler H.G., Abadie E., Breckenridge A., Leufkens H., Rasi G. Open clinical trial data for all? A view from regulators. PLoS Med 2012, 9:e1001202.
51. Murad M., Montori V. Synthesizing evidence: shifting the focus from individual studies to the body of evidence. JAMA 2013, 309:2217-2218.
52. Barton S. Which clinical studies provide the best evidence? The best RCT still trumps the best observational study. BMJ 2000, 321:255-256.
53. Bastian H., Glasziou P., Chalmers I. Seventy-five trials and eleven systematic reviews a day: how will we ever keep up?. PLoS Med 2010, 7:e1000326.
54. Tsafnat G., Dunn A., Glasziou P., Coiera E. The automation of systematic reviews. BMJ 2013, 346:f139.
55. RevMan | The Cochrane IMS. [Accessed: 7/6/2013]. http://ims.cochrane.org/revman.
56. SRDR - Systematic Review Data Repository | Home. [Accessed: 7/6/2013]. http://srdr.ahrq.gov/.
57. OpenMeta[Analyst] -- CEBM Brown. [Accessed: 7/6/2013]. http://www.cebm.brown.edu/open_meta.
58. Fiore L.D., Brophy M., Ferguson R.E., D'Avolio L., Hermos J.A., Lew R.A., et al. A point-of-care clinical trial comparing insulin administered using a sliding scale versus a weight-based regimen. Clin Trials 2011, 8:183-195.
59. Kravitz R.L., Paterniti D.A., Hay M.C., Subramanian S., Dean D.E., Weisner T., et al. Marketing therapeutic precision: potential facilitators and barriers to adoption of n-of-1 trials. Contemp Clin Trials 2009, 30:436-445.
60. Chen C., Haddad D., Selsky J., Hoffman J.E., Kravitz R.L., Estrin D.E., et al. Making sense of mobile health data: an open architecture to improve individual- and population-level health. J Med Internet Res 2012, 14:e112.
61. Salathé M., Freifeld C.C., Mekaru S.R., Tomasulo A.F., Brownstein J.S. Influenza A (H7N9) and the Importance of Digital Epidemiology. N Engl J Med 2013, 369:401-404.
62. Rector A.L., Qamar R., Marley T. Binding ontologies and coding systems to electronic health records and messages. Appl Ontol 2009, 4:51-69.
63. HL7: Reference Information Model (RIM) Downloads. [Accessed: 7/6/2013]. http://www.hl7.org/implement/standards/rim.cfm.
64. Code of Federal Regulations | HHS.gov. [Accessed: 7/6/2013]. http://www.hhs.gov/ohrp/humansubjects/guidance/45cfr46.html#46.102.
65. Tu S.W., Peleg M., Carini S., Bobak M., Ross J., Rubin D., et al. A practical method for transforming free-text eligibility criteria into computable criteria. J Biomed Inform 2011, 44:239-250.
66. Allen J.F. Maintaining knowledge about temporal intervals. Commun ACM 1983, 26:832-843.
67. G.Y. Chung, E. Coiera, A study of structured clinical abstracts and the semantic classification of sentences, In Proceedings of the Workshop on BioNLP 2007: Biological, Translational, and Clinical Language Processing. Prague, Czech Republic (2007) 121-128.
68. Hara K., Matsumoto Y. Extracting clinical trial design information from MEDLINE abstracts. New Gen Comput 2007, 25:263-275.
69. Xu R., Garten Y., Supekar K.S., Das A.K., Altman R.B., Garber A.M. Extracting subject demographic information from abstracts of randomized clinical trial reports. Stud Health TechnolInform 2007, 129:550-554.
70. Chung G.Y. Towards identifying intervention arms in randomized controlled trials: extracting coordinating constructions. J Biomed Inform 2009, 42:790-800.
71. M. Hansen, N. Rasmussen, G. Chung, Extracting number of trial participants from abstracts of randomized controlled trials, In Proceedings of Tromsø Telemedicine and eHealth Conference. (2008).
72. D. Demner-Fushman, J. Lin, Knowledge Extraction for Clinical Question Answering: Preliminary Results, In Proceedings of AAAI Workshop on Question Answering in Restricted Domains. Pittsburgh, PA.10 July 2005 (2005) 1-9.
73. Kiritchenko S., de Bruijn B., Carini S., Martin J., Sim I. ExaCT: automatic extraction of clinical trial characteristics from journal publications. BMC Med Inform Decis Mak 2010, 10. 56-6947-10-56.
74. J. Tao, E. Sirin, J. Bao, D.L. McGuinness, Extending OWL with Integrity Constraints | Tetherless World Constellation, In Proceedings of Description Logics Workshop 2010. May 4-7, 2010.
75. Stardog: Documentation. [Accessed: 7/8/2013]. http://stardog.com/docs/.
76. Roumiantseva D., Carini S., Sim I., Wagner T.H. Sponsorship and design characteristics of trials registered in ClinicalTrials.gov. Contemp Clin Trials 2013, 34:348-355.
77. AACT Database. [Accessed: 7/6/2013]. https://www.ctti-clinicaltrials.org/project-topics/clinical-trials.gov/aact-database.
78. Peng R.D., Dominici F., Zeger S.L. Reproducible epidemiologic research. Am J Epidemiol 2006, 163:783-789.
79. Hernandez M.E., Carini S., Storey M.A., Sim I. An interactive tool for visualizing design heterogeneity in clinical trials. AMIA Annu Symp Proc 2008, 298-302.
80. Brinkley J.F., Detwiler L.T. Structural Informatics Group, A query integrator and manager for the query web. J Biomed Inform 2012, 45:975-991.
81. Shah N.H., Musen M.A. UMLS-Query: a perl module for querying the UMLS. AMIA Annu Symp Proc 2008, 652-656.
82. Lee W.N., Shah N., Sundlass K., Musen M. Comparison of ontology-based semantic-similarity measures. AMIA Annu Symp Proc 2008, 384-388.
83. Jiang R., Gan M., He P. Constructing a gene semantic similarity network for the inference of disease genes. BMC Syst Biol 2011, 5(Suppl 2). S2-0509-5-S2-S2. Epub 2011 Dec 14.
84. Huang X., Lin J., Demner-Fushman D. Evaluation of PICO as a knowledge representation for clinical questions. AMIA Annu Symp Proc 2006, 359-363.
85. W.N. Lee, A.K. Das, Local alignment tool for clinical history: temporal semantic search of clinical databases, AMIA Annu Symp Proc 2010 (2010) 437-441.
86. W. Lee, Evaluating clinical practice variation using a knowledge-based temporal sequence alignment framework (2012).
87. PCORI Methodology Standards. [Accessed: 7/7/2013]. http://www.pcori.org/assets/PCORI-Methodology-Standards1.pdf.
88. Chan A., Tetzlaff J.M., Altman D.G., Laupacis A., Gøtzsche P.C., Krleža-Jerić K., et al. Statement: defining standard protocol items for clinical trials. Ann Inter Med 2013, 158(2013):200-207.
89. Chan A.W., Tetzlaff J.M., Gotzsche P.C., Altman D.G., Mann H., Berlin J.A., et al. SPIRIT 2013 explanation and elaboration: guidance for protocols of clinical trials. BMJ 2013, 346:e7586.
90. Tu S.W., Campbell J.R., Glasgow J., Nyman M.A., McClure R., McClay J., et al. The SAGE Guideline Model: achievements and overview. J Am Med Inform Assoc 2007, 14:589-598.
91. Delgado-Rodríguez M., Llorca J. Bias. J Epidemiol Commun Health 2004, 58:635-641.
92. Milian K., Teije A. Towards automatic patient eligibility assessment: from free-text criteria to queries 2013, 78-83. Springer, Berlin Heidelberg. M. Peleg, N. Peek, R. Marín Morales (Eds.).
93. Huang Z., Teije A., Harmelen F. Rule-based formalization of eligibility criteria for clinical trials 2013, 38-47. Springer, Berlin Heidelberg. M. Peleg, N. Peek, R. Marín Morales (Eds.).
94. Kaiser J. Making clinical data widely available. Science 2008, 322:217-218.
95. Sharing Clinical Research Data: A Workshop - Institute of Medicine. [Accessed: 7/6/2013]. http://www.iom.edu/Activities/Research/SharingClinicalResearchData/2012-OCT-04.aspx.
96. Wallace B.C., Trikalinos T.A., Lau J., Brodley C., Schmid C.H. Semi-automated screening of biomedical citations for systematic reviews. BMC Bioinform 2010, 11. 55-2105-11-55.
97. Cohen A.M., Hersh W.R., Peterson K., Yen P.Y. Reducing workload in systematic review preparation using automated citation classification. JAMIA 2006, 13:206-219.
98. Estrin D., Sim I. Open mHealth architecture: an engine for health care innovation. Science 2010, 330:759-760.
99. R.L. Kravitz, N-of-1 Trials Using mHealth in Chronic, Pain, 1R01NR013938-01.
100. Musen M.A., Noy N.F., Shah N.H., Whetzel P.L., Chute C.G., Story M.A., et al. The national center for biomedical ontology. JAMIA 2012, 19:190-195.
101. Whetzel P.L., Noy N.F., Shah N.H., Alexander P.R., Nyulas C., Tudorache T., et al. BioPortal: enhanced functionality via new Web services from the national center for biomedical ontology to access and use ontologies in software applications. Nucl Acids Res 2011, 39. W541-5.