Multivariate analysis of the population representativeness of related clinical studies

Journal of Biomedical Informatics

Volumn 60, Issue , 2016, Pages 66-76

  He, Zhe ^a,e   Ryan, Patrick ^a,b,c   Hoxha, Julia ^a   Wang, Shuang ^a   Carini, Simona ^d   Sim, Ida ^d   Weng, Chunhua ^a,c  

^a Columbia University ^*  (United States)

^b JANSSEN RESEARCH AND DEVELOPMENT   (United States)

^c Observational Health Data Sciences and Informatics   (United States)

^d UNIVERSITY OF CALIFORNIA   (United States)

^e FLORIDA STATE UNIVERSITY   (United States)

Author keywords

Clinical trial; Knowledge representation; Selection bias

Indexed keywords

KNOWLEDGE REPRESENTATION; MULTIVARIANT ANALYSIS;

CLINICAL TRIAL; DATA-DRIVEN METHODS; ELIGIBILITY CRITERION; MULTI VARIATE ANALYSIS; MULTIVARIATE METHODS; RESEARCH COMMUNITIES; SELECTION BIAS; TYPE 2 DIABETES MELLITUS;

POPULATION STATISTICS;

AGE DISTRIBUTION; AGED; ALGORITHM; ARTICLE; BODY MASS; CLINICAL EFFECTIVENESS; CONTROLLED STUDY; DATA ANALYSIS; GENERALIZABILITY INDEX FOR STUDY TRAIT; HUMAN; INTERMETHOD COMPARISON; MATHEMATICAL COMPUTING; MATHEMATICAL MODEL; MULTIVARIATE ANALYSIS; MULTIVARIATE GENERALIZABILITY INDEX FOR STUDY TRAIT; MULTIVARIATE UNDERREPRESENTED SUBGROUP IDENTIFICATION ALGORITHM; NON INSULIN DEPENDENT DIABETES MELLITUS; OBSERVATIONAL STUDY; PRIORITY JOURNAL; PROCESS DEVELOPMENT; PROCESS OPTIMIZATION; QUANTITATIVE ANALYSIS; SCORING SYSTEM; SEX DIFFERENCE; STATISTICAL ANALYSIS; CLINICAL TRIAL (TOPIC); DEMOGRAPHY; FACTUAL DATABASE; MEDICAL INFORMATICS; MEDICAL RESEARCH; NUTRITION; PATIENT SELECTION; PROCEDURES; SELECTION BIAS; STANDARDS;

ALGORITHMS; BIOMEDICAL RESEARCH; CLINICAL TRIALS AS TOPIC; DATABASES, FACTUAL; DEMOGRAPHY; DIABETES MELLITUS, TYPE 2; HUMANS; MEDICAL INFORMATICS COMPUTING; MULTIVARIATE ANALYSIS; NUTRITION SURVEYS; OBSERVATIONAL STUDIES AS TOPIC; PATIENT SELECTION; SELECTION BIAS;

EID: 84962787155     PISSN: 15320464     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jbi.2016.01.007     Document Type: Article

References (47)

1. From the NIH Director: The Importance of Clinical Trials (April 9, 2014). <>. http://www.nlm.nih.gov/medlineplus/magazine/issues/summer11/articles/summer11pg2-3.html.
2. Filion M., Forget G., Brochu O., Provencher L., Desbiens C., Doyle C., et al. Eligibility criteria in randomized phase II and III adjuvant and neoadjuvant breast cancer trials: not a significant barrier to enrollment. Clin. Trials 2012, 9(5):652-659.
3. Weisberg H.I., Hayden V.C., Pontes V.P. Selection criteria and generalizability within the counterfactual framework: explaining the paradox of antidepressant-induced suicidality?. Clin. Trials 2009, 6(2):109-118.
4. Rothwell P.M. External validity of randomised controlled trials: "to whom do the results of this trial apply?". Lancet 2005, 365(9453):82-93.
5. C. Leaf, Do clinical trials work? The New York Times, 2013.
6. Rodriguez M.I., Gordon-Maclean C. The safety, efficacy and acceptability of task sharing tubal sterilization to midlevel providers: a systematic review. Contraception 2014, 89(6):504-511.
7. Wysowski D.K., Swartz L. Adverse drug event surveillance and drug withdrawals in the United States, 1969-2002: the importance of reporting suspected reactions. Arch. Intern. Med. 2005, 165(12):1363-1369.
8. van de Water W., Kiderlen M., Bastiaannet E., Siesling S., Westendorp R.G., van de Velde C.J., et al. External validity of a trial comprised of elderly patients with hormone receptor-positive breast cancer. J. Natl. Cancer Inst. 2014, 106(4):dju051.
9. Zhang X., Wu Y., Kang D., Wang J., Hong Q., Peng L. The external validity of randomized controlled trials of hypertension within China: from the perspective of sample representation. PLoS One 2014, 8(12):e82324.
10. Somerson J.S., Bhandari M., Vaughan C.T., Smith C.S., Zelle B.A. Lack of diversity in orthopaedic trials conducted in the United States. J. Bone Joint Surg. Am. 2014, 96(7):e56.
11. Hoertel N., Le Strat Y., Lavaud P., Dubertret C., Limosin F. Generalizability of clinical trial results for bipolar disorder to community samples: findings from the National Epidemiologic Survey on Alcohol and Related Conditions. J. Clin. Psychiatr. 2013, 74(3):265-270.
12. Schmidt A.F., Groenwold R.H.H., van Delden J.J.M., van der Does Y., Klungel O.H., Roes K.C.B., et al. Justification of exclusion criteria was underreported in a review of cardiovascular trials. J. Clin. Epidemiol. 2014, 67(6):635-644.
13. Schoenmaker N., Van Gool W.A. The age gap between patients in clinical studies and in the general population: a pitfall for dementia research. Lancet Neurol. 2004, 3(10):627-630.
14. Blanco C., Olfson M., Goodwin R.D., Ogburn E., Liebowitz M.R., Nunes E.V., et al. Generalizability of clinical trial results for major depression to community samples: results from the National Epidemiologic Survey on Alcohol and Related Conditions. J. Clin. Psychiatr. 2008, 69(8):1276-1280.
15. Zimmerman M., Chelminski I., Posternak M.A. Generalizability of antidepressant efficacy trials: differences between depressed psychiatric outpatients who would or would not qualify for an efficacy trial. Am. J. Psychiatr. 2005, 162(7):1370-1372.
16. Hao T., Rusanov A., Boland M.R., Weng C. Clustering clinical trials with similar eligibility criteria features. J. Biomed. Inform. 2014, 52:112-120.
17. Weng C., Li Y., Ryan P., Zhang Y., Gao J., Liu F., et al. A distribution-based method for assessing the differences between clinical trial target populations and patient populations in electronic health records. Appl. Clin. Inform. 2014, 5(2):463-479.
18. Weng C., Tu S.W., Sim I., Richesson R. Formal representation of eligibility criteria: a literature review. J. Biomed. Inform. 2010, 43(3):451-467.
19. He Z., Carini S., Hao T., Sim I., Weng C. A method for analyzing commonalities in clinical trial target populations. AMIA Annu. Symp. Proc. 2014, 1777-1786.
20. He Z., Carini S., Sim I., Weng C. Visual aggregate analysis of eligibility features of clinical trials. J. Biomed. Inform. 2015, 54:241-255.
21. He Z., Wang S., Bornanian E., Weng C. Assessing the population representativeness of type 2 diabetes trials by combining public data from ClinicalTrials.gov and NHANES. Stud. Health Technol. Inform. 2015, 216:569-573.
22. He Z., Chandar P., Ryan P., Weng C. Simulation-based evaluation of the generalizability index for study traits. AMIA Annu. Symp. Proc. 2015, 594-603.
23. CDC, National Health and Nutrition Examination Survey Data: U.S. Department of Health and Human Services, Centers for Disease Control and Prevention (August 1, 2014). <>. http://www.cdc.gov/nchs/nhanes.htm.
24. T. Hao, C. Weng, Valx - Numerical Expression Extraction and Normalization (August 1, 2014). <>. http://columbiaelixr.appspot.com/valx.
25. Bodenreider O. The Unified Medical Language System (UMLS): integrating biomedical terminology. Nucleic Acids Res. 2004, 32(Database issue):D267-D270.
26. MedLinePlus (October 1, 2014). <>. http://www.nlm.nih.gov/medlineplus/.
27. Dodd A.H., Colby M.S., Boye K.S., Fahlman C., Kim S., Briefel R.R. Treatment approach and HbA1c control among US adults with type 2 diabetes: NHANES 1999-2004. Curr. Med. Res. Opin. 2009, 25(7):1605-1613.
28. Key Concepts about Weighting in NHANES (October 2014). <>. http://www.cdc.gov/nchs/tutorials/NHANES/SurveyDesign/Weighting/OverviewKey.htm.
29. CDC, National Health and Nutrition Examination Survey: Analytic Guidelines, 1999-2010 (September 2014). <>. http://www.cdc.gov/nchs/data/series/sr_02/sr02_161.pdf.
30. MedLinePlus, HbA1c Test (August 2014). <>. http://www.nlm.nih.gov/medlineplus/ency/article/003640.htm.
31. Age Categories, Life Cycle Groupings (October 30, 2014). <>. http://www.statcan.gc.ca/concepts/definitions/age2-eng.htm.
32. Interpretation of BMI Values (October 30, 2014). <>. http://www.cdc.gov/healthyweight/assessing/bmi/adult_bmi/index.html?s_cid=tw_ob064.
33. M. Khalilian, F.Z. Boroujeni, N. Mustapha, N. Sulaiman, K-means divide and conquer clustering. computer and automation engineering, in: '09 International Conference on ICCAE, Bangkok, 2009, pp. 306-309.
34. Liu H., Hussain F., Tan C., Dash M. Discretization: an enabling technique. Data Min. Knowl. Disc. 2002, 6(4):393-423.
35. Lee P.Y., Alexander K.P., Hammill B.G., Pasquali S.K., Peterson E.D. Representation of elderly persons and women in published randomized trials of acute coronary syndromes. JAMA 2001, 286(6):708-713.
36. Hutchins L.F., Unger J.M., Crowley J.J., Coltman C.A., Albain K.S. Underrepresentation of patients 65 years of age or older in cancer-treatment trials. N. Engl. J. Med. 1999, 341(27):2061-2067.
37. Lewis J.H., Kilgore M.L., Goldman D.P., Trimble E.L., Kaplan R., Montello M.J., et al. Participation of patients 65 years of age or older in cancer clinical trials. J. Clin. Oncol. 2003, 21(7):1383-1389.
38. Cigolle C.T., Blaum C.S., Halter J.B. Diabetes and cardiovascular disease prevention in older adults. Clin. Geriatr. Med. 2009, 25(4):607-641. vii-viii.
39. Leinonen A., Koponen M., Hartikainen S. Systematic review: representativeness of participants in RCTs of acetylcholinesterase inhibitors. PLoS One 2015, 10(5):e0124500.
40. Beers E., Moerkerken D.C., Leufkens H.G., Egberts T.C., Jansen P.A. Participation of older people in preauthorization trials of recently approved medicines. J. Am. Geriatr. Soc. 2014, 62(10):1883-1890.
41. Friedman J.H., Fisher N.I. Bump-hunting for high dimensional data. Stat. Comput. 1999, 9:123-143.
42. Nannings B., Abu-Hanna A., de Jonge E. Applying PRIM (Patient Rule Induction Method) and logistic regression for selecting high-risk subgroups in very elderly ICU patients. Int. J. Med. Inform. 2008, 77(4):272-279.
43. Breiman L., Friedman J.H., Olshen R.A., Stone C.J. Classification and Regression Trees 1983, Wadsworth, Belmont, CA.
44. R Package of Patient Rule Induction Method (PRIM) (April 6, 2015). <>. http://cran.r-project.org/web/packages/prim/index.html.
45. Cowie C.C., Rust K.F., Byrd-Holt D.D., Eberhardt M.S., Flegal K.M., Engelgau M.M., et al. Prevalence of diabetes and impaired fasting glucose in adults in the U.S. population: National Health and Nutrition Examination Survey 1999-2002. Diabetes Care 2006, 29(6):1263-1268.
46. Webb G. Overfitting. Encyclopedia of Machine Learning 2010, 744. Springer, US. C. Sammut, G. Webb (Eds.).
47. Frankel M.R., Battaglia M.P., Balluz L., Strine T. When data are not missing at random: implications for measuring health conditions in the Behavioral Risk Factor Surveillance System. BMJ Open 2012, 2(4):e000696.