Reporting and handling of missing data in predictive research for prevalent undiagnosed type 2 diabetes mellitus: A systematic review

EPMA Journal

Volumn 6, Issue 1, 2015, Pages

  Masconi, Katya L ^a,b   Matsha, Tandi E ^c   Echouffo Tcheugui, Justin B ^d,e   Erasmus, Rajiv T ^a   Kengne, Andre P ^b,f  

^a UNIVERSITY OF STELLENBOSCH   (South Africa)

^b SOUTH AFRICAN MEDICAL RESEARCH COUNCIL   (South Africa)

^c CAPE PENINSULA UNIVERSITY OF TECHNOLOGY   (South Africa)

^d EMORY UNIVERSITY   (United States)

^e MEDSTAR HEALTH RESEARCH INSTITUTE   (United States)

^f UNIVERSITY OF CAPE TOWN   (South Africa)

Author keywords

Diabetes mellitus; Guidelines; Modeling; Patient Stratification; Patterns; Predictive; Preventive and Personalized Medicine; Risk; Screening

Indexed keywords

ADULT; AGED; HUMAN; MAJOR CLINICAL STUDY; MEDICAL RESEARCH; MISSING DATA; NON INSULIN DEPENDENT DIABETES MELLITUS; PREDICTION; PRIORITY JOURNAL; PUBLICATION; REVIEW; RISK ASSESSMENT; STATISTICAL CONCEPTS; SYSTEMATIC REVIEW; VALIDATION STUDY; YOUNG ADULT;

EID: 84927766865     PISSN: 18785077     EISSN: 18785085     Source Type: Journal    
DOI: 10.1186/s13167-015-0028-0     Document Type: Review

References (92)

1. Steyerberg EW. Clinical prediction models 2009, Springer, New York.
2. Federation ID. IDF Diabetes Atlas 2013, International Diabetes Federation, Brussels, Belgium, 6.
3. Kengne AP, Masconi K, Mbanya VN, Lekoubou A, Echouffo-Tcheugui JB, Matsha TE. Risk predictive modelling for diabetes and cardiovascular disease. Crit Rev Clin Lab Sci 2013, 51(1):1-12. 10.3109/10408363.2013.853025, 24304342.
4. Brown N, Critchley J, Bogowicz P, Mayige M, Unmin N. Risk scores based on self-reported or available clinical data to detect undiagnosed type 2 diabetes: a systematic review. Diabetes Res Clin Pract 2012, 98(3):369-85. 10.1016/j.diabres.2012.09.005, 23010559.
5. Bindraban NR, van Valkengoed IGM, Mairuhu G, Holleman F, Hoekstra JBL, Michels BPJ, et al. Prevalence of diabetes mellitus and the performance of a risk score among Hindustani Surinamese, African Surinamese and ethnic Dutch: a cross-sectional population-based study. BMC Public Health 2008, 8(1):271. 10.1186/1471-2458-8-271, 18673544.
6. Ginde AA, Delaney KE, Lieberman RM, Vanderweil SG, Camargo CA. Estimated risk for undiagnosed diabetes in the emergency department: a multicenter survey. Acad Emerg Med 2007, 14(5):492-5. 10.1111/j.1553-2712.2007.tb01815.x, 17392521.
7. Robinson C, Agarwal G, Nerenberg K. Validating the CANRISK prognostic model for assessing diabetes risk in Canada's multi-ethnic population. Chronic Dis Inj Can 2011, 32(1):19-31. 22153173.
8. Rolka DB, Narayan KM, Thompson TJ, Goldman D, Lindenmayer J, Alich K, et al. Performance of recommended screening tests for undiagnosed diabetes and dysglycemia. Diabetes Care 2001, 24(11):1899-903. 10.2337/diacare.24.11.1899, 11679454.
9. Spijkerman AM, Yuyun MF, Griffin SJ, Dekker JM, Nijpels G, Wareham NJ. The performance of a risk score as a screening test for undiagnosed hyperglycemia in ethnic minority groups data from the 1999 Health Survey for England. Diabetes Care 2004, 27(1):116-22. 10.2337/diacare.27.1.116, 14693976.
10. Zhang L, Zhang Z, Zhang Y, Hu G, Chen L. Evaluation of Finnish Diabetes Risk Score in screening undiagnosed diabetes and prediabetes among US adults by gender and race: NHANES 1999-2010. PLoS One 2014, 9(5):e97865. 10.1371/journal.pone.0097865, 24852786.
11. Griffin S, Little SJ, Hales CN, Kinmonth AL, Wareham NJ. Diabetes risk score: towards earlier detection of type 2 diabetes in general practice. Diabetes Metab Res Rev 2000, 16(3):164-71. 10.1002/1520-7560(200005/06)16:3<164::AID-DMRR103>3.0.CO;2-R, 10867715.
12. Ko G, So W, Tong P, Ma R, Kong A, Ozaki R, et al. A simple risk score to identify Southern Chinese at high risk for diabetes. Diabet Med 2010, 27(6):644-9. 10.1111/j.1464-5491.2010.02993.x, 20546281.
13. de Sousa AGP, Pereira AC, Marquezine GF, Marques do Nascimento-Neto R, Freitas SN, de C Nicolato RL, et al. Derivation and external validation of a simple prediction model for the diagnosis of type 2 diabetes mellitus in the Brazilian urban population. Eur J Epidemiol 2009, 24(2):101-9. 10.1007/s10654-009-9314-2.
14. Lindström J, Tuomilehto J. The Diabetes Risk Score A practical tool to predict type 2 diabetes risk. Diabetes Care 2003, 26(3):725-31. 10.2337/diacare.26.3.725, 12610029.
15. Liu M, Pan C, Jin M. A Chinese diabetes risk score for screening of undiagnosed diabetes and abnormal glucose tolerance. Diabetes Technol Ther 2011, 13(5):501-7. 10.1089/dia.2010.0106, 21406016.
16. Al-Lawati J, Tuomilehto J. Diabetes risk score in Oman: a tool to identify prevalent type 2 diabetes among Arabs of the Middle East. Diabetes Res Clin Pract 2007, 77(3):438-44. 10.1016/j.diabres.2007.01.013, 17306410.
17. Baan CA, Ruige JB, Stolk RP, Witteman JC, Dekker JM, Heine RJ, et al. Performance of a predictive model to identify undiagnosed diabetes in a health care setting. Diabetes Care 1999, 22(2):213-9. 10.2337/diacare.22.2.213, 10333936.
18. Bang H, Edwards AM, Bomback AS, Ballantyre CM, Brillon D, Callahan MA, et al. Development and validation of a patient self-assessment score for diabetes risk. Ann Intern Med 2009, 151(11):775-83. 10.7326/0003-4819-151-11-200912010-00005, 19949143.
19. Chaturvedi V, Reddy KS, Pabhakaran D, Jeemon P, Ramakrishnan L, Shah P, et al. Development of a clinical risk score in predicting undiagnosed diabetes in urban Asian Indian adults: a population-based study. CVD Prev Control 2008, 3(3):141-51. 10.1016/j.cvdpc.2008.07.002.
20. Franciosi M, De Berardis G, Rossi MC, Sacco M, Belfiglio M, Pellegrini F, et al. Use of the diabetes risk score for opportunistic screening of undiagnosed diabetes and impaired glucose tolerance the IGLOO (Impaired Glucose Tolerance and Long-Term Outcomes Observational) study. Diabetes Care 2005, 28(5):1187-94. 10.2337/diacare.28.5.1187, 15855587.
21. Glümer C, Carstensen B, Sandbaek A, Lauritzen T, Jorgensen T, Borch-Johnsen K, et al. A Danish Diabetes Risk Score for Targeted Screening: The Inter99 study. Diabetes Care 2004, 27(3):727-33. 10.2337/diacare.27.3.727, 14988293.
22. Glümer C, Borch-Johnsen K, Colagiuri S. Can a screening programme for diabetes be applied to another population?. Diabet Med 2005, 22(9):1234-8. 10.1111/j.1464-5491.2005.01641.x, 16108854.
23. Glümer C, Vistisen D, Borch-Johnsen K, Colagiuri S. Risk scores for type 2 diabetes can be applied in some populations but not all. Diabetes Care 2006, 29(2):410-4. 10.2337/diacare.29.02.06.dc05-0945, 16443896.
24. Gray L, Taub NA, Khunti K, Gardiner E, Hiles S, Webb DR, et al. The Leicester Risk Assessment score for detecting undiagnosed type 2 diabetes and impaired glucose regulation for use in a multiethnic UK setting. Diabet Med 2010, 27(8):887-95. 10.1111/j.1464-5491.2010.03037.x, 20653746.
25. Gray LJ, Barros H, Raposo L, Khunti K, Daves MJ, Santos AC. The development and validation of the Portuguese risk score for detecting type 2 diabetes and impaired fasting glucose. Prim Care Diabetes 2013, 7(1):11-8. 10.1016/j.pcd.2013.01.003, 23357741.
26. Heianza Y, Arase Y, Saito K, Hsieh SD, Tsuji H, Kodama S, et al. Development of a screening score for undiagnosed diabetes and its application in estimating absolute risk of future type 2 diabetes in Japan: Toranomon Hospital Health Management Center Study 10 (TOPICS 10). J Clin Endocrinol Metab 2013, 98(3):1051-60. 10.1210/jc.2012-3092, 23393174.
27. Heikes KE, Eddy DM, Arondekar B, Schlessinger L. Diabetes Risk Calculator A simple tool for detecting undiagnosed diabetes and pre-diabetes. Diabetes Care 2008, 31(5):1040-5. 10.2337/dc07-1150, 18070993.
28. Keesukphan P, Chanprasertyothin S, Ongphiphadhanakul B, Puavilai G. The development and validation of a diabetes risk score for high-risk Thai adults. J Med Assoc Thai 2007, 90(1):149. 17621746.
29. Lee Y, Bang H, Kim HC, Kim HM, Park SW, Kim DJ. A simple screening score for diabetes for the Korean population development, validation, and comparison with other scores. Diabetes Care 2012, 35(8):1723-30. 10.2337/dc11-2347, 22688547.
30. Mohan V, Deepa R, Deepa M, Somannavar S, Datta M. A simplified Indian Diabetes Risk Score for screening for undiagnosed diabetic subjects. J Assoc Phys India 2005, 53:759-63.
31. Park P, Griffin SJ, Sargeant L, Wareham NJ. The performance of a risk score in predicting undiagnosed hyperglycemia. Diabetes Care 2002, 25(6):984-8. 10.2337/diacare.25.6.984, 12032103.
32. Rahman M, Simmons RK, Harding AH, Wareham NJ, Griffin SJ. A simple risk score identifies individuals at high risk of developing type 2 diabetes: a prospective cohort study. Fam Pract 2008, 25(3):191-6. 10.1093/fampra/cmn024, 18515811.
33. Ramachandran A, Snehalatha C, Vijay V, Wareham NJ, Colagiuri S. Derivation and validation of diabetes risk score for urban Asian Indians. Diabetes Res Clin Pract 2005, 70(1):63-70. 10.1016/j.diabres.2005.02.016, 16126124.
34. Rathmann W, Martin S, Haastert B, Icks A, Holle R, Lowel H, et al. Performance of screening questionnaires and risk scores for undiagnosed diabetes: the KORA Survey 2000. Arch Intern Med 2005, 165(4):436-41. 10.1001/archinte.165.4.436, 15738374.
35. Ruige JB, de Neeling JN, Kostense PJ, Bouter LM, Heine RJ. Performance of an NIDDM screening questionnaire based on symptoms and risk factors. Diabetes Care 1997, 20(4):491-6. 10.2337/diacare.20.4.491, 9096967.
36. Witte D, Shipley MJ, Marmot MG, Brunner EJ. Performance of existing risk scores in screening for undiagnosed diabetes: an external validation study. Diabet Med 2010, 27(1):46-53. 10.1111/j.1464-5491.2009.02891.x, 20121888.
37. Zhou X, Qiao Q, Ji L, Ning F, Yang W, Weng J, et al. Nonlaboratory-Based Risk Assessment Algorithm for undiagnosed type 2 diabetes developed on a nation-wide diabetes survey. Diabetes Care 2013, 36(12):3944-52. 10.2337/dc13-0593, 24144651.
38. Winkler G, Hidvagi T, Vandorfi G, Balogh S, Jermendy G. Prevalence of undiagnosed abnormal glucose tolerance in adult patients cared for by general practitioners in Hungary. Results of a risk-stratified screening based on FINDRISC questionnaire. Med Sci Monit 2012, 19:67-72. 10.12659/MSM.883747.
39. Adhikari P, Pathak R, Kotian S. Validation of the MDRF-Indian Diabetes Risk Score (IDRS) in another South Indian Population through the Boloor Diabetes Study (BDS). JAPI. 2010, 50:434-6.
40. Akyil RC, Miloglu O, Olgun N, Bayrakdar IS. A comparison of three different diabetes screening methods among dental patients in Turkey. Pak J Med Sci 2014, 30(1):65.
41. Al Khalaf MM, Eid MM, Majjar HA, Alhajry KM, Doi SA, Thalib L. Screening for diabetes in Kuwait and evaluation of risk scores. EMHJ 2010, 16(7):725-31.
42. Baan C, Stolk RP, Grobbee DE, Witteman JC, Feskens EJ. Physical activity in elderly subjects with impaired glucose tolerance and newly diagnosed diabetes mellitus. Am J Epidemiol 1999, 149(3):219-27. 10.1093/oxfordjournals.aje.a009795, 9927216.
43. Bergmann A, Li J, Wang L, Schulze J, Bornstein SR, Schwarz PE. A simplified Finnish diabetes risk score to predict type 2 diabetes risk and disease evolution in a German population. Horm Metab Res 2007, 39(09):677-82. 10.1055/s-2007-985353, 17846976.
44. Reddy KS, Prabhakaran D, Chaturvedi V, Jeemon P, Thankappan KR, Ramakrishnan L, et al. Methods for establishing a surveillance system for cardiovascular diseases in Indian industrial populations. Bull World Health Organ 2006, 84(6):461-9. 10.2471/BLT.05.027037, 16799730.
45. Cabrera de León A, Coello SD, Ronriquez MC, Medina MB, Almeida Gonzalez D, Diaz BB, et al. A simple clinical score for type 2 diabetes mellitus screening in the Canary Islands. Diabetes Res Clin Pract 2008, 80(1):128-33. 10.1016/j.diabres.2007.10.022, 18082285.
46. Gao W, Dong YH, Pang ZC, Nan HR, Wang SJ, Ren J, et al. A simple Chinese risk score for undiagnosed diabetes. Diabet Med 2010, 27(3):274-81. 10.1111/j.1464-5491.2010.02943.x, 20536489.
47. Hanif M, Valsamakis G, Dixon A, Boutsiadis A, Jones AF, Barnett AH, et al. Detection of impaired glucose tolerance and undiagnosed type 2 diabetes in UK South Asians: an effective screening strategy. Diabetes Obes Metab. 2008, 10(9):755-62. 10.1111/j.1463-1326.2007.00806.x, 17941866.
48. Heldgaard PE, Griffin S. Routinely collected general practice data aids identification of people with hyperglycaemia and metabolic syndrome. Diabet Med 2006, 23(9):996-1002. 10.1111/j.1464-5491.2006.01929.x, 16922706.
49. Ku G, Kegels G. The performance of the Finnish Diabetes Risk Score, a modified Finnish Diabetes Risk Score and a simplified Finnish Diabetes Risk Score in community-based cross-sectional screening of undiagnosed type 2 diabetes in the Philippines. Prim Care Diabetes 2013, 7(4):249-59. 10.1016/j.pcd.2013.07.004, 23953706.
50. Li J, Bergmann A, Reimann M, Bornstein SR, Schwarz PE. A more simplified Finnish diabetes risk score for opportunistic screening of undiagnosed type 2 diabetes in a German population with a family history of the metabolic syndrome. Horm Metab Res 2009, 41(02):98-103. 10.1055/s-0028-1087191, 18975253.
51. Lin J-W, Chang YC, Li HY, Chien YF, Wu MY, Tsai RY, et al. Cross-sectional validation of diabetes risk scores for predicting diabetes, metabolic syndrome, and chronic kidney disease in Taiwanese. Diabetes Care 2009, 32(12):2294-6. 10.2337/dc09-0694, 19755627.
52. Saaristo T, Peltonen M, Lindstrom J, Saarikoski L, Sundvaall J, Eriksson JG, et al. Cross-sectional evaluation of the Finnish Diabetes Risk Score: a tool to identify undetected type 2 diabetes, abnormal glucose tolerance and metabolic syndrome. Diab Vasc Dis Res 2005, 2(2):67-72. 10.3132/dvdr.2005.011, 16305061.
53. Ta MT, Nguyen KT, Nguyen ND, Campbell JV, Nguyen TV. Identification of undiagnosed type 2 diabetes by systolic blood pressure and waist-to-hip ratio. Diabetologia 2010, 53(10):2139-46. 10.1007/s00125-010-1841-6, 20596691.
54. Tankova T, Chakarova N, Atanassova I, Dakovska L. Evaluation of the Finnish Diabetes Risk Score as a screening tool for impaired fasting glucose, impaired glucose tolerance and undetected diabetes. Diabetes Res Clin Pract 2011, 92(1):46-52. 10.1016/j.diabres.2010.12.020, 21242013.
55. Simpson EH. The interpretation of interaction in contingency tables. J Royal Stat Soc Series B (Methodological), 1951: p. 238-241..
56. Rubin DB. Inference and missing data. Biometrika 1976, 63(3):581-92. 10.1093/biomet/63.3.581.
57. Fairclough D. Methods of analysis for longitudinal studies of health-related quality of life, Quality of life assessment in clinical trials: methods and practice. 1998. p. 227-47..
58. King DW, King LA, Bachrach PS, McArdle JJ. Contemporary approaches to missing data: the glass is really half full. PTSD Res Q 2001, 12(1):1-6.
59. Hair JF, Black WC, Babin BJ, Anderson RE. Multivariate data analysis 1998, Prentice Hall, New Jersey.
60. Curran D, Molenberghs G, Fayers PM, Machin D. Analysis of incomplete quality-of-life data in clinical trials. Quality of life assessment in clinical trials 1998, Oxford University Press, Oxford.
61. Little RJ. A test of missing completely at random for multivariate data with missing values. J Am Stat Assoc 1988, 83(404):1198-202. 10.1080/01621459.1988.10478722.
62. Little RJ, Rubin DB. Statistical analysis with missing data 2002, John Wiley and Sons, New York.
63. Dong Y, Peng C-YJ. Principled missing data methods for researchers. Springer Plus 2013, 2(1):1-17. 10.1186/2193-1801-2-1.
64. Schafer JL. Multiple imputation: a primer. Stat Methods Med Res 1999, 8(1):3-15. 10.1191/096228099671525676, 10347857.
65. Begg CB, Gray R. Calculation of polychotomous logistic regression parameters using individualized regressions. Biometrika 1984, 71(1):11. 10.2307/2336391.
66. Krumholz HM, Wang Y, Mattera JA, Wang Y, Han LF, Ingber MJ, et al. An administrative claims model suitable for profiling hospital performance based on 30-day mortality rates among patients with an acute myocardial infarction. Circulation 2006, 113(13):1683. 10.1161/CIRCULATIONAHA.105.611186, 16549637.
67. Hawthorne G, Elliott P. Imputing cross-sectional missing data: comparison of common techniques. Aust N Z J Psychiatry 2005, 39(7):583-90. 10.1080/j.1440-1614.2005.01630.x, 15996139.
68. Saunders JA, Morrow-Howell N, Spitznagel E, Dore P, Proctor EK, Pascarino R. Imputing missing data: a comparison of methods for social work researchers. Soc Work Res 2006, 30(1):19-31. 10.1093/swr/30.1.19.
69. Vittinghoff E, Shiboski S, McCulloch CE. Regression methods in biostatistics 2005, Springer, New York.
70. Little R, Rubin DB. Statistical analysis with missing data 1987, John A. Wiley & Sons, Inc., New York.
71. Graham JW, Hofer SM, MacKinnon DP. Maximizing the usefulness of data obtained with planned missing value patterns: an application of maximum likelihood procedures. Multivar Behav Res 1996, 31(2):197-218. 10.1207/s15327906mbr3102_3.
72. Alzola CF, Harrell FE. An introduction to S and the Hmisc and design libraries. URL http://biostat.mc.vanderbilt.edu/twiki/pub/Main/RS/sintro.pdf, 2002. 30..
73. Campbell MJ. Statistics at square two : understanding modern statistical applications in medicine 2006, Wiley, New Jersey, 2.
74. Van der Meulen JH, Steyerberg EW, van der Graaf Y, van Herwerden LA, Verbaan CJ, Defauw JJ, et al. Age thresholds for prophylactic replacement of Bjork-Shiley convexo-concave heart valves. A clinical and economic evaluation. Circulation 1993, 88(1):156. 10.1161/01.CIR.88.1.156, 8319328.
75. Austin PC, Tu JV. Bootstrap methods for developing predictive models in cardiovascular research. Am Stat. 2004, 58:131/137. 10.1198/0003130043277.
76. Murray GD, Butcher I, McHugh GS, Lu J, Mushkudiani NA, Maas AI, et al. Multivariable prognostic analysis in traumatic brain injury: results from the IMPACT study. J Neurotrauma 2007, 24(2):329. 10.1089/neu.2006.0035, 17375997.
77. Buuren S, Groothuis-Oudshoorn K. MICE: Multivariate imputation by chained equations in R. J Stat Soft. 2011, 45:3.
78. Sande IG. Hot-deck imputation procedures. Incomplete Data Sample Surveys. 1983, 3:334-50.
79. Little R, Rubin D. The analysis of social science data with missing values. Sociol Methods Res 1989, 18(2-3):292-326. 10.1177/0049124189018002004.
80. Templ M, Alfons A, Kowarik A, Prantner B. VIM: visualization and imputation of missing values. R Package Version. 2011, 2:3.
81. Schafer JL. Analysis of incomplete multivariate data 2010, CRC press, Florida.
82. Hadfield JD. MCMC methods for multi-response generalized linear mixed models: the MCMCglmm R package. J Stat Soft 2010, 33(2):1-22.
83. Dempster AP, Laird NM, Rubin DB. Maximum likelihood from incomplete data via the EM algorithm. J Royal Stat Soc Ser B (Methodological) 1977, 39(1):1-38.
84. Enders CK. A primer on maximum likelihood algorithms available for use with missing data. Struct Equ Model 2001, 8(1):128-41. 10.1207/S15328007SEM0801_7.
85. Honaker J, King G, Blackwell M. Amelia II: a program for missing data. J Stat Soft 2011, 45(7):1-47.
86. Rubin DB. Multiple imputation for nonresponse in surveys 1987, J. Wiley & Sons, New York.
87. Schapire RE. The strength of weak learnability. Mach Learn 1990, 5(2):197-227.
88. He Y. Missing data analysis using multiple imputation: Getting to the heart of the matter. Circ cardiovasc Qual Outcomes 2010, 3(1):98-113. 10.1161/CIRCOUTCOMES.109.875658, 20123676.
89. Rosenbaum PR, Rubin DB. The central role of the propensity score in observational studies for causal effects. Biometrika 1983, 70(1):41-55. 10.1093/biomet/70.1.41.
90. Little RJ. Missing-data adjustments in large surveys. J Bus Econ Stat 1988, 6(3):287-96.
91. Sterne JA, White IR, Carlin JB, Apratt M, Royston P, Kenward MG, et al. Multiple imputation for missing data in epidemiological and clinical research: potential and pitfalls. BMJ. 2009, 338:b2393. 10.1136/bmj.b2393, 19564179.
92. Karahalios A, Baglietto L, Carlin JB, English DR, Simpson JA. A review of the reporting and handling of missing data in cohort studies with repeated assessment of exposure measures. BMC Med Res Methodol 2012, 12(1):96. 10.1186/1471-2288-12-96, 22784200.