Using computational approaches to improve risk-stratified patient management: Rationale and methods

JMIR Research Protocols

Volumn 4, Issue 4, 2015, Pages

  Luo, Gang ^a   Stone, Bryan L ^a   Sakaguchi, Farrant ^a   Sheng, Xiaoming ^a   Murtaugh, Maureen A ^a  

^a UNIVERSITY OF UTAH SCHOOL OF MEDICINE   (United States)

Author keywords

Computer simulation; Decision support techniques; Forecasting; Machine learning; Patient care management

Indexed keywords

EID: 84948649680     PISSN: None     EISSN: 19290748     Source Type: Journal    
DOI: 10.2196/resprot.5039     Document Type: Article

References (90)

1. Gerteis J, Izrael D, Deitz D, LeRoy L, Ricciardi R, Miller T, et al. Multiple Chronic Conditions Chartbook. AHRQ Publications No. Q14-0038. Rockville, MD: Agency for Healthcare Research and Quality; 2014. URL:http://www.ahrq.gov/sites/default/files/wysiwyg/professionals/prevention-chronic-care/decision/mcc/mccchartbook.pdf [accessed 2015-08-10] [WebCite Cache ID 6agZSmKuf]
2. Vogeli C, Shields A, Lee T, Gibson T, Marder W, Weiss K, et al. Multiple chronic conditions: Prevalence, health consequences, and implications for quality, care management, and costs. J Gen Intern Med 2007 Dec; 22 Suppl 3:391-395 [FREE Full text] [doi: 10.1007/s11606-007-0322-1] [Medline: 18026807]
3. Caloyeras J, Liu H, Exum E, Broderick M, Mattke S. Managing manifest diseases, but not health risks, saved PepsiCo money over seven years. Health Aff (Millwood) 2014 Jan; 33(1):124-131. [doi: 10.1377/hlthaff.2013.0625] [Medline: 24395944]
4. Nelson L. Lessons from Medicare's Demonstration Projects on Disease Management and Care Coordination. Washington, DC: Congressional Budget Office; 2012 Jan. URL:https://www.cbo.gov/sites/default/files/112th-congress-2011-2012/workingpaper/WP2012-01_Nelson_Medicare_DMCC_Demonstrations_1.pdf [accessed 2015-08-10] [WebCite Cache ID 6agZcFxD1]
5. Levine S, Adams J, Attaway K, Dorr D, Leung M, Popescu P, et al. Predicting the Financial Risks of Seriously Ill Patients. Oakland, CA: California HealthCare Foundation; 2011 Dec. URL:http://www.chcf.org/-/media/MEDIA%20LIBRARY%20Files/PDF/P/PDF%20PredictiveModelingRiskStratification.pdf [accessed 2015-08-10] [WebCite Cache ID 6agZoop2H]
6. Rubin R, Dietrich K, Hawk A. Clinical and economic impact of implementing a comprehensive diabetes management program in managed care. J Clin Endocrinol Metab 1998 Aug; 83(8):2635-2642. [doi: 10.1210/jcem.83.8.5075] [Medline: 9709924]
7. Greineder D, Loane K, Parks P. A randomized controlled trial of a pediatric asthma outreach program. J Allergy Clin Immunol 1999 Mar; 103(3 Pt 1):436-440. [Medline: 10069877]
8. Kelly C, Morrow A, Shults J, Nakas N, Strope G, Adelman R. Outcomes evaluation of a comprehensive intervention program for asthmatic children enrolled in medicaid. Pediatrics 2000 May; 105(5):1029-1035. [Medline: 10790458]
9. Axelrod R, Zimbro K, Chetney R, Sabol J, Ainsworth V. A disease management program utilizing life coaches for children with asthma. J Clin Outcomes Manag 2001; 8(6):38-42.
10. Beaulieu N, Cutler D, Ho K, Isham G, Lindquist T, Nelson A, et al. The business case for diabetes disease management for managed care organizations. Forum for Health Economics & Policy 2006; 9(1):1-37.
11. Axelrod R, Vogel D. Predictive modeling in health plans. Disease Management & Health Outcomes 2003; 11(12):779-787. [doi: 10.2165/00115677-200311120-00003]
12. Commission for Case Manager Certification. Definition and philosophy of case managementURL:http://ccmcertification. org/about-us/about-case-management/definition-and-philosophy-case-management [accessed 2015-08-10] [WebCite Cache ID 6agZuMc1N]
13. Duncan I. Healthcare Risk Adjustment and Predictive Modeling (ACTEX Professional Series). Winsted, CT: ACTEX Publications, Inc; 2011.
14. Schatz M, Nakahiro R, Jones C, Roth R, Joshua A, Petitti D. Asthma population management: Development and validation of a practical 3-level risk stratification scheme. Am J Manag Care 2004 Jan; 10(1):25-32 [FREE Full text] [Medline: 14738184]
15. Health Dialog, King's Fund, New York University. Combined Predictive Model: Final Report. London, UK: King's Fund; 2006 Dec. URL:http://www.kingsfund.org.uk/sites/files/kf/field/field_document/PARR-combined-predictive-model-final-report-dec06.pdf [accessed 2015-08-09] [WebCite Cache ID 6agZysnRM]
16. Allaudeen N, Schnipper J, Orav E, Wachter R, Vidyarthi A. Inability of providers to predict unplanned readmissions. J Gen Intern Med 2011 Jul; 26(7):771-776 [FREE Full text] [doi: 10.1007/s11606-011-1663-3] [Medline: 21399994]
17. Curry N, Billings J, Darin B, Dixon J, Williams M, Wennberg D. Predictive Risk Project: Literature Review. London, UK: King's Fund; 2015 Jun. URL:http://www.kingsfund.org.uk/sites/files/kf/field/field_document/predictive-risk-literature-review-june2005.pdf [accessed 2015-08-10] [WebCite Cache ID 6aga2XBFC]
18. Moturu S, Johnson W, Liu H. Predicting future high-cost patients: A real-world risk modeling application. In: Proc BIBM. 2007 Presented at: IEEE International Conference on BioInformation and BioMedicine; November 2-4, 2007; San Jose, CA p. 202-208. [doi: 10.1109/BIBM.2007.54]
19. Fleishman J, Cohen J, Manning W, Kosinski M. Using the SF-12 health status measure to improve predictions of medical expenditures. Med Care 2006 May; 44(5 Suppl):I54-I63. [doi: 10.1097/01.mlr.0000208141.02083.86] [Medline: 16625065]
20. Bertsimas D, Bjarnadottir M, Kane M, Kryder J, Pandey R, Vempala S, et al. Algorithmic prediction of health-care costs. Operations Research 2008 Dec; 56(6):1382-1392. [doi: 10.1287/opre.1080.0619]
21. Anderson R, Balkrishnan R, Camacho F. Risk classification of Medicare HMO enrollee cost levels using a decision-tree approach. Am J Manag Care 2004 Feb; 10(2 Pt 1):89-98 [FREE Full text] [Medline: 15011809]
22. Meenan R, Goodman M, Fishman P, Hornbrook M, O'Keeffe-Rosetti MC, Bachman D. Using risk-adjustment models to identify high-cost risks. Med Care 2003 Nov; 41(11):1301-1312. [doi: 10.1097/01.MLR.0000094480.13057.75] [Medline: 14583693]
23. Weir S, Aweh G, Clark R. Case selection for a Medicaid chronic care management program. Health Care Financ Rev 2008; 30(1):61-74 [FREE Full text] [Medline: 19040174]
24. Mays G, Claxton G, White J. Managed care rebound? Recent changes in health plans' cost containment strategies. Health Aff (Millwood) 2004; Suppl Web Exclusives:W4-427-W4-436 [FREE Full text] [doi: 10.1377/hlthaff.w4.427] [Medline: 15451964]
25. Ash A, McCall N. Risk Assessment of Military Populations to Predict Health Care Cost and Utilization. Washington, DC: RTI International; 2005 Nov. URL:http://www.rti.org/pubs/tricare_riskassessment_final_report_combined.pdf [accessed 2015-08-10] [WebCite Cache ID 6aga7wYZC]
26. Diehr P, Yanez D, Ash A, Hornbrook M, Lin D. Methods for analyzing health care utilization and costs. Annu Rev Public Health 1999; 20:125-144. [doi: 10.1146/annurev.publhealth.20.1.125] [Medline: 10352853]
27. Iezzoni L. Risk Adjustment for Measuring Health Care Outcomes, 4th ed. Chicago, IL: Health Administration Press; 2013.
28. Neuvirth H, Ozery-Flato M, Hu J, Laserson J, Kohn M, Ebadollahi S, et al. Toward personalized care management of patients at risk: The diabetes case study. In: Proc KDD. 2011 Presented at: ACM SIGKDD International Conference on Knowledge Discovery and Data Mining; August 21-24, 2011; San Diego, CA p. 395-403. [doi: 10.1145/2020408.2020472]
29. Schatz M, Cook E, Joshua A, Petitti D. Risk factors for asthma hospitalizations in a managed care organization: Development of a clinical prediction rule. Am J Manag Care 2003 Aug; 9(8):538-547 [FREE Full text] [Medline: 12921231]
30. Lieu T, Quesenberry C, Sorel M, Mendoza G, Leong A. Computer-based models to identify high-risk children with asthma. Am J Respir Crit Care Med 1998 Apr; 157(4 Pt 1):1173-1180. [doi: 10.1164/ajrccm.157.4.9708124] [Medline: 9563736]
31. Lieu T, Capra A, Quesenberry C, Mendoza G, Mazar M. Computer-based models to identify high-risk adults with asthma: Is the glass half empty of half full? J Asthma 1999 Jun; 36(4):359-370. [Medline: 10386500]
32. Luo G. A roadmap for designing a personalized search tool for individual healthcare providers. J Med Syst 2014 Feb; 38(2):6. [doi: 10.1007/s10916-014-0006-4] [Medline: 24424432]
33. James B, Savitz L. How Intermountain trimmed health care costs through robust quality improvement efforts. Health Aff (Millwood) 2011 Jun; 30(6):1185-1191 [FREE Full text] [doi: 10.1377/hlthaff.2011.0358] [Medline: 21596758]
34. The Dartmouth Atlas of Health Care. Medicare reimbursementsURL:http://www.dartmouthatlas.org/data/topic/topic. aspx?cat=21 [accessed 2015-08-10] [WebCite Cache ID 6agaBuCzH]
35. Advancing Physician Performance Measurement: Using Administrative Data to Assess Physician Quality and Efficiency. San Francisco, CA: Pacific Business Group on Health; 2005 Sep. URL:http://www.pbgh.org/storage/documents/reports/PBGHP3Report_09-01-05final.pdf [accessed 2015-08-10] [WebCite Cache ID 6agaGjTgH]
36. Gifford E, Foster E. Provider-level effects on psychiatric inpatient length of stay for youth with mental health and substance abuse disorders. Med Care 2008 Mar; 46(3):240-246. [doi: 10.1097/MLR.0b013e318158aee7] [Medline: 18388838]
37. Kramer T, Daniels A, Zieman G, Williams C, Dewan N. Psychiatric practice variations in the diagnosis and treatment of major depression. Psychiatr Serv 2000 Mar; 51(3):336-340. [Medline: 10686240]
38. Miller G. The magical number seven plus or minus two: Some limits on our capacity for processing information. Psychol Rev 1956 Mar; 63(2):81-97. [Medline: 13310704]
39. Duncan I. Managing and Evaluating Healthcare Intervention Programs, 2nd ed. Winsted, CT: ACTEX Publications; 2014.
40. Freitas A. Comprehensible classification models. SIGKDD Explor Newsl 2014 Mar 17; 15(1):1-10. [doi: 10.1145/2594473.2594475]
41. Vellido A, Martin-Guerrero J, Lisboa P. Making machine learning models interpretable. In: Proc ESANN. 2012 Presented at: European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning; April 25-27, 2012; Bruges, Belgium p. 163-172.
42. Guyon I, Elisseeff A. An introduction to variable and feature selection. Journal of Machine Learning Research 2003; 3:1157-1182.
43. Mukamel D, Chou C, Zimmer J, Rothenberg B. The effect of accurate patient screening on the cost-effectiveness of case management programs. Gerontologist 1997 Dec; 37(6):777-784. [Medline: 9432994]
44. Sun Y, Heng B, Tay S, Seow E. Predicting hospital admissions at emergency department triage using routine administrative data. Acad Emerg Med 2011 Aug; 18(8):844-850 [FREE Full text] [doi: 10.1111/j.1553-2712.2011.01125.x] [Medline: 21843220]
45. Jackson J, Chamberlin J, Kroenke K. Predictors of patient satisfaction. Soc Sci Med 2001 Feb; 52(4):609-620. [Medline: 11206657]
46. Saha Y, Singal R. Cognizant 20-20 Insights. 2013 Sep. Predicting patient adherence: why and howURL:http://www. cognizant.com/InsightsWhitepapers/Predicting-Patient-Adherence-Why-and-How.pdf [accessed 2015-08-10] [WebCite Cache ID 6agaJvbtY]
47. Chariatte V, Berchtold A, Akre C, Michaud P, Suris J. Missed appointments in an outpatient clinic for adolescents, an approach to predict the risk of missing. J Adolesc Health 2008 Jul; 43(1):38-45. [doi: 10.1016/j.jadohealth.2007.12.017] [Medline: 18565436]
48. Steyerberg E. Clinical Prediction Models: A Practical Approach to Development, Validation, and Updating (Statistics for Biology and Health). New York: Springer; 2009.
49. Kuhn M, Johnson K. Applied predictive modeling. New York: Springer; 2013.
50. Asadi H, Dowling R, Yan B, Mitchell P. Machine learning for outcome prediction of acute ischemic stroke post intra-arterial therapy. PLoS One 2014; 9(2):e88225 [FREE Full text] [doi: 10.1371/journal.pone.0088225] [Medline: 24520356]
51. Evans R, Lloyd J, Pierce L. Clinical use of an enterprise data warehouse. AMIA Annu Symp Proc 2012; 2012:189-198 [FREE Full text] [Medline: 23304288]
52. Byington C, Reynolds C, Korgenski K, Sheng X, Valentine K, Nelson R, et al. Costs and infant outcomes after implementation of a care process model for febrile infants. Pediatrics 2012 Jul; 130(1):e16-e24 [FREE Full text] [doi: 10.1542/peds.2012-0127] [Medline: 22732178]
53. Centers for Disease Control and Prevention. AsthmaURL:http://www.cdc.gov/nchs/fastats/asthma.htm [accessed 2015-08-10] [WebCite Cache ID 6agaQMYxr]
54. Akinbami L, Moorman J, Liu X. Asthma prevalence, health care use, and mortality: United States, 2005-2009. Natl Health Stat Report 2011 Jan 12(32):1-14 [FREE Full text] [Medline: 21355352]
55. Akinbami L, Moorman J, Bailey C, Zahran H, King M, Johnson C, et al. Trends in asthma prevalence, health care use, and mortality in the United States, 2001-2010. NCHS Data Brief 2012 May(94):1-8 [FREE Full text] [Medline: 22617340]
56. Forno E, Celedon J. Predicting asthma exacerbations in children. Curr Opin Pulm Med 2012 Jan; 18(1):63-69 [FREE Full text] [doi: 10.1097/MCP.0b013e32834db288] [Medline: 22081091]
57. Dick S, Doust E, Cowie H, Ayres J, Turner S. Associations between environmental exposures and asthma control and exacerbations in young children: A systematic review. BMJ Open 2014; 4(2):e003827 [FREE Full text] [doi: 10.1136/bmjopen-2013-003827] [Medline: 24523420]
58. Schatz M. Predictors of asthma control: what can we modify? Curr Opin Allergy Clin Immunol 2012 Jun; 12(3):263-268. [doi: 10.1097/ACI.0b013e32835335ac] [Medline: 22517290]
59. Hall E, Thornton S. Generating nurse profiles from computerized labor and delivery documentation. AMIA Annu Symp Proc 2008; 2008:268-272 [FREE Full text] [Medline: 18998796]
60. Pyle D. Data Preparation for Data Mining. San Francisco, CA: Morgan Kaufmann Publishers; 1999.
61. Segala C, Poizeau D, Mesbah M, Willems S, Maidenberg M. Winter air pollution and infant bronchiolitis in Paris. Environ Res 2008 Jan; 106(1):96-100. [doi: 10.1016/j.envres.2007.05.003] [Medline: 17585899]
62. Karr C, Demers P, Koehoorn M, Lencar C, Tamburic L, Brauer M. Influence of ambient air pollutant sources on clinical encounters for infant bronchiolitis. Am J Respir Crit Care Med 2009 Nov 15; 180(10):995-1001. [doi: 10.1164/rccm.200901-0117OC] [Medline: 19713450]
63. Stanford R, Shah M, D'Souza A, Dhamane A, Schatz M. Short-acting β-agonist use and its ability to predict future asthma-related outcomes. Ann Allergy Asthma Immunol 2012 Dec; 109(6):403-407. [doi: 10.1016/j.anai.2012.08.014] [Medline: 23176877]
64. Schatz M, Zeiger R, Yang S, Chen W, Crawford W, Sajjan S, et al. Relationship of asthma control to asthma exacerbations using surrogate markers within a managed care database. Am J Manag Care 2010 May; 16(5):327-333 [FREE Full text] [Medline: 20469953]
65. Broder M, Gutierrez B, Chang E, Meddis D, Schatz M. Ratio of controller to total asthma medications: Determinants of the measure. Am J Manag Care 2010 Mar; 16(3):170-178 [FREE Full text] [Medline: 20225912]
66. National Committee for Quality Assurance. HEDIS 2015 final NDC listsURL:http://www.ncqa.org/HEDISQualityMeasurement/HEDISMeasures/HEDIS2015/HEDIS2015NDCLicense/HEDIS2015FinalNDCLists.aspx [accessed 2015-08-10] [WebCite Cache ID 6agaUCgFo]
67. Schmittdiel J, Grumbach K, Selby J, Quesenberry CP. Effect of physician and patient gender concordance on patient satisfaction and preventive care practices. J Gen Intern Med 2000 Nov; 15(11):761-769 [FREE Full text] [Medline: 11119167]
68. Adams J, Mehrotra A, Thomas J, McGlynn E. Physician cost profiling-reliability and risk of misclassification. N Engl J Med 2010 Mar 18; 362(11):1014-1021 [FREE Full text] [doi: 10.1056/NEJMsa0906323] [Medline: 20237347]
69. Hornbrook M, Hurtado A, Johnson R. Health care episodes: Definition, measurement and use. Med Care Rev 1985; 42(2):163-218. [Medline: 10274864]
70. Desai J, Wu P, Nichols G, Lieu T, O'Connor P. Diabetes and asthma case identification, validation, and representativeness when using electronic health data to construct registries for comparative effectiveness and epidemiologic research. Med Care 2012 Jul; 50 Suppl:S30-S35. [doi: 10.1097/MLR.0b013e318259c011] [Medline: 22692256]
71. Wakefield D, Cloutier M. Modifications to HEDIS and CSTE algorithms improve case recognition of pediatric asthma. Pediatr Pulmonol 2006 Oct; 41(10):962-971. [doi: 10.1002/ppul.20476] [Medline: 16871628]
72. Xu M, Tantisira K, Wu A, Litonjua A, Chu J, Himes B, et al. Genome Wide Association Study to predict severe asthma exacerbations in children using random forests classifiers. BMC Med Genet 2011; 12:90 [FREE Full text] [doi: 10.1186/1471-2350-12-90] [Medline: 21718536]
73. Forno E, Fuhlbrigge A, Soto-Quiros M, Avila L, Raby B, Brehm J, et al. Risk factors and predictive clinical scores for asthma exacerbations in childhood. Chest 2010 Nov; 138(5):1156-1165 [FREE Full text] [doi: 10.1378/chest.09-2426] [Medline: 20472862]
74. Witten I, Frank E, Hall M. Data Mining: Practical Machine Learning Tools and Techniques, Third Edition (The Morgan Kaufmann Series in Data Management Systems). Burlington, MA: Morgan Kaufmann; 2011.
75. United States Department of Labor, Bureau of Labor Statistics. 2012 Apr 10. Consumer Price Index: Measuring price change for medical care in the CPIURL:http://www.bls.gov/cpi/cpifact4.htm [accessed 2015-08-10] [WebCite Cache ID 6agaajPCS]
76. The APCD (all-payer claims database) Council. URL:http://www.apcdcouncil.org/[accessed 2015-08-10] [WebCite Cache ID 6agaeGTXm]
77. Medicare.gov. Health Maintenance Organization (HMO) PlanURL:https://www.medicare.gov/sign-up-change-plans/medicare-health-plans/medicare-advantage-plans/hmo-plans.html [accessed 2015-08-10] [WebCite Cache ID 6agahAVYf]
78. Fontaine G, Mathews K, Woller S, Stevens S, Lloyd J, Evans R. Major bleeding with dabigatran and rivaroxaban in patients with atrial fibrillation: A real-world setting. Clin Appl Thromb Hemost 2014 Oct; 20(7):665-672. [doi: 10.1177/1076029614536606] [Medline: 24875781]
79. Kraska T, Talwalkar A, Duchi J, Griffith R, Franklin M, Jordan M. MLbase: A distributed machine-learning system. In: Proc CIDR. 2013 Presented at: Conference on Innovative Data Systems Research; January 6-9, 2013; Asilomar, CA.
80. Sparks E, Talwalkar A, Smith V, Kottalam J, Pan X, Gonzalez J, et al. MLI: An API for distributed machine learning. In: Proc ICDM. 2013 Presented at: IEEE International Conference on Data Mining; December 7-10, 2013; Dallas, TX p. 1187-1192. [doi: 10.1109/ICDM.2013.158]
81. Spark MLlib. URL:https://spark.apache.org/mllib/[accessed 2015-08-10] [WebCite Cache ID 6agakLPsf]
82. Bradford W, Hurdle J, LaSalle B, Facelli J. Development of a HIPAA-compliant environment for translational research data and analytics. J Am Med Inform Assoc 2014; 21(1):185-189 [FREE Full text] [doi: 10.1136/amiajnl-2013-001769] [Medline: 23911553]
83. Liu B, Hsu W, Ma Y. Integrating classification and association rule mining. In: Proc KDD. 1998 Presented at: International Conference on Knowledge Discovery and Data Mining; August 27-31, 1998; New York p. 80-86.
84. Li W, Han J, Pei J. CMAR: Accurate and efficient classification based on multiple class-association rules. In: Proc ICDM. 2001 Presented at: IEEE International Conference on Data Mining; November 29-December 2, 2001; San Jose, CA p. 369-376. [doi: 10.1109/ICDM.2001.989541]
85. Yin X, Han J. CPAR: Classification based on predictive association rules. In: Proc SDM. 2003 Presented at: SIAM International Conference on Data Mining; May 1-3, 2003; San Francisco, CA p. 331-335.
86. Richards G, Rayward-Smith V, Sonksen P, Carey S, Weng C. Data mining for indicators of early mortality in a database of clinical records. Artif Intell Med 2001 Jun; 22(3):215-231. [Medline: 11377148]
87. Pazzani M, Mani S, Shankle W. Acceptance of rules generated by machine learning among medical experts. Methods Inf Med 2001; 40(5):380-385. [Medline: 11776735]
88. Wang L, Zhong Y, Wheeler L. Direct and indirect costs of asthma in school-age children. Prev Chronic Dis 2005 Jan; 2(1):A11 [FREE Full text] [Medline: 15670464]
89. Observational Medical Outcomes Partnership. Common Data ModelURL:http://omop.org/CDM [accessed 2015-08-10] [WebCite Cache ID 6agamjByZ]
90. Overhage J, Ryan P, Reich C, Hartzema A, Stang P. Validation of a common data model for active safety surveillance research. J Am Med Inform Assoc 2012; 19(1):54-60 [FREE Full text] [doi: 10.1136/amiajnl-2011-000376] [Medline: 22037893]