Artificial Intelligence in Surgery: Promises and Perils

Annals of Surgery

Volumn 268, Issue 1, 2018, Pages 70-76

  Hashimoto, Daniel A ^a   Rosman, Guy ^b   Rus, Daniela ^b   Meireles, Ozanan R ^a  

^a MASSACHUSETTS GENERAL HOSPITAL   (United States)

^b MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

artificial intelligence; clinical decision support; computer vision; computer assisted surgery; deep learning; machine learning; natural language processing; neural networks; surgery

Indexed keywords

ADULT; ARTIFICIAL INTELLIGENCE; ARTIFICIAL NEURAL NETWORK; CLINICAL DECISION SUPPORT SYSTEM; COMPUTER ASSISTED SURGERY; FEMALE; HUMAN; MACHINE LEARNING; MALE; NATURAL LANGUAGE PROCESSING; NERVOUS SYSTEM; PATIENT CARE; REVIEW; SCIENTIST; SOCIAL NETWORK; STATISTICS; SURGEON; SURGERY; SYSTEMATIC REVIEW; VISION; PHYSICIAN ATTITUDE; PROCEDURES;

ARTIFICIAL INTELLIGENCE; HUMANS; PHYSICIAN'S ROLE; SURGEONS; SURGICAL PROCEDURES, OPERATIVE;

EID: 85049736728     PISSN: 00034932     EISSN: 15281140     Source Type: Journal    
DOI: 10.1097/SLA.0000000000002693     Document Type: Review

References (72)

1. Bellman R. An Introduction to Artificial Intelligence: Can Computers Think? San Francisco: Boyd & Fraser Pub Co; 1978.
2. Lewis-Kraus G. The great AI awakening. New York Times; 2016.
3. Keats EJ. John Henry. New York: Pantheon: An American Legend; 1965.
4. Chen JH, Asch SM. Machine learning and prediction in medicine-beyond the peak of inflated expectations. N Engl J Med. 2017;376:2507-2509.
5. Buchanan BG. A (very) brief history of artificial intelligence. AI Mag. 2005;26:53.
6. CBInsights. The 2016 AI Recap: Startups See Record High in Deals and Funding 2017. Available at: https://www.cbinsights.com/blog/artificial-intel-ligence-startup-funding/. Accessed June 4, 2017.
7. Deo RC. Machine learning in medicine. Circulation. 2015;132:1920-1930.
8. Sutton RS, Barto AG. Reinforcement Learning: An Introduction. Vol. 1. Cambridge: MIT Press; 1998.
9. Skinner BF. The behaviour of organisms: An experimental analysis. Oxford: Appleton-Century; 1938.
10. Bothe MK, Dickens L, Reichel K, et al. The use of reinforcement learning algorithms to meet the challenges of an artificial pancreas. Expert Rev Med Devices. 2013;10:661-673.
11. Miller RA, Pople HEJ, Myers JD, et al. An experimental computer-based diagnostic consultant for general internal medicine. N Engl J Med. 1982;307:468-476.
12. Cruz JA, Wishart DS. Applications of machine learning in cancer prediction and prognosis. Cancer Inform. 2006;2:59.
13. Soguero-Ruiz C, Fei WM, Jenssen R, et al. Data-driven temporal prediction of surgical site infection. AMIA Annu Symp Proc. 2015;2015:1164-1173.
14. Wang PS, Walker A, Tsuang M, et al. Strategies for improving comorbidity measures based on Medicare and Medicaid claims data. J Clin Epidemiol. 2000;53:571-578.
15. Bergquist S, Brooks G, Keating N, et al. Classifying lung cancer severity with ensemble machine learning in health care claims data. Proc Mach Learn Res. 2017;68:25-38.
16. Nadkarni PM, Ohno-Machado L, Chapman WW. Natural language processing: an introduction. J Am Med Inform Assoc. 2011;18:544-551.
17. Murff HJ, FitzHenry F, Matheny ME, et al. Automated identification of postoperative complications within an electronic medical record using natural language processing. JAMA. 2011;306:848-855.
18. Melton GB, Hripcsak G. Automated detection of adverse events using natural language processing of discharge summaries. J Am Med Inform Assoc. 2005;12:448-457.
19. Friedman C, Shagina L, Lussier Y, et al. Automated encoding of clinical documents based on natural language processing. J Am Med Inform Assoc. 2004;11:392-402.
20. Soguero-Ruiz C, Hindberg K, Rojo-Alvarez JL, et al. Support vector feature selection for early detection of anastomosis leakage from bag-of-words in electronic health records. IEEE J Biomed Health Inform. 2016;20:1404-1415.
21. Hinton GE, Osindero S, Teh Y-W. A fast learning algorithm for deep belief nets. Neural Comput. 2006;18:1527-1554.
22. Modifi R, Duff MD, Madhavan KK, et al. Identification of severe acute pancreatitis using an artificial neural network. Surgery. 2007;141:59-66.
23. Monsalve-Torra A, Ruiz-Fernandez D, Marin-Alonso O, et al. Using machine learning methods for predicting inhospital mortality in patients undergoing open repair of abdominal aortic aneurysm. J Biomed Inform. 2016;62: 195-201.
24. Szeliski R. Computer Vision: Algorithms and Applications. London: Springer-Verlag London; 2010.
25. Kenngott HG, Wagner M, Nickel F, et al. Computer-assisted abdominal surgery: new technologies. Langenbecks Arch Surg. 2015;400:273-281.
26. Egmont-Petersen M, de Ridder D, Handels H. Image processing with neural networks-a review. Pattern Recognit. 2002;35:2279-2301.
27. Volkov M, Hashimoto DA, Rosman G, et al. Machine Learning and Coresets for Automated Real-Time Video Segmentation of Laparoscopic and Robot-Assisted Surgery. In: IEEE International Conference on Robotics and Automation, Singapore; 2017:754-759.
28. Natarajan P, Frenzel JC, Smaltz DH. Demystifying Big Data and Machine Learning for Healthcare. Boca Raton: CRC Press; 2017.
29. Bonrath EM, Gordon LE, Grantcharov TP. Characterising "near miss" events in complex laparoscopic surgery through video analysis. BMJ Qual Saf. 2015;24:516-521.
30. Grenda TR, Pradarelli JC, Dimick JB. Using surgical video to improve technique and skill. Ann Surg. 2016;264:32-33.
31. Johnson M, Schuster M, Le QV, et al. Google's multilingual neural machine translation system: enabling zero-shot translation. Transactions of the Asso-ciation for Computational Linguistics. 2017;5:339-351.
32. Krizhevsky A, Sutskever I, Hinton GE. Imagenet classification with deep convolutional neural networks. Advances in neural information processing systems. 2012;25:1097-1105.
33. Esteva A, Kuprel B, Novoa RA, et al. Dermatologist-level classification of skin cancer with deep neural networks. Nature. 2017;542:115-118.
34. Soguero-Ruiz C, Hindberg K, Mora-Jimenez I, et al. Predicting colorectal surgical complications using heterogeneous clinical data and kernel methods. J Biomed Inform. 2016;61:87-96.
35. DiPietro R, Lea C, Malpani A, et al. Recognizing surgical activities with recurrent neural networks. In: Ourselin S, Joskowicz L, Sabuncu M, et al., eds. Medical Image Computing and Computer-Assisted Intervention. Cham: Springer International Publishing; 2016. 551-558.
36. Zappella L, Béjar B, Hager G, et al. Surgical gesture classification from video and kinematic data. Med Image Anal. 2013;17:732-745.
37. Moustris GP, Hiridis SC, Deliparaschos KM, et al. Evolution of autonomous and semi-autonomous robotic surgical systems: a review of the literature. Int J Med Robot. 2011;7:375-392.
38. Shademan A, Decker RS, Opfermann JD, et al. Supervised autonomous robotic soft tissue surgery. Sci Transl Med. 2016;8:337ra64-1337ra.
39. Linden A, Fenn J. Understanding Gartner's Hype Cycles (Strategic Analysis Report No. R-20-1971). Stamford: Gartner, Inc; 2003.
40. Austin PC, Tu JV, Lee DS. Logistic regression had superior performance compared with regression trees for predicting in-hospital mortality in patients hospitalized with heart failure. J Clin Epidemiol. 2010;63: 1145-1155.
41. Bellman RE. Adaptive Control Processes: AGuided Tour. Princeton: Princeton University Press; 2015.
42. Rudin C, Dunson D, Irizarry R, et al. Discovery with Data: Leveraging Statistics with Computer Science to Transform Science and Society. In: American Statistical Association White Paper; 2014.
43. Council NR. Frontiers in Massive Data Analysis. Washington, DC: National Academies Press; 2013.
44. Jüni P, Altman DG, Egger M. Systematic reviews in health care: assessing the quality of controlled clinical trials. BMJ. 2001;323:42-46.
45. Hopewell S, Loudon K, Clarke MJ, et al. Publication bias in clinical trials due to statistical significance or direction of trial results. Cochrane Database Syst Rev. 2009;1:MR000006.
46. Murthy VH, Krumholz HM, Gross CP. Participation in cancer clinical trials: race-, sex-, and age-based disparities. JAMA. 2004;291:2720-2726.
47. Chang AM, Mumma B, Sease KL, et al. Gender bias in cardiovascular testing persists after adjustment for presenting characteristics and cardiac risk. Acad Emerg Med. 2007;14:599-605.
48. Douglas PS, Ginsburg GS. The evaluation of chest pain in women. N Engl J Med. 1996;334:1311-1315.
49. Wang X, Peng Y, Lu L, et al. ChestX-ray8: Hospital-scale Chest X-ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseases. In: IEEE CVPR, Honolulu, HI: 2017.
50. Oakden-Rayner L. Exploring the ChestXray14 dataset: Problems. Wordpress: Luke Oakden Rayner; 2017.
51. Ribeiro MT, Singh S, Guestrin C. Why should I trust you? Explaining the predictions of any classifier. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining: ACM; 2016:1135-1144.
52. Sussillo D, Barak O. Opening the black box: low-dimensional dynamics in high-dimensional recurrent neural networks. Neural Comput. 2013;25: 626-649.
53. Cabitza F, Rasoini R, Gensini GF. Unintended consequences of machine learning in medicine. JAMA. 2017;318:517-518.
54. Sturm I, Lapuschkin S, Samek W, et al. Interpretable deep neural networks for single-trial EEG classification. J Neurosci Methods. 2016;274:141-145.
55. Tan S, Sim KC, Gales M. Improving the interpretability of deep neural networks with stimulated learning. In: Automatic Speech Recognition and Understanding (ASRU), 2015 IEEE Workshop on: IEEE; 2015:617-623.
56. Pearl J. Causality: Models, Reasoning and Inference. 2nd ed. Cambridge, UK: Cambridge University Press; 2009.
57. Wang D, Khosla A, Gargeya R, et al. Deep learning for identifying metastatic breast cancer. arXiv preprint arXiv:1606.05718 2016. Epub ahead of print.
58. Bahl M, Barzilay R, Yedidia AB, et al. High-risk breast lesions: a machine learning model to predict pathologic upgrade and reduce unnecessary surgical excision. Radiology; 0:170549. Epub ahead of print.
59. Harvey C, Koubek R, Begat V, et al. usability evaluation of a blood glucose monitoring system with a spill-resistant vial, easier strip handling, and connectivity to a mobile app: improvement of patient convenience and satisfaction. J Diabetes Sci Technol. 2016;10:1136-1141.
60. Horner GN, Agboola S, Jethwani K, et al. Designing patient-centered text messaging interventions for increasing physical activity among participants with type 2 diabetes: qualitative results from the text to move intervention. JMIR Mhealth Uhealth. 2017;5:e54.
61. Ryu B, Kim N, Heo E, et al. Impact of an electronic health record-integrated personal health record on patient participation in health care: development and randomized controlled trial of MyHealthKeeper. J Med Internet Res. 2017;19:e401.
62. Elvin-Walsh L, Ferguson M, Collins PF. Nutritional monitoring of patients post-bariatric surgery: implications for smartphone applications. J Hum Nutr Diet. 2018;31:141-148.
63. Langerman A, Grantcharov TP. Are we ready for our close-up? Why and how we must embrace video in the OR. Ann Surg. 2017;266:934-936.
64. Hashimoto DA, Rosman G, Rus D, et al. Surgical video in the age of big data. Ann Surg. 2017 [Epub ahead of print].
65. Groves P, Kayyali B, Knott D, et al. The 'Big Data' Revolution in Healthcare: Accelerating Value and Innovation. New York: McKinsey & Co; 2013.
66. Weber GM, Mandl KD, Kohane IS. Finding the missing link for big biomedi-cal data. JAMA. 2014;311:2479-2480.
67. Birkmeyer JD, Finks JF, O'Reilly A, et al. Surgical skill and complication rates after bariatric surgery. N Engl J Med. 2013;369:1434-1442.
68. Scally CP, Varban OA, Carlin AM, et al. Video ratings of surgical skill and late outcomes of bariatric surgery. JAMA Surg. 2016;151:e160428.
69. O'Shea P. Future medicine shaped by aninterdisciplinary new biology. Lancet. 2012;379:1544-1550.
70. Emanuel EJ, Emanuel LL. Four models of the physician-patient relationship. JAMA. 1992;267:2221-2226.
71. Obermeyer Z, Emanuel EJ. Predicting the future-big data, machine learning, and clinical medicine. N Engl J Med. 2016;375:1216-1219.
72. Miller RH, Sim I. Physicians' use of electronic medical records: barriers and solutions. Health Aff. 2004;23:116-126.