Reinforcement learning: A novel method for optimal control of propofol-induced hypnosis

Anesthesia and Analgesia

Volumn 112, Issue 2, 2011, Pages 360-367

  Moore, Brett L ^a   Doufas, Anthony G ^b   Pyeatt, Larry D ^a  

^a Department of Electrical and Computer Engineering   (United States)

^b STANFORD UNIVERSITY SCHOOL OF MEDICINE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

PROPOFOL;

ANESTHESIA; ARTICLE; ARTIFICIAL NEURAL NETWORK; BISPECTRAL INDEX; DECISION MAKING; HYPNOSIS; LEARNING; MACHINE LEARNING; NOISE; PRIORITY JOURNAL; REINFORCEMENT LEARNING; ROBOTICS;

EID: 79251625912     PISSN: 00032999     EISSN: None     Source Type: Journal    
DOI: 10.1213/ANE.0b013e31820334a7     Document Type: Article

References (21)

1. Glass PS, Glen JB, Kenny GN, Schuttler J, Shafer SL. Nomenclature for computer-assisted infusion devices. Anesthesiology 1997;86:1430-1
2. Schwilden H, Schuttler J. Target controlled anaesthetic drug dosing. Handb Exp Pharmacol 2008;425-50
3. Struys MM, Mortier EP, De Smet T. Closed loops in anaesthesia. Best Pract Res Clin Anaesthesiol 2006;20:211-20
4. Locher S, Stadler KS, Boehlen T, Bouillon T, Leibundgut D, Schumacher PM, Wymann R, Zbinden AM. A new closed-loop control system for isoflurane using bispectral index outperforms manual control. Anesthesiology 2004;101:591-602
5. Shieh JS, Kao MH, Liu CC. Genetic fuzzy modelling and control of bispectral index (BIS) for general intravenous anaesthesia. Med Eng Phys 2006;28:134-48
6. Struys MM, De Smet T, Versichelen LF, Van De Velde S, Van den Broecke R, Mortier EP. Comparison of closed-loop controlled administration of propofol using bispectral index as the controlled variable versus "standard practice" controlled administration. Anesthesiology 2001;95:6-17
7. Liu N, Chazot T, Genty A, Landais A, Restoux A, McGee K, Laloe PA, Trillat B, Barvais L, Fischler M. Titration of propofol for anesthetic induction and maintenance guided by the bispectral index: closed-loop versus manual control: a prospective, randomized, multicenter study. Anesthesiology 2006;104:686-95
8. Absalom AR, Kenny GN. Closed-loop control of propofol anaesthesia using bispectral index: performance assessment in patients receiving computer-controlled propofol and manually controlled remifentanil infusions for minor surgery. Br J Anaesth 2003;90:737-41
9. Absalom AR, Sutcliffe N, Kenny GN. Closed-loop control of anesthesia using bispectral index: performance assessment in patients undergoing major orthopedic surgery under combined general and regional anesthesia. Anesthesiology 2002;96:67-73
10. Kenny GN, Mantzaridis H. Closed-loop control of propofol anaesthesia. Br J Anaesth 1999;83:223-8
11. Mortier E, Struys M, De Smet T, Versichelen L, Rolly G. Closed-loop controlled administration of propofol using bispectral analysis. Anaesthesia 1998;53:749-54
12. Sakai T, Matsuki A, White PF, Giesecke AH. Use of an EEG-bispectral closed-loop delivery system for administering propofol. Acta Anaesthesiol Scand 2000;44:1007-10
13. De Smet T, Struys MM, Neckebroek MM, Van den Hauwe K, Bonte S, Mortier EP. The accuracy and clinical feasibility of a new bayesian-based closed-loop control system for propofol administration using the bispectral index as a controlled variable. Anesth Analg 2008;107:1200-10
14. Schaublin J, Derighetti M, Feigenwinter P, Petersen-Felix S, Zbinden AM. Fuzzy logic control of mechanical ventilation during anaesthesia. Br J Anaesth 1996;77:636-41
15. Zhang XS, Huang JW, Roy RJ. Depth of anesthesia control with fuzzy logic. In: Barro S, Marin R, eds. Fuzzy Logic in Medicine. 1st ed. Heidelberg: Physica-Verlag, 2000:83-112
16. Huang JW, Lu YY, Nayak A, Roy RJ. Depth of anesthesia estimation and control. IEEE Trans Biomed Eng 1999;46:71-81
17. Kashihara K. Automatic regulation of hemodynamic variables in acute heart failure by a multiple adaptive predictive controller based on neural networks. Ann Biomed Eng 2006;34:1846-69
18. Martin-Guerrero JD, Gomez F, Soria-Olivas E, Schmidhuber J, Climente-Martí M, Jiménez-Torres NV. A reinforcement learning approach for individualizing erythropoietin dosages in hemodialysis patients. Exp Syst Appl 2009;36:9737-42
19. Sutton RS, Barto AG. Reinforcement Learning: An Introduction. Cambridge, MA: MIT Press, 1998
20. Bellman RE. Dynamic Programming. Princeton: Princeton University Press, 1957
21. Watkins CJCH. Learning from Delayed Rewards [PhD thesis]. Cambridge, UK: University of Cambridge, 1989