Intelligent control of closed-loop sedation in simulated ICU patients

Proceedings of the Seventeenth International Florida Artificial Intelligence Research Society Conference, FLAIRS 2004

Volumn 1, Issue , 2004, Pages 109-114

  Moore, Brett L ^a   Sinzinger, Eric D ^a   Quasny, Todd M ^a   Pyeatt, Larry D ^a  

^a Department of Electrical and Computer Engineering   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DRUG INFUSION SYSTEMS; PHARMACODYNAMIC MODELS; PID CONTROLLERS; SEDATION;

CONTROL EQUIPMENT; DRUG INFUSION; DRUG PRODUCTS; INTENSIVE CARE UNITS; PATIENT TREATMENT; PHARMACODYNAMICS; PHARMACOKINETICS;

INTELLIGENT CONTROL;

EID: 10044239547     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (39)

1. Absalom; Sutcliffe; and Kenny. 2002. Closed-loop control of anesthesia using bispectral index performance assessment in pa-tients undergoing major orthopedic surgery under combined general and regional anesthesia. Anesthesiology 96(1):67-73.
2. Aiken; Clarke; Sloane; Sochalski; and Silber. 2002. Hospital nurse staffing and patient mortality, nurse burnout, and job dissatisfaction. JAMA 288(16):1987-1993.
3. Albrecht; Frenkel; Ihmsen; and Schuttler. 1999. A rational approach to the control of sedation in intensive care unit patients based on closed-loop control. Eur J Anaesthesiol 16(10):678-687.
4. Baird. 1995. Residual algorithms: Reinforcement learning with function approximation. In Proc. 12th International Conference on Machine Learning, 30-37. Morgan Kaufmann.
5. Barr; Egan; Sandoval; Zomorodi; Cohane; Gambus; and Shafer. 2001. Propofol dosing regimens for ICU sedation based upon an integrated pharmacokinetic-pharmacodynamic model. Anesthesiology 95(2):324-333.
6. Bellman; Kalaba; and Kotkin. 1963. Polynomial approximation-A new computational technique in dynamic programming: Allocation processes. J Math Comput 17(82):155-161.
7. Boyan, and Moore. 1995. Generalization in reinforcement learning: Safely approximating the value function. In Advances in Neural Information Processing Systems 7, 369-376. The MIT Press.
8. Davies. 1997. Multidimensional triangulation and interpolation for reinforcement learning. In Advances in Neural Information Processing Systems, volume 9, 1005-1011. The MIT Press.
9. Dayan. 1992. The convergence of TD(λ) for general λ. Machine Learning 8:341-362.
10. Doi; Gajraj; Mantzaridis; and Kenny. 1997. Relationship between calculated blood concentration of propofol and electrophysiological variables during emergence from anaesthesia: Comparison of bispectral index, spectral edge frequency, median frequency and auditory evoked potential index. Br J Anaesth 78(2):180-4.
11. Fulton, and Sorkin. 1995. Propofol. An overview of its pharmacology and a review of its clinical efficacy in intensive care sedation. Drugs 50(4):636-57.
12. Gordon. 1995. Stable function approximation in dynamic programming. In Proceedings of the Twelfth International Conference on Machine Learning, 261-268. Morgan Kaufmann.
13. Gullapalli. 1993. Learning control under extreme uncertainty. In Advances in Neural Information Processing Systems, volume 5, 327-334. Morgan Kaufmann, San Mateo, CA.
14. Hu; Lovejoy; and Shafer. 1994. Comparison of some control strategies for three-compartment PK/PD models. Journal of Pharmacokinetics and Biopharmaceutics 22(6):525-550.
15. Hunt-Smith; Donaghy; Leslie; Kluger; Gunn; and Warwick. 1999. Safety and efficacy of target controlled infusion (Diprifusor) vs manually controlled infusion of propofol for anaesthesia. Anaesth Intensive Care 27(3):260-264.
16. Kowalski, and Rayfield. 1999. A post hoc descriptive study of patients receiving propofol. Am J Crit Care 8(1):507-13.
17. Kress; Pohlman; O'Connor; and Hall. 2000. Daily interruption of sedative infusions in critically ill patients undergoing mechanical ventilation. N Engl J Med 342(20):147-7.
18. Lasalandra. 2001. Norwood hospital staff shortage eyed in patient's death. http://www.bostonherald.com/ news/local_regional/cari01152001.htm: World Wide Web.
19. Leslie; Absalom; and Kenny. 2002. Closed loop control of sedation for colonoscopy using the bispectral index. Anaesthesia 57(7):690-709.
20. Marsh; White; Morton; and Kenny. 1991. Pharmacokinetic model driven infusion of propofol in children. Br J Anaesth 67(1):41-8.
21. Mortier; Struys; De Smet; Versichelen; and Rolly. 1998. Closed-loop controlled administration of propofol using bispectral analysis. Anaesthesia 53(8):749-754.
22. Munos, and Moore. 1999. Variable resolution discretization for high-accuracy solutions of optimal control problems. In IJCAI, 1348-1355.
23. Norrie. 1997. Nurses' time management in intensive care. Nurs Crit Care 2(3):121-125.
24. Ronan; Gallagher; George: and Hamby. 1995. Comparison of propofol and midazolam for sedation in intensive care unit patients. Crit Care Med 23(2):286-93.
25. Russell, and Norvig. 1995. Artificial Intelligence. Prentice-Hall.
26. Sakai; Matsuki; and Giesecke. 2000. Use of an EEG-bispectral closed-loop delivery system for administering propofol. Acta Anesthesiologica Scandinavica 44:1007-1010.
27. Schnider; Minto; Shafer; Gambus; Andresen; Goodale; and Youngs. 1999. The influence of age on propofol pharmacodynamics. Anesthesiology 90(6):1502-16.
28. Servin. 1998. TCI compared with manually controlled infusion of propofol: A multicentre study. Anaesthesia 53(Suppl 1):82-86.
29. Struys; De Smet; Depoorter; Versichelen; Mortier; Dumortier; Shafer; and Rolly. 2000. Comparison of plasma compartment versus two methods for effect compartment-controlled target-controlled infusion for propofol. Anesthesiology 92(2):399-406.
30. Struys; De Smet; Versichelen; Van De Velde; Van den Broecke; and Mortier. 2001. Closed-loop controlled administration of propofol using bispectral analysis. Anesthesiology 95(1):6-17.
31. Sutton, and Barto. 1998. Reinforcement Learning: An Introduction. MIT Press.
32. Sutton. 1987. Learning to predict by the method of temporal differences. Technical Report TR87-509.1, University of Massachusetts.
33. Swinhoe; Peacock; Glen; and Reilly. 1998. Evaluation of the predictive performance of a 'Diprifusor' TCI system. Anaesthesia 53(Suppl 1):61-67.
34. Task Force on Sedation and Analgesia by Non-Anesthesiologists. 1996. Practice guidelines for sedation and analgesia by non-anesthesiologists. Anesthesiology 84(2):459-471.
35. Theil; Stanley; White; Goodman; Glass; Bai; Jacobs; and Reves. 1993. Midazolam and fentanyl continuous infusion anesthesia for cardiac surgery: a comparison of computer-assisted versus manual infusion systems. J Cardiothorac Vasc Anesth 7(3):300-6.
36. Thrun, and Schwartz. 1993. Issues in Using Function Approximation for Reinforcement Learning. In Proceedings of the 1993 Connectionist Models Summer School. Lawrence Erlbaum.
37. Tsitsiklas, and Van Roy. 1996. An analysis of temporal difference learning with function approximation. Technical Report LIDS-P-2322, Massachusetts Institute of Technology.
38. Vuyk; Engbers; Burm; Vletter; and Bovill. 1995. Performance of computer-controlled infusion of propofol: An evaluation of five pharmacokinetic parameter sets. Anesth Analg 81(6):1275-1282.
39. Watkins. 1989. Learning from Delayed Rewards. PhD dissertation, Cambridge University, Computer Science Department.