Reinforcement learning based resource allocation in business process management

Data and Knowledge Engineering

Volumn 70, Issue 1, 2011, Pages 127-145

  Huang, Zhengxing ^a,b   Van Der Aalst, W M P ^b   Lu, Xudong ^a   Duan, Huilong ^a  

^a ZHEJIANG UNIVERSITY   (China)

^b EINDHOVEN UNIVERSITY OF TECHNOLOGY   (Netherlands)

Author keywords

Business process; Markov decision process; Q learning; Reinforcement learning; Resource allocation

Indexed keywords

BUSINESS PROCESS; BUSINESS PROCESS EXECUTION; BUSINESS PROCESS MANAGEMENT; DYNAMIC TASKS; EFFICIENT RESOURCE ALLOCATION; MARKOV DECISION PROCESSES; PERFORMANCE OPTIMIZATIONS; Q-LEARNING; RESOURCE ALLOCATION OPTIMIZATION;

ENTERPRISE RESOURCE MANAGEMENT; LEARNING ALGORITHMS; MARKOV PROCESSES; OPTIMIZATION; REINFORCEMENT LEARNING;

RESOURCE ALLOCATION;

EID: 78649774395     PISSN: 0169023X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.datak.2010.09.002     Document Type: Article

References (57)

1. N. Russell, A.H.M. ter Hofstede, D. Edmond, and W.M.P. van der Aalst Workflow resource patterns BETA Working Paper Series WP 127 2004
2. K. van Hee, A. Serebrenik, N. Sidorova, M. Voorhoeve, and J. van der Wal Scheduling-free resource management Data & Knowledge Engineering 61 1 2007 59 75
3. A. Kumar, W.M.P. van der Aaslt, and E.M.W. Verbeek Dynamic work distribution in workflow management systems: how to balance quality and performance Journal of Management Information Systems 18 3 2002 157 193
4. M. Pesic, and W.M.P. van der Aalst Modeling work distribution mechanisms using Colored Petri Nets International Journal on Software Tools for Technology Transfer 9 3-4 2007 327 352
5. M. Dumas, W.M.P. van der Aalst, and A.H.M. ter Hofstede Process-Aware Information Systems: Bridging People and Software through Process Technology 2005 Wiley&Sons
6. N. Russell, and W.M.P. van der Aalst Work distribution and resource management in BPEL4People: capabilities and opportunities Lecture Notes in Computer Science vol. 5074 2008
7. Y. Liu, J. Wang, Y. Yang, and J. Sun A semi-automatic approach for workflow staff assignment Computers in Industry 59 2008 465 476
8. L.T. Ly, S. Rinderle, P. Dadam, and M. Reichert Mining staff assignment rules from event-based data Lecture Notes in Computer Science vol. 3812 2006 177 190
9. B. Turhan, and A. Bener Analysis of naive Bayes' assumptions on software fault data: an empirical study Data & Knowledge Engineering 68 2 2009 278 290
10. W. Zhang, and T. Dietterich A reinforcement learning approach to job-shop scheduling IJCAI 1995
11. M. Gravel, J.M. Martel, R. Nadeau, W. Price, and R. Tremblay A multicriterion view of optimal resource allocation in job-shop production European Journal of Operational Research 61 1-2 1992 230 244
12. D.A. Koonce, and S.-C. Tsai Using data mining to find patterns in genetic algorithm solutions to a job shop schedule Computers & Industrial Engineering 38 3 2000 361 374
13. W.M.P. van der Aalst, A.H.M. ter Hofstede, B. Kiepuszewski, and A.P. Barros Workflow patterns Distributed and Parallel Database 14 3 2003 5 51
14. M.L. Puterman Markov Decision Processes 1994 Wiley
15. J. Filar, and K. Vrieze Competitive Markov Decision Processes 1997 Springer
16. J. Tang, and J. Zhang Modeling the evolution of associated data Data & Knowledge Engineering 69 9 2010 965 978
17. S. Mahadevan, and L.P. Kaelbling The NSF workshop on reinforcement learning: summary and observations AI Magazine Winter 1996
18. R.S. Sutton, and A.G. Barto Reinforcement learning: An introduction 1998 The MIT Press Cambridge, MA
19. A.B. Hillel, A.D. Nur, L. Ein, R.G. Bachrach, and Y. Ittach Workstation capacity tuning using reinforcement learning ACM/IEEE Conference on Supercomputing 2007
20. K.H. Quah, and C. Quek Maximium reward reinforcement learning: a non-cumulative reward criterion Expert Systems with Applications 31 2 2006 351 359
21. F. Liu, and G. Zeng Study of genetic algorithm with reinforcement learning to solve the tsp Expert Systems with Applications 36 3 2009 6695 7001
22. G. Gmez-Prez, and J.D. Martn-Guerrero A reinforcement learning approach for individualizing erythropoietin dosages in hemodialysis patients Expert Systems with Applications 36 6 2009 9737 9742
23. R.E. Bellman Dynamic Programming 1957 Princeton University Press Princeton, NJ
24. Business process http://en.wikipedia.org/wiki/Business-process
25. G. Decker, and J. Mendling Process instantiation Data & Knowledge Engineering 68 9 2009 777 792
26. J. Nakatumba, and W.M.P. van der Aalst Analyzing resource behavior using process mining Business process management workshops: BPM2009 International Workshops 2009
27. W.W. Hudson Measurement issues in human behavior theory Journal of Human Behavior in the Social Environment 1998
28. M.D. Feit, J.S. Wodarski, and W.R. Nugent Approaches to Measuring Human Behavior in the Social Environment February 2006 Routledge
29. S. Jablonski, and C. Bussler Workflow Management: Modeling Concepts, Architecture, and Implementation 1996 International Thomson Computer Press London, UK
30. W.M.P. van der Aalst, and K.M. van Hee Workflow Management: Models, Methods, and Systems 2002 MIT press Cambridge, MA
31. J. Xu, C. Liu, and X. Zhao Resource allocation vs. business process improvement: how they impact on each other, 6th international conference BPM2008, Lecture Note in Computer Science, vol. 5240 2008
32. S.A. Burns, L. Liu, and C.W. Feng The LP/IP hybrid method for construction time-cost trade-off analysis Construction Management & Economics 14 3 1996 265 276
33. R.W. Eglese Simulated annealing: a tool for operational research European Journal of Operational Research 46 3 1990 271 281s
34. E.G. Coffman Computer and Job-Shop Scheduling Theory 1976 John Wiley & Sons
35. G. Viloct, and J.C. Billaut A tabu search and a genetic algorithm for solving a bicriteria general job shop scheduling problem European Journal of Operational Research 190 2008 398 411
36. D. Vengerov A reinforcement learning approach to dynamic resource allocation Engineering Applications of Artificial Intelligence 20 3 2007 383 390
37. D. Vengerov, L. Mastroleon, D. Murphy, and N. Bambos Adaptive data-aware utility-based scheduling in resource-constrained systems Journal of Parallel and Distributed Computing 70 9 2010 871 879
38. S.E. Elmagrhraby Resource allocation via dynamic programming in activity networks European Journal of Operational Research 64 1993 199 215
39. G. Tesauro, R. Das, W.E. Walsh, and J.Q. Kephart Utility-function-driven resource allocation in autonomic systems Proceedings of the 2nd IEEE International Conference on Autonomic Computing 2005
40. P. Stone, and M. Veloso Team-partitioned, opaque-transition reinforcement learning M. Asada, H. Kitano, Robo-Cup-98: Robot Soccer World Cup II 1999 Springer
41. H.A. Reijers Resource allocation in workflows Lecture Notes in Computer Science, Design and Control of Workflow Processes vol. 2617 2003 177 206
42. Y.H.V. Lun, K.-H. Lai, and T.C.E. Cheng Shipping and Logistics Management 2010 Springer London
43. C.J.C.H. Watkins, and P. Dayan Q-learning Machine Learning 8 1992 279 292
44. T. Mitchell Machine Learning 1997 McGraw-Hill New York
45. J. Zhang, X. Lu, H. Nie, Z. Huang, and W.M.P. van der Aalst Radiology information system: a workflow-based approach International Journal of Computer Assisted Radiology and Surgery 4 5 2009 509 516
46. W.M.P. van der Aalst Journal of Circuits, Systems, and Computers J. Circuit. Syst. Comput 8 1 1998 21 66
47. K.R. Baker Introduction to Sequencing and Scheduling 1974 Wiley New York
48. S.S. Panwalker, and W. Iskander A survey of scheduling rules Operation Research 25 1977 45 61
49. D.F. Ferraiolo, R. Sandhu, S. Gavrila, D.R. Kuhn, and R. Chandramouli Proposed NIST standard for role-based access control ACM Transactions on Information and System Security 4 3 2001 224 274
50. Z. Xiangpeng, A. Cerone, and P. Krishnan Verifying BPEL workflows under authorization constraints S. Dustdar, J.L. Fiaderio, A.P. Sheth, Business process management, 4th international conference, BPM2006, vol. 4102 2006 439 444
51. C. Wolter, and A. Schadd Modeling of task-based authorization constraints in BPMN G. Alonso, P. Dadam, M. Rosemann, Business process management, 5th international conference, BPM2007, vol. 4714 2007 64 79
52. W.M.P. van der Aalst, and A. Kumar A reference model for team-enabled workflow management systems Data & Knowledge Engineering 38 3 2001 335 363
53. K. Jensen Coloured petri nets, basic concepts, analysis methods and practical use EATCS monographs on Theoretical Computer Science 1 1997
54. CPN Group CPN Tools Home Page http://wiki.daimi.au.dk/cpntools/ University of Aarhus, Denmark
55. S. Rinderle, and W.M.P. van der Aaslt Life-cycle support for staff assignment rules in process-aware infromation systems Technical Report. TU Eindhoven 2007
56. B. van Dongen, A.K. Alves de Medeiros, H.M.W. Verbeek, A.J.M.M. Weijters, and W.M.P. van der Aalst The ProM framework: a new era in process mining tool support G. Ciardo, P. Darondeau, Application and Theory of Petri Nets, volume 3536 of Lecture Note in Computer Science 2005
57. W.M.P. van der Aalst, and A.H.M. ter Hofstede YAWL: yet another workflow language Information Systems 30 4 2005 245 275