Solving stochastic resource-constrained project scheduling problems by closed-loop approximate dynamic programming

European Journal of Operational Research

Volumn 246, Issue 1, 2015, Pages 20-33

  Li, Haitao ^a   Womer, Norman K ^a  

^a UNIVERSITY OF MISSOURI ST LOUIS   (United States)

Author keywords

Approximate dynamic programming; Resource constrained project scheduling; Simulation; Stochastic scheduling; Uncertain task durations

Indexed keywords

BENCHMARKING; COMPUTER PROGRAMMING; CONSTRAINT THEORY; PROBABILITY DISTRIBUTIONS; SCHEDULING; STOCHASTIC SYSTEMS; TABLE LOOKUP;

APPROXIMATE DYNAMIC PROGRAMMING; RESOURCE CONSTRAINED PROJECT SCHEDULING; SIMULATION; STOCHASTIC SCHEDULING; UNCERTAIN TASK DURATIONS;

DYNAMIC PROGRAMMING;

EID: 84930082767     PISSN: 03772217     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ejor.2015.04.015     Document Type: Article

References (62)

1. Ashtiani B., Leus R., Aryanezhad M.-B. New competitive results for the stochastic resource-constrained project scheduling problem: Exploring the benfits of pre-processing Journal of Scheduling 14 2 2011 157 171
2. Badiru A.B. A simulation approach to PERT network analysis Simulation 57 1991 245 255
3. Ballestin F. When it is worthwhile to work with the stochastic RCPSP Journal of Scheduling 10 2007 153 166
4. Ballestin F., Leus R. Resource-constrained project scheduling for timely project completion with stochastic activity durations Production and Operations Management 18 4 2009 459 474
5. Baptiste P., Le Pape C., Nuijten W. Constraint-based scheduling: Applying constraint programming to scheduling problems 2001 Springer New York
6. Bartusch M., Mohring R.H., Randermacher F.J. Scheduling project networks with resource constraints and time windows Annals of Operations Research 16 1 1988 201 240
7. Bellman R. Dynamic programming 1957 Princeton University Press Princeton, NJ
8. Bertsekas D. Dynamic programming and optimal control 2007 Athena Scientific
9. Bertsekas D. Rollout algorithms for discrete optimization: A survey P.M. Pardalos D.-Z. Du R.L. Graham Handbook of combinatorial optimization 2013 Springer 2989 3013
10. Bertsekas D., Castanon D.A. Rollout algorithms for stochastic scheduling problems Journal of Heuristics 5 1 1999 89 108
11. Bertsekas D., Tsitsiklis J.N. Neuro-dynamic programming 1996 Athena Scientific
12. Bertsekas D., Tsitsiklis J.N., Wu C. Rollout algorithms for combinatorial optimization Journal of Heuristics 3 3 1997 245 262
13. Bertsimas D.J., Popescu I. Revenue management in a dynamic network environment Transportation Science 37 3 2003 257 277
14. Brucker P. Scheduling and constraint propagation Discrete Applied Mathematics 123 1-3 2002 227 256
15. Bruni M.E., Beraldi P., Guerrero F.M., Pinto E. A heuristic approach for resource constrained project scheduling with uncertain activity durations Computers & Operations Research 38 9 2011 1305 1318
16. Choi J., Realff M.J., Lee J.H. Dynamic programming in a heuristically confined state space: A stochastic resource-constrained project scheduling application Computers & Chemical Engineering 28 2004 1039 1058
17. Debels D., Vanhoucke M. A decomposition-based genetic algorithm for the resource-constrained project-scheduling problem Operations Research 55 3 2007 457 469
18. Deblaere F., Demeulemeester E.L., Herroelen W.S. Proactive policies for the stochastic resource-constrained project scheduling problem European Journal of Operational Research 214 2 2011 308 316
19. Demeulemeester E.L., Herroelen W.S. Project scheduling: A research handbook 2002 Kluwer Academic Publishers Norwell, MA
20. Demeulemeester E.L., Herroelen W.S., Leus R. Proactive-reactive project scheduling C. Artigues S. Demassey E. Neron Resource-constrained project scheduling: Models, algorithms, extensions and applications 2008 Wiley 203 211
21. Dodin B. Determining the K most critical paths in PERT networks Operations Research 32 4 1984 859 877
22. Dodin B. A practical and accurate alternative to PERT J. Jozefowska J. Weglarz Perspectives in modern project scheduling 2006 Springer 3 24
23. Dorndorf U., Pesch E., Phan-Huy T. A time-oriented branch-and-bound algorithm for resource-constrained project scheduling with generalized precedence constraints Management Science 46 10 2000 1365 1384
24. Dreyfus S.E., Law A.M. The art and theory of dynamic programming 1977 Academic Press Inc
25. Elmaghraby S.E., Ferreira A.A., Tavares L. Optimal start times under stochastic activity durations International Journal of Production Economics 64 1-3 2000 153 164
26. Fernandez, A.A. (1995). The optimal solution to the resource-constrained project scheduling problem with stochastic task durations (Ph.D. thesis). University of Central Florida.
27. Fernandez A.A., Armacost R.L. The role of the non-anticipativity constraint in commercial software for stochastic project scheduling Computers & Chemical Engineering 31 1996 233 236
28. Fernandez A.A., Armacost R.L., Pet-Edwards J.J. Understanding simulation solutions to resource constrained project scheduling problems with stochastic task durations Engineering Management Journal 10 4 1998 5 13
29. Glover F., Kochenberger G. Handbook of metaheuristics 2005 Springer
30. Goldratt E.M. Critical chain 1997 North River Press Great Barrington, MA
31. Golenko-Ginzburg D., Gonik A. Stochastic network project scheduling with non-consumable limited resource International Journal of Production Economics 48 1 1997 29 37
32. Graham R.L. Bounds on multiprocessing timing anomalies SIAM Journal on Applied Mathematics 17 2 1966 416 429
33. Gutjahr W.J., Strauss C., Wagner E. A stochastic branch-and-bound approach to activity crashing in project management INFORMS Journal on Computing 12 2 2000 125 135
34. Herroelen W.S., Leus R. Robust and reactive project scheduling: A review and classification of procedures International Journal of Production Research 15 2004 1599 1620
35. Igelmund G., Radermacher F.J. Preselective strategies for the optimization of stochastic project networks under resource constraints Networks 13 1 1983 1 28
36. Igelmund G., Radermacher F.J. Algorithmic approaches to preselective strategies for stochastic scheduling problems Networks 13 1983 29 48
37. Keller B., Bayraksan G. Scheduling jobs sharing multiple resource under uncertainty: A stochastic programming approach IIE Transactions 42 1 2010 16 30
38. Kolisch R. Serial and parallel resource-constrained project scheduling methods revisited: Theory and computation European Journal of Operational Research 90 1996 320 333
39. Kolisch R., Hartmann S. Experimental investigation of heuristics resource-constrained project scheduling: An update European Journal of Operational Research 174 1 2006 23 27
40. Kolisch R., Sprecher A. PSPLIB - A project scheduling problem library European Journal of Operational Research 96 1 1997 205 216
41. Li, H. (2009). Constraint programming based approximate dynamic programming for deterministic resource-constrained project scheduling. Technical Report.College of Business Administration, University of Missouri - St. Louis.
42. Li, H. (2011). An approximate dynamic programming algorithm for the resource-constrained project scheduling problem with stochastic task durations. Technical Report. College of Business Administration, University of Missouri - St. Louis.
43. Li H., Womer K. Scheduling projects with multi-skilled personnel by a hybrid MILP/CP Benders decomposition algorithm Journal of Scheduling 12 3 2009 281 298
44. Malcolm D.G., Roseboom J.H., Clark C.E., Fazar W. Applications of a technique for research and development program evaluation Operations Research 7 5 1959 646 669
45. Marriott K., Stuckey P.J. Programming with constraints 1998 The MIT Press Cambridge, M A
46. Mohring R.H., Stork F. Linear preselective policies for stochastic project scheduling Mathematical Methods of Operations Research 52 3 2000 501 515
47. Patterson J. Alternative methods of project scheduling with limited resources Naval Research Logistic 20 1973 767 784
48. Powell W.B. Approximate dynamic programming: Solving the curse of dimensionality 2007 John Wiley & Sons Inc New Jersey
49. Puterman M.L. Markov decision processes: Discrete stochastic dynamic programming 2005 John Wiley & Sons Inc
50. Secomandi N. A rollout policy for the vehicle routing problem with stochastic demands Operations Research 48 5 2001 796 802
51. Shen S., Smith J.C., Ahmad S. Expectation and chance-constrained models and algorithms for insuring critical paths Management Science 56 10 2010 1794 1814
52. Si J., Barto A.G., Powell W.B., Wunsch D. Handbook of learning and approximate dynamic programming 2004 Wiley
53. Simao H.P., Day J., George A., Gifford T., Nienow J., Powell W.B. An approximate dynamic programming algorithm for large-scale fleet management: A case application Transportation Science 43 2 2009 178 197
54. Slyke V., Richard M. Monte Carlo methods and the PERT problem Operations Research 11 5 1963 839 860
55. Stork F. Stochastic resource-constrained project scheduling (Ph.D. thesis) 2001 Technische Universitat Berlin
56. Sutton R.S., Barto A.G. Reinforcement learning: An introduction 1998 The MIT Press
57. Tang B. Orthogonal array-based latin hypercubes Journal of American Statistical Association 88 424 1993 1392 1397
58. Topaloglu H., Powell W.B. Dynamic-programming approximations for stochastic time-staged integer multicommodity-flow problems INFORMS Journal on Computing 18 1 2006 31 42
59. Tsai Y.-W., Gemmill D.D. Using tabu search to schedule activities of stochastic resource-constrained projects European Journal of Operational Research 111 1998 129 141
60. Van de Vonder S., Ballestin P., Demeulemeester E., Herroelen W. Heuristic procedures for reactive poroject scheduling Computers & Industrial Engineering 52 2007 11 28
61. Van de Vonder S., Demeulemeester E., Herroelen W., Leus R. The trade-off between stability and makespan in resource-constrained project scheduling International Journal of Production Research 44 2 2006 215 236
62. Xu N., McKee S.A., Nozick L.K., Ufomata R. Augmenting priority rule heuristics with justification and rollout to solve the resource-constrained project scheduling problem Computers & Operations Research 35 2008 3284 3297