Incorporating network considerations into pavement management systems: A case for approximate dynamic programming

Transportation Research Part C: Emerging Technologies

Volumn 33, Issue , 2013, Pages 134-150

  Medury, Aditya ^a   Madanat, Samer ^a  

^a 109 McLaughlin Hall   (United States)

Author keywords

Approximate dynamic programming; Infrastructure management; Markov decision process

Indexed keywords

BEHAVIORAL RESEARCH; BUDGET CONTROL; CONCRETE PAVEMENTS; CONSTRUCTION INDUSTRY; DECISION MAKING; MARKOV PROCESSES;

APPROXIMATE DYNAMIC PROGRAMMING; CONSTRUCTION ACTIVITIES; DECISION MAKING PROCESS; INFRASTRUCTURE MANAGEMENTS; MARKOV DECISION PROCESSES; PAVEMENT MANAGEMENT SYSTEMS; RESOURCE ALLOCATION PROBLEM; VALUE FUNCTION APPROXIMATION;

DYNAMIC PROGRAMMING;

DECISION MAKING; MANAGEMENT; MARKOV CHAIN; NUMERICAL MODEL; OPTIMIZATION; PAVEMENT;

EID: 84878870534     PISSN: 0968090X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.trc.2013.03.003     Document Type: Article

References (37)

1. Bellman R. The theory of dynamic programming. Bulletin of American Mathematical Society 1954, 60(6):503-515.
2. Bertsekas D.P., Tsitsiklis J.N. Neuro-Dynamic Programming 1996, Athena Scientific.
3. Chang, Y.Y., Sawaya, O.B., Ziliaskopoulos, A.K., 2001. A tabu search based approach for work zone scheduling. In: Proceeding of the Transportation Research Board 80th Annual Meeting, Washington, DC.
4. Childress S., Durango-Cohen P. On parallel machine replacement problems with general replacement cost functions and stochastic deterioration. Naval Research Logistics (NRL) 2005, 52(5):409-419.
5. Chu J.C., Chen Y.-J. Optimal threshold-based network-level transportation infrastructure life-cycle management with heterogeneous maintenance actions. Transportation Research Part B: Methodological 2012, 46(9):1123-1143.
6. Dekker R., Wildeman R.E., van der Duyn Schouten F.A. A review of multi-component maintenance models with economic dependence. Mathematical Methods of Operations Research 1997, 45(3):411-435.
7. Durango-Cohen P.L. Maintenance and repair decision making for infrastructure facilities without a deterioration model. Journal of Infrastructure Systems 2004, 10(1):1-8.
8. Durango-Cohen P.L., Sarutipand P. Maintenance optimization for transportation systems with demand responsiveness. Transportation Research Part C: Emerging Technologies 2009, 17(4):337-348.
9. Furuya A., Madanat S. Accounting for network effects in railway asset management. Journal of Transportation Engineering 2012, 139(1):92-100.
10. Fwa T.F., Cheu R.L., Muntasir A. Scheduling of pavement maintenance to minimize traffic delays. Transportation Research Record: Journal of the Transportation Research Board 1998, 1650(1):28-35.
11. Gao, L., Zhang, Z., 2009. Approximate dynamic programming approach to network-level budget planning and allocation for pavement infrastructure. In: Transportation Research Board 88th Annual Meeting. Number 09-2344.
12. Golabi K., Kulkarni R.B., Way G.B. A statewide pavement management system. Interfaces 1982, 12(6):5-21.
13. Golabi K., Shepard R. Pontis: a system for maintenance optimization and improvement of US bridge networks. Interfaces 1997, 27(1):71-88.
14. Hajdin R., Lindenmann H.P. Algorithm for the planning of optimum highway work zones. Journal of Infrastructure Systems 2007, 13(3):202-214.
15. Jones P.C., Zydiak J.L., Hopp W.J. Parallel machine replacement. Naval Research Logistics (NRL) 1991, 38(3):351-365.
16. Kallenberg L.C.M. Survey of linear programming for standard and nonstandard Markovian control problems. Part I: Theory. Mathematical Methods of Operations Research 1994, 40(1):1-42.
17. Karabakal N., Lohmann J.R., Bean J.C. Parallel replacement under capital rationing constraints. Management Science 1994, 40(3):305-319.
18. Kuhn K., Madanat S. Model uncertainty and the management of a system of infrastructure facilities. Transportation Research Part C: Emerging Technologies 2005, 13(5-6):391-404.
19. Kuhn K.D. Network-level infrastructure management using approximate dynamic programming. Journal of Infrastructure Systems 2010, 16(2):103-111.
20. Lee E.B., Ibbs C.W. Computer simulation model: construction analysis for pavement rehabilitation strategies. Journal of Construction Engineering and Management 2005, 131(4):449-458.
21. Madanat S. Optimal infrastructure management decisions under uncertainty. Transportation Research Part C: Emerging Technologies 1993, 1(1):77-88.
22. Madanat S., Park S., Kuhn K. Adaptive optimization and systematic probing of infrastructure system maintenance policies under model uncertainty. Journal of Infrastructure Systems 2006, 12(3):192-198.
23. Medury A., Madanat S. A simultaneous network optimization approach for pavement management systems. Journal of Infrastructure Systems 2013, 10.1061/(ASCE)IS.1943-555X.0000149.
24. Ng M., Lin D.Y., Waller S.T. Optimal long-term infrastructure maintenance planning accounting for traffic dynamics. Journal of Computer-Aided Civil and Infrastructure Engineering 2009, 24(7):459-469.
25. Ohlmann J.W., Bean J.C. Resource-constrained management of heterogeneous assets with stochastic deterioration. European Journal of Operational Research 2009, 199(1):198-208.
26. Ouyang Y. Pavement resurfacing planning for highway networks: parametric policy iteration approach. Journal of Infrastructure Systems 2007, 13(1):65-71.
27. Ouyang Y., Madanat S. An analytical solution for the finite-horizon pavement resurfacing planning problem. Transportation Research Part B: Methodological 2006, 40(9):767-778.
28. Powell W.B. Approximate Dynamic Programming: Solving the Curses of Dimensionality 2007, John Wiley & Sons, Inc.
29. Sathaye N., Madanat S. A bottom-up solution for the multi-facility optimal pavement resurfacing problem. Transportation Research Part B: Methodological 2011, 45(7):1004-1017.
30. Simão H.P., Day J., George A.P., Gifford T., Nienow J., Powell W.B. An approximate dynamic programming algorithm for large-scale fleet management: a case application. Transportation Science 2009, 43(2):178-197.
31. Sinha, K., Saito, M., Jiang, Y., Murthy, S., Tee, A., Bowman, M., 1988. The Development of Optimal Strategies for Maintenance, Rehabilitation and Replacement of Highway Bridges, vol. 1: The Elements of the Indiana Bridge Management System (IBMS). Tech. Rep. FHWA/IN/JHRP-88/15-1. Joint Highway Research Project, Indiana Department of Transportation and Purdue University, West Lafayette, Indiana.
32. Smilowitz K., Madanat S. Optimal inspection and maintenance policies for infrastructure networks. Journal of Computer-Aided Civil and Infrastructure Engineering 2000, 15(1):5-13.
33. Sousa J., Wolsey L. A time indexed formulation of non-preemptive single machine scheduling problems. Mathematical Programming 1992, 54(1):353-367.
34. Sutton R.S., Barto A.G. Reinforcement Learning: An Introduction 1998, Cambridge University Press.
35. Tesauro G. Temporal difference learning and TD-gammon. Communications of the ACM 1995, 38(3):58-68.
36. Wunderlich, K., Hardesty, D., 2003. A Snapshot of Summer 2001 Work Zone Activity. Tech. Rep. EDL: 13793, National Transportation Library, FHWA, U.S. Department of Transportation.
37. Yeo H., Yoon Y., Madanat S. Algorithms for bottom-up maintenance optimisation for heterogeneous infrastructure systems. Structure and Infrastructure Engineering: Maintenance, Management, Life-Cycle Design and Performance 2012, 10.1080/15732479.2012.657649.