Local online kernel ridge regression for forecasting of urban travel times

Transportation Research Part C: Emerging Technologies

Volumn 46, Issue , 2014, Pages 151-178

  Haworth, James ^a   Shawe Taylor, John ^a   Cheng, Tao ^a   Wang, Jiaqiu ^a  

^a UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

Forecasting; Kernel method; Machine learning; Prediction; Time series; Travel time

Indexed keywords

FORECASTING; INTELLIGENT SYSTEMS; LEARNING SYSTEMS; MACHINE LEARNING; MOTOR TRANSPORTATION; REGRESSION ANALYSIS; TIME SERIES; TRAVEL TIME;

ADVANCED TRAVELLER INFORMATION SYSTEMS; INTELLIGENT TRANSPORTATION SYSTEMS; KERNEL METHODS; KERNEL RIDGE REGRESSIONS; MACHINE LEARNING APPROACHES; NON-PARAMETRIC REGRESSION; NON-STATIONARY PROPERTIES; TIME-VARYING DISTRIBUTION;

ADVANCED TRAVELER INFORMATION SYSTEMS;

ALGORITHM; INTELLIGENT TRANSPORTATION SYSTEM; NUMERICAL MODEL; REGRESSION ANALYSIS; ROAD TRANSPORT; TIME SERIES; TRAFFIC MANAGEMENT; TRANSPORTATION PLANNING; TRAVEL TIME; URBAN TRANSPORT; FORECASTING METHOD; PREDICTION;

ENGLAND; LONDON [ENGLAND]; UNITED KINGDOM;

EID: 84902485592     PISSN: 0968090X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.trc.2014.05.015     Document Type: Article

References (99)

1. Anacleto O., Queen C., Albers C.J. Forecasting multivariate road traffic flows using Bayesian dynamic graphical models, splines and other traffic variables. Aust. N. Z. J. Stat. 2013, 55:69-86. 10.1111/anzs.12026.
2. Anacleto O., Queen C., Albers C.J. Multivariate forecasting of road traffic flows in the presence of heteroscedasticity and measurement errors. J. R. Stat. Soc. Ser. C Appl. Stat. 2013, 62:251-270. 10.1111/j.1467-9876.2012.01059.x.
3. Bergmeir C., Benítez J.M. Neural networks in R using the Stuttgart neural network simulator: RSNNS. J. Stat. Softw. 2012, 46:1-26.
4. Billings, D., Yang, J.-S., 2006. Application of the ARIMA models to urban roadway travel time prediction - a case study. In: 2006 IEEE International Conference on Systems, Man, and Cybernetics. Presented at the 2006 IEEE International Conference on Systems, Man, and Cybernetics, Taipei.
5. Boser, B.E., Guyon, I.M., Vapnik, V.N., 1992. A training algorithm for optimal margin classifiers. In: Proceedings of the 5th Annual ACM Workshop on Computational Learning Theory. ACM Press, pp. 144-152.
6. Box G.E.P., Jenkins G.M., Reinsel G.C. Time Series Analysis: Forecasting and Control 1994, Prentice Hall.
7. Cai, Z., Li, S., Zhang, X., 2009. Tourism demand forecasting by support vector regression and genetic algorithm. In: Computer Science and Information Technology, 2009. ICCSIT 2009. 2nd IEEE International Conference on. Presented at the Computer Science and Information Technology, 2009. ICCSIT 2009. 2nd IEEE International Conference on, pp. 144-146. doi:10.1109/ICCSIT.2009.5234447.
8. Caputo, B., Sim, K., Furesjo, F., Smola, A., 2002. Appearance-based object recognition using SVMs: which kernel should I use? In: Proceedings of NIPS Workshop on Statistical Methods for Computational Experiments in Visual Processing and Computer Vision. Presented at the NIPS Workshop on Statistical Methods for Computational Experiments in Visual Processing and Computer Vision, Whistler.
9. Castro-Neto M., Jeong Y.S., Jeong M.K., Han L.D. Online-SVR for short-term traffic flow prediction under typical and atypical traffic conditions. Expert Syst. Appl. 2009, 36:6164-6173.
10. Chan K.Y., Dillon T., Chang E., Singh J. Prediction of short-term traffic variables using intelligent swarm-based neural networks. IEEE Trans. Control Syst. Technol. 2013, 21:263-274. 10.1109/TCST.2011.2180386.
11. Chan K.Y., Dillon T.S., Chang E. An Intelligent particle swarm optimization for short-term traffic flow forecasting using on-road sensor systems. IEEE Trans. Ind. Electron. 2013, 60:4714-4725. 10.1109/TIE.2012.2213556.
12. Chan K.Y., Dillon T.S., Singh J., Chang E. Neural-network-based models for short-term traffic flow forecasting using a hybrid exponential smoothing and Levenberg-Marquardt algorithm. IEEE Trans. Intell. Transport. Syst. 2012, 13:644-654. 10.1109/TITS.2011.2174051.
13. Chan K.Y., Khadem S., Dillon T.S., Palade V., Singh J., Chang E. Selection of significant on-road sensor data for short-term traffic flow forecasting using the taguchi method. IEEE Trans. Ind. Inform. 2012, 8:255-266. 10.1109/TII.2011.2179052.
14. Chen C., Wang Y., Li L., Hu J., Zhang Z. The retrieval of intra-day trend and its influence on traffic prediction. Transport. Res. Part C Emerg. Technol. 2012, 22:103-118. 10.1016/j.trc.2011.12.006.
15. Chen H., Grant-Muller S. Use of sequential learning for short-term traffic flow forecasting. Transport. Res. Part C Emerg. Technol. 2001, 9:319-336. 10.1016/S0968-090X(00)00039-5.
16. Cheng T., Wang J., Haworth J., Heydecker B., Chow A. A dynamic spatial weight matrix and localized space-time autoregressive integrated moving average for network modeling. Geogr. Anal. 2014, 46:75-97. 10.1111/gean.12026.
17. Cheng, T., Wang, J., Heydecker, B., Haworth, J., 2010. STARIMA for journey time prediction in London. In: Proceedings of the 5th IMA (Institute of Mathematics and Its Applications) Conference on Mathematics in Transport. London, UK.
18. Dimitriou L., Tsekeris T., Stathopoulos A. Adaptive hybrid fuzzy rule-based system approach for modeling and predicting urban traffic flow. Transport. Res. Part C Emerg. Technol. 2008, 16:554-573. 16/j.trc.2007.11.003.
19. Ding Q.Y., Wang X.F., Zhang X.Y., Sun Z.Q. Forecasting traffic volume with space-time ARIMA model. Adv. Mater. Res. 2010, 156-157:979-983. 10.4028/www.scientific.net/AMR.156-157.979.
20. Dougherty M. A review of neural networks applied to transport. Transport. Res. Part C Emerg. Technol. 1995, 3:247-260. 10.1016/0968-090X(95)00009-8.
21. Elman J.L. Finding structure in time* 1. Cogn. Sci. 1990, 14:179-211.
22. Exterkate P. Model selection in kernel ridge regression. Comput. Stat. Data Anal. 2013, 68:1-16. 10.1016/j.csda.2013.06.006.
23. Fei X., Lu C.-C., Liu K. A Bayesian dynamic linear model approach for real-time short-term freeway travel time prediction. Transport. Res. Part C Emerg. Technol. 2011, 19:1306-1318. 10.1016/j.trc.2010.10.005.
24. Fosgerau M., Fukuda D. Valuing travel time variability: characteristics of the travel time distribution on an urban road. Transport. Res. Part C Emerg. Technol. 2012, 24:83-101. 10.1016/j.trc.2012.02.008.
25. Hamilton J.D. Time Series Analysis 1994, Princeton University Press.
26. Hardoon D.R., Szedmak S., Shawe-Taylor J. Canonical correlation analysis: an overview with application to learning methods. Neural Comput. 2004, 16:2639-2664. 10.1162/0899766042321814.
27. Harris R., Singleton A., Grose D., Brunsdon C., Longley P. Grid-enabling geographically weighted regression: a case study of participation in higher education in England. Trans. GIS 2010, 14:43-61. 10.1111/j.1467-9671.2009.01181.x.
28. Haworth, J., Cheng, T., 2014. Graphical LASSO for local spatio-temporal neighbourhood selection. In: Proceedings the GIS Research UK 22nd Annual Conference. Presented at the GISRUK 2014, University of Glasgow, Glasgow, Scotland, pp. 425-433.
29. Hoerl A.E., Kennard R.W. Ridge regression: biased estimation for nonorthogonal problems. Technometrics 1970, 12:55-67. 10.2307/1267351.
30. Hofleitner A., Herring R., Bayen A. Arterial travel time forecast with streaming data: a hybrid approach of flow modeling and machine learning. Transport. Res. Part B Methodol. 2012, 46:1097-1122. 10.1016/j.trb.2012.03.006.
31. Hong, W.-C., 2010. Application of seasonal SVR with chaotic immune algorithm in traffic flow forecasting. Neural Comput. Appl. doi:10.1007/s00521-010-0456-7.
32. Hong W.-C. Traffic flow forecasting by seasonal SVR with chaotic simulated annealing algorithm. Neurocomputing 2011, 74:2096-2107. 10.1016/j.neucom.2010.12.032.
33. Hong W.-C. Application of seasonal SVR with chaotic immune algorithm in traffic flow forecasting. Neural Comput. Appl. 2012, 21:583-593. 10.1007/s00521-010-0456-7.
34. Hong W.-C., Dong Y., Zheng F., Lai C.-Y. Forecasting urban traffic flow by SVR with continuous ACO. Appl. Math. Model. 2011, 35:1282-1291. 10.1016/j.apm.2010.09.005.
35. Hotelling H. Relations between two sets of variates. Biometrika 1936, 28:321-377. 10.1093/biomet/28.3-4.321.
36. Huang S., Sadek A.W. A novel forecasting approach inspired by human memory: the example of short-term traffic volume forecasting. Transport. Res. Part C Emerg. Technol. 2009, 17:510-525. 10.1016/j.trc.2009.04.006.
37. Hyndman, R.J., Khandakar, Y., 2007. Automatic Time Series for Forecasting: the Forecast Package for R.
38. Hyndman R.J., Koehler A.B. Another look at measures of forecast accuracy. Int. J. Forecast. 2006, 22:679-688. 10.1016/j.ijforecast.2006.03.001.
39. Jordan, M., 1986. Attractor dynamics and parallellism in a connectionist sequential machine. Presented at the Proceedings of the Eighth Annual Meeting of the Cognitive Science Society, Lawrence Erlbaum Associates, pp. 531-546.
40. Juszczak, P., Tax, D., Duin, R.P.W., 2002. Feature scaling in support vector data description. In: Proc. ASCI. pp. 95-102.
41. Kamarianakis Y., Oliver Gao H., Prastacos P. Characterizing regimes in daily cycles of urban traffic using smooth-transition regressions. Transport. Res. Part C Emerg. Technol. 2010, 18:821-840. 10.1016/j.trc.2009.11.001.
42. Kamarianakis Y., Prastacos P. Space-time modeling of traffic flow. Comput. Geosci. 2005, 31:119-133. 10.1016/j.cageo.2004.05.012.
43. Kamarianakis Y., Shen W., Wynter L. Real-time road traffic forecasting using regime-switching space-time models and adaptive LASSO. Appl. Stoch. Models Bus. Ind. 2012, 28:297-315. 10.1002/asmb.1937.
44. Karatzoglou A., Meyer D., Hornik K. Support vector machines in R. J. Stat. Softw. 2006, 15:1-28.
45. Karatzoglou, A., Smola, A., Hornik, K., Zeileis, A., 2004. kernlab-An S4 package for kernel methods in R.
46. Karlaftis M.G., Vlahogianni E.I. Statistical methods versus neural networks in transportation research: differences, similarities and some insights. Transport. Res. Part C Emerg. Technol. 2011, 19:387-399. 10.1016/j.trc.2010.10.004.
47. Keerthi S.S., Lin C.-J. Asymptotic behaviors of support vector machines with gaussian kernel. Neural Comput. 2003, 15:1667-1689. 10.1162/089976603321891855.
48. Kendall, M.G., Ord, J.K., 1990. Time Series. E. Arnold.
49. Krige, d g, 1951. A Statistical Approach to Some Mine Valuation and Allied Problems on the Witwatersrand.
50. Lahiri, S.K., Ghanta, K.C., 2008. The Support Vector Regression with the parameter tuning assisted by a differential evolution technique: study of the critical velocity of a slurry flow in a pipeline. Association of Chemical Engineers.
51. Ledoux C. An urban traffic flow model integrating neural networks. Transport. Res. Part C Emerg. Technol. 1997, 5:287-300. 10.1016/S0968-090X(97)00015-6.
52. Li J., Cai Z. A novel automatic parameters optimization approach based on differential evolution for support vector regression. Adv. Comput. Intell. 2008, 510-519.
53. Li R., Rose G. Incorporating uncertainty into short-term travel time predictions. Transport. Res. Part C Emerg. Technol. 2011, 19:1006-1018. 10.1016/j.trc.2011.05.014.
54. Li, W., Yang, Y., 2008. Hybrid kernel learning via genetic optimization for TS fuzzy system identification. Int. J. Adapt. Control Signal Process. n/a-n/a. doi:10.1002/acs.1089.
55. Li X., Shao M., Ding L., Xu G., Li J. Particle swarm optimization-based LS-SVM for building cooling load prediction. J. Comput. 2010, 5. 10.4304/jcp.5.4.614-621.
56. Min W., Wynter L. Real-time road traffic prediction with spatio-temporal correlations. Transport. Res. Part C Emerg. Technol. 2011, 19:606-616. 10.1016/j.trc.2010.10.002.
57. Min, X., Hu, J., Chen, Q., Zhang, T., Zhang, Y., 2009. Short-term traffic flow forecasting of urban network based on dynamic STARIMA model. In: Intelligent Transportation Systems, 2009. ITSC '09. 12th International IEEE Conference on. Presented at the Intelligent Transportation Systems, 2009. ITSC '09. 12th International IEEE Conference on, pp. 1-6. doi:10.1109/ITSC.2009.5309741.
58. Min, X., Hu, J., Zhang, Z., 2010. Urban traffic network modeling and short-term traffic flow forecasting based on GSTARIMA model. In: Intelligent Transportation Systems (ITSC), 2010 13th International IEEE Conference on. Presented at the Intelligent Transportation Systems (ITSC), 2010 13th International IEEE Conference on, pp. 1535-1540. doi:10.1109/ITSC.2010.5625123.
59. Mitchell, T.M., 1997. Machine Learning, 1st ed. McGraw-Hill Science/Engineering/Math.
60. Okutani I., Stephanedes Y.J. Dynamic prediction of traffic volume through Kalman filtering theory. Transport. Res. Part B Methodol. 1984, 18:1-11.
61. Ozaki T. On the order determination of ARIMA Models. J. R. Stat. Soc. Ser. C Appl. Stat. 1977, 26:290-301. 10.2307/2346970.
62. Poggio T., Girosi F. Regularization algorithms for learning that are equivalent to multilayer networks. Science 1990, 247:978-982. 10.1126/science.247.4945.978.
63. Rasmussen C.E., Williams C. Gaussian Processes for Machine Learning 2006, MIT Press, Cambridge, MA.
64. Saunders, C., Gammerman, A., Vovk, V., 1998. Ridge regression learning algorithm in dual variables, in: (ICML-1998) Proceedings of the 15th International Conference on Machine Learning. pp. 515-521.
65. Schölkopf B., Smola A., Müller K.-R. Kernel Principal Component Analysis. Artificial Neural Networks - ICANN'97, Lecture Notes in Computer Science 1997, 583-588. Springer, Berlin Heidelberg. W. Gerstner, A. Germond, M. Hasler, J.-D. Nicoud (Eds.).
66. Shawe-Taylor J., Cristianini N. Kernel Methods for Pattern Analysis 2004, Cambridge University Press, New York, NY, USA.
67. Sun Shiliang, Zhang Changshui, Guoqiang Yu A bayesian network approach to traffic flow forecasting. Intell. Transport. Syst. IEEE Trans. 2006, 7:124-132. 10.1109/TITS.2006.869623.
68. Smith B., Demetsky M. Multiple-interval freeway traffic flow forecasting. Transport. Res. Rec. J. Transp. Res. Board 1996, 1554:136-141. 10.3141/1554-17.
69. Smola A.J., Schölkopf B A tutorial on support vector regression. Stat. Comput. 2004, 14:199-222.
70. Stathopoulos A., Karlaftis M.G. A multivariate state space approach for urban traffic flow modeling and prediction. Transport. Res. Part C Emerg. Technol. 2003, 11:121-135. 10.1016/S0968-090X(03)00004-4.
71. Sun S., Zhang C., Yu G., Lu N., Xiao F. Bayesian network methods for traffic flow forecasting with incomplete data. Mach. Learn. ECML 2004, 2004:419-428.
72. Sun, S., Zhang, C., Zhang, Y., 2005. Traffic flow forecasting using a spatio-temporal bayesian network predictor. Artif. Neural Netw. Form. Models Their Appl.-ICANN 2005 273-278.
73. Üstün B., Melssen W.J., Oudenhuijzen M., Buydens L.M.C. Determination of optimal support vector regression parameters by genetic algorithms and simplex optimization. Anal. Chim. Acta 2005, 544:292-305. 10.1016/j.aca.2004.12.024.
74. Van Der Voort M., Dougherty M., Watson S. Combining Kohonen maps with arima time series models to forecast traffic flow. Transport. Res. Part C Emerg. Technol. 1996, 4:307-318. 10.1016/S0968-090X(97)82903-8.
75. Van Hinsbergen C.P.I., van Lint J.W.C., van Zuylen H.J. Bayesian committee of neural networks to predict travel times with confidence intervals. Transport. Res. Part C Emerg. Technol. 2009, 17:498-509. 10.1016/j.trc.2009.04.007.
76. Van Lint J.W.C. Reliable real-time framework for short-term freeway travel time prediction. J. Transport. Eng. 2006, 132:921-932. 10.1061/(ASCE)0733-947X(2006) 132:12(921).
77. Van Lint J.W.C., Hoogendoorn S.P., van Zuylen H.J. Accurate freeway travel time prediction with state-space neural networks under missing data. Transport. Res. Part C Emerg. Technol. 2005, 13:347-369. 10.1016/j.trc.2005.03.001.
78. Van Vaerenbergh S., Lazaro-Gredilla M., Santamaria I. Kernel recursive least-squares tracker for time-varying regression. IEEE Trans. Neural Netw. Learn. Syst. 2012, 23:1313-1326. 10.1109/TNNLS.2012.2200500.
79. Van Vaerenbergh, S., Santamaria, I., Liu, W., Principe, J.C., 2010. Fixed-budget kernel recursive least-squares. In: 2010 IEEE International Conference on Acoustics Speech and Signal Processing (ICASSP). Presented at the 2010 IEEE International Conference on Acoustics Speech and Signal Processing (ICASSP), pp. 1882-1885. doi:10.1109/ICASSP.2010.5495350.
80. Van Vaerenbergh, S., Via, J., Santamana, I., 2006. A sliding-window kernel RLS algorithm and its application to nonlinear channel identification. In: Acoustics, Speech and Signal Processing, 2006. ICASSP 2006 Proceedings. 2006 IEEE International Conference on. pp. V-V.
81. Vanajakshi, L., Rilett, L.R., 2004. A comparison of the performance of artificial. neural networks and support vector machines for the prediction of traffic speed. In: 2004 IEEE Intelligent Vehicles Symposium. Parma.
82. Vanajakshi, L., Rilett, L.R., 2007. Support Vector Machine Technique for the Short Term Prediction of Travel Time. In: Proceedings of the 2007 IEEE Intelligent Vehicles Symposium. Istanbul.
83. Vapnik V., Lerner A. Pattern recognition using generalized portrait method. Autom. Remote Control 1963, 24:774-780.
84. Vlahogianni E.I., Golias J.C., Karlaftis M.G. Short-term traffic forecasting: overview of objectives and methods. Transport. Rev. Transnatl. Transdiscipl. J. 2004, 24:533. 10.1080/0144164042000195072.
85. Vlahogianni E.I., Karlaftis M.G., Golias J.C. Optimized and meta-optimized neural networks for short-term traffic flow prediction: a genetic approach. Transport. Res. Part C Emerg. Technol. 2005, 13:211-234. 10.1016/j.trc.2005.04.007.
86. Vlahogianni E.I., Karlaftis M.G., Golias J.C. Spatio-temporal short-term urban traffic volume forecasting using genetically optimized modular networks. Comput.-Aided Civ. Infrastruct. Eng. 2007, 22:317-325. 10.1111/j.1467-8667.2007.00488.x.
87. Vlahogianni E.I., Karlaftis M.G., Golias J.C. Short-term traffic forecasting: where we are and where we're going. Transport. Res. Part C Emerg. Technol 2014, 11. 10.1016/j.trc.2014.01.005.
88. Wang J., Shi Q. Short-term traffic speed forecasting hybrid model based on Chaos-Wavelet Analysis-Support Vector Machine theory. Transport. Res. Part C Emerg. Technol. Selected papers from the Seventh Triennial Symposium on Transportation Analysis (TRISTAN VII) 2013, 27:219-232. 10.1016/j.trc.2012.08.004.
89. Wang, J., Wang, Y., Zhang, C., Du, W., Zhou, C., Liang, Y., 2009. Parameter Selection of Support Vector Regression Based on a Novel Chaotic Immune Algorithm. In: Innovative Computing, Information and Control (ICICIC), 2009 Fourth International Conference on. Presented at the Innovative Computing, Information and Control (ICICIC), 2009 Fourth International Conference on, pp. 652-655. doi:10.1109/ICICIC.2009.287.
90. Wang, Y., Wang, J., Du, W., Zhang, C., Zhang, Y., Zhou, C., 2009. Parameters optimization of support vector regression based on immune particle swarm optimization algorithm. In: Proceedings of the First ACM/SIGEVO Summit on Genetic and Evolutionary Computation, GEC '09. ACM, New York, NY, USA, pp. 997-1000. doi:10.1145/1543834.1543992.
91. Williams B.M., Hoel L.A. Modeling and forecasting vehicular traffic flow as a seasonal ARIMA process: theoretical basis and empirical results. J. Transport. Eng. ASCE 2003, 129:664-672.
92. Willmott C.J., Matsuura K. Advantages of the mean absolute error (MAE) over the root mean square error (RMSE) in assessing average model performance. Clim. Res. 2005, 30:79.
93. Wu C.-H., Ho J.-M., Lee D.T. Travel-time prediction with support vector regression. IEEE Trans. Intell. Transport. Syst. 2004, 5:276-281. 10.1109/TITS.2004.837813.
94. Wu C.-H., Tzeng G.-H., Lin R.-H. A Novel hybrid genetic algorithm for kernel function and parameter optimization in support vector regression. Expert Syst. Appl. Int. J. 2009, 36:4725-4735. 10.1016/j.eswa.2008.06.046.
95. Xie Y., Zhao K., Sun Y., Chen D. Gaussian processes for short-term traffic volume forecasting. Transport. Res. Rec. J. Transport. Res. Board 2010, 2165:69-78. 10.3141/2165-08.
96. Yin H., Wong S.C., Xu J., Wong C.K. Urban traffic flow prediction using a fuzzy-neural approach. Transport. Res. Part C Emerg. Technol. 2002, 10:85-98. 10.1016/S0968-090X(01)00004-3.
97. Zhang Y., Xie Y. Forecasting of short-term freeway volume with v-support vector machines. Transport. Res. Rec. J. Transport. Res. Board 2008, 2024:92-99. 10.3141/2024-11.
98. Zheng, L., Yu, M., Yu, S., 2008. Support vector regression and ant colony optimization for combustion performance of boilers. In: Natural Computation, 2008. ICNC '08. Fourth International Conference on. Presented at the Natural Computation, 2008. ICNC '08. Fourth International Conference on, pp. 178-182. doi:10.1109/ICNC.2008.479.
99. Zheng W., Lee D.H., Shi Q. Short-term freeway traffic flow prediction: Bayesian combined neural network approach. J. Transport. Eng. 2006, 132:114.