Deep architecture for traffic flow prediction: Deep belief networks with multitask learning

IEEE Transactions on Intelligent Transportation Systems

Volumn 15, Issue 5, 2014, Pages 2191-2201

  Huang, Wenhao ^a   Song, Guojie ^a   Hong, Haikun ^a   Xie, Kunqing ^a  

^a PEKING UNIVERSITY   (China)

Author keywords

Deep learning; multitask learning (MTL); task grouping; Traffic flow prediction

Indexed keywords

DEEP ARCHITECTURES; DEEP BELIEF NETWORKS; DEEP LEARNING; MULTITASK LEARNING; TASK GROUPING; TRAFFIC FLOW PREDICTION;

EID: 84907500988     PISSN: 15249050     EISSN: None     Source Type: Journal    
DOI: 10.1109/TITS.2014.2311123     Document Type: Article

References (37)

1. R. Caruana, Multitask Learning. New York, NY, USA: Springer-Verlag, 1998.
2. M. Castro-Neto, Y.-S. Jeong, M.-K. Jeong, and L. D. Han, "Online-SVR for short-term traffic flow prediction under typical and atypical traffic conditions," Expert Syst. Appl., vol. 36, no. 3, pp. 6164-6173, Apr. 2009.
3. K. Y. Chan, T. S. Dillon, J. Singh, and E. Chang, "Neural-network-based models for short-term traffic flow forecasting using a hybrid exponential smoothing and Levenberg-Marquardt algorithm," IEEE Trans. Intell. Transp. Syst., vol. 13, no. 2, pp. 644-654, Jun. 2012.
4. S. Clark, "Traffic prediction using multivariate nonparametric regression," J. Transp. Eng., vol. 129, no. 2, pp. 161-168, Mar. 2003.
5. R. Collobert and J. Weston, "A unified architecture for natural language processing: Deep neural networks with multitask learning," in Proc. 25th Int. Conf. Mach. Learn., 2008, pp. 160-167.
6. J. Dean, G. S. Corrado, R. Monga, K. Chen, M. Devin, Q. V. Le, M.Z. Mao, M. A. Ranzato, A. Senior, P. Tucker, K. Yang, and A. Y. Ng, "Large scale distributed deep networks," in Proc. NIPS, 2012, pp. 1232-1240.
7. L. Deng, D. Yu, and J. Platt, "Scalable stacking and learning for building deep architectures," in Proc. IEEE ICASSP, 2012, pp. 2133-2136.
8. B. Ghosh, B. Basu, and M. O'Mahony, "Bayesian time-series model for short-term traffic flow forecasting," J. Transp. Eng., vol. 133, no. 3, pp. 180-189, Mar. 2007.
9. G. E. Hinton, "Training products of experts by minimizing contrastive divergence," Neural Comput., vol. 14, no. 8, pp. 1771-1800, Aug. 2002.
10. G. E. Hinton, S. Osindero, and Y.-W. Teh, "A fast learning algorithm for deep belief nets," Neural Comput., vol. 18, no. 7, pp. 1527-1554, May 2006.
11. G. E. Hinton and R. R. Salakhutdinov, "Reducing the dimensionality of data with neural networks," Science, vol. 313, no. 5786, pp. 504-507, Jul. 2006.
12. F. Jin and S. Sun, "Neural network multitask learning for traffic flow forecasting," in Proc. IEEE IJCNN (IEEE World Congress on Computational Intelligence), 2008, pp. 1897-1901.
13. A. Krizhevsky, I. Sutskever, and G. Hinton, "Imagenet classification with deep convolutional neural networks," in Proc. Adv. Neural Inf. Process. Syst., 2012, vol. 25, pp. 1106-1114.
14. H. Larochelle, Y. Bengio, J. Louradour, and P. Lamblin, "Exploring strategies for training deep neural networks," J. Mach. Learn. Res., vol. 10, pp. 1-40, Jan. 2009.
15. H. Lee, C. Ekanadham, and A. Ng, "Sparse deep belief net model for visual area v2," in Adv. Neural Inf. Process. Syst., 2008, vol. 20, pp. 873-880.
16. Highway Capacity Manual, Transportation Research Board, Washington, DC, USA, 2000.
17. A.-R. Mohamed, G. Dahl, and G. Hinton, "Deep belief networks for phone recognition," in Proc. NIPSWorkshop Deep Learn. Speech Recog. Related Appl., 2009, pp. 1-9.
18. C. K. Moorthy and B. G. Ratcliffe, "Short term traffic forecasting using time series methods," Transp. Planning Technol., vol. 12, no. 1, pp. 45-56, Jul. 1988.
19. B. T. Morris, C. Tran, G. Scora, M. M. Trivedi, and M. J. Barth, "Real-time video-based traffic measurement and visualization system for energy/emissions," IEEE Trans. Intell. Transp. Syst., vol. 13, no. 4, pp. 1667-1678, Dec. 2012.
20. J. Ngiam, A. Khosla, M. Kim, J. Nam, H. Lee, and A. Ng, "Multimodal deep learning," in Proc. 28th ICML, 2011, pp. 689-696.
21. T. L. Pan, A. Sumalee, R. X. Zhong, and N. Indra-Payoong, "Shortterm traffic state prediction based on temporal-spatial correlation," IEEE Trans. Intell. Transp. Syst., vol. 14, no. 3, pp. 1242-1254, Sep. 2013.
22. R. Salakhutdinov and G. Hinton, "Using deep belief nets to learn covariance kernels for Gaussian processes," in Proc. Adv. Neural Inf. Process. Syst., 2008, vol. 20, pp. 1249-1256.
23. M. Shuai, K. Xie,W. Pu, G. Song, and X. Ma, "An online approach based on locally weighted learning for short-term traffic flow prediction," in Proc. 16th ACM SIGSPATIAL Int. Conf. Adv. Geogr. Inf. Syst., 2008, p. 45.
24. B. L. Smith and M. J. Demetsky, "Short-term traffic flow prediction: Neural network approach," Transp. Res. Rec., vol. 1453, pp. 98-104, 1994.
25. S. Sun, "Traffic flow forecasting based on multitask ensemble learning," in Proc. 1st ACM/SIGEVO Summit Genetic Evol. Comput., 2009, pp. 961-964.
26. S. Sun and X. Xu, "Variational inference for infinite mixtures of Gaussian processes with applications to traffic flow prediction," IEEE Trans. Intell. Transp. Syst., vol. 12, no. 2, pp. 466-475, Jun. 2011.
27. S. Sun and C. Zhang, "The selective random subspace predictor for traffic flow forecasting," IEEE Trans. Intell. Transp. Syst., vol. 8, no. 2, pp. 367-373, Jun. 2007.
28. S. Sun, C. Zhang, and G. Yu, "A Bayesian network approach to traffic flow forecasting," IEEE Trans. Intell. Transp. Syst., vol. 7, no. 1, pp. 124-132, Mar. 2006.
29. M.-C. Tan, S. C. Wong, J.-M. Xu, Z.-R. Guan, and P. Zhang, "An aggregation approach to short-term traffic flow prediction," IEEE Trans. Intell. Transp. Syst., vol. 10, no. 1, pp. 60-69, Mar. 2009.
30. Y. W. Teh and G. E. Hinton, "Rate-coded restricted Boltzmann machines for face recognition," in Proc. Adv. Neural Inf. Process. Syst., 2001, pp. 908-914.
31. T. Thomas, W. Weijermars, and E. Van Berkum, "Predictions of urban volumes in single time series," IEEE Trans. Intell. Transp. Syst., vol. 11, no. 1, pp. 71-80, Mar. 2010.
32. M. Van Der Voort, M. Dougherty, and S. Watson, "Combining Kohonen maps with ARIMA time series models to forecast traffic flow," Transp. Res. C., Emerging Technol., vol. 4, no. 5, pp. 307-318, Oct. 1996.
33. F.-Y. Wang, "Parallel control and management for intelligent transportation systems: Concepts, architectures, and applications," IEEE Trans. Intell. Transp. Syst., vol. 11, no. 3, pp. 630-638, Sep. 2010.
34. Q. Ye, W. Y. Szeto, and S. C. Wong, "Short-term traffic speed forecasting based on data recorded at irregular intervals," IEEE Trans. Intell. Transp. Syst., vol. 13, no. 4, pp. 1727-1737, Dec. 2012.
35. G. Yu, J. Hu, C. Zhang, L. Zhuang, and J. Song, "Short-term traffic flow forecasting based on Markov chain model," in Proc. IEEE Intell. Veh. Symp., 2003, pp. 208-212.
36. J. Zhang, F.-Y. Wang, K. Wang, W.-H. Lin, X. Xu, and C. Chen, "Datadriven intelligent transportation systems: A survey," IEEE Trans. Intell. Transp. Syst., vol. 12, no. 4, pp. 1624-1639, Dec. 2011.
37. W. Zheng, D.-H. Lee, and Q. Shi, "Short-term freeway traffic flow prediction: Bayesian combined neural network approach," J. Transp. Eng., vol. 132, no. 2, pp. 114-121, 2006.