Dynamical functional prediction and classification, with application to traffic flow prediction

Annals of Applied Statistics

Volumn 6, Issue 4, 2012, Pages 1588-1614

  Chiou, Jeng Min ^a  

^a INSTITUTE OF STATISTICAL SCIENCE   (Taiwan)

Author keywords

Clustering; Discrimination; Functional regression; Intelligent transportation system; Mixture model; Subspace projection; Traffic flow rate

Indexed keywords

EID: 84901049442     PISSN: 19326157     EISSN: 19417330     Source Type: Journal    
DOI: 10.1214/12-AOAS595     Document Type: Article

References (56)

1. Abraham, C., Cornillon, P. A., Matzner-Løber, E. and Molinari, N. (2003). Unsupervised curve clustering using B-splines. Scand. J. Stat. 30 581-595. MR2002229
2. Antoch, J., Prchal, L., De Rosa, M. R. and Sarda, P. (2010). Electricity consumption prediction with functional linear regression using spline estimators. J. Appl. Stat. 37 2027-2041. MR2740138
3. Aston, J. A. D., Chiou, J.-M. and Evans, J. P. (2010). Linguistic pitch analysis using functional principal component mixed effect models. J. R. Stat. Soc. Ser. C Appl. Stat. 59 297-317. MR2744475
4. Bishop, C. M. and Lasserre, J. (2007). Generative or discriminative? Getting the best of both worlds. In Bayesian Statistics 8 3-24. Oxford Univ. Press, Oxford. MR2433187
5. Çetiner, B. G., Sari, M. and Borat, O. (2010). A neural network based traffic-flow prediction model. Math. and Comput. Appl 15 269-278.
6. Chen, H. and Grant-Muller, S. (2001). Use of sequential learning for short-term traffic flow forecasting. Transportation Research Part C: Emerging Technologies 9 319-336.
7. Chiou, J.-M. (2012). Supplement to "Dynamical functional prediction and classification, with application to traffic flow prediction. " DOI:10.1214/12-AOAS595SUPP.
8. Chiou, J.-M. and Li, P.-L. (2007). Functional clustering and identifying substructures of longitudinal data. J. R. Stat. Soc. Ser. B Stat. Methodol. 69 679-699. MR2370075
9. Chiou, J.-M. and Li, P.-L. (2008). Correlation-based functional clustering via subspace projection. J. Amer. Statist. Assoc. 103 1684-1692. MR2724685
10. Chiou, J.-M., Müller, H.-G. and Wang, J.-L. (2003). Functional quasi-likelihood regression models with smooth random effects. J. R. Stat. Soc. Ser. B Stat. Methodol. 65 405-423. MR1983755
11. Chiou, J.-M. and Müller, H.-G. (2007). Diagnostics for functional regression via residual processes. Comput. Statist. Data Anal. 51 4849-4863. MR2364544
12. Chiou, J.-M. andMüller, H.-G. (2009). Modeling hazard rates as functional data for the analysis of cohort lifetables and mortality forecasting. J. Amer. Statist. Assoc. 104 572-585. MR2751439
13. Coffey, N. and Hinde, J. (2011). Analyzing time-course microarray data using functional data analysis-a review. Stat. Appl. Genet. Mol. Biol. 10 Art. 23, 34. MR2800687
14. Cuevas, A., Febrero, M. and Fraiman, R. (2007). Robust estimation and classification for functional data via projection-based depth notions. Comput. Statist. 22 481-496. MR2336349
15. D'Amato, V., Piscopo, G. and Russolillo, M. (2011). The mortality of the Italian population: Smoothing techniques on the Lee-Carter model. Ann. Appl. Stat. 5 705-724. MR2840172
16. Dawid, A. P. (1976). Properties of diagnostic data distributions. Biometrics 32 647-658.
17. Di, C.-Z., Crainiceanu, C.M., Caffo, B. S. and Punjabi, N. M. (2009). Multilevel functional principal component analysis. Ann. Appl. Stat. 3 458-488. MR2668715
18. Fan, J. and Gijbels, I. (1996). Local Polynomial Modelling and Its Applications. Monographs on Statistics and Applied Probability 66. Chapman & Hall, London. MR1383587
19. Ferraty, F. and Vieu, P. (2006). Nonparametric Functional Data Analysis: Theory and Practice. Springer, New York. MR2229687
20. Gao, H. O. and Niemeier, D. A. (2008). Using functional data analysis of diurnal ozone and NOx cycles to inform transportation emissions control. Transportation Research Part D: Transport and Environment 13 221-238.
21. Gneiting, T. (2008). Editorial: Probabilistic forecasting. J. Roy. Statist. Soc. Ser. A 171 319-321. MR2427336
22. Hyndman, R. J. and Shahid Ullah, M. (2007). Robust forecasting of mortality and fertility rates: A functional data approach. Comput. Statist. Data Anal. 51 4942-4956. MR2364551
23. James, G. M. and Sugar, C. A. (2003). Clustering for sparsely sampled functional data. J. Amer. Statist. Assoc. 98 397-408. MR1995716
24. Kamarianakis, Y., Shen, W. andWynter, L. (2012). Real-time road traffic forecasting using regime-switching space-time models and adaptive LASSO (with discussion). Appl. Stoch. Models Bus. Ind. 28 297-323.
25. Kirby, H. R., Waston, S. M. and Dougherty, M. S. (1997). Should we use neural networks or statistical models for short-term motorway traffic forecasting? Int. J. Forecasting 13 43-50.
26. Li, P.-L. and Chiou, J.-M. (2011). Identifying cluster number for subspace projected functional data clustering. Comput. Statist. Data Anal. 55 2090-2103. MR2785116
27. López-Pintado, S. and Romo, J. (2006). Depth-based classification for functional data. In Data Depth: Robust Multivariate Analysis, Computational Geometry and Applications (R. Liu, R. Serfling and D. L. Souvaine, eds.). DIMACS Ser. Discrete Math. Theoret. Comput. Sci. 72 103-119. Amer. Math. Soc., Providence, RI. MR2343116
28. Ma, P. and Zhong, W. (2008). Penalized clustering of large-scale functional data with multiple covariates. J. Amer. Statist. Assoc. 103 625-636. MR2435467
29. McCullagh, P. and Nelder, J. A. (1983). Generalized Linear Models. Chapman & Hall, London. MR0727836
30. Müller, H.-G. (2005). Functional modelling and classification of longitudinal data. Scand. J. Stat. 32 223-246. MR2188671
31. Müller, H.-G. (2009). Functional modeling of longitudinal data. In Longitudinal Data Analysis (G. Fitzmaurice, M. Davidian, G. Verbeke and G. Molenberghs, eds.) 223-251. CRC Press, Boca Raton, FL. MR1500120
32. Müller, H.-G., Chiou, J.-M. and Leng, X. (2008). Inferring gene expression dynamics via functional regression analysis. BMC Bioinformatics 9 60.
33. Müller, H.-G. and Zhang, Y. (2005). Time-varying functional regression for predicting remaining lifetime distributions from longitudinal trajectories. Biometrics 61 1064-1075. MR2216200
34. Ng, A. Y. and Jordan, M. I. (2002). On discriminative vs. generative classifier: A comparison of logistic regression and naive Bayes. Neural Information Processing System 2 841-848.
35. Okutani, I. and Stephanides, Y. J. (1984). Dynamic prediction of traffic volume through Kalman filtering theory. Transportation Research Part B: Methodological 18 1-11.
36. Ramsay, J. O. and Dalzell, C. J. (1991). Some tools for functional data analysis. J. Roy. Statist. Soc. Ser. B 53 539-572. MR1125714
37. Ramsay, J. O. and Silverman, B. W. (2002). Applied Functional Data Analysis: Methods and Case Studies. Springer, New York. MR1910407
38. Ramsay, J. O. and Silverman, B. W. (2005). Functional Data Analysis, 2nd ed. Springer, New York. MR2168993
39. Rice, J. A. (2004). Functional and longitudinal data analysis: Perspectives on smoothing. Statist. Sinica 14 631-647. MR2087966
40. Sentürk, D. and Müller, H.-G. (2010). Functional varying coefficient models for longitudinal data. J. Amer. Statist. Assoc. 105 1256-1264.
41. Serban, N. and Wasserman, L. (2005). CATS: Clustering after transformation and smoothing. J. Amer. Statist. Assoc. 100 990-999. MR2201025
42. Smith, B. L. and Demetsky, M. J. (1997). Short-term traffic flow prediction: Neural network approach. Transportation Research Record: Journal of the Transportation Research Board 1453 98-104.
43. Smith, B. L., William, B. M. and Oswald, R. K. (2002). Comparison of parametric and nonparametric models for traffic flow forecasting. Transportation Research Part C: Emerging Technologies 10 303-321.
44. Stathopoulos, A. and Karlaftis, M. G. (2003). A multivariate state space approach for urban traffic flow modeling and prediction. Transportation Research Part C: Emerging Technologies 11 121-135.
45. Sun, H., Liu, H. X., Xiao, H., He, R. R. and Ran, B. (2003). Use of local linear regression model for short-term traffic forecasting. Transportation Research Record 1836 143-150.
46. Vlahogianni, E. I., Karlaftis, M. G. and Golias, J. C. (2008). Temporal evolution of shortterm urban traffic flow: A nonlinear dynamic approach. Computer-Aided Civil and Infrastructure Engineering 22 326-334.
47. Williams, B. M. and Hoel, L. A. (2003). Modeling and forecasting vehicular traffic flow as a seasonal ARIMA process: Theoretical basis and empirical results. Journal of Transportation Engineering 129 664-672.
48. Xie, Y., Zhang, Y. and Ye, Z. (2007). Short-term traffic volume forecasting using Kalman filter with discrete wavelet decomposition. Computer-Aided Civil and Infrastructure Engineering 22 326-334.
49. Xue, J. H. and Titterington, D. M. (2008). Comment on "On discriminative vs. generative classifier: A comparison of logistic regression and naive Bayes. " Neural Process Letters 28 169-187.
50. Yao, F., Müller, H.-G. andWang, J.-L. (2005a). Functional data analysis for sparse longitudinal data. J. Amer. Statist. Assoc. 100 577-590. MR2160561
51. Yao, F., Müller, H.-G. andWang, J.-L. (2005b). Functional linear regression analysis for longitudinal data. Ann. Statist. 33 2873-2903. MR2253106
52. Yin, H., Wong, S. C., Xu, J. andWong, C. K. (2002). Urban traffic flow prediction using fuzzyneural approach. Transportation Research Part C: Emerging Technologies 10 85-98.
53. Zhang, Y. andYe, Z. (2008). Short-term traffic flow forecasting using fuzzy logic system methods. Journal of Intelligent Transportation System 12 102-112.
54. Zhao, X., Marron, J. S. andWells, M. T. (2004). The functional data analysis view of longitudinal data. Statist. Sinica 14 789-808. MR2087973
55. Zheng, W., Lee, D. H. and Shi, Q. (2006). Short-term freeway traffic prediction: Bayesian combined neural network approach. Journal of Transportation Engineering 132 114-121.
56. Zhou, R. R., Serban, N. and Gebraeel, N. (2011). Degradation modeling applied to residual lifetime prediction using functional data analysis. Ann. Appl. Stat. 5 1586-1610. MR2849787