Safety prediction with datasets characterised with excess zero responses and long tails

Transport and Sustainability

Volumn 11, Issue , 2018, Pages 297-323

  Lord, Dominique ^a   Geedipally, Srinivas Reddy ^b  

^a Texas A and M University   (United States)

^b TEXAS A AND M UNIVERSITY SYSTEM   (United States)

Author keywords

Count distributions; Excess zero responses; Highly dispersed data; Multi parameter models

Indexed keywords

EID: 85047179732     PISSN: 20449941     EISSN: 2044995X     Source Type: Book Series    
DOI: 10.1108/S2044-994120180000011016     Document Type: Chapter

References (82)

1. AASHTO (2010) Highway Safety Manual. American Association of State Highway and Transportation Officials, Washington, D.C.
2. Aryuyuen. S., & Bodhisuwan, W. (2013). Negative binomial-generalized exponential (NB-GE) distribution. Applied Mathematical Sciences, 7, 1093–1105.
3. Barbour, A. D., Holst, L., & Janson, S. (1992). Poisson approximation. New York, NY: Clarendon Press.
4. Bowonrattenaset, P., & Budsaba, K. (2011). Some properties of the three-parameter crack distribution. Thailand Statistician, 9(2), 195–203.
5. Cameron, A. C., & Trivedi, P. K. (1998). Regression analysis of count data. Cambridge, UK: Cambridge University Press.
6. Cordeiro, G. M., Hashimoto, E. M., & Ortega, E. M. M. (2014). The McDonald Weibull model. Statistics, 48, 256–278.
7. Couturier, D.-L., & Victoria-Feser, M.-P. (2010). Zero-inflated truncated generalized Pareto distribution for the analysis of radio audience data. Annals of Applied Statistics, 4, 1824–1846.
8. da Costa, J. O., Freitas, E. F., & Pereira, P. A. A. (2016). Collision prediction models with longitudinal data: A note on modeling collision frequency in road segments in Portugal. Paper presented at the 95th Annual Meeting of the Transportation Research Board, Washington, D.C.
9. Davis, G. A. (2004). Possible aggregation biases in road safety research and a mechanism approach to accident modeling. Accident Analysis and Prevention, 36(6), 1119–1127.
10. Dong, C., Richards, S. H., Clarke, D. B., Zhou, X., & Ma, Z. (2014). Examining signalized intersection crash frequency using multivariate zero-inflated Poisson regression. Safety Science, 70, 63–69.
11. Elvik, R., & Mysen, A. B. (1999). Incomplete accident reporting: Meta-analysis of studies made in 13 countries. Transportation Research Record, 1665, 133–140.
12. Fox, J.-P. (2013). Multivariate zero-inflated modeling with latent predictors: Modeling feedback behavior. Computational Statistics and Data Analysis, 68, 361–374.
13. Francis, R.A., Geedipally, S.R., Guikema, S.D., Dhavala, S.S., Lord, D., & Larocca, S. (2011). Characterizing the performance of the Conway-Maxwell-Poisson generalized linear model. Risk Analysis, 32(1), 167–183.
14. Geedipally, S. R., Lord, D., & Dhavala S. S. (2012). The negative binomial-Lindley generalized linear model: Characteristics and application using crash data. Accident Analysis and Prevention, 45(2), 258–265.
15. Geedipally, S.R., Lord, D., & Dhavala, S.S. (2014). A caution about using the Deviance Information Criterion while modeling traffic crashes. Safety Science, 62, 495–498.
16. Geedipally, S.R., Lord, D., & Park, B.-J. (2009). Analyzing different parameterizations of the varying dispersion parameter as a function of segment length. Transportation Research Record, 2103, pp. 108–118.
17. Ghitany, M. E., Atieh, B., & Nadarajah, S. (2008). Lindley distribution and its application. Mathematics and Computers in Simulation, 78, 39–49.
18. Gourieroux, C. A., & Visser, M. (1986). A count data model with unobserved heterogeneity. Journal of Econometrics, 79, 247–268.
19. Guo, J., & Trivedi, P. (2002). Flexible parametric models for long-tailed patent count distributions. Oxford Bulletin of Economics and Statistics, 64, 63–82.
20. Gupta, R. D., & Kundu, D. (1999). Generalized exponential distributions. Australian and New Zealand Journal of Statistics, 41(2), 173–188.
21. Gupta, R., Szczesniak, R.D., & Macaluso, M. (2015). Modeling repeated count measures with excess zeros in an epidemiological. Annals of Epidemiology, 25, 583–589.
22. Hallmark, S. L., Qiu, Y., Pawlovitch, M., & McDonald, T. J. (2013). Assessing the safety impacts of paved shoulders. Journal of Transportation Safety and Security, 5(2), 131–147.
23. Han, S.-R., Guikema, S. D., & Quiring, S. M. (2009). Improving the predictive accuracy of hurricane power outage forecasts using generalized additive models. Risk Analysis, 29, 1443–1453.
24. Hauer, E. (1997). Observational before-after studies in road safety. London: Pergamon Publications.
25. Hauer, E. (1999). Safety in highway design standards. Proceedings of the 2nd International Symposium of Highway Geometric Design, San Antonio, TX.
26. Hauer, E. (2015). The art of regression modeling in road safety. Switzerland: Springer.
27. Hauer, E., & Hakkert, A. S. (1988). Extent and some implications of incomplete accident reporting. Transportation Research Record, 1185, 1–10.
28. Hauer, E., Ng, J. C. N., & Lovell, J. (1988). Estimation of safety at signalized intersections. Transportation Research Record, 1185, 48–61.
29. Hickman, J. J. (1976). The common structures of statistical models of truncation, sample selection and limited variables and a simple estimator for such models. Annals of Economic and Social Measurement, 5, 575–492.
30. Hilbe, J. M. (2011). Negative binomial regression (2nd ed.). Cambridge: Cambridge University Press.
31. Jovanis, P. P., & Chang, H. L. (1986). Modeling the relationship of accidents to miles traveled. Transportation Research Record, 1068, 42–51.
32. Khazraee, S. H., Saez-Castillo, A. J., Geedipally, S. R., & Lord, D. (2015). Application of the hyper-Poisson generalized linear model for analyzing motor vehicle crashes. Risk Analysis, 35, 919–930.
33. Kim, D., & Washington, S. (2006). The significance of endogeneity problems in crash models: An examination of left-turn lanes in intersection crash models. Accident Analysis and Prevention, 38, 1094–1100.
34. Kumara, S. S. P., & Chin, H. C. (2005). Application of Poisson underreporting model to examine crash frequencies at signalized three-legged intersections. Transportation Research Record, 1908, 46–50.
35. Lambert, D. (1992). Zero-inflated poisson regression, with an application to defects in manufacturing. Technometrics, 34(1), 1–14.
36. Levine, N., & Lord, D. (2013). CrimeStat IV: Chapter 15 – OLS regression modeling (Part V: Spatial modeling II). Washington, D.C.: Ned Levine & Associates and the National Institute of Justice.
37. Lindley, D. V., (1958). Fiducial distributions and Bayes’ theorem. Journal of the Royal Statistical Society. Series B (Methodological), 20(1),102–107.
38. Lord, D. (2006) Modeling motor vehicle crashes using poisson-gamma models: Examining the effects of low sample mean values and small sample size on the estimation of the fixed dispersion parameter. Accident Analysis & Prevention, 38(4), 751–766.
39. Lord, D., & Bonneson, J. A. (2005) Calibration of predictive models for estimating the safety of ramp design configurations. Transportation Research Record, 1908, 88–95.
40. Lord, D., & Geedipally, S. R. (2011). The negative binomial-Lindley distribution as a tool for analyzing crash data characterized by a large amount of zeros. Accident Analysis and Prevention, 43, 1738–1742.
41. Lord, D., Geedipally, S. R., & Guikema, S. (2010). Extension of the application of Conway-Maxwell-Poisson Models: Analyzing traffic crash data exhibiting under-dispersion. Risk Analysis, 30, 1268–1276.
42. Lord, D., Geedipally, S. R., Persaud, B. N., Washington, S. P., van Schalkwyk, I., Ivan, J. N., …, Jonsson, T. (2008). Methodology for estimating the safety performance of multilane rural highways (NCHRP Web-Only Document 126). Washington, D.C.: National Cooperation Highway Research Program.
43. Lord. D., & Mannering, F. (2010). The statistical analysis of crash-frequency data: A review and assessment of methodological alternatives. Transportation Research Part A, 44, 291–305.
44. Lord, D., Washington, S. P., & Ivan, J. N. (2005). Poisson, Poisson-gamma and zero inflated regression models of motor vehicle crashes: Balancing statistical fit and theory. Accident Analysis and Prevention, 37(1), 35–46.
45. Ma, J. (2009). Bayesian analysis of underreporting Poisson regression model with an application to traffic crashes on two-lane highways (Paper #09-3192). Paper presented at the 88th Annual Meeting of the Transportation Research Board, Washington, D.C.
46. Mannering, F. L., & Bhat, C. R. (2014). Analytic methods in accident research: Methodological frontier and future directions. Analytic Methods in Accident Research, 1, 1–22.
47. Mannering, F. L., Shankar, V., & Bhat, C. R. (2016). Unobserved heterogeneity and the statistical analysis of highway accident data. Analytic Methods in Accident Research, 11, 1–16.
48. Miaou, S.-P. (1994). The relationship between truck accidents and geometric design of road sections: Poisson versus negative binomial regressions. Accident Analysis and Prevention, 26, 471–482.
49. Miaou, S.-P., & Song, J. J., 2005. Bayesian ranking of sites for engineering safety improvements: Decision parameter, treatability concept, statistical criterion and spatial dependence. Accident Analysis and Prevention, 37(4), 699–720.
50. Mitra, S., & Washington, S. (2007). On the nature of over-dispersion in motor vehicle crash prediction models. Accident Analysis and Prevention, 39, 459–468.
51. Mitra, S. & Washington, S. (2012). On the significance of omitted variables in intersection crash modeling. Accident Analysis and Prevention, 49, 439–448.
52. Neldelman, J., & Wallenius, T. (1986). Bernoulli trials, Poisson trials, surprising variance, and Jensen’s inequality. The American Statistician, 40, 286–289.
53. NHTSA. (2011). The crash outcome data evaluation system (CODES) and applications to improve traffic safety decision-making. Washington, DC: National Highway Transportation Safety Administration. Retrieved from http://www-nrd.nhtsa.dot.gov/Pubs/811181.pdf
54. Oh, J., Lyon, C., Washington, S. P., Persaud, B. N., & Bared, J. (2003). Validation of the FHWA crash models for rural intersections: Lessons learned. Transportation Research Record, 1840, 41–49.
55. Ortega, E. M. M., Cordeiro, G. M., & Kattan, M. W. (2012). The negative binomial–beta Weibull regression model to predict the cure of prostate cancer. Journal of Applied Statistics, 39(6), 1191–1210.
56. Park, B.-J., & Lord, D. (2009). Application of finite mixture models for vehicle crash data analysis. Accident Analysis and Prevention, 41(4), 683–691.
57. Park, B.-J., Lord, D., & Hart, J., (2010). Bias properties of Bayesian statistics in finite mixture of negative regression models for crash data analysis. Accident Analysis and Prevention, 42(2), 741–749.
58. PEO. (1997). Highway 407 safety review. Toronto: Professional Engineers of Ontario.
59. Poormeta, K. (1999). On the modelling of overdispersion of counts. Statistica Neerlandica, 53(1), 5–20.
60. Saboor, A., Kamal, M., & Ahmad, M. (2015). The transmuted exponential–Weibull distribution with applications. Pakistan Journal of Statistics, 31, 229–250.
61. Saengthong, P., & Bodhisuwan, W. (2013). Negative binomial-crack (NB-CR) distribution. Journal of Pure and Applied Mathematics, 84, 213–230.
62. Savolainen, P. T., Mannering, F. L., Lord, D., & Quddus, M. A. (2011). The statistical analysis of highway crash-injury severities: A review and assessment of methodological alternatives. Accident Analysis & Prevention, 43, 1666–1676.
63. Shankar, V., Milton, J., & Mannering, F. L. (1997). Modeling accident frequency as zero-altered probability processes: An empirical inquiry. Accident Analysis & Prevention, 29, 829–837.
64. Shaon, M. R. R. & Qin, X. (2016). Use of mixed distribution generalized linear models to quantify safety effects of rural roadway features. Transportation Research Record, 2583, 134–141.
65. Shaon, M. R. R., Qin, X., Shirazi, A., Lord, D., & Geedipally, S. (2017). Development of a random parameters negative binomial-lindley generalized linear model to analyze over-dispersed data. Working paper, Zachry Department of Civil Engineering, Texas A&M University, College Station, TX.
66. Shirazi, M., Dhavala, S. S., Lord, D., & Geedipally, S. R. (2017). A methodology to design heuristics for model selection based on the characteristics of data: Application to investigate when the negative binomial Lindley (NB-L) is preferred over the negative binomial (NB). Accident Analysis and Prevention, forthcoming. Retrieved from http://dx.doi. org/10.1016/j.aap.2017.07.002
67. Shirazi, M., Lord, D., Dhavala, S. S., & Geedipally, S. R. (2016). A semiparametric negative binomial generalized linear model for modeling over dispersed count data with a heavy tail: Characteristics and applications to crash data. Accident Analysis & Prevention, 91, 10–18.
68. Spiegelhalter, D. J., Best, N. G., Carlin, B. P., & Van Der Linde, A. (2002). Bayesian measures of model complexity and fit. Journal of the Royal Statistical Society-Series B, 64, 583–639.
69. St-Aubin, P., Saunier, N., Miranda-Moreno, L., & Ismail, K. (2013). Use of computer vision data for detailed driver behavior analysis and trajectory interpretation at roundabouts. Transportation Research Record, 2389, 65–77.
70. Vangala, P. (2015). Negative binomial-generalized exponential distribution: Generalized linear model and its applications. Master of Science dissertation, Zachry Department of Civil Engineering, Texas A&M University, College Station, TX.
71. Vangala, P., Lord, D., & Geedipally, S. R. (2015). Exploring the application of the negative binomial-generalized exponential model for analyzing traffic crash data with excess zeros. Analytic Methods in Accident Research, 7, 29–36.
72. Watson, A., Watson, B., & Vallmuur, K. (2015). Estimating under-reporting of road crash injuries to police using multiple linked data collections. Accident Analysis and Prevention, 83, 18–25.
73. Xu, J., & Sun, L. (2015). Modeling of excess zeros issue in crash count analysis. Journal of Jilin University (Engineering and Technology Edition), 45, 769–775.
74. Ye, F., & Lord, D. (2011). Investigating the effects of underreporting of crash data on three commonly used traffic crash severity models: Multinomial logit, ordered probit and mixed logit models. Transportation Research Record, 2241, 51–58.
75. Ye, F., & Lord, D. (2014). Comparing three commonly used crash severity models on sample size requirements: Multinomial logit, ordered probit and mixed logit models. Analytic Methods in Accident Research, 1, 72–85.
76. Young, W., Sobhani, A., Lenné, M. G., & Sarvi, M. (2014). Simulation of safety: A review of the state of the art in road safety simulation modelling. Accident Analysis and Prevention, 66, 89–103.
77. Zamani, H., & Ismail, N. (2010). Negative binomial-Lindley distribution and its application. Journal of Mathematics and Statistics, 6(1), 4–9.
78. Zamani, H., Ismail, N., & Faroughi, P. (2014). Poisson-weighted exponential univariate version and regression model with applications. Journal of Mathematics and Statistics, 10, 148–154.
79. Zha, L., Lord, D., & Zou, Y. (2015). The Poisson inverse Gaussian (PIG) generalized linear regression model for analyzing motor vehicle crash data. Journal of Transportation Safety and Security, 8(1), 18–35. doi:10.1080/19439962.2014.977502
80. Zou, Y., Lord, D., Zhang, Y., & Peng, Y. (2013). Comparison of Sichel and negative binomial models in estimating empirical Bayes estimates. Transportation Research Record, 2392, 11–21.
81. Zou, Y., Wu, L., & Lord, D. (2015). Modeling over-dispersed crash data with a long tail: Examining the accuracy of the dispersion parameter in negative binomial models. Analytic Methods in Accident Research, 5–6, 1–16.
82. Zou, Y., Zhang, Y., & Lord, D. (2012) Application of finite mixture of negative binomial regression models with varying weight parameters for vehicle crash data analysis. Accident Analysis and Prevention, 50, 1042–1051.