Bridging the gap between different statistical approaches: An integrated framework for modelling

International Statistical Review

Volumn 71, Issue 2, 2003, Pages 335-368

  Kuhnert, Petra M ^a   Mengersen, Kerrie ^b   Tesar, Peter ^c  

^a UNIVERSITY OF QUEENSLAND   (Australia)

^b UNIVERSITY OF NEWCASTLE   (Australia)

^c THE PRINCE CHARLES HOSPITAL   (Australia)

Author keywords

Binary response; Cardiac morbidity; Decision trees; Generalized additive models; Generalized linear models; Multiple Additive Regression Trees; Multivariate Adaptive Regression Splines; Reliability

Indexed keywords

EID: 0041859694     PISSN: 03067734     EISSN: None     Source Type: Journal    
DOI: 10.1111/j.1751-5823.2003.tb00202.x     Document Type: Review

References (56)

1. Augustin, N., Borchers, D., Clarke, E., Buckland, S. & Walsh, M. (1998). Spatiotemporal modelling for the annual egg production method of stock assessment using generalized additive models. Canadian Journal of Fisheries and Aquatic Sciences, 55(12), 2608-2621.
2. Austin, M. & Meyers, J. (1996). Current approaches to modelling the environmental niche of eucalypts: implication for management of forest biodiversity. Forest Ecology and Management, 85(1-3), 95-106.
3. Bernstein, A. & Parsonnet, V. (2000). Bedside estimation of risk as an aid for decision making in cardiac surgery. Annals of Thoracic Surgery, 69(3), 823-828.
4. Besag, J., Green, P., Higdon, D. & Mengersen, K. (1995). Bayesian computation and stochastic systems. Statistical Science, 10 (1), 3-66.
5. Best, N., Ickstadt, K., Wolpert, R. & Briggs, D. (2000).Combining models of health and exposure data: The SAVIAH study. In Spatial Epidemiology: Methods and Applications, Eds. Elliott, Wakefield, Best and Briggs, pp. 393-414. Oxford University Press.
6. Breiman, L. (1996). Bagging predictors. Machine Learning, 24(2), 123-140.
7. Breiman, L. (1998). Arcing classifiers (with discussion). Annals of Statistics, 26(3), 801-824.
8. Breiman, L., Friedman, J., Olshen, R. & Stone, C. (1984). Classification and Regression Trees. California: Wadsworth.
9. Chipman, H., George, E. & McCulloch, R. (1998). Bayesian CART model search. Journal of the American Statistical Association, 93(443), 935-960.
10. De'Ath, G. & Fabricius, K. (2000). Classification and regression trees: A powerful yet simple technique for the analysis of complex ecological data. Ecology, 81(11), 3178-3192.
11. De Gooijer, J., Ray, B. & Krager, H. (1998), Forecasting exchange rates using TSMARS. Journal of International Money and Finance, 17, 513-534.
12. De Veaux, R., Gordon, A., Comiso, J. & Bachere, N. (1993). Modeling of topographic effects on antarctic sea ice using multivariate adaptive regression splines. Journal of Geophysical Research, 98 (C11), 20,307-20,319.
13. De Veaux, R., Psichogios, D. & Ungar, L. (1993). A comparison of two non- parametric estimation schemes: MARS and neural networks. Computers and Chemical Engineering, 17(8), 819-837.
14. Denison, D., Mallick, B. & Smith, A. (1998a). A Bayesian CART algorithm. Biometrika, 85, 363-377.
15. Denison, D., Mallick, B. & Smith, A. (1998b). Bayesian MARS. Statistics and Computing, 8, 337-346.
16. Do, K.-A., Broom, B., Kuhnert, P., Duffy, D., Todorov, A., Treloar, S. & Martin, N. (2000). Genetic analysis of the age at menopause by using estimating equations and Bayesian random effects models. Statistics in Medicine, 19, 1217-1235.
17. Dupuis, J.-Y., Wang, F., Nathan, H., Lam, M., Grimes, S. & Bourke, M. (2001). The cardiac anesthesia risk evaluation score. Anesthesiology, 94, 194-204.
18. Forney, K. (2000). Environmental models of cetacean abundance: Reducing uncertainty in population trends. Conservation Biology, 14(5), 1271-1286.
19. Fox, C., O'Brien, C., Dickey-Collas, M. & Nash, R. (2000). Patterns in the spawning of cod (Gadus morhua L.), sole (Solea solea L.) and plaice (Pleuronectes platessa L.) in the Irish Sea as determined by generalized additive models. Fisheries Oceanography, 9, 33-49.
20. Frank, I. (1995). Tutorial: Modern nonlinear regression methods. Chemometrics and intelligent laboratory systems, 27, 1-9.
21. Freund, Y. & Schapire, R.E. (1996). Experiments with a new boosting algorithm. In Machine Learning: Proceedings of the Thirteenth International Conference, pp. 148-156. Bari, Italy.
22. Friedman, J. (1991). Multivariate adaptive regression splines (with discussion). Annals of Statistics, 19(1), 1-141.
23. Friedman, J. & Roosen, C. (1995). An introduction to multivariate adaptive regression splines. Statistical Methods in Medical Research, 4, 197-217.
24. Friedman, J. & Silverman, B. (1989). Flexible parsimonious smoothing and additive modeling. Technometrics, 31(1), 3-39.
25. Friedman, J.H. (1993). Fast MARS. Technical Report LCS110, Department of Statistics, Stanford University, California, USA.
26. Friedman, J.H. (2001). Greedy function approximation: A gradient boosting machine. Annals of Statistics, 29(5), 1189-1232.
27. Friedman, J.H. (2002). Stochastic gradient boosting. Computational Statistics and Data Analysis, 38(4), 367-378.
28. Friedman, J., Hastie, T. & Tibshirani, R. (2000). Additive logistic regression: a statistical view of boosting. The Annals of Statistics, 28(2), 337-407.
29. Gamerman, D. (1997). Markov Chain Monte Carlo: Stochastic simulation for Bayesian Inference. London: Chapman and Hall.
30. Gelman, A. & Rubin, D. (1992). Inference from iterative simulation using multiple sequences (with discussion). Statistical Science, 7, 457-511.
31. Geman, S. & Geman, D. (1984), Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images. IEEE Transactions on Pattern Analysis and Machine Intelligence, 6, 721-741.
32. Gilks, W., Richardson, S. & Spiegelhalter, D. (1996). Markov Chain Monte Carlo in Practice. London: Chapman and Hall.
33. Gill, R., Kuhnert, P., Warren, P., Stone, G. & Kossoff, G. (1996). Multiparameter fetal risk assessment in pregnancies with risk factors. In HIC'96: Making IT Happen, Eds. B. McGuinness and T. Leeder, pp. 61-65.
34. Green, A., Purdie, D., Bain, C., Siskind, V., Russell, P., Quinn, M. & Ward, B. (1996). Tubal sterilisation, hysterectomy and decreased risk of ovarian cancer. International Journal of Cancer, 71, 948-951.
35. Hastie, T. & Tibshirani, R. (1990). Generalized Additive Models. London: Chapman and Hall.
36. Hastings, W. (1970). Monte Carlo sampling methods using Markov chains and their applications. Biometrika, 57(1), 97-109.
37. Hess, K., Abbruzzese, M., Lenzi, R., Raber, M. & Abbruzzese, J.L. (1999). Classification and regression tree analysis of 1000 consecutive patients with unknown primary carcinoma. Clinical Cancer Research, 5(11), 3403-3410.
38. Hosmer, D. & Lemeshow, S. (1989). Applied Logistic Regression. New York: John Wiley & Sons.
39. Khan, S., Do, K.-A., Kuhnert P., Pillay, S., Papadimos, D., Conrad, R. & Jass, J. (1998). Diagnostic value of p53 immunohistochemistry in Barret's oesophagus: an endoscopic study. Pathology, 30(2), 136-140.
40. Kim, H. & Loh, W.-Y. (2001). Classification trees with unbiased multiway splits. Journal of the American Statistical Association, 96, 589-604.
41. Kuhnert, P. & Mengersen, K. (In Press). Reliability Measures for local nodes assessment in classification trees. Journal of Computational and Graphical Statistics.
42. Kuhnert, P., Do, K.-A. & McClure, R. (2000). Combining non-parametric models with logistic regression: an application to motor vehicle injury data. Computational Statistics and Data Analysis, 34, 371-386.
43. Lewis, P. & Stevens, J. (1991). Nonlinear modeling of time series using multivariate adaptive regression splines (MARS). Journal of the American Statistical Association, 86(416), 864-877.
44. McCullagh, P. & Nelder, J. (1989). Generalized Linear Models, Second Edition. London: Chapman and Hall.
45. Mengersen, K., Robert, C. & Guihenneuc-Jouyaux, C. (2000). MCMC convergence diagnostics: a "reviewww". In Spatial Epidemiology: Methods and Applications, Eds. Elliott, Wakefield, Best and Briggs, pp. 393-414. Oxford University Press.
46. Metropolis, N., Rosenbluth, A., Rosenbluth, M., Teller, A. & Teller, E. (1953). Equations of state calculations by fast computing machines. Journal of Chemical Physics, 21, 1087-1091.
47. Michie, D., Spiegelhalter, D. & Taylor, C. (1994). Machine Learning, Neural and Statistical Classification. New York: Ellis Horwood.
48. Parsonnet, V., Dean, D. & Bernstein, A. (1989). A method of uniform stratification of risk for evaluating the results of surgery in acquired heart disease. Circulation, 79(Suppl. 1), 3-12.
49. Quinlan, J. (1993). C4.5: Programs for Machine Learning. California: Morgan Kaufmann.
50. Quinlan, J.R. (1996). Bagging, boosting and C4.5. In Proceedings of the Thirteenth National Conference on Artificial Intelligence AAAI-97, pp. 725-730. Portland, Oregon.
51. Sekulic, S. & Kowalski, B. (1992). MARS: A tutorial. Journal of Chemometrics, 6, 199-216.
52. Spiegelhalter, D., Thomas, A. & Best, N. (1997). BUGS Version 0.6 User Manual. MRC Biostatistics Unit.
53. Therneau, T. & Atkinson, E. (1997). An introduction to recursive partitioning using the RPART routines. Technical Report, Mayo Foundation, Rochester.
54. Tu, J., Mazer, C., Levinton, C., Armstrong, P. & Naylor, C. (1994). A predictive index for length of stay in the intensive care unit following cardiac surgery. Canadian Medical Association Journal, 151 (2), 177-185.
55. Uysal, I. & Guvenir, H. (1999). An overview of regression techniques for knowledge discovery (review). The Knowledge Engineering Review, 14(4), 319-340.
56. Whiteman, D., Valery, P., McWhirter, W. & Green, A. (1997). Risk factors for childhood melanoma in Queensland, Australia. International Journal of Cancer, 70, 26-31.