메뉴 건너뛰기




Volumn 4, Issue 4, 2004, Pages 683-712

Comparing bayes model averaging and stacking when model approximation error cannot be ignored

Author keywords

Bayes model averaging; Model selection; Robustness; Stacking

Indexed keywords

APPROXIMATION THEORY; DATA HANDLING; ERROR ANALYSIS; MATRIX ALGEBRA; PROBABILITY; ROBUSTNESS (CONTROL SYSTEMS); SPURIOUS SIGNAL NOISE; VECTORS;

EID: 2542484580     PISSN: 15324435     EISSN: None     Source Type: Journal    
DOI: 10.1162/153244304773936090     Document Type: Conference Paper
Times cited : (116)

References (40)
  • 1
    • 0004222683 scopus 로고
    • Prentice-Hall, Englewood Cliffs, NJ
    • Toby Berger. Rate Distortion Theory. Prentice-Hall, Englewood Cliffs, NJ, 1971.
    • (1971) Rate Distortion Theory
    • Berger, T.1
  • 2
    • 0002269120 scopus 로고
    • Limiting behavior of posterior distributions when the model is incorrect
    • Robert Berk. Limiting Behavior of Posterior Distributions When the Model is Incorrect. Annals of Mathematical Statistics, 37(1):51-58, 1966.
    • (1966) Annals of Mathematical Statistics , vol.37 , Issue.1 , pp. 51-58
    • Berk, R.1
  • 4
    • 0030196364 scopus 로고    scopus 로고
    • Stacked regressions
    • Leo Breiman. Stacked Regressions. Machine Learning, 24:49-64, 1996a.
    • (1996) Machine Learning , vol.24 , pp. 49-64
    • Breiman, L.1
  • 5
    • 0030211964 scopus 로고    scopus 로고
    • Bagging predictors
    • Leo Breiman. Bagging Predictors. Machine Learning, 24:123-140, 1996b.
    • (1996) Machine Learning , vol.24 , pp. 123-140
    • Breiman, L.1
  • 6
    • 0030344230 scopus 로고    scopus 로고
    • Heuristics of instability and stabilization in model selection
    • Leo Breiman. Heuristics of Instability and Stabilization in Model Selection. Annals of Statistics, 24(6):2350-2383, 1996c.
    • (1996) Annals of Statistics , vol.24 , Issue.6 , pp. 2350-2383
    • Breiman, L.1
  • 7
    • 0000245743 scopus 로고    scopus 로고
    • Statistical modeling: The two cultures
    • Leo Breiman. Statistical Modeling: The Two Cultures. Statistical Science, 16(3): 199-231, 2001.
    • (2001) Statistical Science , vol.16 , Issue.3 , pp. 199-231
    • Breiman, L.1
  • 8
    • 0043289776 scopus 로고    scopus 로고
    • Analyzing bagging
    • Peter Buhlman and Bin Yu. (2002) Analyzing Bagging. Annals of Statistics, 30(4):927-961.
    • (2002) Annals of Statistics , vol.30 , Issue.4 , pp. 927-961
    • Buhlman, P.1    Yu, B.2
  • 9
    • 0001078433 scopus 로고    scopus 로고
    • Bayesian model averaging and model search strategies
    • Valencia, Spain
    • Merlise Clyde. Bayesian Model Averaging and Model Search Strategies. In Bayesian Statistics 6, pages 157-185, Valencia, Spain, 1999.
    • (1999) Bayesian Statistics , vol.6 , pp. 157-185
    • Clyde, M.1
  • 10
    • 2542476712 scopus 로고    scopus 로고
    • Combining model selection procedures for online prediction
    • Bertrand Clarke. Combining Model Selection Procedures for Online prediction. Sankhya A 63:229-249, 2001.
    • (2001) Sankhya A , vol.63 , pp. 229-249
    • Clarke, B.1
  • 12
    • 2542422477 scopus 로고    scopus 로고
    • Model metaselection
    • Dept. of Stat. Sci. UCL
    • Xavier de Luna and Kostas Skouras. Model Metaselection. Technical Report 203, Dept. of Stat. Sci. UCL, 1999.
    • (1999) Technical Report , vol.203
    • De Luna, X.1    Skouras, K.2
  • 13
    • 0002276308 scopus 로고
    • Assessment and propagation of model uncertainty
    • David Draper. Assessment and Propagation of Model Uncertainty. Journal of the Royal Statistical Society, 57(1):45-97, 1995.
    • (1995) Journal of the Royal Statistical Society , vol.57 , Issue.1 , pp. 45-97
    • Draper, D.1
  • 14
    • 2542481425 scopus 로고    scopus 로고
    • Dilution priors for model uncertainty
    • Berkeley, California
    • Edward George. Dilution Priors for Model Uncertainty. MSRI Workshop on Nonlinear Estimation and Classification, Berkeley, California. Available electronically via http://www.msri.Org/publications/ln/msri/2001/nle/george/l/ banner/01.html 2001.
    • (2001) MSRI Workshop on Nonlinear Estimation and Classification
    • George, E.1
  • 15
    • 0001729472 scopus 로고    scopus 로고
    • Calibration and empirical bayes variable selection
    • Edward George and David Foster. Calibration and Empirical Bayes Variable Selection. Biometrika, 87(4):731-747, 2000.
    • (2000) Biometrika , vol.87 , Issue.4 , pp. 731-747
    • George, E.1    Foster, D.2
  • 17
    • 0002192516 scopus 로고
    • Decision-theoretic generalizations of the PAC model for neural net and other learning applications
    • 1992
    • David Haussler. (1992). Decision-Theoretic Generalizations of the PAC Model for Neural Net and Other Learning Applications. Information and Computing, 100(1):78-150, 1992.
    • (1992) Information and Computing , vol.100 , Issue.1 , pp. 78-150
    • Haussler, D.1
  • 18
    • 0000263475 scopus 로고
    • The determination of the order of an autoregression
    • Edward Hannan and Barry Quinn. The Determination of the Order of an Autoregression. Journal of the Royal Statistical Society B, 41(2):190-195, 1979.
    • (1979) Journal of the Royal Statistical Society B , vol.41 , Issue.2 , pp. 190-195
    • Hannan, E.1    Quinn, B.2
  • 20
    • 0000796112 scopus 로고
    • A simple lemma on greedy approximation in hubert space and convergence rates for projection pursuit regression and neural network training
    • Lee Jones. A Simple Lemma on Greedy Approximation in Hubert Space and Convergence Rates for Projection Pursuit Regression and Neural Network Training. Annals of Statistics, 20(1):608-613, 1992.
    • (1992) Annals of Statistics , vol.20 , Issue.1 , pp. 608-613
    • Jones, L.1
  • 21
    • 0034287161 scopus 로고    scopus 로고
    • Local greedy approximation for nonlinear regression and neural network training
    • Lee Jones. Local Greedy Approximation for Nonlinear Regression and Neural Network Training. Annals of Statistics, 28(5): 1379-1389, 2000.
    • (2000) Annals of Statistics , vol.28 , Issue.5 , pp. 1379-1389
    • Jones, L.1
  • 22
    • 0034362823 scopus 로고    scopus 로고
    • Functional aggregation for nonparametric regression
    • Anatoli Juditsky and Arkadii Nemirovski. Functional Aggregation for Nonparametric Regression. Annals of Statistics, 28(3):681-712, 2000.
    • (2000) Annals of Statistics , vol.28 , Issue.3 , pp. 681-712
    • Juditsky, A.1    Nemirovski, A.2
  • 23
    • 0036381087 scopus 로고    scopus 로고
    • Generalized analysis of experimental data for interrelated biological measurements
    • Zvi Kam. Generalized Analysis of Experimental Data for Interrelated Biological Measurements. Bulletin of Mathematical Biology, 64:133-145, 2002.
    • (2002) Bulletin of Mathematical Biology , vol.64 , pp. 133-145
    • Kam, Z.1
  • 25
    • 0001556720 scopus 로고    scopus 로고
    • Efficient agnostic learning of neural networks with bounded fan-in
    • Wee Sun Lee, Peter Bartlett, and Robert Williamson. Efficient Agnostic Learning of Neural Networks with Bounded Fan-in. IEEE Transactions on Information Theory, 42(6):2118-2132, 1996.
    • (1996) IEEE Transactions on Information Theory , vol.42 , Issue.6 , pp. 2118-2132
    • Lee, W.S.1    Bartlett, P.2    Williamson, R.3
  • 26
    • 0001462696 scopus 로고
    • L, cross-validation, and generalized cross-validation: Discrete index set
    • L, cross-validation, and generalized cross-validation: Discrete index set. Annals of Statistics, 15(3):958-975, 1987.
    • (1987) Annals of Statistics , vol.15 , Issue.3 , pp. 958-975
    • Li, K.C.1
  • 27
    • 0028515872 scopus 로고
    • Data fusion with minimal communication
    • Zhao-Qing Luo and John Tsitsiklis. (1994) Data Fusion with Minimal Communication. IEEE Trans. Inform. Theory 40(5):1551-1563.
    • (1994) IEEE Trans. Inform. Theory , vol.40 , Issue.5 , pp. 1551-1563
    • Luo, Z.-Q.1    Tsitsiklis, J.2
  • 28
    • 84950945692 scopus 로고
    • Model selection and accounting for model uncertainty in graphical models using occam's window
    • David Madigan and Adrian Raftery. Model Selection and Accounting for Model Uncertainty in Graphical Models Using Occam's Window. Journal of the American Statistical Association, 89:1535-1546, 1984.
    • (1984) Journal of the American Statistical Association , vol.89 , pp. 1535-1546
    • Madigan, D.1    Raftery, A.2
  • 32
    • 0642336882 scopus 로고    scopus 로고
    • An asymptotic theory for linear model selection
    • Jun Shao. An Asymptotic Theory for Linear Model Selection. Statistica Sinica, 7:221-261, 1997.
    • (1997) Statistica Sinica , vol.7 , pp. 221-261
    • Shao, J.1
  • 34
    • 77956887130 scopus 로고
    • An optimal selection of regression variables
    • Ritei Shibata. An optimal selection of regression variables. Biometrika, 68(1):45-54, 1981.
    • (1981) Biometrika , vol.68 , Issue.1 , pp. 45-54
    • Shibata, R.1
  • 35
    • 2542506048 scopus 로고    scopus 로고
    • An evaluation of linearly combining density estimators via stacking
    • Information and Computer Science Department, University of Irvine
    • Padhraic Smyth and David Wolpert. An Evaluation of Linearly Combining Density estimators via Stacking. Technical Report 98-25, Information and Computer Science Department, University of Irvine, 1998.
    • (1998) Technical Report , vol.98 , Issue.25
    • Smyth, P.1    Wolpert, D.2
  • 36
    • 0042252623 scopus 로고
    • Regression shrinkage and selection via the lasso
    • Dept. of Statistics, University of Toronto
    • Robert Tibshirani. Regression Shrinkage and Selection via the Lasso. Technical Report, Dept. of Statistics, University of Toronto, 1994.
    • (1994) Technical Report
    • Tibshirani, R.1
  • 37
    • 0026692226 scopus 로고
    • Stacked generalization
    • David Wolpert. Stacked Generalization. Neural Networks, 5:241-259, 1992.
    • (1992) Neural Networks , vol.5 , pp. 241-259
    • Wolpert, D.1
  • 38
    • 29144460670 scopus 로고    scopus 로고
    • Combining forecasting procedures: Some theoretical results
    • forthcoming
    • Yuhong Yang. Combining Forecasting Procedures: Some Theoretical Results. Econometric Theory, forthcoming.
    • Econometric Theory
    • Yang, Y.1
  • 39
    • 0742271402 scopus 로고    scopus 로고
    • Aggregating regression procedures for better performance
    • forthcoming
    • Yuhong Yang. Aggregating Regression Procedures for Better Performance. Bernoulli, forthcoming.
    • Bernoulli
    • Yang, Y.1
  • 40
    • 0141573227 scopus 로고    scopus 로고
    • Regression with multiple candidate models: Selecting or mixing?
    • forthcoming
    • Yuhong Yang. Regression with Multiple Candidate Models: Selecting or Mixing? Statistica Sinica, forthcoming.
    • Statistica Sinica
    • Yang, Y.1


* 이 정보는 Elsevier사의 SCOPUS DB에서 KISTI가 분석하여 추출한 것입니다.