Forecast Accuracy and Bias

Springer Series on Demographic Methods and Population Analysis

Volumn 37, Issue , 2013, Pages 323-371

  Smith, Stanley K ^a   Tayman, Jeff ^b   Swanson, David A ^c  

^a UNIVERSITY OF FLORIDA   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Base Period; Forecast Accuracy; Forecast Error; Population Projection; Prediction Interval

Indexed keywords

EID: 84904267843     PISSN: 18772560     EISSN: 22151990     Source Type: Book Series    
DOI: 10.1007/978-94-007-7551-0_13     Document Type: Chapter

References (139)

1. Ahlburg, D. (1995). Simple versus complex models: Evaluation, accuracy, and combining. Mathematical Population Studies, 5, 281–290.
2. Ahlburg, D. (1999). Using economic information and combining to improve forecast accuracy in demography. Unpublished paper. Rochester: Industrial Relations Center, University of Minnesota.
3. Alders, M., Keilman, N., & Cruijsen, H. (2007). Assumptions for long-term stochastic population forecasts in 18 European countries. European Journal of Population, 23, 33–69.
4. Alho, J. (1997). Scenarios, uncertainty and conditional forecasts of the world population. Journal of the Royal Statistical Society A, 160(part 1), 71–85.
5. Alho, J., & Spencer, B. (1997). The practical specification of the expected error of population forecasts. Journal of Official Statistics, 13, 203–225.
6. Alkema, L., Raftery, A. E., Gerland, P., Clark, S. J., Pelletier, F., Buettner, T., & Heilig, G. K. (2011). Probabilistic projections of the total fertility rate for all countries. Demography, 48, 815–839.
7. Armstrong, J. (1983). Relative accuracy of judgmental and extrapolative methods of forecasting annual earnings. Journal of Forecasting, 2, 437–447.
8. Armstrong, J. (1985). Long range forecasting: From crystal ball to computer. New York: Wiley.
9. Armstrong, J. S. (2001a). Combining forecasts. In J. S. Armstrong (Ed.), Principles of forecasting: A handbook for researchers and practitioners (pp. 417–439). Norwell: Kluwer.
10. Armstrong, J. S. (2001b). Evaluating forecasting methods. In J. S. Armstrong (Ed.), Principles of forecasting: A handbook for researchers and practitioners (pp. 443–472). Norwell: Kluwer.
11. Armstrong, J. S. (2006). Findings from evidence-based forecasting: Methods for reducing forecast error. International Journal of Forecasting, 22, 583–598.
12. Armstrong, J., & Collopy, F. (1992). Error measures for generalizing about forecasting methods: Empirical comparisons. International Journal of Forecasting, 8, 69–80.
13. Armstrong, J., & Fildes, R. (1995). Correspondence on the selection of error measures for comparisons among forecasting methods. Journal of Forecasting, 14, 67–71.
14. Ascher, W. (1981). The forecasting potential of complex models. Policy Sciences, 13, 247–267.
15. Ashton, A., & Ashton, R. (1985). Aggregating subjective forecasts: Some empirical results. Management Science, 31, 1499–1508.
16. Batchelor, R., & Dua, P. (1990). Forecaster ideology, forecasting technique, and the accuracy of economic forecasts. International Journal of Forecasting, 6, 3–10.
17. Bates, J., & Granger, C. (1969). The combination of forecasts. Operational Research Quarterly, 20, 451–468.
18. Beaumont, P., & Isserman, A. (1987). Comment. Journal of the American Statistical Association, 82, 1004–1009.
19. Becker, R., & Clements, A. E. (2008). Are combination forecasts of S&P 500 volatility statistically superior? International Journal of Forecasting, 24, 122–133.
20. Brodie, R., & De Kluyver, C. (1987). A comparison of the short term forecasting accuracy of econometric and naive extrapolation models of market share. International Journal of Forecasting, 3, 423–437.
21. Bryan, T. (1999). Small area population estimation technique using administrative records and evaluation of results with loss functions and optimization criteria. Paper presented at the Federal Committee on Statistical Methodology Research Conference, Washington, DC.
22. Cameron, M. P., & Poot, J. (2011). Lessons from stochastic small-area population projections: The case of Waikato subregions in New Zealand. Journal of Population Research, 28, 245–265.
23. Campbell, P. R. (1994). Population projections for states, by age, sex, race, and Hispanic origin: 1993 to 2020. Current Population Reports, P-25, No. 1111. Washington, DC: U.S. Bureau of the Census.
24. Campbell, P. R. (1996). Population projections for states by age, sex, race, and Hispanic origin: 1995 to 2050. PPL 47. Washington, DC: U.S. Census Bureau.
25. Chi, G. (2009). Can knowledge improve population forecasts at subcounty levels? Demography, 46, 405–427.
26. Chi, G., & Voss, P. R. (2011). Small-area population forecasting: Borrowing strength across space and time. Population, Space and Place, 17, 505–520.
27. Chi, G., Zhou, X., & Voss, P. R. (2011). Small-area population forecasting in an urban setting: A spatial regression approach. Journal of Population Research, 28, 185–201.
28. Clemen, R. (1989). Combining forecasts: A review and annotated bibliography. International Journal of Forecasting, 5, 559–583.
29. Clemen, R., & Guerard, J. (1989). Econometric GNP forecasts: Incremental information relative to naive extrapolation. International Journal of Forecasting, 5, 417–426.
30. Cohen, J. (1986). Population forecasts and the confidence intervals for Sweden: A comparison of model-based and empirical approaches. Demography, 23, 105–126.
31. Congdon, P. (1992). Multiregional demographic projections in practice: A metropolitan example. Regional Studies, 26, 177–191.
32. Crone, S. F., Hibon, M., & Nikolopoulos, K. (2011). Advances in forecasting with neural networks? Empirical evidence from the NN3 competition on time series prediction. International Journal of Forecasting, 27, 635–660.
33. Cushing, B., & Poot, J. (2004). Crossing boundaries and borders: Regional science advances in migration modeling. Papers in Regional Science, 83, 317–338.
34. Day, J. (1992). Population projections of the United States, by age, sex, race, and Hispanic origin: 1992 to 2050. Current Population Reports, P-25, No. 1092. Washington, DC: U.S. Bureau of the Census.
35. de Beer, J. (1993). Forecast intervals of net migration: The case of the Netherlands. Journal of Forecasting, 12, 585–599.
36. Fildes, R. (1985). Quantitative forecasting–the state of the art: Econometric models. Journal of the Operational Research Society, 36, 549–580.
37. Fildes, R. (1992). The evaluation of extrapolative forecasting methods. International Journal of Forecasting, 8, 81–98.
38. Genre, V., Kenny, G., Meyler, A., & Timmermann, A. (2013). Combining expert forecasts: Can anything beat the simple average? International Journal of Forecasting, 29, 108–121.
39. Granger, C. (1989). Invited review: Combining forecasts–twenty years later. Journal of Forecasting, 8, 167–173.
40. Greenwood, M. (1997). Internal migration in developed countries. In M. Rosenzweig & O. Stark (Eds.), Handbook of population and family economics (pp. 647–720). Amsterdam: Elsevier Science B.V.
41. Hamilton, C., & Perry, J. (1962). A short method for projecting population by age from one decennial census to another. Social Forces, 41, 163–170.
42. He, C., & Xu, X. (2005). Combination of forecasts using self-organizing algorithms. Journal of Forecasting, 24, 269–278.
43. Hendry, D. V., & Clements, M. P. (2004). Pooling of forecasts. The Econometrics Journal, 7, 1–31.
44. Hoogerheide, L., Kleijn, R., Ravazzolo, F., Van Dijk, H. K., & Verbeek, M. (2010). Forecast accuracy and economic gains from Bayesian model averaging using time-varying weights. Journal of Forecasting, 29, 251–269.
45. Hunt, G. (1993). Equilibrium and disequilibrium in migration modelling. Regional Studies, 27, 341–349.
46. Hyndman, R. J., & Booth, H. (2008). Stochastic population forecasts using functional data models for mortality, fertility and migration. International Journal of Forecasting, 24, 323–342.
47. Hyndman, R. J., & Koehler, A. B. (2006). Another look at measures of forecast accuracy. International Journal of Forecasting, 22, 679–688.
48. Irwin, R. (1977). Guide for local area population projections. Technical Paper #39. Washington, DC: U.S. Bureau of the Census.
49. Isserman, A. (1977). The accuracy of population projections for subcounty areas. Journal of the American Institute of Planners, 43, 247–259.
50. Isserman, A. (1993). The right people, the right rates: Making population estimates and forecasts with an interregional cohort-component model. Journal of the American Planning Association, 59, 45–64.
51. Kale, B., Voss, P. R., Palit, C., & Krebs, H. (1981). On the question of errors in population projections. Paper presented at the meeting of the Population Association of America, Washington, DC.
52. Kale, B., Voss, P. R., & Krebs, H. (1985). Small area population projections: The Wisconsin experience. Paper presented at the meeting of the Federal State Cooperative Program for Population Projections, Boston.
53. Keilman, N. (1990). Uncertainty in national population forecasting. Amsterdam: Swets and Zeitlinger.
54. Keilman, N. (1999). How accurate are the United Nations world population projections? In W. Lutz, J. Vaupel, & D. Ahlburg (Eds.), Frontiers of population forecasting (pp. 15–41). New York: The Population Council. (A supplement to Population and Development Review, 24).
55. Keyfitz, N. (1981). The limits of population forecasting. Population and Development Review, 7, 579–593.
56. Kulkarni, M., & Pol, L. (1994). Migration expectancy revisited: Results for the 1970s, 1980s and 1990s. Population Research and Policy Review, 13, 195–202.
57. Leach, D. (1981). Re-evaluation of the logistic curve for human populations. Journal of the Royal Statistical Society A, 144, 94–103.
58. Lee, R. (1974). Forecasting births in post-transition populations: Stochastic renewal with serially correlated fertility. Journal of the American Statistical Association, 69, 607–617.
59. Lee, R. (1992). Stochastic demographic forecasting. International Journal of Forecasting, 8, 315–327.
60. Lee, R. (1993). Modeling and forecasting the time series of U.S. fertility: Age distribution, range, and ultimate level. International Journal of Forecasting, 9, 187–212.
61. Lee, R., & Carter, L. (1992). Modeling and forecasting U.S. mortality. Journal of the American Statistical Association, 87, 659–675.
62. Lee, R., & Tuljapurkar, S. (1994). Stochastic population forecasts for the United States: Beyond high, medium, and low. Journal of the American Statistical Association, 89, 1175–1189.
63. Leitch, G., & Tanner, J. (1995). Professional economic forecasts: Are they worth their costs? Journal of Forecasting, 14, 143–157.
64. LeSage, J. (1990). Forecasting metropolitan employment using an export-base error-correction model. Journal of Regional Science, 30, 307–323.
65. Long, J. (1995). Complexity, accuracy, and utility of official population projections. Mathematical Population Studies, 5, 203–216.
66. Long, J., & McMillen, D. (1987). A survey of Census Bureau projection methods. Climatic Change, 11, 141–177.
67. Lutz, W., Sanderson, W., & Scherbov, S. (1999). Expert-based probabilistic population projections. In W. Lutz, J. Vaupel, & D. Ahlburg (Eds.), Frontiers of population forecasting (pp. 139–155). New York: The Population Council. (A supplement to Population and Development Review, 24).
68. Mahmoud, E. (1984). Accuracy in forecasting: A survey. Journal of Forecasting, 3, 139–159.
69. Mahmoud, E. (1987). The evaluation of forecasts. In S. Makridakis & S. Wheelwright (Eds.), The handbook of forecasting (pp. 504–522). New York: Wiley.
70. Makridakis, S. (1986). The art and science of forecasting: An assessment and future directions. International Journal of Forecasting, 2, 15–39.
71. Makridakis, S. (1993). Accuracy measures: Theoretical and practical concerns. International Journal of Forecasting, 9, 527–529.
72. Makridakis, S., & Hibon, M. (2000). The M3-competition: Results, conclusions and implications. International Journal of Forecasting, 16, 451–476.
73. Makridakis, S., & Taleb, N. (2009). Decision making and planning under low levels of predictability. International Journal of Forecasting, 25, 716–733.
74. Makridakis, S., & Winkler, R. (1983). Averages of forecasts: Some empirical results. Management Science, 29, 987–996.
75. Makridakis, S., Hibon, M., Lusk, E., & Belhadjali, M. (1987). Confidence intervals: An empirical investigation of the series in the M-competition. International Journal of Forecasting, 3, 489–508.
76. McNees, S. (1992). The uses and abuses of ‘consensus’ forecasts. Journal of Forecasting, 11, 703–710.
77. McNown, R., Rogers, A., & Little, J. (1995). Simplicity and complexity in extrapolative population forecasting models. Mathematical Population Studies, 5, 235–257.
78. Morgenroth, E. (2002). Evaluating methods for short to medium term county population forecasting. Journal of the Statistical and Social Inquiry Society of Ireland, 31, 111–136.
79. Mulder, T. J. (2002). Accuracy of the U.S. Census Bureau national population projections and their respective components of change, Population Division Working Paper Series, No. 50. Suitland: U.S. Census Bureau.
80. Murdock, S. H., Leistritz, F., Hamm, R., Hwang, S., & Parpia, B. (1984). An assessment of the accuracy of a regional economic-demographic projection model. Demography, 21, 383–404.
81. Nakosteen, R. (1989). Detailed population projections for small areas: The Massachusetts experience. Socio-Economic Planning Science, 23, 125–138.
82. Pant, P., & Starbuck, W. (1990). Innocents in the forest: Forecasting and research methods. Journal of Management, 16, 433–460.
83. Pflaumer, P. (1988). Confidence intervals for population projections based on Monte Carlo methods. International Journal of Forecasting, 4, 135–142.
84. Pflaumer, P. (1992). Forecasting U.S. population totals with the Box-Jenkins approach. International Journal of Forecasting, 8, 329–338.
85. Pittenger, D. (1980). Some problems in forecasting population for government planning purposes. The American Statistician, 34, 135–139.
86. Rayer, S. (2007). Population forecast accuracy: Does the choice of summary measure of error matter? Population Research and Policy Review, 26, 163–184.
87. Rayer, S. (2008). Population forecast errors: A primer for planners. Journal of Planning Education and Research, 27, 417–430.
88. Rayer, S., & Smith, S. K. (2010). Factors affecting the accuracy of subcounty population forecasts. Journal of Planning Education and Research, 30, 147–161.
89. Rayer, S., Smith, S. K., & Tayman, J. (2009). Empirical prediction intervals for county population forecasts. Population Research and Policy Review, 28, 773–793.
90. Rogers, A. (1995). Population forecasting: Do simple models outperform complex models? Mathematical Population Studies, 5, 187–202.
91. San Diego Association of Governments. (2006). 2030 Regional growth forecast. San Diego.
92. San Diego County Water Authority. (2002). Regional water facilities master plan. Appendix C: Development of probabilistic water demand forecasts. San Diego.
93. Sanderson, W. (1999). Knowledge can improve forecasts: A review of selected socioeconomic population projection models. In W. Lutz, J. Vaupel, & D. Ahlburg (Eds.), Frontiers of population forecasting (pp. 88–117). New York: The Population Council. (A supplement to Population and Development Review, 24).
94. Schmitt, R., & Crosetti, A. (1951). Accuracy of the ratio method for forecasting city population. Land Economics, 27, 346–348.
95. Schnaars, S. (1986). A comparison of extrapolation models on yearly sales forecasts. International Journal of Forecasting, 2, 71–85.
96. Shang, H. L. (2012). Point and interval forecasts of age-specific life expectancies: A model averaging approach. Demographic Research, 27, 593–644.
97. Sjaastad, L. (1962). The costs and returns of human migration. Journal of Political Economy, 70, 80–93.
98. Smith, S. K. (1986). Accounting for migration in cohort-component projections of state and local populations. Demography, 23, 127–135.
99. Smith, S. K. (1987). Tests of forecast accuracy and bias for county population projections. Journal of the American Statistical Association, 82, 991–1012.
100. Smith, S. K., & Ahmed, B. (1990). A demographic analysis of the population growth of states, 1950–1980. Journal of Regional Science, 30, 209–227.
101. Smith, S. K., & Rayer, S. (2012). An evaluation of population forecast errors for Florida and its counties, 1980–2010. Paper presented at the Conference on Applied Demography, San Antonio.
102. Smith, S. K., & Shahidullah, M. (1995). An evaluation of population projection errors for census tracts. Journal of the American Statistical Association, 90, 64–71.
103. Smith, S. K., & Sincich, T. (1988). Stability over time in the distribution of population forecast errors. Demography, 25, 461–473.
104. Smith, S. K., & Sincich, T. (1990). The relationship between the length of the base period and population forecast errors. Journal of the American Statistical Association, 85, 367–375.
105. Smith, S. K., & Sincich, T. (1991). An empirical analysis of the effect of the length of forecast horizon on population forecast errors. Demography, 28, 261–273.
106. Smith, S. K., & Sincich, T. (1992). Evaluating the forecast accuracy and bias of alternate population projections for states. International Journal of Forecasting, 8, 495–508.
107. Smith, S. K., & Tayman, J. (2003). An evaluation of population projections by age. Demography, 40, 741–757.
108. Spencer, G. (1989). Projection of the population of the United States by age, sex, and race: 1988 to 2008. Current Population Reports, P-25, No. 1018. Washington, DC: U.S. Bureau of the Census.
109. Stock, J. H., & Watson, M. W. (2004). Combination forecasts of output growth in a seven-country data set. Journal of Forecasting, 23, 405–430.
110. Stoto, M. (1983). The accuracy of population projections. Journal of the American Statistical Association, 78, 13–20.
111. Swanson, D. A., & Beck, D. (1994). A new short-term county population projection method. Journal of Economic and Social Measurement, 20, 25–50.
112. Swanson, D. A., & Tayman, J. (1995). Between a rock and a hard place: The evaluation of demographic forecasts. Population Research and Policy Review, 14, 233–249.
113. Swanson, D. A., Tayman, J., & Bryan, T. M. (2011). MAPE-R: A rescaled measure of accuracy for cross-sectional subnational population forecasts. Journal of Population Research, 28, 225–243.
114. Tayman, J. (1996). Forecasting, growth management, and public policy decision making. Population Research and Policy Review, 15, 491–508.
115. Tayman, J. (2011). Assessing uncertainty in small area forecasts: State of the practice and implementation strategy. Population Research and Policy Review, 30, 781–800.
116. Tayman, J., & Swanson, D. A. (1996). On the utility of population forecasts. Demography, 33, 523–528.
117. Tayman, J., Schafer, E., & Carter, L. (1998). The role of population size in the determination and prediction of population forecast errors: An evaluation using confidence intervals for subcounty areas. Population Research and Policy Review, 17, 1–20.
118. Tayman, J., Smith, S. K., & Lin, J. (2007). Precision, bias, and uncertainty for state population forecasts: An exploratory analysis of time series models. Population Research and Policy Review, 26, 347–369.
119. Tayman, J., Smith, S. K., & Rayer, S. (2011). Evaluating population forecast accuracy: A regression approach using county data. Population Research and Policy Review, 30, 235–262.
120. Tayman, J., Swanson, D. A., & Barr, C. (1999). In search of the idea measure of accuracy for subnational demographic forecasts. Population Research and Policy Review, 18, 387–409.
121. Theil, H. (1966). Applied economic forecasting. Amsterdam, Holland: North-Holland Publishing.
122. Thompson, W., & Whelpton, P. (1933). Population trends in the United States. New York: McGraw-Hill.
123. Torri, T., & Vaupel, J. W. (2012). Forecasting life expectancy in an international context. International Journal of Forecasting, 28, 519–531.
124. U.S. Census Bureau. (1950). Illustrative projections of the population of the United States: 1950 to 1960. Current Population Reports, P-25, No. 43. Washington, DC.
125. U.S. Census Bureau. (1957). Illustrative projections of the population, by state, 1960, 1965, and 1970. Current Population Reports, P-25, No. 160. Washington, DC.
126. U.S. Census Bureau. (1966). Illustrative projections of the population of states: 1970 to 1985. Current Population Reports, P-25, No. 326. Washington, DC.
127. U.S. Census Bureau. (1972). Preliminary projections of the population of states: 1975–1990. Current Population Reports, P-25, No. 477. Washington, DC.
128. U.S. Census Bureau. (1979). Illustrative projections of state populations by age, race, and sex: 1975 to 2000. Current Population Reports, P-25, No. 796. Washington, DC.
129. U. S. Census Bureau. (2005). Interim population projections for states by age and sex: 2004 to 2030. Suitland, MD: Population Projections Branch, Population Division.
130. Voss, P. R., & Kale, B. (1985). Refinements to small-area population projection models: Results of a test based on 128 Wisconsin communities. Paper presented at the meeting of the Population Association of America, Boston.
131. Webby, R., & O’Connor, M. (1996). Judgmental and statistical time series forecasting: A review of the literature. International Journal of Forecasting, 12, 91–118.
132. West, C., & Fullerton, T. (1996). Assessing the historical accuracy of regional economic forecasts. Journal of Forecasting, 15, 19–36.
133. Wetrogan, S. I. (1990). Projections of the population of states by age, sex, and race: 1989–2010. Current Population Reports, P-25, No. 1053. Washington, DC: U.S. Bureau of the Census.
134. Whelpton, P., Eldridge, H., & Siegel, J. S. (1947). Forecasts of the population of the United States: 1945–1975. Washington, DC: US Government Printing Office.
135. White, H. (1954). Empirical study of the accuracy of selected methods of projecting state populations. Journal of the American Statistical Association, 49, 480–498.
136. Williams, W., & Goodman, M. (1971). A simple method for the construction of empirical confidence limits for economic forecasts. Journal of the American Statistical Association, 66, 752–754.
137. Wilson, T. (2007). The forecast accuracy of Australian Bureau of Statistics national population projections. Journal of Population Research, 24, 91–117.
138. Wilson, T., & Bell, M. (2004). Probabilistic regional population forecasts: The example of Queensland, Australia. Geographical Analysis, 39, 1–25.
139. Zarnowitz, V. (1984). The accuracy of individual and group forecasts from business outlook surveys. Journal of Forecasting, 3, 11–26.