Management strategy evaluation: Best practices

Fish and Fisheries

Volumn 17, Issue 2, 2016, Pages 303-334

  Punt, André E ^a,b   Butterworth, Doug S ^c   de Moor, Carryn L ^c   De Oliveira, José A A ^d   Haddon, Malcolm ^b  

^a UNIVERSITY OF WASHINGTON   (United States)

^b CSIRO   (Australia)

^c UNIVERSITY OF CAPE TOWN   (South Africa)

^d CENTRE FOR ENVIRONMENT   (United Kingdom)

Author keywords

Fisheries management; Management procedure; Management strategy evaluation; Simulation; Stakeholders; Uncertainty

Indexed keywords

BEST MANAGEMENT PRACTICE; DECISION MAKING; FISHERY MANAGEMENT; GUIDELINE; NUMERICAL MODEL; STAKEHOLDER; SUBPOPULATION; UNCERTAINTY ANALYSIS; WHALE;

ARCTIC OCEAN; BEAUFORT SEA; BERING SEA; CHUKCHI SEA; PACIFIC OCEAN;

BALAENA MYSTICETUS; BALAENIDAE; CLUPEIDAE; SARDINOPS SAGAX;

EID: 84964322540     PISSN: 14672960     EISSN: 14672979     Source Type: Journal    
DOI: 10.1111/faf.12104     Document Type: Article

References (169)

1. A'mar, Z.T., Punt, A.E. and Dorn, M.W. (2008) The management strategy evaluation approach and the fishery for walleye pollock in the Gulf of Alaska. In: Resiliency of Gadid Stocks to Fishing and Climate Change (eds G.H. Kruse, K. Drinkwater, J.N. Ianelli, J.S. Link, D.L. Stram, V. Wespestad and D. Woodby ). Alaska Sea Grant College Program, University of Alaska, Fairbanks, pp. 317-346.
2. A'mar, Z.T., Punt, A.E. and Dorn, M.W. (2009a) The evaluation of management strategies for the Gulf of Alaska walleye pollock under climate change. ICES Journal of Marine Science 66, 1614-1632.
3. A'mar, Z.T., Punt, A.E. and Dorn, M.W. (2009b) The impact of regime shifts on the performance of management strategies for the Gulf of Alaska walleye pollock fishery. Canadian Journal of Fisheries and Aquatic Sciences 66, 2222-2242.
4. A'mar, Z.T., Punt, A.E. and Dorn, M.W. (2010) Incorporating ecosystem forcing through predation into a management strategy evaluation for the Gulf of Alaska walleye Pollock (Theragra chalcogramma) fishery of ecosystem changes on the management of the fishery for walleye pollock in the Gulf of Alaska. Fisheries Research 102, 98-114.
5. Anderson, B.S., Vermard, Y., Ulrich, C., Hutton, T. and Poos, J.J. (2010) Challenges in integrating short-term behaviour in a mixed-fishery Management Strategies Evaluation frame: a case study of the North Sea flatfish fishery. Fisheries Research 102, 26-40.
6. Anderson, S.C., Monnahan, C.C., Johnson, K.F., Ono, K. and Valero, J.L. (2014) ss3sim: an R package for fisheries stock assessment simulation with Stock Synthesis. PLoS One 9, e92725.
7. Anonymous. (2011) Report of the 16th meeting of the Extended Scientific Committee for the Commission for the Conservation of Southern Bluefin Tuna. CCSBT.
8. Babcock, E.A. and MacCall, A.D. (2011) How useful is the ratio of fish density outside versus inside no-take marine reserves as a metric for fishery management control rules? Canadian Journal of Fisheries and Aquatic Sciences 68, 343-359.
9. Baumgartner, T., Soutar, A. and Ferriera-Bartrina, V. (1992) Reconstruction of the history of pacific sardine and northern anchovy populations over the past two millennia from sediments of the Santa Barbara Basin, California. CalCOFI Reports 33, 24-40.
10. Bence, J.R., Gordoa, A. and Hightower, J.E. (1993) Influence of age-selective surveys on the reliability of stock synthesis assessments. Canadian Journal of Fisheries and Aquatic Sciences 50, 827-840.
11. Bentley, N. and Stokes, K. (2009a) Moving fisheries from data-poor to data-sufficient: evaluating the costs of management versus the benefits of management. Marine and Coastal Fisheries: Dynamics, Management, and Ecosystem Science 1, 378-390.
12. Bentley, N. and Stokes, K. (2009b) Contrasting paradigms for fisheries management decision making: how well do they serve data-poor fisheries? Marine and Coastal Fisheries: Dynamics, Management, and Ecosystem Science 1, 391-401.
13. Bergh, M.O. and Butterworth, D.S. (1987) Towards rational harvesting of the South African anchovy considering survey imprecise and recruitment variability. South African Journal of Marine Science 5, 937-951.
14. Breen, P.A. and Kim, S.W. (2006) Development of an operational management procedure (decision rule) for CRA 4. New Zealand Fisheries Assessment Report 2006/53, 46 pp.
15. Bunnefeld, N., Hoshino, E. and Milner-Gulland, E.J. (2011) Management strategy evaluation: a powerful tool for conservation? Trends in Ecology and Evolution 26, 441-447.
16. Butterworth, D.S. (2007) Why a management procedure approach? Some positives and negatives. ICES Journal of Marine Science 64, 613-617.
17. Butterworth, D.S. (2008a) A commentary on: salvaged pearls: lessons learned from a floundering attempt to develop a management procedure for Southern Bluefin Tuna. Fisheries Research 94, 351-354.
18. Butterworth, D.S. (2008b) Some lessons from implementing management procedures. In: Fisheries for Global Welfare and Environment, 5th World Fisheries Congress 2008 (eds K. Tsukamoto, T. Kawamura, T. Takeuchi, T.D. Beard Jr and M.J. Kaiser ). TERRAPUB, Tokyo, pp. 381-397.
19. Butterworth, D.S. and Geromont, H.F. (2001) Evaluation of a class of possible simple interim management procedures for the Namibian hake fishery. South African Journal of Marine Science 23, 357-374.
20. Butterworth, D.S. and Johnston, S.J. (2014) Recommendations on rock lobster TACs for the Tristan outer group of islands for the 2014/15 season. MARAM Document: MARAM/2014/JUL/10, 6 pp. Available at: http://www.mth.uct.ac.za/maram/pub/2014/MARAM_TRISTAN_2014_FEB_03.pdf (accessed 10 November 2014).
21. Butterworth, D.S. and Punt, A.E. (1999) Experiences in the evaluation and implementation of management procedures. ICES Journal of Marine Science 56, 985-998.
22. Butterworth, D.S. and Rademeyer, R.A. (2010) Greenland halibut MSE results for updated SCAA reference case and robustness test operating models. NAFO Document: FCWGMSE WP 10/13, 18 pp. Available at: http://www.mth.uct.ac.za/maram/pub/2010/wgmsewp10-13_MSE_update.pdf (accessed 26 June 2014).
23. Butterworth, D.S., De Oliveira, J.A.A. and Cochrane, K.L. (1993) Current initiatives in refining the management procedure for the South African anchovy resource. In: Proceedings of the International Symposium on Management Strategies for Exploited Fish Populations (Anchorage, Alaska, October 1992) (eds G. Kruse, D.M. Eggers, R.J. Marasco, C. Pautzke and T.J. Quinn II). Alaska Sea Grant College Program AK-SG-93-02, Fairbanks, AK, pp. 439-473.
24. Butterworth, D.S., Punt, A.E. and Smith, A.D.M. (1996) On plausible hypotheses and their weighting, with implications for selection between variants of the Revised Management Procedure. Reports of the International Whaling Commission 46, 637-640.
25. Butterworth, D.S., Johnston, S.J. and Brandáo, A. (2010a) Pretesting the likely efficacy of suggested approach to data-poor fisheries. Marine and Coastal Fisheries: Dynamics, Management, and Ecosystem Science 2, 131-145.
26. Butterworth, D.S., Bentley, N., De Oliveira, J.A.A. et al. (2010b) Purported flaws in management strategy evaluation: basic problems or misinterpretations? ICES Journal of Marine Science 67, 567-574.
27. Butterworth, D.S., De Oliveira, J.A.A. and de Moor, C.L. (2012) Are South African administrative law procedures adequate for the evaluation of issues resting on scientific analyses. South African Law Journal 129, 461-477.
28. Carruthers, T.R., McAllister, M.K. and Taylor, N. (2011) Spatial surplus production modeling of Atlantic tunas and billfish. Ecological Applications 21, 2734-2755.
29. Carruthers, T.R., Punt, A.E., Walters, C.J. et al. (2014) Evaluating methods for setting catch limits in data-limited fisheries. Fisheries Research 153, 48-68.
30. Christensen, S. (1997) Evaluation of management strategies - a bioeconomic approach applied to the Greenland Shrimp Fishery. ICES Journal of Marine Science 54, 412-426.
31. Cochrane, K.L., Butterworth, D.S., De Oliveira, J.A.A. and Roel, B.A. (1998) Management procedures in a Fishery based on highly variable stocks and with conflicting objectives: experiences in the South African pelagic fishery. Reviews in Fish Biology and Fisheries 8, 177-214.
32. Commission for the Conservation of Southern Bluefin Tuna (CCSBT) (2011) Report of the Eighteenth Annual Meeting of the Commission. Available at: http://www.ccsbt.org/userfiles/file/docs_english/meetings/meeting_reports/ccsbt_20/report_of_SC18.pdf (accessed 11 November 2014).
33. Cooke, J.G. (1999) Improvement of fishery-management advice through simulation testing of harvest algorithms. ICES Journal of Marine Science 56, 797-810.
34. Cox, S.P. and Kronlund, A.R. (2008) Practical stakeholder-driven harvest policies for groundfish fisheries in British Columbia, Canada. Fisheries Research 94, 224-237.
35. De Oliveira, J.A.A. (2003) The development and implementation of a joint management procedure for the South African pilchard and anchovy resources. PhD thesis, University of Cape Town, [iv] + 319 pp.
36. De Oliveira, J.A.A. and Butterworth, D.S. (2004) Developing and refining a joint management procedure for the multispecies South African pelagic fishery. ICES Journal of Marine Science 61, 1432-1442.
37. Dereksdóttir, E.H. and Magnússon, K.G. (2003) A Strike Limit Algorithm based on Adaptive Kalman Filtering with an application to aboriginal whaling of bowhead whales. Journal of Cetacean Research and Management 5, 29-37.
38. Dichmont, C.M. and Brown, I.W. (2010) A case study in successful management of a data-poor fishery using simple decision rules: the Queensland spanner crab fishery. Marine and Coastal Fisheries: Dynamics, Management, and Ecosystem Science 2, 1-13.
39. Dichmont, C.M., Deng, R., Punt, A.E., Venables, W. and Haddon, M. (2006a) Management strategies for short lived species: the case of Australia's Northern Prawn Fishery. 1. Accounting for multiple species, spatial structure and implementation uncertainty when evaluating risk. Fisheries Research 82, 204-220.
40. Dichmont, C.M., Deng, R., Punt, A.E., Venables, W. and Haddon, M. (2006b) Management strategies for short lived species: the case of Australia's Northern Prawn Fishery. 3. Management strategy scale and complexity. Fisheries Research 82, 235-245.
41. Dichmont, C.M., Deng, A., Punt, A.E. et al. (2008) Beyond biological performance measures in Management Strategy Evaluation: bringing in economics and the effects of trawling on the benthos. Fisheries Research 94, 238-250.
42. Dichmont, C.M., Ellis, N., Bustamante, R.H. et al. (2013) Evaluating marine spatial closures with conflicting fisheries and conservation objectives. Journal of Applied Ecology 50, 1060-1070.
43. DiNardo, G.T. and Wetherall, J.A. (1999) Accounting for uncertainty in the development of harvest strategies for the Northwestern Hawaiian Islands lobster trap fishery. ICES Journal of Marine Science 56, 943-951.
44. Dowling, N.A., Smith, D.C., Knuckey, I. et al. (2008) Developing harvest strategies for low-value and data-poor fisheries: case studies from three Australian fisheries. Fisheries Research 94, 380-390.
45. Dunstan, P.K. and Bax, N.J. (2008) Management of an invasive marine species: defining and testing the effectiveness of ballast-water management options using management strategy evaluation. ICES Journal of Marine Science 66, 841-850.
46. Fay, G., Punt, A.E. and Smith, A.D.M. (2011) Impacts of spatial uncertainty on the performance of age structure-based harvest strategies for blue-eye trevalla (Hyperoglyphe antarctica). Fisheries Research 110, 391-407.
47. Field, J.C., Punt, A.E., Methot, R.D. and Thomson, C.J. (2006) Does MPA mean "Major Problem for Assessments?" Considering the consequences of place-based management systems. Fish and Fisheries 7, 284-302.
48. Francis, R.I.C.C. and Shotton, R. (1997) "Risk" in fisheries management: a review. Canadian Journal of Fisheries and Aquatic Sciences 54, 1699-1715.
49. Fulton, E.A., Smith, A.D.M. and Punt, A.E. (2004) Which ecological indicators can robustly detect effects of fishing? ICES Journal of Marine Science 62, 540-551.
50. Fulton, E.A., Smith, A.D.M. and Smith, D.C. (2007) Alternative management strategies for Southeastern Australian Commonwealth Fisheries: Stage 2: Quantitative Management Strategy Evaluation. Report to the Australian Fisheries Management Authority and the Fisheries Research and Development Corporation. CSIRO Marine and Atmospheric Research.
51. Fulton, E.A., Smith, A.D.M., Smith, D.C. and van Putten, I.E. (2011a) Human behavior: the key source of uncertainty in fisheries management. Fish and Fisheries 12, 2-17.
52. Fulton, E.A., Link, J.S., Kaplan, I.C. et al. (2011b) Lessons in modelling and management of marine ecosystems: the Atlantis experience. Fish and Fisheries 12, 171-188.
53. Fulton, E.A., Smith, A.D.M., Smith, D.C. and Johnson, P. (2014) An integrated approach is needed for Ecosystem Based Fisheries Management: insights from ecosystem-level management strategy evaluation. PLoS One 9, e84242.
54. Furman, L.B. and Butterworth, D.S. (2012) Proposed Catch Control Rules for Horse Mackerel Bycatch in the Small Pelagics fishery and Directed Catch in the Midwater Trawl Fishery. Department of Agriculture, Forestry and Fisheries Report No. FISHERIES/2012/OCT/SWG-DEM/23, 33 pp. Available at: http://www.mth.uct.ac.za/maram/pub/2012/FISHERIES_2012_OCT_SWG-DEM_23_Horse_mackerel_juvenile_PUCL.pdf (accessed 11 November 2014).
55. Gaichas, S., Gamble, R., Fogarty, M. et al. (2012) Assembly rules for aggregate-species production models: simulations in support of management strategy evaluation. Marine Ecology Progress Series 459, 275-292.
56. George, J.C., Bada, J., Zeh, J. et al. (1999) Age and growth estimates of bowhead whales (Balaena mysticetus) via aspartic acid racemisation. Canadian Journal of Zoology 77, 571-580.
57. Geromont, H.F. and Butterworth, D.S. (In press-a) Generic management procedures for data-poor fisheries: forecasting with few data. ICES Journal of Marine Science.
58. Geromont, H.F. and Butterworth, D.S. (In press-b) Complex assessments or simple management procedures for efficient fisheries management: a comparative study. ICES Journal of Marine Science.
59. Geromont, H.F., De Oliveira, J.A.A., Johnston, S.J. and Cunningham, C.L. (1999) Development and application of management procedures for fisheries in southern Africa. ICES Journal of Marine Science 56, 952-966.
60. Givens, G.H. (2003) Empirical estimation of safe aboriginal whaling limits for bowhead whales. Journal of Cetacean Research and Management 5, 39-43.
61. Givens, G.H., Zeh, J.E. and Raftery, A.E. (1995) Assessment of the Bering-Chukchi-Beaufort Seas stock of bowhead whales using the Baleen II Model in a Bayesian synthesis framework. Reports of the International Whaling Commission 45, 345-364.
62. Haddon, M. (2011a) Modelling and Quantitative Methods in Fisheries, 2nd edn. Chapman & Hall, CRC Press, 449 pp.
63. Haddon, M. (2011b) Management Strategy Evaluation testing of the Management Strategies used with South-Eastern Scallop Fisheries. Report prepared for the Department of Agriculture, Fisheries and Forestry (DAFF) as part of the Reducing Uncertainty in Stock Status Project, 100 pp.
64. Haddon, M. and Helidoniotis, F. (2013) Legal minimum lengths and the management of abalone fisheries. Journal of Shellfish Research 32, 197-208.
65. Hilborn, R., Parma, A. and Maunder, M. (2002) Exploitation rate reference points for West Coast rockfish: are they robust and are there better alternatives? North American Journal of Fisheries Management 22, 365-375.
66. Hill, K.T., Crone, P.R., Lo, N.C.H. et al. (2011) Assessment of the Pacific sardine resource in 2011 for U.S. management in 2012. U.S. Dep. Commer., NOAA Tech. Memo. NMFS-SWFSC-487, 260 pp.
67. Hillary, R. (2009) An introduction to FLR fisheries simulation tools. Aquatic Living Resources 22, 225-232.
68. Howell, D., Filin, A.A., Bogstad, B. and Stiansen, J.E. (2013) Unquantifiable uncertainty in projecting stock response to climate change: example from North East Arctic cod. Marine Biology Research 9, 920-931.
69. Hurtado-Ferro, F. and Punt, A.E. (2014) Revised Analyses Related to Pacific Sardine Harvest Parameters. Pacific Fishery Management Council, Portland, OR.
70. Hurtado-Ferro, F., Punt, A.E. and Hill, K.T. (2014) Use of multiple selectivity patterns as a proxy for spatial structure. Fisheries Research 158, 102-115.
71. Ianelli, J.N., Hollowed, A.B., Haynie, A.C., Mueter, F.J. and Bond, N.A. (2011) Evaluating management strategies for eastern Bering Sea walleye pollock (Theragra chalcogramma) in a changing environment. ICES Journal of Marine Science 68, 1297-1304.
72. ICES. (2008) Report of the Working Group on Methods of Fish Stock Assessments (WGMG), 7-16 October 2008, Woods Hole, USA. ICES CM 2008/RMC:03, 147 pp.
73. ICES. (2012) Report of the ICES Advisory Committee 2012. ICES Advice, 2012. Book 1, 156 pp.
74. ICES. (2013) Report of the Workshop on Guidelines for Management Strategy Evaluations (WKGMSE), 21-23 January 2013, ICES HQ, Copenhagen, Denmark.
75. International Whaling Commission (IWC) (1992) Report of the Third Comprehensive Assessment on Management Procedures. Reports of the International Whaling Commission 42, 271-304.
76. International Whaling Commission (IWC) (1994) Report of the Scientific Committee, Annex H. The Revised Management Procedure (RMP) for Baleen Whales. Reports of the International Whaling Commission 44, 145-152.
77. International Whaling Commission (IWC) (2003) Report of the Scientific Committee, Annex E. Report of the Standing Working Group (SWG) on the Development of an Aboriginal Subsistence Whaling Management Procedure (AWMP). Journal of Cetacean Research and Management 5(Suppl), 154-225.
78. International Whaling Commission (IWC) (2008a) Report of the Scientific Committee, Annex E. Report of the Standing Working Group (SWG) on the Aboriginal Subsistence Whaling Management Procedure (AWMP). Journal of Cetacean Research and Management 10(Suppl), 121-149.
79. International Whaling Commission (IWC) (2008b) Report of the Scientific Committee, Annex D. Report of the Sub-committee on the Revised Management Procedure. Journal of Cetacean Research and Management 10(Suppl), 84-92.
80. International Whaling Commission (IWC) (2009) Report of the Scientific Committee, Annex D. Report of the Sub-committee on the Revised Management Procedure. Journal of Cetacean Research and Management 11(Suppl), 91-144.
81. International Whaling Commission (IWC) (2010) Report of the Scientific Committee, Annex D. Report of the Sub-committee on the Revised Management Procedure. Journal of Cetacean Research and Management 12(Suppl), 89-116.
82. International Whaling Commission (IWC) (2012a) Requirements and Guidelines for Implementations under the Revised Management Procedure (RMP). Journal of Cetacean Research and Management 13(Supplement), 497-505.
83. International Whaling Commission (IWC) (2012b) The Revised Management Procedure (RMP) for Baleen Whales. Journal of Cetacean Research and Management 13(Supplement), 485-494.
84. International Whaling Commission (IWC) (2013) Report of the Scientific Committee, Annex E. Report of the Standing Working Group (SWG) on the Aboriginal Subsistence Whaling Management Procedure (AWMP). Journal of Cetacean Research and Management 14(Suppl), 137-171.
85. International Whaling Commission (IWC) (2014) Report of the Scientific Committee, Annex D1. Report of the Working Group on the Implementation Review for Western North Pacific Common Minke Whales. Journal of Cetacean Research and Management 15(Suppl), 112-188.
86. Johnston, S.J. and Butterworth, D.S. (2000) Examination of a potential Strike Limit Algorithm for the Bering-Chukchi-Beaufort Seas stock of bowhead whales. Paper SC/52/AWMP6 presented to the IWC Scientific Committee, June 2000, in Adelaide, Australia (unpublished).
87. Johnston, S.J. and Butterworth, D.S. (2005) Evolution of operational management procedures for the South African West Coast rock lobster (Jasus lalandii) fishery. New Zealand Journal of Marine and Freshwater Research 39, 687-702.
88. Johnston, S.J. and Butterworth, D.S. (2013). An operational management procedure for the Tristan da Cunha rock lobster fishery. Document MARAM/TRISTAN/2013/OCT/14, 11 pp. Available at: http://www.mth.uct.ac.za/maram/pub/2013/MARAM_Tristan_2013_OCT_14.pdf (accessed 10 November 2014).
89. Johnston, S.J. and Butterworth, D.S. (2014). Initial OMP candidates for the Inaccessible and Gough island fisheries. Document MARAM/TRISTAN/2014/FEB/03, 33 pp. Available at: http://www.mth.uct.ac.za/maram/pub/2014/FISHERIES_2014_SEP_SWG-SCRL_07.pdf (accessed 10 November 2014).
90. Johnston, S.J., Butterworth, D.S. and Glazer, J.P. (2008) OMP 2008 for the South Coast Rock Lobster Resource. Marine and Coastal Management Report No. MCM/2008/AUG/SWG-SCRL/30, 8 pp. Available at: http://www.mth.uct.ac.za/maram/pub/2008/MCM_2008_AUG_SWG_SCRL_30.pdf (accessed 10 November 2014).
91. Johnston, S.J., Butterworth, D.S. and Glazer, J.P. (2014) South Coast Rock Lobster OMP 2014: Initial Specifications. Department of Agriculture, Forestry and Fisheries Report No. FISHERIES/2014/SEP/SWG-SCRL/07, 14 pp.
92. Kai, M. and Shirakihara, K. (2005) A feedback management procedure based on controlling the size of marine protected areas. Fisheries Science 71, 56-62.
93. Kell, L.T. and Fromentin, J.-M. (2009) A management strategy evaluation framework for Mediterranean Atlantic bluefin tuna. Collective Volume of the Scientific Papers - ICCAT 64, 633-646.
94. Kell, L.T. and Fromentin, J.-M. (2010) Evaluation of the robustness of maximum sustainable yield based management strategies to variation in carrying capacity or migration pattern of Atlantic bluefin tuna (Thunnus thynnus). Canadian Journal of Fisheries and Aquatic Sciences 64, 837-847.
95. Kell, L.T., Pastoors, M.A., Scott, R.D. et al. (2005a) Evaluation of multiple management objectives for Northeast Atlantic flatfish stocks: sustainability vs. stability of yield. ICES Journal of Marine Science 62, 1104-1117.
96. Kell, L.T., Pilling, G.M., Kirkwood, G.P. et al. (2005b) An evaluation of the implicit management procedure used for some ICES roundfish stocks. ICES Journal of Marine Science 62, 750-759.
97. Kell, L.T., Pilling, G.M., Kirkwood, G.P. et al. (2006) An evaluation of multi-annual management strategies for ICES roundfish stocks. ICES Journal of Marine Science 63, 12-24.
98. Kell, L.T., Mosqueira, I., Grosjean, P. et al. (2007) FLR: an open-source framework for the evaluation and development of management strategies. ICES Journal of Marine Science 64, 640-646.
99. Kolody, D., Polacheck, T., Basson, M. and Davies, C. (2008) Salvaged pearls: lessons learned from a floundering attempt to develop a management procedure for Southern Bluefin Tuna. Fisheries Research 94, 339-350.
100. Kraak, S.B.M., Buisman, F.C., Dickey-Collas, M. et al. (2008) The effect of management choices on the sustainability and economic performance of a mixed fishery: a simulation study. ICES Journal of Marine Science 65, 697-712.
101. Kraak, S.B.M., Kelly, C.J., Codling, E.A. and Rogan, E. (2011) On scientists' discomfort in fisheries advisory science: the example of simulation-based fisheries management-strategy evaluations. Fish and Fisheries 11, 119-132.
102. Kraak, S.B.M., Bailey, N., Cardinale, M. et al. (2013) Lessons for fisheries management from the EU cod recovery plan. Marine Policy 37, 200-213.
103. Kurota, H., Hiramatsu, K., Takahashi, N., Shono, H., Itoh, T. and Tsuji, S. (2010) Developing a management procedure robust to uncertainty for southern bluefin tuna: a somewhat frustrating struggle to bridge the gap between ideals and reality. Population Ecology 52, 359-372.
104. Little, L.R., Wayte, S.E., Tuck, G.N. et al. (2011) Development and evaluation of a cpue-based harvest control rule for the southern and eastern scalefish and shark fishery of Australia. ICES Journal of Marine Science 68, 1699-1705.
105. Mapstone, B.D., Little, L.R., Punt, A.E. et al. (2008) Management strategy evaluation for line fishing in the Great Barrier Reef: balancing conservation and multi-sector fishery objectives. Fisheries Research 94, 315-329.
106. Marasco, R.J., Goodman, D., Grimes, C.B., Lawson, P.W., Punt, A.E. and Quinn, T.J. II (2007) Ecosystem Based Fisheries Management: some practical suggestions. Canadian Journal of Fisheries and Aquatic Sciences 64, 928-939.
107. Maunder, M.N. (2014) Management Strategy Evaluation (MSE) implementation in Stock Synthesis: Application to Pacific bluefin tuna. IATTC Document SAC-05-10b. Available at: http://www.iattc.org/Meetings/Meetings2014/MAYSAC/PDFs/SAC-05-10b-Management-Strategy-Evaluation.pdf (accessed 11 November 2014).
108. McClatchie, S., Goericke, R., Auad, G. and Hill, K. (2010) Re-assessment of the stock-recruit and temperature-recruit relationships for Pacific sardine (Sardinops sagax). Canadian Journal of Fisheries and Aquatic Sciences 67, 1782-1790.
109. McGilliard, C.R., Hilborn, R., MacCall, A., Punt, A.E. and Field, J. (2010) Can information from marine Protected Area be used to inform control rule-based management of small-scale, data-poor stocks? ICES Journal of Marine Science 68, 201-211.
110. Merritt, M.F. and Quinn, T.J. II (2000) Using perceptions of data accuracy and empirical weighting of information: assessment of a recreational fish population. Canadian Journal of Fisheries and Aquatic Sciences 57, 1459-1469.
111. Methot, R.D. and Wetzel, C.R. (2013) Stock Synthesis: a biological and statistical framework for fish stock assessment and fishery management. Fisheries Research 142, 86-89.
112. Miller, D.C. and Shelton, P.A. (2010) "Satisficing" and trade-offs: evaluating rebuilding strategies for Greenland halibut off the east coast of Canada. ICES Journal of Marine Science 67, 1896-1902.
113. Milner-Gulland, E.J., Arroyo, B., Bellard, C. et al. (2010) New directions in management strategy evaluation through cross-fertilization between fisheries science and terrestrial conservation. Biology Letters 6, 719-722.
114. de Moor, C.L., Butterworth, D.S. and De Oliveira, J.A.A. (2011) Is the management procedure approach equipped to handle short-lived pelagic species with their boom and bust dynamics? The case of the South African fishery for sardine and anchovy. ICES Journal of Marine Science 68, 2075-2085.
115. Moore, J.E., Curtis, K.A., Lewison, R.L. et al. (2013) Evaluating sustainability of fisheries bycatch mortality for marine megafauna: a review of conservation reference points for data-limited populations. Environmental Conservation 40, 329-344.
116. Mori, M. and Butterworth, D.S. (2006) A first step towards modelling the krill-predator dynamics of the Antarctic ecosystem. CCAMLR Science 13, 217-277.
117. NAFO (2010) Report of the FC Working Group on Greenland Halibut Management Strategy Evaluation (WGMSE), 16-17 September 2010, Halifax, Nova Scotia, Canada. FC Doc 10/30, 60 pp. Available at: http://www.nafo.int/publications/frames/publications.html (accessed 26 June 2014).
118. Parrish, R. (2014) Comments on the Sardine Re-Analysis. Pacific Fishery Management Council, Portland, OR.
119. Pastoors, M.A., Poos, J.J., Kraak, S.B.M. and Machiels, M.A.M. (2007) Validating management simulation models and implications for communicating results to stakeholders. ICES Journal of Marine Science 64, 818-824.
120. Peterman, R.M. (2004) Possible solutions to some challenges facing fisheries scientists and managers. ICES Journal of Marine Science 61, 1331-1343.
121. PFMC (1998) Amendment 8 (to the Northern Anchovy Fishery Management Plan) Incorporating a Name Change To: The Coastal Pelagic Species Fishery Management Plan. Pacific Fishery Management Council, Portland, OR. Appendix B. Available at: http://www.pcouncil.org/wp-content/uploads/a8apdxb.pdf (accessed 26 June 2014).
122. PFMC (2011) Coastal Pelagics Species Fishery Management Plan as Amended Through Amendment 13. Pacific Fishery Management Council, Portland, OR. Available at: http://www.pcouncil.org/wp-content/uploads/CPS_FMP_as_Amended_thru_A13_current.pdf (accessed 26 June 2014).
123. PFMC (2013) Report of the Pacific Sardine Harvest Parameters Workshop. Pacific Fishery Management Council, Portland, OR. Available at: http://www.pcouncil.org/wp-content/uploads/I1b_ATT1_SARDINE_WKSHP_RPT_APR2013BB.pdf (accessed 26 June 2014).
124. Plagányi, É.E. (2007) Models for an ecosystem approach to fisheries. FAO Fisheries Technical Paper 477, 108.
125. Plagányi, É.E., Skewes, T.D., Dowling, N.A. and Haddon, M. (2013) Risk management tools for sustainable fisheries management under changing climate: a sea cucumber example. Climatic Change 119, 181-197.
126. Plagányi, É.E., Punt, A.E., Hillary, R. et al. (2014) Models of intermediate complexity for ecosystem assessment to support tactical management decisions in fisheries and conservation. Fish and Fisheries 15, 1-22.
127. Plagányi, É.E., van Putten, I., Hutton, T. et al. (In press) Integrating indigenous livelihood and lifestyle objectives in managing a natural resource. Proceedings of the National Academy of Sciences.
128. Pomarede, M., Hillary, R., Ibaibarriaga, L., Bogaards, J. and Apostolaki, P. (2010) Evaluating the performance of survey-based operational management procedures. Aquatic Living Resources 23, 77-94.
129. Punt, A.E. (2011) The impact of climate change on the performance of rebuilding strategies for overfished groundfish species of the U.S. west coast. Fisheries Research 109, 320-329.
130. Punt, A.E. and Butterworth, D.S. (1991) On an approach for comparing the implications of alternative fish stock assessments, with application to the stock of Cape Hake, Merluccius spp. off Northern Namibia. South African Journal of Marine Science 10, 219-240.
131. Punt, A.E. and Butterworth, D.S. (1995) The effects of future consumption by the Cape fur seal on catches and catch rates of the Cape hakes. 4. Modelling the biological interaction between Cape fur seals Arctocephalus pusillus pusillus and Cape hakes Merluccius capensis and M. paradoxus. South African Journal of Marine Science 16, 255-285.
132. Punt, A.E. and Donovan, G. (2007) Developing management procedures that are robust to uncertainty: lessons from the International Whaling Commission. ICES Journal of Marine Science 64, 603-612.
133. Punt, A.E. and Hobday, D. (2009) Management strategy evaluation for rock lobster, Jasus edwardsii, off Victoria, Australia: accounting for uncertainty in stock structure. New Zealand Journal of Marine and Freshwater Research 43, 485-509.
134. Punt, A.E. and Ralston, S.V. (2007) A Management Strategy Evaluation of rebuilding revision rules for overfished rockfish species. In: Biology, Assessment and Management of North Pacific Rockfishes (eds J. Heifetz, J. DiCosimo, A.J. Gharrett, M.S. Love, V.M. O'Connell and R.D. Stankey ). Alaska Sea Grant College Program, University of Alaska Fairbanks, Anchorage, pp. 329-351.
135. Punt, A.E., Smith, A.D.M. and Cui, G. (2002) Evaluation of management tools for Australia's South East Fishery. 3. Towards selecting appropriate harvest strategies. Marine and Freshwater Research 53, 645-660.
136. Punt, A.E., Pribac, F., Taylor, B.L. and Walker, T.I. (2005) Harvest strategy evaluation for school and gummy shark. Journal of Northwest Atlantic Fisheries Science 35, 387-406.
137. Punt, A.E., McGarvey, R., Linnane, A., Phillips, J., Triantafillos, L. and Feenstra, J. (2012a) Evaluating empirical decision rules for southern rock lobster fisheries: a South Australian example. Fisheries Research 115-116, 60-71.
138. Punt, A.E., Siddeek, M.S.M., Garber-Yonts, B. et al. (2012b) Evaluating the impact of buffers to account for scientific uncertainty when setting TACs: application to red king crab in Bristol Bay, Alaska. ICES Journal of Marine Science 69, 624-634.
139. Punt, A.E., Trinnie, F., Walker, T.I. et al. (2013) The performance of a management procedure for rock lobsters, Jasus edwardsii, off western Victoria, Australia in the face on non-stationary dynamics. Fisheries Research 137, 116-128.
140. Punt, A.E., A'mar, T., Bond, N.A. et al. (2014) Fisheries management under climate and environmental uncertainty: control rules and performance simulation. ICES Journal of Marine Science 71, 2208-2220.
141. Rademeyer, R.A. and Butterworth, D.S. (2011) Technical details underlying the Management Strategy Evaluation process leading to selection of a management procedure for Western Component (4Xopqrs5) pollock. DFO Canadian Scientific Advisory Secretariat Research Document 2011/nnn.
142. Rademeyer, R.A., Plagányi, É.E. and Butterworth, D.S. (2007) Tips and tricks in designing management procedures. ICES Journal of Marine Science 64, 618-625.
143. Rademeyer, R.A., Butterworth, D.S. and Plagányi, É.E. (2008) A history of recent bases for management and the development of a species-combined Operational Management Procedure for the South African hake resource. African Journal of Marine Science 30, 291-310.
144. Radomski, P., Bence, J.R. and Quinn, T.J. II (2005) Comparison of virtual population analysis and statistical kill-at-age analysis for a recreational, kill-dominated fishery. Canadian Journal of Fisheries and Aquatic Sciences 62, 436-452.
145. Rochet, M.-J. and Rice, J.C. (2009) Simulation-based management strategy evaluation: ignorance disguised as mathematics? ICES Journal of Marine Science 66, 754-762.
146. Rosenberg, A.A. and Brault, S. (1993) Choosing a management strategy for stock rebuilding when control is uncertain. In: Risk Evaluation and Biological Reference Points for Fisheries Management (eds S.J. Smith, J.J. Hunt and D. Rivard ). Canadian Special Publication in Fisheries and Aquatic Sciences 120, 243-249.
147. Rosenberg, A.A. and Restrepo, V.R. (1994) Uncertainty and risk evaluation in stock assessment advice for U.S. fisheries. Canadian Journal of Fisheries and Aquatic Sciences 51, 2715-2720.
148. Sainsbury, K.J., Campbell, R.A.Lindholm.R. and Whitelaw, A.W. (1997) Experimental management of an Australian multispecies trawl fishery: examining the possibility of trawl induced habitat modification. In: Global Trends: Fisheries Management (eds E.L. Pikitch, D.D. Huppert and M.P. Sissenwine ). American Fisheries Society Symposium 20, Bethesda, Maryland, pp. 107-112.
149. Sainsbury, K.J., Punt, A.E. and Smith, A.D.M. (2000) Design of operational management strategies for achieving fishery ecosystem objectives. ICES Journal of Marine Science 57, 731-741.
150. Sampson, D.B. and Yin, Y. (1998) A Monte Carlo evaluation of the Stock Synthesis assessment program. In: Fishery Stock Assessment Models (eds F. Funk, T.J. Quinn II, J. Hiefetz, J.N. Ianelli, J.E. Powers, J.F. Schweigert, P.J. Sullivan and C.-I. Zhang ). Alaska Sea Grant College Program Report No. AK-SG-98-01, pp. 315-318.
151. Schweder, T., Hagen, G.S. and Hatlebakk, E. (1998) On the effect on cod and herring fisheries of retuning the Revised Management Procedure for minke whaling in the greater Barents Sea. Fisheries Research 37, 77-95.
152. Smith, A.D.M. (1994) Management strategy evaluation - The light on the hill. In: Population Dynamics for Fisheries Management, Australian Society for Fish Biology Workshop Proceedings, Perth 24-25 August 1993 (ed. D.A. Hancock ). Australian Society for Fish Biology, Perth, pp. 249-253.
153. Smith, A.D.M., Sainsbury, K.J. and Stevens, R.A. (1999) Implementing effective fisheries-management systems - management strategy evaluation and the Australian partnership approach. ICES Journal of Marine Science 56, 967-979.
154. Smith, A.D.M., Fulton, E.J., Hobday, A.J., Smith, D.C. and Shoulder, P. (2007) Scientific tools to support the practical implementation of ecosystem-based fisheries management. ICES Journal of Marine Science 64, 633-639.
155. Soutar, A. and Isaacs, J.D. (1969) History of fish populations inferred from fish scales in anaerobic sediments off California. CalCOFI Reports 13, 63-70.
156. Soutar, A. and Isaacs, J.D. (1974) Abundance of pelagic fish during the 19th and 20th Centuries as recorded in anaerobic sediment off the Californias. Fishery Bulletin 72, 257-273.
157. Starr, P.J., Breen, P.A., Hilborn, R.H. and Kendrick, T.H. (1997) Evaluation of a management decision rule for a New Zealand rock lobster substock. Marine and Freshwater Research 48, 1093-1101.
158. STECF. (2011a) Impact Assessment of Baltic cod multi-annual plans (STECF 11-05) (ed. J. Simmonds). EUR 24899 EN-2011, 231 pp.
159. STECF. (2011b) Evaluation of multi-annual plans for cod in Irish Sea, Kattegat, North Sea, and West of Scotland (STECF-11-07) (eds J. Simmonds and S. Kraak). EUR 24901 EN-2011, 358 pp.
160. Szuwalski, C. and Punt, A.E. (2013) Fisheries management for regime-based ecosystems: a management strategy evaluation for the snow crab fishery in the eastern Bering Sea. ICES Journal of Marine Science 70, 955-967.
161. Tuck, G.N. (2011) Are bycatch rates sufficient as the principal fishery performance measure and method of assessment for seabirds? Aquatic Conservation: Marine and Freshwater Ecosystems 21, 412-422.
162. Ulrich, C., Andersen, B.S., Sparre, P.J. and Nielsen, J.R. (2007) TEMAS: fleet-based bioeconomic simulation software to evaluate management strategies accounting for fleet behaviour. ICES Journal of Marine Science 64, 647-651.
163. Wade, P.R. (1998) Calculating limits to the allowable human-caused mortality of cetaceans and pinnipeds. Marine Mammal Science 14, 1-37.
164. Walters, C.J. (1986) Adaptive Management of Renewable Resources. Macmillan, New York.
165. Walters, C.J. (1994) Use of gaming procedures in evaluation of management experiments. Canadian Journal of Fisheries and Aquatic Sciences 51, 2705-2714.
166. Wayte, S.E. (2011) Management implications of including a climate-induced recruitment shift in the stock assessment for jackass morwong (Nemadactylus macropterus) in south-eastern Australia. Fisheries Research 142, 47-55.
167. Wayte, S.E. and Klaer, N.L. (2010) An effective harvest strategy using improved catch-curves. Fisheries Research 106, 310-320.
168. Wiedenmann, J., Wilberg, M.J. and Miller, T.J. (2013) An evaluation of harvest control rules for data-poor fisheries. North American Journal of Fisheries Management 33, 845-860.
169. Wilson, J.R., Prince, J.D. and Lenihan, H.S. (2010) A management strategy for sedentary nearshore species that uses Marine Protected Areas as a reference. Marine and Coastal Fisheries: Dynamics, Management, and Ecosystem Science 2, 14-27.