Improving visual estimation through active feedback

Methods in Ecology and Evolution

Volumn 4, Issue 1, 2013, Pages 53-62

  Wintle, Bonnie C ^a   Fidler, Fiona ^a   Vesk, Peter A ^a   Moore, Joslin L ^a  

^a UNIVERSITY OF MELBOURNE   (Australia)

Author keywords

Calibration feedback; Cover estimation; Expert judgement; Interval; Overconfidence; Species abundance; Uncertainty; Wisdom of Crowds

Indexed keywords

EID: 84872939205     PISSN: None     EISSN: 2041210X     Source Type: Journal    
DOI: 10.1111/j.2041-210x.2012.00254.x     Document Type: Article

References (44)

1. Andujar, D., Ribeiro, A., Carmona, R., Fernandez-Quintanilla, C. & Dorado, J. (2010) An assessment of the accuracy and consistency of human perception of weed cover. Weed Research, 50, 638-647.
2. Balzer, W.K., Doherty, M.E. & O'Connor, R. (1989) Effects of cognitive feedback on performance. Psychological Bulletin, 106, 410-433.
3. Bedford, T. & Cooke, R.M. (2001) Mathematical Tools for Probabilistic Risk Analysis. Cambridge University Press, Cambridge.
4. Benson, P.G. & Önkal, D. (1992) The effects of feedback and training on the performance of probability forecasters. International Journal of Forecasting, 8, 559-573.
5. Bolger, F. & Önkal-Atay, D. (2004) The effects of feedback on judgmental interval predictions. International Journal of Forecasting, 20, 29-39.
6. Bråkenhielm, S. & Liu, Q. (1995) Comparison of field methods in vegetation monitoring. Water, Air & Soil Pollution, 79, 75-87.
7. Brehmer, B. (1980) In one word: not from experience. Acta Psychologica, 45, 223-241.
8. Burgman, M.A., McBride, M., Ashton, R., Speirs-Bridge, A., Flander, L., Wintle, B., Fidler, F., Rumpff, L. & Twardy, C. (2011) Expert status and performance. PLoS ONE, 6, e22998.
9. Cheal, D. (2008) Repeatability of cover estimates? Ecological Management & Restoration, 9, 67-68.
10. Cropper, S. (2009) Results of the EcoRambling's area estimation challenge. EcoRamblings, 8, 1-6.
11. Daubenmire, R. (1959) A canopy-coverage method of vegetational analysis. Northwest Science, 4, 3-64.
12. Elzinga, C.L., Salzer, D.W. & Willoughby, J.W. (1999) Measuring and Monitoring Plant Populations (BLM Technical Reference 1730-1). Bureau of Land Management, Denver, Co.
13. Fidler, F., Thomason, N., Cumming, G., Finch, S. & Leeman, J. (2005) Still much to learn about confidence intervals. Reply to Rouder and Morey. Psychological Science, 16, 494-495.
14. Fischer, G.W. (1982) Scoring-rule feedback and the overconfidence syndrome in subjective probability forecasting. Organizational Behavior & Human Performance, 29, 352-369.
15. Floyd, D.A. & Anderson, J.E. (1987) A comparison of three methods for estimating plant cover. Journal of Ecology, 75, 221.
16. Galton, F. (1907) Vox populi. Nature, 75, 450-451.
17. González-Vallejo, C. & Bonham, A. (2007) Aligning confidence with accuracy: revisiting the role of feedback. Acta Psychologica, 125, 221-239.
18. Gorrod, E.J. & Keith, D.A. (2009) Observer variation in field assessments of vegetation condition: Implications for biodiversity conservation. Ecological Management & Restoration, 10, 31-40.
19. van Hees, W. & Mead, B.R. (2000) Ocular estimates of understory vegetation structure in a closed Picea glauca/Betula papyrifera forest. Journal of Vegetation Science, 11, 195-200.
20. Helm, D.J. & Mead, B.R. (2004) Reproducibility of vegetation cover estimates in south-central Alaska forests. Journal of Vegetation Science, 15, 33-40.
21. Herzog, S.M. & Hertwig, R. (2009) The wisdom of many in one mind: improving individual judgments with dialectical bootstrapping. Psychological Science, 20, 231-237.
22. Hope-Simpson, J.F. (1940) On the errors in the ordinary use of subjective frequency estimations in grassland. Journal of Ecology, 28, 193-209.
23. Jacoby, J., Troutman, T., Mazursky, D. & Kuss, A. (1984) When feedback is ignored - disutility of outcome feedback. Journal of Applied Psychology, 69, 531-545.
24. Kahneman, D., Slovic, P. & Tversky, A.. (1982) Judgment Under Uncertainty: Heuristics and Biases. Cambridge University Press, New York.
25. Kennedy, K.A. & Addison, P.A. (1987) Some Considerations for the Use of Visual Estimates of Plant Cover in Biomonitoring. The Journal of Ecology, 75, 151-157.
26. Klimeš, L. (2003) Scale-dependent variation in visual estimates of grassland plant cover. Journal of Vegetation Science, 14, 815-821.
27. Kopelman, R.E.. (1986) Objective feedback. Generalizing From Laboratory to Field Settings (ed. E.A. Locke), pp. 119-145. Lexington Books, Lexington, MA.
28. Latham, G.P. & Locke, E.A. (1991) Self-regulation through goal setting. Organizational Behavior and Human Decision Processes, 50, 212-247.
29. Lichtenstein, S. & Fischhoff, B. (1980) Training for calibration. Organizational Behavior and Human Performance, 26, 149-171.
30. McBride, M.F., Garnett, S.T., Szabo, J.K., Burbidge, A.H., Butchart, S.H.M., Christidis, L., Dutson, G., Ford, H.A., Loyn, R.H., Watson, D.M. & Burgman, M.A. (2012) Structured elicitation of expert judgments for threatened species assessment: a case study on a continental scale using email. Methods in Ecology and Evolution, doi: 10.1111/j.2041-210X.2012.00221.x
31. Mueller-Dombois, D. & Ellenberg, H. (1974) Aims and Methods of Vegetation Ecology. Wiley, New York.
32. Newell, B.R., Weston, N.J., Tunney, R.J. & Shanks, D.R. (2009) The effectiveness of feedback in multiple-cue probability learning. Quarterly Journal Of Experimental Psychology, 62, 890-908.
33. Parkes, D., Newell, G. & Cheal, D. (2003) Assessing the quality of native vegetation: the 'Habitat Hectares' approach. Ecological Management & Restoration, 4, S29-S38.
34. Smith, A. (1944) A study of the reliability of range vegetation estimates. Ecology, 25, 441-448.
35. Soll, J.B. & Klayman, J. (2004) Overconfidence in interval estimates. Journal of Experimental Psychology: Learning Memory and Cognition, 30, 299-314.
36. Soll, J.B. & Larrick, R.P. (2009) Strategies for revising judgment: how (and how well) people use others' opinions. Journal of Experimental Psychology: Learning, Memory, and Cognition, 35, 780-805.
37. Speirs-Bridge, A., Fidler, F., McBride, M., Flander, L., Cumming, G. & Burgman, M. (2010) Reducing overconfidence in the interval judgments of experts. Risk Analysis, 30, 512-523.
38. Surowiecki, J.. (2005) The Wisdom of Crowds: Why the Many are Smarter Than the Few. Abacus, London.
39. Sweller, J. (1988) Cognitive load during problem solving: effects on learning. Cognitive Science, 12, 257-285.
40. Sykes, J.M., Horrill, A.D. & Mountford, M.D. (1983) Use of visual cover assessments as quantitative estimators of some British woodland taxa. Journal of Ecology, 71, 437.
41. Symstad, A.J., Wienk, C.L. & Thorstenson, A.D. (2008) Precision, repeatability, and efficiency of two canopy-cover estimate methods in northern Great Plains vegetation. Rangeland Ecology & Management, 61, 419-429.
42. Teigen, K.H. & Jørgensen, M. (2005) When 90% confidence intervals are 50% certain: on the credibility of credible intervals. Applied Cognitive Psychology, 19, 455-475.
43. Todd, F.J. & Hammond, K.R. (1965) Differential effects in two multiple-cue probability learning tasks. Behavioral Science, 10, 429-435.
44. Vittoz, P., Bayfield, N., Brooker, R., Elston, D.A., Duff, E.I., Theurillat, J.P. & Guisan, A. (2010) Reproducibility of species lists, visual cover estimates and frequency methods for recording high-mountain vegetation. Journal of Vegetation Science, 21, 1035-1047.