A method for eliciting, preserving, and sharing the knowledge of forecasters

Weather and Forecasting

Volumn 21, Issue 3, 2006, Pages 416-428

  Hoffman, Robert R ^a   Coffey, John W ^a   Ford, Kenneth M ^a   Novak, Joseph D ^a  

^a INSTITUTE FOR HUMAN AND MACHINE COGNITION   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DATA REDUCTION; KNOWLEDGE ACQUISITION; KNOWLEDGE BASED SYSTEMS; KNOWLEDGE REPRESENTATION; LEARNING SYSTEMS;

FORECASTERS; KNOWLEDGE CAPTURE; KNOWLEDGE PRESERVATION; WEATHER CONCEPTS;

WEATHER FORECASTING;

COASTAL ZONE; DATA PROCESSING; MAPPING; NUMERICAL MODEL; REMOTE SENSING; WEATHER FORECASTING;

GULF COAST [UNITED STATES]; NORTH AMERICA; UNITED STATES;

MERLANGIUS MERLANGUS;

EID: 33745858330     PISSN: 08828156     EISSN: None     Source Type: Journal    
DOI: 10.1175/WAF927.1     Document Type: Article

References (56)

1. Ausubel, D. P., 1960: The use of advance organizers in the learning and retention of meaningful verbal material. J. Educ. Psychol., 51, 267-272.
2. Ausubel, D. P., J. D. Novak, and H. Hanesian, 1978: Educational Psychology: A Cognitive View. 2d ed. Holt, Rinehart and Winston, 733 pp.
3. Ballas, J., 2006: Human centered computing for tactical weather forecasting: An example of the "moving target rule." Expertise out of Context, R. Hoffman, Ed., Erlbaum, in press.
4. Bosart, L. F., 2003: Whither the weather analysis forecasting process? Wea. Forecasting, 18, 520-529.
5. Briggs, G., D. A. Shamma, A. J. Cañas, R. Carff, J. Scargle, and J. D. Novak, 2004: Concept Maps applied to Mars exploration public outreach. Concept Maps: Theory, Methodology, Technology: Proc. First Int. Conf. on Concept Mapping, Pamplona, Spain, Universidad Pública de Navarra, 109-116. [Available online at http:// cmc.ihmc.us/CMC2004Programa.html.]
6. Brooking, A., 1999: Corporate Memory: Strategies for Knowledge Management International Thomson Business Press, 181 pp.
7. Cañas, A. J., J. W. Coffey, M. J. Carnot, P. Feltovich, R. Hoffman, J. Feltovich, and J. D. Novak, 2003: A summary of literature pertaining to the use of concept mapping techniques and technologies for education and performance support. Report prepared for the Chief of Naval Education and Training, Florida Institute for Human and Machine Cognition, Pensacola, FL, 108 pp. [Available online at http:// www.ihmc.us/users/acanas/Publications/ConceptMapLitReview/ IHMC%20Literature%20Review%20on%20Concept%20Mapping.pdf.]
8. Cañas, A. J., and Coauthors, 2004: CmapTools: A knowledge modeling and sharing environment. Concept Maps: Theory, Methodology, Technology: Proc. First Int. Conf. on Concept Mapping, Pamplona, Spain, Universidad Pública de Navarra, 125-134. [Available online at http:// cmc.ihmc.us/CMC2004Programa.html.]
9. Chase, W. G., and H. A. Simon, 1973: Perception in chess. Cognit. Psychol., 5, 55-81.
10. Coffey, J. W., and R. R. Hoffman, 2003: Knowledge modeling for the preservation of institutional memory. J. Knowl. Manage., 7, 38-52.
11. Coffey, J. W., A. J. Cañas, T. Reichherzer, G. Hill, N. Suri, R. Carff, T. Mitrovich, and D. Eberle, 2003: Knowledge modeling and the creation of El-Tech: Performance support and training system for electronic technicians. Expert Syst. Appl., 25, 483-492.
12. Cooke, N. M., and J. E. McDonald, 1987: The application of psychological scaling techniques to knowledge elicitation for knowledge-based systems. Int. J. Man Mach. Stud., 26, 533-550.
13. Crandall, B., G. Klein, and R. R. Hoffman, 2006: Working Minds: A Practitioner's Guide to Cognitive Task Analysis. MIT Press, in press.
14. Cullen, J., and A. Bryman, 1988: The knowledge acquisition bottleneck: Time for a reassessment? Expert Syst., 5, 216-255.
15. Dodson, D. C., 1989: Interaction with knowledge systems through connection diagrams: Please adjust your diagrams. Research and Development in Expert Systems V, B. Kelly and A. L. Rector, Eds., Cambridge University Press, 35-46.
16. Dorsey, D. W., G. E. Campbell, L. L. Foster, and D. E. Miles, 1999: Assessing knowledge structures: Relations with experience and posttraining performance. Human Performance, 12, 31-57.
17. Doswell, C. A., III, 2004: Weather forecasting by humans - Heuristics and decision making. Wea. Forecasting, 19, 1115-1126.
18. Ericsson, K. A., and H. Simon, 1984: Protocol Analysis: Verbal Reports as Data. The MIT Press, 443 pp.
19. Ericsson, K. A., N. Charness, P. Feltovich, and R. R. Hoffman, Eds., 2006: The Cambridge Handbook of Expertise and Expert Performance. Cambridge University Press, in press.
20. Feltovich, P. J., and K. A. Ford, and R. R. Hoffman, Eds., 1997: Expertise in Context. The MIT Press, 590 pp.
21. Ford, K. M., J. W. Coffey, A. J. Cañas, E. J. Andrews, and C. W. Turne, 1996: Diagnosis and explanation by a nuclear cardiology expert system. Int. J. Expert Syst., 9, 499-506.
22. Gaines, B., and M. Shaw, 1995: Concept Maps as hypermedia components. Int. J. Hum. Comput. Stud., 43, 323-361.
23. Gilbreth, F. B., 1911: Motion Study. Van Nostrand, 116 pp.
24. Glaser, R., 1987: Thoughts on expertise. Cognitive Functioning and Social Structure over the Life Course, C. Schooler and W. Schaie, Eds., Ablex, 81-94.
25. Glasgow, J., N. H. Narayanan, and B. Chandrasekaran, Eds., 1995: Diagrammatic Reasoning: Cognitive and Computational Perspectives. The MIT Press, 780 pp.
26. Gordon, J. L., 2000: Creating knowledge maps by exploiting dependent relationships. Knowl.-Based Syst., 13, 71-79.
27. Gordon, S. E., K. A. Schmierer, and R. T. Gill, 1993: Conceptual graph analysis: Knowledge acquisition for instructional systems design. Hum. Factors, 35, 459-481.
28. Hanes, L. F., and M. M. Gross, 2002: Capturing valuable undocumented knowledge: Lessons learned at electric utility sites. Seventh Conf. on Human Factors and Power Plants, Scottsdale, AZ, IEEE, 6-25.
29. Hoffman, R. R., 1987: The problem of extracting the knowledge of experts from the perspective of experimental psychology. AI Mag., 8 (2), 53-67.
30. Hoffman, R. R., 1991: Human factors psychology in the support of forecasting: The design of advanced meteorological workstations. Wea. Forecasting, 6, 98-110.
31. Hoffman, R. R., 1998: How can expertise be defined?: Implications of research from cognitive psychology. Exploring Expertise, R. Williams, W. Faulkner, and J. Fleck, Eds., Macmillan, 81-100.
32. Hoffman, R. R., and J. A. Conway, 1990: Psychological factors in remote sensing: A review of recent research. Geocarto Int., 4, 3-22.
33. Hoffman, R. R., and D. D. Woods, 2000: Studying cognitive systems in context. Hum. Factors, 42, 1-7.
34. Hoffman, R. R., and L. F. Hanes, 2003: The boiled frog problem. IEEE Intell. Syst., 18 (4), 68-71.
35. Hoffman, R. R., M. A. Detweiler, K. Lipton, and J. A. Conway, 1993: Considerations in the use of color in meteorological displays. Wea. Forecasting, 8, 505-518.
36. Hoffman, R. R., N. Shadbolt, A. M. Burton, and G. Klein, 1995: Eliciting knowledge from experts: A methodological analysis. Organ. Behav. Hum. Decis. Processes, 62, 129-158.
37. Hoffman, R. R., B. Crandall, and N. Shadbolt, 1998: A case study in cognitive task analysis methodology: The critical decision method for the elicitation of expert knowledge. Hum. Factors, 40, 254-276.
38. Hoffman, R. R., J. W. Coffey, and K. M. Ford, 2000: A case study in the research paradigm of Human-Centered Computing: Local expertise in weather forecasting. Rep. to the National Technology Alliance, Florida Institute for Human and Machine Cognition, Pensacola, FL, 827 pp.
39. Hoffman, R. R., J. W. Coffey, M. J. Carnot, and J. D. Novak, 2002: An empirical comparison of methods for eliciting and modeling expert knowledge. Proc. 46th Meeting of the Human Factors and Ergonomics Society, Baltimore, MD, Human Factors and Ergonomics Society, 482-486.
40. Hoffman, R. R., J. W. Coffey, J. D. Novak, and A. J. Cañas, 2005: Applications of concept maps to web design and web work. Handbook of Human Factors in Web Design, R. W. Proctor and K.-P. L. Vu, Eds., Erlbaum, 157-175.
41. Klein, G., 1992: Using knowledge engineering to preserve corporate memory. The Psychology of Expertise: Cognitive Research and Empirical AI, R. R. Hoffman, Ed., Erlbaum, 170-190.
42. Mandl, H., and J. R. Levin, Eds., 1989: Knowledge Acquisition from Text and Pictures. Elsevier, 329 pp.
43. McGraw, K., and M. R. Seale, 1988: Knowledge elicitation with multiple experts: Considerations and techniques. Artificial Intell. Rev., 2, 31-44.
44. McNeese, M. D., B. S. Zaff, C. E. Brown, and M. Citera, 1993: Understanding the context of multidisciplinary design: Establishing ecological validity in the study of design problem solving. Proc. 37th Annual Meeting, Seattle, WA, Human Factors and Ergonomics Society, 1082-1086.
45. Mostek, A., and Coauthors, 2004: VISIT: Bringing training to Weather Service forecasters using a new distance-learning tool. Bull. Amer. Meteor. Soc., 85, 823-829.
46. Novak, J. D., 1998: Learning, Creating, and Using Knowledge. Erlbaum, 264 pp.
47. O'Dell, C., and C. J. Grayson, 1998: If We Only Knew What We Know: The Transfer of Internal Knowledge and Best Practice. The Free Press, 238 pp.
48. Pliske, R., B. Crandall, and G. Klein, 2004: Competence in weather forecasting. Psychological Investigations of Competent Decision Making, K. Smith, J. Shanteau, and P. Johnson, Eds., Cambridge University Press, 40-70.
49. Roebber, P. J., 1998: The regime dependence of degree day forecast technique, skill, and value. Wea. Forecasting, 13, 783-794.
50. Roth, E. M., 2004: Applying cognitive engineering to meteorological forecasting: From analysis of expertise to human-centered design. Proc. 48th Annual Meeting, New Orleans, LA, Human Factors and Ergonomics Society, 305-310.
51. Scott, R., E. M. Roth, S. E. Deutsch, E. Malchiodi, T. E. Kazmierczak, R. G. Eggleston, S. R. Kuper, and R. D. Whittaker, 2005: Work-centered support systems: A human-centered approach to intelligent system design. IEEE Intell. Syst., 20 (2), 73-81.
52. Stein, E. W., 1997: A look at expertise from a social perspective. Expertise in Context, P. J. Feltovich, K. M. Ford, and R. R. Hoffman, Eds., The MIT Press, 181-194.
53. Stephenson, D. B., 2000: Use of the "odds ratio" for diagnosing forecast skill. Wea. Forecasting, 15, 221-232.
54. Sutcliffe, A. G., 1985: Use of conceptual maps as human-computer interfaces. People and Computers: Designing the Interface, P. Johnson and S. Cook, Eds., Cambridge University Press, 117-127.
55. Vekirl, I., 2002: What is the value of graphical displays in learning? Educ. Psychol. Rev., 14, 261-298.
56. Vicente, K., 1999: Cognitive Work Analysis: Toward Safe, Productive, and Healthy Computer-Based Work. Erlbaum, 392 pp.