Can we trust best practices? Six cognitive challenges of evidence-based approaches

Journal of Cognitive Engineering and Decision Making

Volumn 10, Issue 3, 2016, Pages 244-254

  Klein, Devorah E ^a   Woods, David D ^b   Klein, Gary ^c   Perry, Shawna J ^d  

^a Marimo Consulting LLC   (United States)

^b OHIO STATE UNIVERSITY   (United States)

^c MacroCognition LLC   (United States)

^d UNIVERSITY OF FLORIDA   (United States)

Author keywords

decision making; evidence based medicine; expertise; quality; safety; training

Indexed keywords

ACCIDENT PREVENTION; DECISION MAKING; IMAGE QUALITY; PERSONNEL TRAINING;

BEST PRACTICES; DATA DRIVEN; EVIDENCE-BASED; EVIDENCE-BASED MEDICINE; EXPERTISE; PATIENT SAFETY;

BEHAVIORAL RESEARCH;

DECISION MAKING; HUMAN; MEDICINE; PATIENT SAFETY; TRUST;

EID: 84978976000     PISSN: 15553434     EISSN: 21695032     Source Type: Journal    
DOI: 10.1177/1555343416637520     Document Type: Conference Paper

References (50)

1. Abbott K., McKenney D., Railsback P., (2013). Operational use of flight path management systems. Retrieved from http://www.faa.gov/about/office-org/headquarters-offices/avs/offices/afs/afs400/parc/parc-reco/media/2013/130908-PARC-FltDAWG-Final-Report-Recommendations.pdf
2. Amalberti R., (2013). Navigating safety: Necessary compromises and tradeoffs, theory and practice. Dordrecht, Netherlands: Springer-Verlag.
3. Brehmer B., (1987). Development of mental models for decision in technological systems. In Rasmussen J., Duncan K., Leplat J., (Eds.), New technology and human error (pp. 111-120). Chichester, UK: Wiley.
4. Brehmer B., (1992). Dynamic decision making: Human control of complex systems. Acta Psychologica, 81, 211-241.
5. Chase W. G., Simon H. A., (1973). Perception in chess. Cognitive Psychology, 4, 55-81.
6. Chatterjee T., (2015). Out of the darkness. Science, 350, 372-375.
7. Cook R. I., (2006). Being bumpable: Consequences of resource saturation and near-saturation for cognitive demands on ICU practitioners. In Woods D. D., Hollnagel E., (Eds.), Joint cognitive systems: Patterns in cognitive systems engineering (pp. 23-35). Boca Raton, FL: CRC Press.
8. Cook R. I., Render M. L., Woods D. D., (2000). Gaps in the continuity of care and progress on patient safety. British Medical Journal, 320, 791-794.
9. DeAnda A., Gaba D., (1991). The role of experience in the response to simulated critical incidents. Anesthesia and Analgesia, 72, 308-315.
10. Delis D., (2014, 31). Cognitive assessment leaps into the digital age. ESchool News. Retrieved from http://www.eschoolnews.com/2014/10/31/cognitive-assessment-digital-429/
11. Denrell J., (2003). Vicarious learning, undersampling of failure, and the myths of management. Organization Science, 14, 228-243.
12. Denrell J., Fang C., (2010). Predicting the next big thing: Success as a signal of poor judgment. Management Science, 56, 1653-1667.
13. Ericsson K. A., (2004). Deliberate practice and the acquisition and maintenance of expert performance in medicine and related domains. Academic Medicine, 10, S70-S81.
14. Ericsson K. A., Charness N., Feltovich P. J., Hoffman R. R., (Eds.). (2006). The Cambridge handbook of expertise and expert performance. Cambridge, UK: Cambridge University Press.
15. Gaba D., Maxwell M., DeAnda A., (1987). Anesthetic mishaps: Breaking the chain of accident evolution. Anesthesiology, 66, 670-676.
16. Ghaffarzadegan N., Epstein A. J., Martin E. G., (2013). Practice variation, bias, and experiential learning in Cesarean delivery: A data-based system dynamics approach. Health Services Research, 48, 713-734.
17. Gigerenzer G., (2002). Calculated risks: How to know when numbers deceive you. New York, NY: Simon & Schuster.
18. Gray J. A. M., (1996). Evidence-based healthcare. London, UK: Churchill Livingstone.
19. Hoffman R. R., Ward P., Feltovich P. J., DiBello L., Fiore S. M., Andrews D. H., (2014). Accelerated expertise: Training for high proficiency in a complex world. New York, NY: Psychology Press.
20. Hollnagel E., Woods D. D., Leveson N., (2006). Resilience engineering: Concepts and precepts. Farnham, UK: Ashgate.
21. Kahneman D., Klein G. A., (2009). Conditions for intuitive expertise: A failure to disagree. American Psychologist, 64, 515-526.
22. Kaiser J., (2015). The cancer test: A nonprofit's effort to replicate 50 top cancer papers is shaking up labs. Science, 348, 1411-1413.
23. Klein D. E., (2009). The forest and the trees: An integrated approach to designing adherence interventions. Australasian Medical Journal, 1, 181-184.
24. Klein G., (1998). Sources of power: How people make decisions. Cambridge, MA: MIT Press.
25. Klein G., (2005). The power of intuition. New York, NY: Currency/Doubleday.
26. Klein G., (2007a). Flexecution as a paradigm for replanning, Part 1. IEEE Intelligent Systems, 22, 79-83.
27. Klein G., (2007b). Flexecution, Part 2: Understanding and supporting flexible execution. IEEE Intelligent Systems, 22, 108-112.
28. Klein G., (2009). Streetlights and shadows: Searching for the keys to adaptive decision making. Cambridge, MA: MIT Press.
29. Klein G., Borders J., (in press). The ShadowBox approach to cognitive skills training: An empirical evaluation. Journal of Cognitive Decision Making.
30. Klein G., Pliske R., Crandall B., Woods D., (2005). Problem detection. Cognition, Technology, and Work, 7, 14-28.
31. Kylesten B., (2013). Dynamic decision-making on an operative level: A model including preconditions and working method. Cognitive Technology & Work, 15, 197-205.
32. Marshall B. J., (2005,). Helicobacter connections. Nobel lecture, Stockholm, Sweden.
33. Nemeth C., O'Connor M., Klock P. A., Cook R., (2006). Discovering healthcare cognition: The use of cognitive artifacts to reveal cognitive work. Organization Studies, 27, 1011-1035.
34. O'Sullivan G. C., (2010). Advancing surgical research in a sea of complexity. Annals of Surgery, 252, 711-714.
35. Pascale R., Sternin J., (2010). The power of positive deviance: How unlikely innovators solve the world's toughest problems. Boston, MA: Harvard Business Review Press.
36. Perry S. J., Wears R. L., (2011). Large scale coordination of work: Coping with complex chaos within healthcare. In Mosier K. L., Fisher U., (Eds.), Informed by knowledge: Expert performance in complex situations (pp. 55-59). New York, NY: Taylor & Francis.
37. Pronovost P., Needham D., Berenholtz S., Sinopoli D., Chu H., Cosgrove S., Sexton B., Hyzy R., Welsh R., Roth G., Bander J., Kepros J., Goeschel C., (2006). An intervention to decrease catheter-related bloodstream infections in the ICU. New England Journal of Medicine, 355, 2725-2732.
38. Rittel H. W. J., Weber M. M., (1973). Dilemmas in a general theory of planning. Policy Sciences, 4, 155-169.
39. Roberts A. R., Yeager K. R., (Eds.), (2004). Evidence-based practice manual: Research and outcome measures in health and human services. New York, NY: Oxford University Press.
40. Rudolph J. W., Morrison J. B., Carroll J. S., (2009). The dynamics of action-oriented problem solving: Linking interpretation and choice. Academy of Management Review, 34, 733-756.
41. Staszewski J., (2004). Models of expertise as blueprints for cognitive engineering: Applications to landmine detection. In Proceedings of the Human Factors and Ergonomics Society 48th Annual Meeting (pp. 458-462). Santa Monica, CA: Human Factors and Ergonomics Society.
42. Suchman L. A., (1987). Plans and situated actions: The problem of human-machine communication. Cambridge, UK: Cambridge University Press.
43. Timmermans S., Berg M., (2003). The gold standard: The challenge of evidence-based medicine and standardization in healthcare. Philadelphia, PA: Temple University Press.
44. Wears R. L., Hunte G. S., (2014). Seeing patient safety "like a state." Safety Science, 67, 50-57.
45. Wears R. L., Schubert C. C., (2015). Visualizing expertise in context. Annals of Emergency Medicine. Advance online publication. doi: 10.1016/j.annemergmed.2015.11.027
46. Woods D. D., (1994). Cognitive demands and activities in dynamic fault management. In Stanton N., (Ed.), Human factors in alarm design (pp. 63-92). London, UK: Taylor & Francis.
47. Woods D. D., (2005). Creating foresight: Lessons for resilience from. Columbia. In Starbuck W. H., Farjoun M., (Eds.), Organization at the limit: NASA and the Columbia disaster (pp. 289-308). Malden, MA: Blackwell.
48. Woods D. D., Hollnagel E., (2006). Joint cognitive systems: Patterns in cognitive systems engineering. Boca Raton, FL: Taylor & Francis.
49. Woods D. D., Roth E. M., Bennett K. B., (1990). Explorations in joint human-machine cognitive systems. In Robertson S., Zachary W., Black J., (Eds.), Cognition, computing and cooperation (pp. 123-158). Norwood, NJ: Ablex.
50. Zelik D., Patterson E. S., Woods D. D., (2010). Measuring attributes of rigor in information analysis. In Patterson E. S., Miller J., (Eds.), Macrocognition metrics and scenarios: Design and evaluation for real-world teams (pp. 65-83). Aldershot, UK: Ashgate.