Unreliable numbers: Error and harm induced by bad design can be reduced by better design

Journal of the Royal Society Interface

Volumn 12, Issue 110, 2015, Pages

  Thimbleby, Harold ^a   Oladimeji, Patrick ^a   Cairns, Paul ^b  

^a SWANSEA UNIVERSITY   (United Kingdom)

^b UNIVERSITY OF YORK   (United Kingdom)

Author keywords

Dependable systems; Evaluating user interfaces; Human error; Number entry

Indexed keywords

DESIGN; ERRORS; USER INTERFACES;

DEPENDABLE SYSTEMS; DESIGN SYSTEMS; ENTRY SYSTEM; EVALUATING USER INTERFACES; HUMAN ERRORS; MISSION CRITICAL; NOVEL DESIGN; NUMBER ENTRY;

MONTE CARLO METHODS;

ACCIDENT; ARTICLE; AWARENESS; BEHAVIOR; COMPUTER SYSTEM; CONTROLLED STUDY; DEVICE SAFETY; EYE TRACKING; FRAUD; HUMAN; HUMAN EXPERIMENT; INFUSION PUMP; LINEAR REGRESSION ANALYSIS; MEASUREMENT ERROR; MEDICAL DEVICE; MENTAL FUNCTION; MONTE CARLO METHOD; MOTIVATION; OPERATOR; ORGANIZATIONAL STRUCTURE; REVERSE ENGINEERING; RISK ASSESSMENT; SCIENCE; STATISTICAL ANALYSIS; STUDY DESIGN; THEORETICAL MODEL;

HUMANS; MODELS, THEORETICAL; MONTE CARLO METHOD;

EID: 84942049207     PISSN: 17425689     EISSN: 17425662     Source Type: Journal    
DOI: 10.1098/rsif.2015.0685     Document Type: Article

References (51)

1. Feynman RP. 2005 The pleasure of finding things out: The best short works of Richard P. Feynman. New York, NY: Basic Books.
2. Oladimeji P, Thimbleby H, Cox A. 2011 Number entry interfaces and their effects on error detection. In Human-computer interaction- INTERACT 2001 (eds P Campos et al.). Lecture Notes in Computer Science, vol. 6949, pp. 178-185. Berlin, Germany: Springer.
3. Thimbleby H. 2015 Safer user interfaces: A case study in improving number entry. IEEE Trans. Software Eng. 41, 711-729. (doi:10.1109/TSE.2014.2383396).
4. Masci P, Zhang Y, Jones P, Curzon P, Thimbleby H. 2014 Formal verification of medical device user interfaces using PVS. In Fundamental approaches to software engineering (eds S Gnesi, A Rensink). Lecture Notes in Computer Science, vol. 8411, pp. 200-214. Berlin, Germany: Springer.
5. Cairns P, Thimbleby H. 2010 Reducing number entry errors: solving a widespread, serious problem. J. R. Soc. Interface 7, 1429-1439. (doi:10.1098/rsif.2010.0112).
6. Thimbleby H, Cairns P, Jones M. 2001 Usability analysis with Markov models. ACM Trans. Comput. Hum. Interact. 8, 99-132. (doi:10.1145/376929.376941).
7. Thimbleby H. 2007 Press on: principles of interaction programming. Cambridge, MA: MIT Press.
8. Hollnagel E. 2014 Safety-I and Safety-II. Aldershot, UK: Ashgate.
9. Kachalia A, Kaufman SR, Boothman R, Anderson S, Welch K, Saint S, Rogers MAM. 2010 Liability claims and costs before and after implementation of a medical error disclosure program. Ann. Intern. Med. 153, 213-221. (doi:10.7326/0003-4819-153-4-201008170-00002).
10. Editorial. 2014 STAP retracted. Nature 511, 5-6. (doi:10.1038/511005b).
11. Reason J. 2008 The human contribution. Aldershot, UK: Ashgate.
12. Wu A. 2000 Medical error: The second victim. The doctor who makes the mistake needs help too. Br. Med. J. 320, 726-727. (doi:10.1136/bmj.320.7237.726).
13. Hollnagel E. 2009 The ETTO principle: efficiencythoroughness trade-off. Aldershot, UK: Ashgate.
14. Dekker S. 2015 Safety differently, 2nd edn. Boca Raton, FL: CRC Press.
15. Reason J. 2000 Human error: models and management. Br. Med. J. 320, 768-770. (doi:10.1136/bmj.320.7237.768).
16. Thimbleby H. 2000 Calculators are needlessly bad. Int. J. Hum. Comp. Stud. 52, 1031-1069. (doi:10.1006/ijhc.1999.0341).
17. Thimbleby H. 2006 Interaction walkthrough: evaluation of safety critical interactive systems. In Interactive systems: design, specification, and verification (eds G Doherty, A Blandford). Lecture Notes in Computer Science, vol. 4323, pp. 52-66. Berlin, Germany: Springer.
18. Thimbleby H, Williams JG, Lewis A. 2015 Making healthcare safer by understanding, designing and buying better IT. Clin. Med. 15, 258-262. (doi:10.7861/clinmedicine.15-3-258).
19. Thimbleby H, Witten IH. 1993 User modelling as machine identification: new design methods for HCI. In Advances in human computer interaction, vol IV (eds RH Hartson, D Hix), pp. 58-86. Norwood, NJ: Ablex.
20. Wren K. 2014 At FDA, speedier approval could add uncertainty over risks. Science 345, 391. (doi:10.1126/science.345.6195.391).
21. Simone LK. 2013 Software-related recalls: An analysis of records. Biomed. Instrument. Technol. 47, 514-522. (doi:10.2345/0899-8205-47.6.514).
22. James JT. 2013 A new evidence-based estimate of patient harms associated with hospital care. J. Patient Safety 9, 112-128. (doi:10.1097/PTS.0b013e3182948a69).
23. Vicente KJ, Kada-Bekhaled K, Hillel G, Cassano A, Orser BA. 2003 Programming errors contribute to death from patient-controlled analgesia: case report and estimate of probability. Can. J. Anesth. 50, 328-332. (doi:10.1007/BF03021027).
24. Daily Mail Reporter (anonymous). 2011 Mother-offour dies after blundering nurse administers TEN times drug overdose. Daily Mail Online, 23 February 2011. (http://www.dailymail.co.uk/health/article-1359778/Mother-diesnurse-administers-TEN-timesprescribed-drug.html#ixzz3eoPUHrXF).
25. Logan GD, Crump MJC. 2010 Cognitive illusions of authorship reveal hierarchical error detection in skilled typists. Science 330, 683-686. (doi:10.1126/science.1190483).
26. Gustafson JL. 2015 The end of error. Boca Raton, FL: CRC Press.
27. Thimbleby H. 1995 A new calculator and why it is necessary. Comput. J. 38, 418-433. (doi:10.1093/comjnl/38.6.418).
28. Thimbleby W, Thimbleby H. 2005 A novel gesture-based calculator and its design principles. In Proc. 19th British Computer Society HCI Conf., vol. 2 (eds L MacKinnon, O Bertelsen, N Bryan-Kinns), pp. 27-32. Swindon, UK: British Computer Society.
29. Thimbleby H. 2012 Heedless programming: ignoring detectable error is a widespread hazard. Software Practice Exp. 42, 1393-1407. (doi:10.1002/spe.1141).
30. Miller BP, Fredriksen L, So B. 1990 An empirical study of the reliability of UNIX utilities. Commun. ACM 33, 32-44. (doi:10.1145/96267.96279).
31. Cauchi A, Curzon P, Gimblett A, Masci P, Thimbleby H. 2012 Safer '5-key' number entry user interfaces using differential formal analysis. In Proc. 26th Annual BCS Interaction Specialist Group Conf. on People and Computers, pp. 29-38. Oxford, UK: Oxford University Press.
32. Olsen KA. 2008 The $100, 000 keying error. IEEE Comput. 41, 1005-1008. (doi:10.1109/MC.2008.135).
33. Thimbleby H. 2013 Improving safety in medical devices and systems. In Proc. IEEE Int. Conf. on Healthcare Informatics, Philadelphia, PA, 9-11 September 2013. (doi:10.1109/ICHI.2013.91).
34. Thimbleby H. 1983 Guidelines for 'manipulative' editing. Behav. Inform. Technol. 2, 127-161. (doi:10.1080/01449298308914472).
35. NHS Common User Interface Programme Team. 2010 NHS Number Input and Display User Interface Design Guidance. NHS, 5.0.0.0 edition.
36. Barchard KA, Pace LA. 2011 Preventing human error: The impact of data entry methods on data accuracy and statistical results. Comp. Hum. Behav. 27, 1834-1839. (doi:10.1016/j.chb.2011.04.004).
37. Institute for Safe Medication Practices. 2006 Double key bounce and double keying errors. ISMP. (www.ismp.org/newsletters/acutecare/articles/20060112.asp).
38. Institute for Safe Medication Practices. 2007 ISMP's list of error-prone abbreviations, symbols, and dose designations. ISMP. (www.ismp.org).
39. Trbovich PL, Pinkney S, Cafazzo JA, Easty AC. 2010 The impact of traditional and smart pump infusion technology on nurse medication administration performance in a simulated inpatient unit. Qual. Safety Health Care 19, 430-434.
40. Chrisomalis S. 2010 Numerical notation. Cambridge, UK: Cambridge University Press.
41. Flegg G. 1983 Numbers: Their history and meaning. New York, NY: Dover Publications.
42. Thimbleby H. 2011 Interactive numbers-a grand challenge. In Proc. IADIS Int. Conf. on Interfaces and Human Computer Interaction (ed. K Blashki), pp. xxviii-xxxv.
43. Allman E. 2012 Managing technical debt. Commun. ACM 55, 50-55. (doi:10.1145/2160718.2160733).
44. Card SK, Moran TP, Newell A. 1983 The psychology of human-computer interaction. Hillsdale, NJ: L. Erlbaum Associates Inc.
45. Norman DA. 1983 Design rules based on analyses of human error. Commun. ACM 26, 254-258. (doi:10.1145/2163.358092).
46. Landauer TK. 1995 The trouble with computers. Boston, MA: MIT Press.
47. Hanna S, Rolles R, Molina-Markham A, Poosankam P, Fu K, Song D. 2011 Take two software updates and see me in the morning: The case for software security evaluations of medical devices. In 2nd USENIX Workshop on Health Security and Privacy, HealthSec'11 (eds B Adida, U Shankar), pp. 1-5. Berkeley, CA: USENIX Association.
48. Thimbleby H. 2014 Safety versus security in healthcare IT. In Addressing Systems Safety Challenges, Proc. 22nd Safety-Critical Systems Symp. (eds C Dale, T Anderson), pp. 133-146.
49. Thimbleby H. 1990 You're right about the cure: don't do that. Interact. Comput. 2, 8-25. (doi:10.1016/0953-5438(90)90011-6).
50. W3C. 2013 A vocabulary and associated APIs for HTML and XHTML W3C working draft, 2013. See http://www.w3.org/TR/2011/WD-html5-20110525/common-microsyntaxes.html#real-numbers.
51. Thimbleby H, Gimblett A. 2011 Dependable keyed data entry for interactive systems. In FMIS 2011, 4th Int. Workshop on Formal Methods for Interactive Systems, vol. 45, pp. 116-1616.