SCOPUS 정보 검색 플랫폼

International Journal of Medical Informatics

Volumn 64, Issue 1, 2001, Pages 39-56

Evaluating informatics applications - Some alternative approaches: Theory, social interactionism, and call for methodological pluralism

(1) Kaplan, Bonnie a,b

a YALE UNIVERSITY SCHOOL OF MEDICINE (United States)

b Kaplan Associates (United States)

Author keywords

Attitude to computers; CDSS; Clinical decision support systems; Clinical practice guidelines; Decision support; Diffusion of innovation; Evaluation; Organizational change and impact; Organizational culture; Organizational innovation; Psychiatry information systems; Qualitative methods; Randomized controlled clinical trials; Social interactionism; Social science; Sociology of technology

Indexed keywords

INFORMATION ANALYSIS; SOCIAL ASPECTS; SOCIETIES AND INSTITUTIONS;

RANDOMIZED CONTROLLED CLINICAL TRIALS (RCT);

MEDICAL APPLICATIONS;

CLINICAL TRIAL; CONTROLLED CLINICAL TRIAL; EVALUATION; INFORMATION SYSTEM; LITERATURE; MENTAL HEALTH CARE; METHODOLOGY; PRACTICE GUIDELINE; PRIORITY JOURNAL; RANDOMIZED CONTROLLED TRIAL; RESEARCH; REVIEW; SOCIAL INTERACTION; TECHNOLOGY; THEORY;

EID: 0034775071 PISSN: 13865056 EISSN: None Source Type: Journal
DOI: 10.1016/S1386-5056(01)00184-8 Document Type: Article

Times cited : (314)

References (99)

1
- 0003029661
- B. Kaplan, Evaluating informatics applications-clinical decision support systems literature review Int. J. Med. Inform. 64 (2001) 15-37.

2
- 0003033523
- A.W. Kushniruk, V.L. Patel, J.J. Cimino, Usability testing in medical informatics: cognitive approaches to evaluation of information systems and user interfaces, Proc. AMIA Symp. 1997, 218-22.

3
- 0002957169
- B. Kaplan, Organizational evaluation of medical information systems. In: C.P. Friedman, J.C. Wyatt (Eds.), Evaluation methods in medical informatics. Springer, New York, 1997, pp. 255-280.

4
- 0031093744
- Addressing organizational issues into the evaluation of medical systems
- (1997) J. Am. Med. Inform. Assoc. , vol.4 , Issue.2 , pp. 94-101
- Kaplan, B.¹

5
- 0034702175
- Randomized, controlled trials, observational studies, and the hierarchy of research designs
- (2000) New Engl. J. Med. , vol.42 , Issue.25 , pp. 1887-1892
- Concato, J.¹ Shah, N.² Horwitz, R.I.³

6
- 0034702233
- Comparison of observational studies and randomized controlled trials
- (2000) New Engl. J. Med. , vol.42 , Issue.25 , pp. 1878-1886
- Benson, K.¹ Hartz, A.J.²

7
- 0023176495
- Evaluating medical expert systems
- (1987) Soc. Sci. Med. , vol.24 , Issue.10 , pp. 805-819
- Lundsgaarde, H.P.¹

8
- 0002960717
- D. Forsythe, B. Buchanan, Broadening our approach to evaluating medical expert systems, In: P.D. Clayton (Ed.), Symposium on computer applications in medical care. McGraw-Hill, New York, 1991, pp. 8-12.

9
- 0027528886
- Philosophies for the design and development of clinical decision-support systems
- (1993) Meth. Inform. Med. , vol.32 , pp. 1-8
- Heathfield, H.A.¹ Wyatt, J.²

10
- 0032572361
- Evaluating information technology in health care: barriers and challenges
- (1998) Br. Med. J. , vol.316 , Issue.7149 , pp. 1959-1961
- Heathfield, H.¹ Pitty, D.² Hanka, R.³

11
- 0031798448
- Medical informatics and the science of cognition
- (1998) J. Am. Med. Inform. Assoc. , vol.5 , Issue.6 , pp. 493-502
- Patel, V.L.¹ Kaufman, D.R.²

12
- 0032832052
- Patient care information systems and health care work: a sociotechnical approach
- (1999) Int. J. Med. Inform. , vol.55 , Issue.2 , pp. 87-101
- Berg, M.¹

13
- 0033485302
- The contextual nature of medical information
- (1999) Int. J. Med. Inform. , vol.56 , Issue.1-3 , pp. 51-60
- Berg, M.¹ Gorman, E.²

14
- 0032192460
- Considerations for sociotechnical design: experiences with an electronic patient record in a clinical context
- (1998) Int. J. Med. Inform. , vol.52 , Issue.1-3 , pp. 243-251
- Berg, M.¹ Langenberg, C.² Berg, I.³

15
- 0033941104
- Building a virtual network in a community health research training program
- (2000) J. Am. Med. Inform. Assoc. , vol.7 , Issue.4 , pp. 361-377
- Lau, F.¹ Hayward, R.²

16
- 0003030431
- J.G. Anderson, C.E. Aydin, S.J. Jay (Eds.), Evaluating health care information systems: approaches and applications. Sage, Thousand Oaks, CA, 1994.

17
- 0002883524
- J.G. Anderson, C.E. Aydin, B. Kaplan, An analytical framework for measuring the effectiveness/impacts of computer-based patient record systems. In: J.F. Nunamaker, R.H. Sprague, Jr. (Eds.), Proceedings of the 28th Hawaii International Conference on Systems Science, vol. IV, information systems-collaboration systems and technology, organizational systems and technology. IEEE Computer Society Press, Los Alamitos, CA,1995, pp. 767-776.

18
- 0032143433
- Cognitive evaluation of decision making processes and assessment of information technology in medicine
- (1998) Int. J. Med. Inform. , vol.51 , Issue.2-3 , pp. 83-90
- Kushniruk, A.W.¹ Patel, V.L.²

19
- 0028414134
- The evaluation of expert diagnostic systems-How to assess outcomes and quality parameters?
- (1994) Artif. Intell. Med. , vol.6 , Issue.2 , pp. 123-135
- Nøhr, C.¹

20
- 0023187016
- The medical computing 'lag': perceptions of barriers to the application of computers to medicine
- (1987) Int. J. Technol. Assess Health Care , vol.3 , Issue.1 , pp. 123-136
- Kaplan, B.¹

21
- 0033485856
- Using a descriptive model of change when implementing large-scale clinical information systems to identify priorities for future research
- (1999) Int. J. Med. Inform. , vol.56 , Issue.1-3 , pp. 43-50
- Aarts, J.¹ Peel, V.²

22
- 0033485651
- The VATAM guidelines
- (1999) Int. J. Med. Inform. , vol.56 , pp. 107-115
- Talmon, J.¹

23
- 0028478305
- An plea for controlled trials in medical informatics
- (1994) J. Am. Med. Inform. Assoc. , vol.1 , Issue.4 , pp. 353-355
- Tierney, W.M.¹ Overhage, J.M.² McDonald, C.J.³

24
- 0029847756
- Current evaluations of information technology in health care are often inadequate
- (1996) Br. Med. J. , vol.313 , Issue.7063 , pp. 1008
- Heathfield, H.A.¹ Buchan, I.E.²

25
- 0002959458
- I. Sim, P. Gorman, R.A. Greenes, R.B. Haynes, B. Kaplan, H. Lehmann, P.C. Tang, Clinical decision support systems for evidence-based medicine, J. Am. Med. Inform. Assoc. 2001, in press.

26
- 0003033525
- H.A. Heathfield, V. Peel, P. Hudson, S. Kay, et al., Evaluating large scale health information systems: from practice towards theory. Proc. AMIA Symp. 1997, 116-120.

27
- 0033532984
- Users' guides to the medical literature: XVIII. How to use an article evaluating the clinical impact of a computer-based clinical decision support system
- (1999) J. Am. Med. Assoc. , vol.282 , Issue.1 , pp. 67-74
- Randolph, A.G.¹ Haynes, R.B.² Wyatt, J.C.³

28
- 0002956001
- J.G. Anderson, C.E. Aydin, S.J. Jay (Eds.), Evaluating health care information systems: methods and applications, Sage Publications, Thousand Oaks, CA, 1994.

29
- 0003024630
- C.P. Friedman, J.C. Wyatt, Evaluation methods in medical informatics, Springer, New York, 1997.

30
- 0002957796
- E.M.S. van Gennip, J.L. Talmon (Eds.), Assessment and evaluation of information technologies, Studies in Health Technology and Informatics, vol. 17, Amsterdam IOS Press, 1995

31
- 0028414124
- A methodology for evaluation of knowledge-based systems in medicine
- (1994) Artif. Intell. Med. , vol.6 , Issue.2 , pp. 107-121
- Clarke, K.¹

32
- 0002945120
- F. Grémy, M. Bonnin, Evaluation of automatic health information systems. What and how?, In: E.M.S. van Gennip, J.L. Talmon (Eds.), Assessment and evaluation of information technologies, Studies in Health Technology and Informatics, vol 17, Amsterdam IOS Press, 1995, pp. 9-20.

33
- 0003030956
- T. Jørgensen, Measuring effects, In: E.M.S. van Gennip, J.L. Talmon (Eds.), Assessment and evaluation of information technologies, Studies in Health Technology and Informatics, vol. 17, Amsterdam IOS Press, 1995, pp. 99-109.

34
- 0035021946
- Towards an informatics research agenda: key people and organizational issues
- (2001) J. Am. Med. Inform. Assoc. , vol.8 , Issue.3 , pp. 234-241
- Kaplan, B.¹ Brennan, P.F.² Dowling, A.F.³

35
- 0002962522
- J.S. Ash, P.N. Gorman, W.R. Hersh, Physician order entry in US hospitals, Proc. AMIA Symp. 1998, 235-39.

36
- 0027423182
- Effect of clinical guidelines on medical practice: a systematic review of rigorous evaluations
- (1993) Lancet , vol.342 , pp. 1317-1322
- Grimshaw, J.M.¹ Russell, I.T.²

37
- 0032721879
- Why don't physicians follow clinical practice guide-lines?: a framework for improvement
- (1999) J. Am. Med. Assoc. , vol.82 , pp. 1458-1465
- Cabana, M.D.¹ Rand, C.S.² Powe, N.R.³

38
- 0030806534
- Translating guidelines into practice: a systematic review of theoretic concepts, practical experience and research evidence in the adoption of clinical practice guidelines
- (1997) Can. Med. Assoc. J. , vol.157 , Issue.4 , pp. 408-416
- Davis, D.A.¹ Taylor-Vaisey, A.²

39
- 0027024409
- Implementing clinical practice guidelines: social influence strategies and practitioner behavior change
- (1992) QRB , vol.18 , Issue.12 , pp. 413-442
- Mittman, B.S.¹ Tonesk, X.² Jacobson, P.³

40
- 0033585883
- Potential benefits, limitations, and harms of clinical guidelines
- (1999) Br. Med. J. , vol.318 , pp. 527-530
- Woolf, R.G.¹ Grol, R.² Hutchinson, A.³

41
- 0002956003
- Information technology and three studies of clinical work
- (1995) ACM SIGBIO Newsl. , vol.15 , Issue.2 , pp. 2-5
- Kaplan, B.¹

42
- 0032005538
- Electronic communication and collaboration in a health care practice
- (1998) Artif. Intell. Med. , vol.12 , Issue.2 , pp. 137-151
- Safran, C.¹ Jones, P.C.² Rind, D.³

43
- 0032436641
- The computer based patient record: a strategic issue in process innovation
- (1998) J. Med. Syst. , vol.22 , Issue.6 , pp. 431-443
- Sicotte, C.¹ Denis, J.L.² Lehoux, P.³

44
- 0033485641
- The behavioral side of information technology
- (1999) Int. J. Med. Inform. , vol.56 , Issue.1-3 , pp. 117-123
- Dixon, D.R.¹

45
- 0003015787
- B. Kaplan, The influence of medical values and practices on medical computer applications, Proceedings, MEDCOMP'82: The First IEEE Computer Society International Conference on Medical Computer Science/Computational Medicine. Silver Spring, MD.: IEEE Computer Society Press; 1982: 83-88. Reprinted in: Anderson JG, Jay SJ (Eds.), Use and impact of computers in clinical medicine. Springer, New York, 1987, pp. 39-50.

46
- 0033485945
- Information systems evaluation and subjectivity
- (1999) Int. J. Med. Inform. , vol.56 , Issue.1-3 , pp. 13-23
- Grémy, F.¹ Fessler, J.M.² Bonnin, M.³

47
- 0023701007
- Development and acceptance of medical information systems: an historical overview
- (1988) J. Health Hum. Resour. Admin. , vol.11 , Issue.1 , pp. 9-29
- Kaplan, B.¹

48
- 0003033527
- C. Aydin, Computerized order entry in a large medical center: evaluating interactions between departments, in: J.G., Anderson, C.E., Aydin, S.J., Jay, (Eds.), Evaluating health care information systems: approaches and applications, Sage, Thousand Oaks, CA, 1994, pp. 260-275.

49
- 0027458608
- Introducing physician order entry at a major academic medical center: 1. Impact on organizational culture and behavior
- (1993) Acad. Med. , vol.68 , Issue.1 , pp. 20-25
- Massaro, T.A.¹

50
- 0031688367
- Representing clinical guidelines in GLIF: individual and collaborative expertise
- (1998) J. Am. Med. Inform. Assoc. , vol.5 , Issue.5 , pp. 467-483
- Patel, V.L.¹ Allen, V.G.² Arocha, J.F.³

51
- 0031977315
- An informatics-based chronic disease practice: case study of a 35-year computer-based longitudinal record system
- (1998) J. Am. Med. Inform. Assoc. , vol.5 , Issue.1 , pp. 88-103
- Nordyke, R.A.¹ Kulikowski, C.A.²

52
- 0032191865
- Organizational issues in health informatics: a model approach
- (1998) Int. J. Med. Inform. , vol.52 , Issue.1-3 , pp. 235-242
- Aarts, J.¹ Peel, V.² Wright, G.³

53
- 0003030349
- N. Folz-Murphy, M. Partin, L. Williams et al., Physician use of an ambulatory medical record system: matching form and function, Proc. AMIA Symp. 1998, 260-64.

54
- 0032770679
- Lessons from a failed information systems initiative: issues for complex organisations
- (1999) Int. J. Med. Inform. , vol.55 , Issue.1 , pp. 33-46
- Southon, G.¹ Sauer, C.² Dampney, K.³

55
- 84965683342
- The computer prescription: medical computing, public policy, and views of history
- (1995) Sci. Technol. Hum. Values , vol.20 , Issue.1 , pp. 5-38
- Kaplan, B.¹

56
- 0033485331
- Cultural aspects of information technology implementation
- (1999) Int. J. Med. Inform. , vol.56 , Issue.1-3 , pp. 25-41
- Demeester, M.¹

57
- 0030333020
- New bottles, old wine: hidden cultural assumptions in a computerized explanation system for migraine sufferers
- (1996) Med. Anthropol. Q. , vol.10 , Issue.4 , pp. 551-574
- Forsythe, D.E.¹

58
- 0002883526
- J.S. Ash, P.N. Gorman, M. Lavelle et al., Multiple perspectives on physician order entry, Proc. AMIA Symp. 2000, 27-31.

59
- 0032818288
- Information technology leadership in academic medical centers: a tale of four cultures
- (1999) Acad. Med. , vol.74 , Issue.7 , pp. 795-799
- Friedman, C.P.¹

60
- 0033777952
- Culture counts: how institutional values affect computer use
- (2000) MD Comput. , vol.17 , Issue.1 , pp. 23-26
- Kaplan, B.¹

61
- 0030055637
- The diluting effect of medical work groups on feedback efficacy in changing physician's practice
- (1996) J. Behav. Med. , vol.19 , Issue.4 , pp. 367-383
- Sicotte, C.¹ Pineault, R.² Tilquin, C.³

62
- 0031843936
- The computer-based patient record: challenges towards timeless and spaceless medical practice
- (1998) J. Med. Syst. , vol.22 , Issue.4 , pp. 237-256
- Sicotte, C.¹ Denis, J.L.² Lehoux, P.³

63
- 84976798799
- Representations of work
- (1995) Commun. ACM. , vol.38 , Issue.9 , pp. 33-34
- Suchman, L.¹

64
- 37949015851
- Artifacts as psychological theories: the case for human-computer interaction
- (1989) Behav. Info. Tech. , vol.8 , Issue.4 , pp. 247-256
- Carroll, J.M.¹ Campbell, R.L.²

65
- 0002885572
- A. Dillon, Artifacts as theories: convergence through user-centered design. Proc 58th Annual ASIS Conference. Medford NJ: ASIS/Information Today 1995; 208-210

66
- 0002957798
- When is a system only a system?
- (2001) Healthcare Inform. Manage. Commun. Canada , vol.15 , Issue.1 , pp. 46-47
- Covvey, H.D.¹

67
- 0002885211
- Connecting the design of software to the design of work
- (1999) Comm. ACM , vol.42 , Issue.1 , pp. 38-46
- Butler, K.A.¹ Esposito, C.² Hebron, R.³

68
- 55249113766
- Combining qualitative and quantitative approaches in information systems research: a case study
- (1998) Manag. Inform. Sys. Q , vol.12 , Issue.4 , pp. 571-586
- Kaplan, B.¹ Duchon, D.²

69
- 0003030351
- Computer rorschach test: what do you see when you look at a computer?
- (2001) Physicians Comput. , vol.18 , Issue.5 , pp. 12-13
- Kaplan, B.¹

70
- 0003030433
- D.A. Travers, S.M. Downs, Comparing the user acceptance of a computer system in two pediatric offices: a qualitative study, Proc. AMIA Symp. 2000, 853-857.

71
- 0002884171
- C.S Gadd, P. Baskaran, D.F. Lobach, Identification of design features to enhance utilization and acceptance of systems for Internet-based decision support at the point of care, Proc. AMIA Symp. 1998, 91-5.

72
- 0002886964
- L.D. Gamm, C.K. Barsukiewicz, K.H. Dansky et al., Pre- and post- control model research on end-users' satisfaction with an electronic medical record: preliminary results, Proc. AMIA Symp. 1998, 225-29.

73
- 0002885213
- B. Kaplan, R. Morelli, J. Goethe, Preliminary findings from an evaluation of the acceptability of an expert system in psychiatry, Extended Proc. AMIA Symp. 1997 (CD-ROM).

74
- 0002949131
- D. Karlsson, C. Ekdahl, O. Wigertz et al., A qualitative study of clinicians ways of using a decision-support system, Proc. AMIA Symp. 1997, 268-72.

75
- 0002884173
- L.A. Moore, Reaction of medical personnel to a medical expert system for stroke. In: J.G. Anderson, C.E. Aydin, S.J. Jay (Eds.), Evaluating health care information systems: Approaches and applications, Sage, Thousand Oaks, CA, 1994, pp. 226-244.

76
- 0028367412
- Medical diagnostic decision support systems-past, present, and future: a threaded bibliography and brief commentary
- (1994) J. Am. Med. Inform. Assoc. , vol.1 , pp. 8-27
- Miller, R.A.¹

77
- 0002962524
- J.G. Anderson, S.J. Jay (Eds.), Use and impact of computers in clinical medicine, Springer, New York, 1987.

78
- 0002885895
- L.A. Suchman, Plans and situated actions: the problem of human-machine communication, Cambridge University Press, Cambridge, 1987.

79
- 0000494224
- Expert systems and computer-controlled decision making in medicine
- (1989) AI Soc. , vol.3 , pp. 184-197
- Lipscombe, B.¹

80
- 0002832801
- Architectures for architects
- (1993) Meth. Inform. Med. , vol.32 , pp. 12-13
- Musen, M.A.¹

81
- 0002884175
- Artificial Intelligence in Medicine, 7, (1995).

82
- 0002884535
- J. Greenbaum, M. Kyng, Design at work: cooperative design of computer systems, Lawrence Erlbaum Associates, Hillsdale NJ, 1991.

83
- 0003029418
- T. Winograd, F. Flores, Understanding computers and cognition: a new foundation for design, Ablex, Norwood, NJ, 1986.

84
- 0003032139
- B. Latour, Science in action, Harvard University Press, Cambridge, 1987.

85
- 0003033529
- J.H. Leavitt, Applying organizational change in industry: structural, technology and humanistic approaches, In: J.G. March (Ed.), Handbook of organizations. Rand-McNally, Chicago, IL, 1965, pp. 115-123.

86
- 0002884177
- M. Berg, Rationalizing medical work: decision-support techniques and medical practices, MIT Press, MA, 1997.

87
- 0031743719
- Science and practice: a case for medical informatics as a local science of design
- (1998) J. Am. Med. Inform. Assoc. , vol.5 , Issue.6 , pp. 489-492
- Patel, V.L.¹ Kaufman, D.R.²

88
- 0028367411
- Designing medical informatics research and library resource projects to increase what is learned
- (1994) J. Am. Med. Inform. Assoc. , vol.1 , Issue.1 , pp. 28-33
- Stead, W.W.¹ Haynes, R.B.² Fuller, S.³

89
- 0003030353
- E.M. Rogers, Diffusion of innovations, third ed., The Free Press, New York, 1983.

90
- 0003015789
- R.E. Rice, J.G. Anderson, Social networks and health care information systems: a structural approach to evaluation. In: J.G. Anderson, C.E. Aydin, S.J. Jay (Eds.), Evaluating health care information systems: approaches and applications, Sage, Thousand Oaks, CA, 1994, pp. 135-163.

91
- 0031443449
- Translating good advice into better practice
- (1997) J. Am. Med. Assoc. , vol.278 , Issue.23 , pp. 2108-2109
- Lee, T.H.¹ Cooper, H.L.²

92
- 0002886966
- R.R. Weaver, Evaluating the Problem Knowledge Coupler: a case study. In: J.G. Anderson, C.E. Aydin, S.J. Jay (Eds.), Evaluating health care information systems: approaches and applications, Sage, Thousand Oaks, CA, 1994, pp. 203-225.

93
- 0003030355
- R.G. Havelock et al., Planning for innovation through dissemination and utilization of knowledge, second printing. Center for Research on Utilization of Scientific Knowledge, Institute for Social Research, University of Michigan, Ann Arbor, 1971.

94
- 84976842442
- Social analyses of computing: theoretical perspectives in recent empirical research
- (1980) ACM Comp. Surv. , vol.12 , pp. 61-110
- Kling, R.¹

95
- 0023300121
- Different perspectives on information systems: problems and solutions
- (1987) ACM Comp. Surv. , vol.19 , pp. 5-46
- Lyytinen, K.¹

96
- 0002949133
- J.G. Anderson, C.E. Aydin, Overview: Theoretical perspectives and methodologies for the evaluation of health care information systems, In: J.G. Anderson, C.E. Aydin, S.J. Jay (Eds.), Evaluating health care information systems: approaches and applications. Sage, Thousand Oaks, CA, 1994, pp. 5-29.

97
- 0002886201
- B. Kaplan, J.A. Maxwell, Qualitative research methods for evaluating computer information systems, In: J.G. Anderson, C.E. Aydin, S.J. Jay (Eds.), Evaluating health care information systems: approaches and applications. Sage, Thousand Oaks, CA, 1994, pp. 45-68.

98
- 0026745647
- Microchips versus stethoscopes: Calgary hospital, MDs face off over controversial computer system
- (1992) Can. Med. Assoc. J. , vol.147 , Issue.10 , pp. 1534-1547
- Williams, L.S.¹

99
- 0002956005
- A.F. Dowling, Jr., Do hospital staff interfere with computer system implementation? Health Care Manag. Rev. 5 (1980) 23-32. Reprinted in: J.G. Anderson, S.J. Jay (Eds.), Use and impact of computers in clinical medicine, Springer, New York, 1987, pp. 302-317.

* 이 정보는 Elsevier사의 SCOPUS DB에서 KISTI가 분석하여 추출한 것입니다.