The Clinical Value of Computerized Information Services a Review of 98 Randomized Clinical Trials

Archives of Family Medicine

Volumn 5, Issue 5, 1996, Pages 271-278

  Balas, E Andrew ^a   Austin, Suzanne M ^a   Mitchell, Joyce A ^a   Ewigman, Bernard G ^b   Bopp, Kenneth D ^a   Brown, Gordon D ^a  

^a UNIVERSITY OF MISSOURI   (United States)

^b University of Missouri   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; CLINICAL TRIAL; CONTROLLED CLINICAL TRIAL; INFORMATION SYSTEM; RANDOMIZED CONTROLLED TRIAL; UTILIZATION REVIEW;

INFORMATION SYSTEMS; RANDOMIZED CONTROLLED TRIALS;

EID: 0030137968     PISSN: 10633987     EISSN: None     Source Type: Journal    
DOI: 10.1001/archfami.5.5.271     Document Type: Article

References (119)

1. Gorry GA. Computer-assisted clinical decision making. Methods Inf Med. 1973; 12:45-51.
2. de Dombal FT, Leaper DJ, Staniland JR, McCann AP, Horrocks JC. Computer-aided diagnosis of acute abdominal pain. BMJ. 1972;2:9-13.
3. Mc Adam WA, Brock BM, Armitage T, Davenport P, Chan M, de Dombal FT. Twelve years' experience of computer-aided diagnosis in a district general hospital. Ann R Coll Surg Engl. 1990;72:140-146.
4. Sutton GC. Computers in medicine: how accurate is computer-aided diagnosis? Lancet. 1989;2:905-908.
5. Paterson-Brown S, Vipond MN, Simms K, Gatzen C, Thompson JN, Dudley HA. Clinical decision making and laparoscopy versus computer prediction inthe management of the acute abdomen. Br J Surg. 1989;76:1011-1013
6. Piantadosi S, Byar DP. A proposal for registering clinical trials. Control Clin Trials. 1988;9:82-84.
7. Byar DP. Why data bases should not replace randomized clinical trials. Biometrics. 1980;36:337-342.
8. Ewigman BG, Crane JP, Frigoletto FD, et al. Effect of prenatal ultrasound screening on perinatal outcome. N Engl J Med. 1993;329:821-827.
9. Dickersin K, Min YI, Meinert CL. Factors influencing publication of research results: follow-up of applications submitted to two institutional review boards. JAMA. 1992;267:374-378.
10. Balas EA, Mitchell JA, Bopp KD, Brown GD, Ewigman BG. The Columbia Registry of Controlled Clinical Computer Trials. Proc Annu Symp Comput Appl Med Care. 1993;16:220-224.
11. Balas EA, Austin SM, Ewigman BG, Brown GD, Mitchell JA. Methods of randomized controlled clinical trials in health services research. Med Care. 1995; 33:687-699.
12. Armitage P, Blendis LM, Smyllie HC. The measurement of observer disagreement in the recording of signs. J R Stat Soc. 1966;A129:98-109.
13. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159-174.
14. Light RJ, Smith PV. Accumulating evidence: procedures for resolving contradictions among studies. Harvard Educ Rev. 1971;41:429-471.
15. Bushman BJ. Vote counting procedures in meta-analysis. In: Cooper H, Hedges L, eds. The Handbook of Research Synthesis. New York, NY: Russell Sage Foundation; 1994:193-213.
16. Conover WJ. Practical Nonparametric Statistics. 2nd ed. New York, NY: John Wiley & Sons Inc; 1980.
17. Rosenthal R. The 'file drawer problem' and tolerance for null results. Psychol Bull. 1979;86:638-641.
18. Morgan M, Studney DR, Barnett GO, Winickoff RN. Computerized concurrent review of prenatal care. QRB Qual Rev Bull. September 1978;4:33-36.
19. Banks NJ, Palmer RH, Kane NM, Braun P, Feldstein ML, Harrington AM. Implementation and evaluation of a computerized reminder system in ambulatory care. Proc Annu Symp Comput Appl Med Care. 1988;12:753-757.
20. Barnett GO, Winickoff RN, Morgan MM, Zielstorff RD. A computer-based monitoring system for follow-up of elevated blood pressure. Med Care. 1983;21: 400-409.
21. Begg EJ, Atkinson HC, Jeffery GM, Taylor NW. Individualized aminoglycoside dosage based on pharmacokinetic analysis is superior to dosage based on physician intuition at achieving target plasma drug concentrations. Br J Clin Pharmacol. 1989;28:137-141.
22. Bird JA, McPhee SJ, Jenkins C, Fordham D. Three strategies to promote cancer screening: how feasible is wide-scale implementation? Med Care. 1990; 28:1005-1012.
23. Boswik JM, Lee KL, Aronson LG, et al. Use of computerized statistical models to educate medical housestaff in estimating clinical outcomes. Proc Annu Symp Comput Appl Med Care. 1987;11:162-165.
24. Brimberry R. Vaccination of high-risk patients for influenza: a comparison of telephone and mail reminder methods. J Fam Pract. 1988;26:397-400.
25. Bulpitt CJ, Beilin LJ, Coles EC, et al. Randomized controlled trial of computer-held medical records in hypertensive patients. BMJ. 1976;273:677-679.
26. Burling TA, Marotta J, Gonzalez R, et al. Computerized smoking cessation program for the worksite: treatment outcome and feasibility. J Consult Clin Psychol. 1989;57:619-622.
27. Campbell DS, Neill J, Dudley P. Computer-aided self-instruction training with hearing-impaired impulsive students. Am Ann Deaf. 1989;134:227-231.
28. Carel RS. Utilization of an AMHTS for pre-hospitalization examinations. In: Lindberg DAB, Collen MF, Van Brunt EE, eds. Proceedings of American Medical Informatics Association Congress 82. New York, NY: Masson Publishing USA Inc; 1982:352-356.
29. Chambers CV, Balaban DJ, Carlson BL, Grasberger DM. The effect of microcomputer-generated reminders on influenza vaccination rates in a university-based family practice center. J Am Board Fam Pract. 1991;4:19-26.
30. Chambers CV, Balaban DJ, Carlson BL, Ungemack JA, Grasberger DM. Microcomputer-generated reminders: improving the compliance of primary care physicians with mammography screening guidelines. J Fam Pract. 1989;3: 273-280.
31. Chan CW, Witherspoon JM. Health risk appraisal modifies cigarette smoking behavior among college students. J Gen Intern Med. 1988;3:555-559.
32. Chase CR, Vacek PM, Shinozaki T, Giard AM, Ashigaka T. Medical information management: improving the transfer of research results to presurgical evaluation. Med Care. 1983;21:410-424.
33. Chiarelli F, Tumini S, Morgese G, Albisser AM. Controlled study in diabetic children comparing insulin-dosage adjustment by manual and computer algorithms. Diabetes Care. 1990;13:1080-1084.
34. Coe FL, Norton E, Oparil S, Tatar A, Pullman TN. A prospective controlled study of hypertension treatment by computer and physician. In: McCormick BH, ed. Proceedings of Third Illinois Conference on Medical Information Systems. Dept of Information Engineering, University of Illinois at Chicago; 1976: 206-217.
35. Darnell JC, Hiner SL, Neill PJ, Mamlin JJ, McDonald CJ, Hui SL, Tierney WM. After-hours access to physicians with access to computerized medical records: experience in an inner-city general medicine clinic. Med Care. 1985; 23:20-26.
36. Rogers JL, Haring OM, Watson RA. Automating the medical record: emerging issues. Proc Annu Symp Comput Appl Med Care. 1979;3:255-263.
37. Dickinson JC, Warhasw GA, Gehlbach SH, Bobula JA, Muhlbaier LH, Parkerson GR. Improving hypertension control: impact of computer feedback and physician education. Med Care. 1981;19:843-854.
38. Peck CC, Sheiner LB, Martin MM, Combs DT, Melmon KL. Computer-assisted digoxin therapy: N Engl J Med. 1973;289:441-446.
39. Baird TK, Broekemeier RL, Anderson MW. Effectiveness of a computer-supported refill reminder system. Am J Hosp Pharm. 1984;41:2395-2397.
40. Fordham D, McPhee SJ, Bird JA, Rodnick JE, Detmer WM. The cancer prevention reminder system. MD Comput. 1990;7:289-295.
41. Gehlbach SH, Wilkinson WE, Hammond WE, et al. Improving drug prescribing in a primary care practice. Med Care. 1984;22:193-201.
42. Ghosh A, Marks IM, Carr AC. Controlled study of self-exposure treatment for phobies: preliminary communication. J R Soc Med. 1984;77:483-487.
43. Ghosh A, Marks IM, Carr AC. Therapist contact and outcome of self-exposure treatment for phobias. Br J Psychiatry. 1988;152:234-238.
44. Rubin DH, Leventhal JM, Sadock RT, et al. Educational intervention by computer in childhood asthma: a randomized clinical trial testing the use of a new teaching intervention in childhood asthma. Pediatrics. 1986;77:1-10.
45. Hershey CO, Porter DK, Breslau D, Coheri DI: Influence of simple computerized feedback on prescription charges in an ambulatory clinic. Med Care. 1986;24:472-481.
46. Hershey CO, Goldberg HI, Cohen DI. The effect of computerized feedback coupled with a newsletter upon outpatient prescribing charges. Med Care. 1988;26:88-93.
47. Hickling K, Begg E, Moore ML. A prospective randomized trial comparing individualized pharmacokinetic dosage prediction for aminoglycosides with prediction based on estimated creatinine clearance in critically ill patients. Intensive Care Med. 1989;15:233-237.
48. Hofmeyr GJ, Pattinson R, Buckley D, Jennings J, Redman CW. Umbilical artery resistance index as a screening test for fetal well-being: randomized feasibility study. Obstet Gynecol. 1991;78:359-362.
49. Berwick DM, Coltin KL. Feedback reduces test use in a health maintenance organization. JAMA. 1986;255:1450-1454.
50. Lin DTC, Wilson SE, Reidy JJ, et al. An adjustable single running suture technique to reduce postkeratoplasty astigmatism. Ophthalmology. 1990;97:934-938.
51. Lorentz A, Gasteiger P, Osswald PM. Calculation of the allowable pretransfusion blood loss with a programmable pocket computer [in German]. Anaesthetist. 1987;36:306-312.
52. McAlister NH, Covvey HD, Tong C, Lee A, Wigle ED. Randomized controlled trial of computer-assisted management of hypertension in primary care. BMJ. 1986;293:670-674.
53. Mamon J, Barrett P, Fahey M, Steinwachs DM. Impact of receipt of patient bills in an inpatient setting on physician ordering practices. Proc Annu Symp Comput Appl Med Care. 1980;4:1673-1679.
54. Margolis CZ, Warshawsky S, Goldman L, Dagan O, Wirtschafter D. Effect of a computerized clinical algorithm system on patient care. In: Barber B, Cao D, Qin D, Wagner G, eds. Proceedings of the Sixth World Congress on Medical Informatics: MEDINFO 89. Amsterdam, the Netherlands: North-Holland Publishing Co; 1989:161-164.
55. McDonald CJ. Use of computer to detect and respond to clinical events: its effect on clinician behavior. Ann Intern Med. 1976;84:162-167.
56. McDonald CJ. Protocol-based computer reminders, the quality of care and the non-perfectibility of man. N Engl J Med. 1976;295:1351-1355.
57. McDonald CJ, Hui SL, Smith DM, et al. Reminders to physicians from an introspective computer medical record: a 2-year randomized trial. Ann Intern Med. 1984;100:130-138.
58. McDonald CJ, Wilson GA, McCabe GP. Physician response to computer reminders. JAMA. 1980;244:1579-1581.
59. McDowell I, Newell C, Rosser W. Comparison of three methods of recalling patients for influenza vaccination. Can Med Assoc J. 1986;135:991-997.
60. McDowell I, Newell C, Rosser W. A randomized trial of computerized reminders for blood pressure screening in primary care. Med Care. 1989;27:297-305.
61. McDowell I, Newell C, Rosser W. Computerized reminders to encourage cervical screening in family practice. J Fam Pract. 1989;28:420-424.
62. McDowell I, Newell C, Rosser W. A follow-up study of patients advised to obtain influenza immunizations. Fam Med. 1990;22:303-306.
63. McKibbon KA, Walker CJ, Ryan NC, Fitzgerald D, Haynes B. A study of MEDLINE in clinical settings: design and preliminary results. Proc Annu Symp Comput Appl Med Care. 1988;12:526-529.
64. McPhee SJ, Bird JA, Jenkins C, Fordham D. Promoting cancer screening: a randomized controlled trial of three interventions. Arch Intern Med. 1989; 149:1866-1872.
65. Millstein SG, Irwin CE. Acceptability of computer-acquired sexual histories in adolescent girls. J Pediatr. 1983;103:815-819.
66. Ornstein SM, Garr DR, Jenkins RG, Rust PF, Arnon A. Computer-generated physician and patient reminders: tools to improve population adherence to selected preventive services. J Fam Pract. 1991:32:82-90.
67. Peterson CM, Jovanovic L, Chanoch LH. Randomized trial of computer-assisted insulin delivery in patients with type I diabetes beginning pump therapy. Am J Med. 1986;81:69-72.
68. Porter D. Patient responses to computer counseling. Proc Annu Symp Comput Appl Med Care. 1978;2:233-237.
69. Privitera MD, Homan RW, Ludden TM, Peck CC, Vasko MR. Clinical utility of a Bayesian dosing program for phenytoin. Ther Drug Monit. 1989;11:285-294.
70. Reid JA, Kenny GNC. Evaluation of closed-loop control of arterial pressure after cardiopulmonary bypass. Br J Anaesth. 1987;59:247-255.
71. Reid RA, Hodges AG, Drucker RP. Utilization of computerized medical data system to assess and improve patient appointment keeping. Proc Annu Symp Comput Appl Med Care. 1977;1:194-198.
72. Robertson IH, Gray JM, Pentland B, Waite U. Microcomputer-based rehabilitation for unilateral left visual neglect: a randomized controlled trial. Arch Phys Med Rehabil. 1990;71:663-668.
73. Robinson TN. Community health behavior change through computer network health promotion: preliminary findings from Stanford Health-Net. Comput Methods Programs Biomed. 1989;30:137-144.
74. Robson J, Boomla K, Fitzpatrick S, et al. Using nurses for preventive activities with computer assisted follow up: a randomized controlled trial. BMJ. 1989;298:433-436.
75. Rodman JH, Jelliffe RW, Kolb E, et al. Clinical studies with computer-assisted initial lidocaine therapy. Arch Intern Med. 1984;144:703-709.
76. Rogers JL, Haring OM. Assessing computerized medical records on outcome of care. Presented at the Eighth Annual Conference of the Society for Computer Medicine; October 12-14, 1978; Minneapolis, Minn.
77. Rogers JL, Haring OM. Effect of a computerized medical record summary system on patient hospitalization. In: McCormick BH, ed. Proceedings of Third Illinois Conference on Medical Information Systems. Dept of Information Engineering, University of Illinois at Chicago; 1976;3:382-385.
78. Rogers JL, Haring OM. The impact of a computerized medical record summary system on incidence and length of hospitalization. Med Care. 1979;17: 618-630.
79. Rogers JL, Haring OM, Goetz JP. Changes in patient attitudes following the implementation of a medical information system. QRB Qual Rev Bull. March 1984;10:65-74.
80. Rogers JL, Haring OM, Wortman PM, Watson RA, Goetz JP. Medical information systems: assessing impact in the areas of hypertension, obesity and renal disease. Med Care. 1982;20:63-74.
81. Schrezenmeir J, Achterberg H, Bergeler J, et al. Controlled study on the use of hand-held insulin dosage computers enabling conversion to and optimizing of meal-related insulin therapy regimens. Life Support Syst. 1985;3(suppl): 561-567.
82. Selmi PM, Klein MH, Greist JH, Sorell PS, Erdman HP. Computer-administered cognitive-behavioral therapy for depression. Am J Psychiatry. 1990;147:51-56.
83. Simkins CV, Wenzloff NJ. Evaluation of a computerized reminder system in the enhancement of patient medication refill compliance. Drug Intell Clin Pharm. 1986;20:799-802.
84. Smith DM, Weinberger M, Katz BP. A controlled trial to increase office visits and reduce hospitalizations of diabetic patients. J Gen Intern Med. 1987;2: 231-237.
85. Smith DM, Weinberger M, Katz BP, Moore PS. Postdischarge care and readmissions. Med Care. 1988;26:699-708.
86. Soljak MA, Handford S. Early results from the Northland Immunization Register. N Z Med J. 1987;100:244-246.
87. Steele MA, Bess DT, Franse VL, Graber SE. Cost effectiveness of two interventions for reducing outpatient prescribing costs. Drug Intell Clin Pharm. 1989;23:497-500.
88. Strack T, Bergeler J, Beyer J, Hutten H. Computer assisted conventional insulin therapy. Life Support Syst. 1985;3:568-572.
89. Tape TG, Givner N, Wigton RS, Seelig CB, Patil K, Cambell R. Process in ambulatory care: a controlled trial of computerized records. Proc Annu Symp Comput Appl Med Care. 1988;12:749-752.
90. Tierney WM, Hui SL, McDonald CJ., Delayed feedback of physician performance versus immediate reminders to perform preventive care. Med Care. 1986;24:659-666.
91. Tierney WM, McDonald CJ, Hui SL, Martin DK. Computer predictions of abnormal test results: effects on outpatient testing. JAMA 1988;259:1194-1198.
92. Tierney WM, Miller ME, McDonald CJ. The effect on test ordering of informing physicians of the charges for outpatient diagnostic tests. N Engl J Med. 1990;322:1499-1504.
93. Turner BJ, Day SC, Borenstein B. A controlled trial to improve delivery of preventive care: physician or patient reminders? J Gen Intern Med. 1989;4: 403-409.
94. Weinberger M, Smith DM, Katz BP, Moore PS. The cost-effectiveness of intensive postdischarge care: a randomized trial. Med Care. 1988;26:1092-1102.
95. Weingarten MA, Bazel D, Shannon HS. Computerized protocol for preventive medicine: a controlled self-audit in family practice. Fam Pract. 1989;6:120-124.
96. Wetstone SL, Sheehan TJ, Votaw RG, Peterson MG, Rothfield N. Evaluation of a computer based education lesson for patients with rheumatoid arthritis. J Rheumatol. 1985;12:907-912.
97. Wheeler LA, Wheeler ML, Ours P, Swider C. Use of CAI/video in diabetes patient nutritional education. Proc Annu Symp Comput Appl Med Care. 1983; 7:961-964.
98. White KS, Lindsay A, Pryor TA, Brown WF, Walsh K. Application of a computerized medical decision-making process to the problem of digoxin intoxication. J Am Coll Cardiol. 1984;4:571-576.
99. Whiting-O'Keefe QE, Simborg DW, Epstein WV, Warger A. A computerized summary medical record system can provide more information than the standard medical record. JAMA. 1985;254:1185-1192.
100. Wilkinson WE, Gehlbach SH, Hammond WE, Clapp NE. Using computer-generated feedback to improve physician prescribing. Proc Annu Symp Comput Appl Med Care. 1982;6:76-78.
101. Wilson GA, McDonald CJ, McCabe GP. The effect of immediate access to a computerized medical record on physician test ordering: a controlled clinical trial in the emergency room. Am J Public Health. 1982;72:698-702.
102. Wolffing BK. Computerized literature searching in the ambulatory setting using PaperChase. Henry Ford Hosp Med J. 1990;38:57-61.
103. Wones RG. Failure of low-cost audits with feedback to reduce laboratory test utilization. Med Care. 1987;25:78-82.
104. Wyatt J. Lessons learnt from the field trial of ACORN, an expert system to advise on chest pain. In: Barber B, Cao D, Qin D, Wagner G, eds. Proceedings of the Sixth World Congress on Medical Informatics: MEDINFO 89. Amsterdam, the Netherlands: North-Holland Publishing Co; 1989:111-115.
105. Ziegler DK, Hurwitz A, Hassanein RS, Kodanaz HA, Preskorn SH, Mason J. Migraine prophylaxis: a comparison of propranolol and amitriptyline. Arch Neurol. 1987;44:486-489.
106. Winickoff RN, Coltin KL, Morgan MM, Buxbaum RC, Barnett GO. Improving physician performance through peer comparison feedback. Med Care. 1984; 22:527-534.
107. Larson EB, Bergman J, Heidrich F, Alvin BL, Schneeweiss R. Do postcard reminders improve influenza vaccination compliance? Med Care. 1982;20: 639-648.
108. Peters A, Rubsamen M, Jacob U, Look D, Scriba PC. Clinical evaluation of decision support system for insulin-dose adjustment in IDDM. Diabetes Care. 1991;14:875-880.
109. Lucas RW, Mullin PJ, Luna CBX, McInroy DC. Psychiatrists and a computer as interrogators of patients with alcohol-related illness: a comparison. Br J Psychiatry. 1977;131:160-167.
110. Pozen MW, D'Agostino RB, Selker HP, Sytkowski PA, Hood WB. A predictive instrument to improve coronary-care-unit admission practices in acute ischemic heart disease. N Engl J Med. 1984;310:1273-1278.
111. Fisher LA, Johnson TS, Porter D, Bleich HL, Slack WV. Collection of clean voided urine specimen: a comparison among spoken, written, and computer-based instructions. Am J Public Health. 1977;67:640-644.
112. Sheiner LB, Halkin H, Peck C, Rosenberg B, Melmon KL. Improved computer-assisted digoxin therapy: a method using feedback of measured serum digoxin concentrations. Ann Intern Med. 1975;82:619-627.
113. Reid RA, Lantz KH. Physician profiles in training the graduate internist. J Med Educ. 1977;52:301-307.
114. Coe FL, Norton E, Oparil S, Tatar A, Pullman TN. Treatment of hypertension by computer and physician: a prospective controlled study. J Chronic Dis. 1977;30:81-92.
115. Pozen MW, D'Agostino RB, Mitchell JB, et al. The usefulness of a predictive instrument to reduce innappropriate admissions to the coronary care unit. Ann Intern Med. 1980;92:238-242.
116. Shortliffe EH, Perreault LE, eds; Fagan LM, Wiederhold G, assoc eds. Medical Informatics: Computer Applications in Health Care. Reading, Mass: Addison-Wesley Publishing Co; 1990.
117. Antman EM, Lau J, Kupelnick B, Mosteller F, Chalmers TC. A comparison of results of meta-analyses of randomized control trials and recommendations of clinical experts: treatments for myocardial infarction. JAMA. 1992;268: 240-248.
118. Sacks HS, Berrier J, Reitman D, Ancona-Berk VA, Chalmers TC. Meta-analyses of randomized controlled trials. N Engl J Med. 1987;316:450-455.
119. Light RJ, Smith PV. Accumulating evidence: procedures for resolving contradictions among different research studies. Harvard Educ Rev. 1971;41: 429-471.