Quantifying data quality for clinical trials using electronic data capture

PLoS ONE

Volumn 3, Issue 8, 2008, Pages

  Nahm, Meredith L ^a   Pieper, Carl F ^b   Cunningham, Maureen M ^c  

^a DUKE UNIVERSITY SCHOOL OF MEDICINE   (United States)

^b DUKE UNIVERSITY MEDICAL CENTER   (United States)

^c DUKE CLINICAL RESEARCH INSTITUTE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ABSTRACT REPORT; ANALYTICAL ERROR; ARTICLE; CASE STUDY; CLINICAL RESEARCH; CONTROLLED STUDY; DATA ANALYSIS; FACTUAL DATABASE; INFORMATION PROCESSING; INFORMATION TECHNOLOGY; INTERMETHOD COMPARISON; MEDICAL RECORD REVIEW; OUTPATIENT; PUBLICATION; QUALITATIVE ANALYSIS; QUALITY CONTROL; SYSTEM ANALYSIS; CLINICAL TRIAL; HEALTH SERVICES RESEARCH; HUMAN; MEDICAL AUDIT; METHODOLOGY; NATIONAL HEALTH ORGANIZATION; STANDARD; UNITED STATES;

AUTOMATIC DATA PROCESSING; CLINICAL AUDIT; CLINICAL TRIALS AS TOPIC; COMMISSION ON PROFESSIONAL AND HOSPITAL ACTIVITIES; HUMANS; NATIONAL INSTITUTE ON DRUG ABUSE (U.S.); NATIONAL INSTITUTES OF HEALTH (U.S.); ORGANIZATIONAL CASE STUDIES; RESEARCH DESIGN; UNITED STATES;

EID: 52449108356     PISSN: None     EISSN: 19326203     Source Type: Journal    
DOI: 10.1371/journal.pone.0003049     Document Type: Article

References (82)

1. Jonasson G, Carlsen KH, Sodal A, Jonasson C, Mowinckel P (1999) Patient compliance in a clinical trial with inhaled budesonide in children with mild asthma. Eur Respir J 14: 150-154.
2. Milgrom H, Bender B, Ackerson L, Bowry P, Smith B, et al. (1996) Noncompliance and treatment failure in children with asthma. J Allergy Clin Immunol 98: 1051-1057.
3. Spector SL, Kinsman R, Mawhinney H, Siegel SC, Rachelefsky GS, et al. (1986) Compliance of patients with asthma with an experimental aerosolized medication: implications for controlled clinical trials. J Allergy Clin Immunol 77: 65-70.
4. Straka RJ, Fish JT, Benson SR, Suh JT (1997) Patient self-reporting of compliance does not correspond with electronic monitoring: an evaluation using isosorbide dinitrate as a model drug. Pharmacotherapy 17: 126-132.
5. Verschelden P, Cartier A, L'Archeveque J, Trudeau C, Malo JL (1996) Compliance with and accuracy of daily self-assessment of peak expiratory flows (PEF) in asthmatic subjects over a three month period. Eur Respir J 9: 880-885.
6. Chmelik F, Doughty A (1994) Objective measurements of compliance in asthma treatment. Ann Allergy 73: 527-532.
7. Simmons MS, Nides MA, Rand CS, Wise RA, Tashkin DP (2000) Unpredictabdity of deception in compliance with physician-prescribrd bronchodilator inhaler use in a clinical trial. Chest 118: 290-295.
8. Mazze RS, Shamoon H, Pasmantier R, Lucido D, Murphy J, et al. (1984) Reliability of blood glucose monitoring by patients with diabetes mellitus. Am J Med 77: 211-217.
9. Williams ML, Freeman RC, Bowen AM, Zhao Z, Elwood WN, et al. (2000) A comparison of the reliability of self-reported drug use and sexual behaviors using computer-assisted versus face-to-face interviewing. AIDS Educ Prev 12: 199-213.
10. Newman JC, Des Jarlais DC, Turner CF, Gribble J, Cooley P, et al. (2002) The differential effects of face-to-face and computer interview modes. Am J Public Health 92: 294-297.
11. Turner CF, Ku L, Rogers SM, Lindberg LD, Pleck JH, et al. (1998) Adolescent sexual behavior, drug use, and violence: increased reporting with computer survey technology. Science 280: 867-873.
12. Metzger DS, Koblin B, Turner C, Navaline H, Valenti F, et al. (2000) Randomized controlled trial of audio computer-assisted self-interviewing: utility and acceptability in longitudinal studies. HIVNET Vaccine Preparedness Study Protocol Team. Am J Epidemiol 152: 99-106.
13. Good Clinical Data Management Practices (version 4.0). Society for Clinical Data Management. Available at: http://www.scdm.org/. Accessed August 8, 2006.
14. Blumenstein BA (1993) Verifying keyed medical research data. Stat Med 12: 1535-1542.
15. Bagniewska A, Black D, Molvig K, Fox C, Ireland C, et al. (1986) Data quality in a distributed data processing system: the SHEP Pilot Study. Control Clin Trials 7: 27-37.
16. Caloto T, Multicentre Project for Tuberculosis Research Study Group (2001) Quality control and data-handling in multicentre studies: the case of the Multicentre Project for Tuberculosis Research. BMC Med Res Methodol 1: 14.
17. Crombie IK, Irving JM (1986) An investigation of data entry methods with a personal computer. Comput Biomed Res 19: 543-550.
18. DuChene AG, Hultgren DH, Neaton JD, Grambsch PV, Broste SK, et al. (1986) Forms control and error detection procedures used at the Coordinating Center of the Multiple Risk Factor Intervention Trial (NMFIT). Control Clin Trials 7: 34S-45S.
19. Goldhill DR, Sumner A (1998) APACHE II, data accuracy and outcome prediction. Anaesthesia 53: 937-943.
20. Jorgensen CK, Karlsmose B (1998) Validation of automated forms processing. A comparison of Teleform with manual data entry. Comput Biol Med 28: 659-667.
21. Kawado M, Hinotsu S, Matsuyama Y, Yamaguchi T, Hashimoto S, et al. (2003) A comparison of error detection rates between the reading aloud method and the double data entry method. Control Clin Trials 24: 560-569.
22. Kronmal RA, Davis K, Fisher LD, Jones RA, Gillespie MJ (1978) Data management for a large collaborative clinical trial (CASS: Coronary Artery Surgery Study). Comput Biomed Res 11: 553-566.
23. Lancaster S, Hallstrom A, McBride R, Morris M (1995) A comparison of key data entry versus fax data entry, accuracy and time [abstract]. Control Clin Trials 16(Suppl 1): 75-76.
24. McEntegart DJ, Jadhav SP, Brown T, Channon EJ (1999) Checks of case record forms versus the database for efficacy variables when validation programs exist. Drug Inform J 33: 101-107.
25. Neaton JD, Duchene AG, Svendsen KH, Wentworth D (1990) An examination of the efficiency of some quality assurance methods commonly employed in clinical trials. Stat Med 9: 115-123.
26. Norton SL, Buchanan AV, Rossmann DL, Chakraborty R, Weiss KM (1981) Data entry erroys in an on-line operation. Comput Biomed Res 14: 179-198.
27. O'Rourke MK, Fernandez LM, Bittel CN, Sherrill JL, Blackwell TS, et al. (1999) Mass data massage: an automated data processing system used for NHEXAS, Arizona. National Human Exposure Assessment Survey. J Expo Anal Environ Epidemiol 9: 471-484.
28. Prud'homme GJ, Canner PL, Cutler JA (1989) Quality assurance and monitoring in the Hypertension Prevention Trial. Hypertension Prevention Trial Research Group. Control Clin Trials 10: 84S-94S.
29. Reynolds-Haertle RA, McBride R (1992) Single vs. double data entry in CAST. Control Clin Trials 13: 487-494.
30. Rostami R. Society for Clinical Data Management (Fall 2004). Available from SCDM at www.scdm.org.
31. Stone EJ, Osganian SK, McKinlay SM, Wu MC, Webber LS, et al. (1996) Operational design and quality control in the CATCH multicenter Trial. Prev Med 25: 384-399.
32. Quan KH, Vigano A, Fainsinger RL (2003) Evaluation of a data collection tool (TELEform) for palliative care research. J Palliat Med 6: 401-408.
33. Velikova G, Wright EP, Smith AB, Cull A, Gould A, et al. (1999) Automated collection of quality-of-life data: a comparison of paper and computer touch-screen questionnaires. J Clin Oncol 17: 998-1007.
34. Nahm M, Dziem G, Fendt K, Freeman L, Masi J, et al. (2004) Data quality survey results. Data Basics 10: 13-19.
35. Gad SC, Taulbee SM (1996) Handbook of data recording, maintenance, and management for the biomedical sciences. Boca Raton FL: CRC Press.
36. U.S. Food and Drug Administration Web site. Guidance for industry. E6 good clinical practice: Consolidated guidance (April 1996). Available at: http://www.fda.gov/cder/guidance/959fnl.pdf (accessed July 16, 2007).
37. Adams WG, Conners WP, Mann AM, Palfrey S (2000) Immunization entry at the point of service improves quality, saves time, and is well-accepted. Pediatrics 106: 489-492.
38. Arts D, de Keizer N, Scheffer GJ, de Jonge E (2002) Quality of data collected for severity of illness scores in the Dutch National Intensive Care Evaluation (NICE) registry. Intensive Care Med 28: 656-659.
39. Arts DG, De Keizer NF, Scheffer GJ (2002) Defining and improving data quality in medical registries: a literature review, case study, and generic framework. J Am Med Inform Assoc 9: 600-611.
40. Arts DG, Bosman RJ, de Jonge E, Joore JC, de Keizer NF (2003) Training in data definitions improves quality of intensive care data. Crit Care 7: 179-184.
41. Christian MC, McCabe MS, Korn EL, Abrams JS, Kaplan RS, et al. (1995) The National Cancer Institute audit of the National Surgical Adjuvant Breast and Bowel Project Protocol B-06. N Engl J Med 333: 1469-1474.
42. Clive RE, Ocwieja KM, Kamell L, Hoyler SS, Seiffert JE, et al. (1995) A national quality improvement effort: cancer registry data. J Surg Oncol 58: 155-161.
43. Cousley RR, Roberts-Harry D (2000) An audit of the Yorkshire Regional Cleft Database. J Orthod 27: 319-322.
44. Cress RD, Zaslavsky AM, West DW, Wolf RE, Felter MC, et al. (2003) Completeness of information on adjuvant therapies for colorectal cancer in population-based cancer registries. Med Care 41: 1006-1012.
45. Håkansson I, Lundström M, Stenevi U, Ehinger B (2001) Data reliability and structure in the Swedish National Cataract Register. Acta Ophthalmol Scand 79: 518-523.
46. Dreisler E, Schou L, Adamsen S (2001) Completeness and accuracy of voluntary reporting to a national case registry of laparoscopic cholecystectomy. Int J Qual Health Care 13: 51-55.
47. Favalli G, Vermorken JB, Vantongelen K, Renard J, Van Oosterom AT, et al. (2000) Quality control in multicentric clinical trials. An experience of the EORTC Gynecological Cancer Cooperative Group. Eur J Cancer 36: 1125-1133.
48. Fortmann SP, Haskell WL, Williams PT, Varady AN, Hulley SB, et al. (1986) Community surveillance of cardiovascular diseases in the Stanford Five-City Project. Methods and initial experience. Am J Epidemiol 123: 656-669.
49. Ghali WA, Rothwell DM, Quan H, Brant R, Tu JV (2000) A Canadian comparison of data sources for coronary artery bypass surgery outcome "report cards". Am Heart J 140: 402-408.
50. Gibbs JL, Monro JL, Cunningham D, Rickards A, Society of Cardiothoracic Surgeons of Great Britain and Northern Ireland, Paediatric Cardiac Association, Alder Hey Hospital (2004) Survival after surgery or therapeutic catheterisation for congenital heart disease in children in the United Kingdom: analysis of the central cardiac audit database for 2000-1. BMJ 328: 611.
51. Gissler M, Teperi J, Hemminki E, Merilainen J (1995) Data quality after restructuring a national medical registry. Scand J Soc Med 23: 75-80.
52. Goldhill DR, Sumner A (1998) APACHE II, data accuracy and outcome prediction. Anaesthesia 53: 937-943.
53. Herbert MA, Prince SL, Williams JL, Magee MJ, Mack MJ (2004) Are unaudited records from an outcomes registry database accurate? Ann Thorac Surg 77: 1960-1964.
54. Horbar JD, Leahy KA (1995) An assessment of data quality in the Vermont-Oxford Trials Network database. Control Clin Trials 16: 51-61.
55. Hunt JP, Cherr GS, Hunter C, Wright MJ, Wang YZ, et al. (2000) Accuracy of administrative data in trauma: splenic injuries as an example. J Trauma 49: 679-686.
56. Jenders RA, Dasgupta B, Mercedes D, Fries F, Stambaugh K (1999) Use of a hospital practice management system to provide initial data for a pediatric immunization registry. Proc AMIA Symp. pp 286-290.
57. Kantonen I, Lepantalo M, Salenius JP, Forsström E, Hakkarainen T, et al. (1997) Auditing a nationwide vascular registry-the 4-year Finnvasc experience. Finnvasc Study Group. Eur J Vasc Endovasc Surg 14: 468-474.
58. Karam V, Gunson B, Roggen F, Grande L, Wannoff W, et al. (2003) Quality control of the European liver Transplant Registry: results of audit visits to the contributing centers. Transplantation 75: 2167-2173.
59. Knatterud GL, Rockhold FW, George SL, Barton FB, Davis CE, et al. (1998) Guidelines for quality assurance in multicenter trials: a position paper. Control Clin Trials 19: 477-493.
60. Lin CM, Lee PC, Teng SW, Lu TH, Mao IF, et al. (2004) Validation of the Taiwan Birth Registry using obstetric records. J Formos Med Assoc 103: 297-301.
61. Linblad U, Råstam L, Ranstam J, Peterson M (1993) Validity of of register data on acute myocardial infarction and acute stroke: The Skaraborg Hypertension Project. Scand J Soc Med 21: 3-9.
62. Lovison G, Bellini P (1989) Study on the accuracy of official recording of nosological codes in an Italian regional hospital registry. Methods Inf Med 28: 142-147.
63. Lorenzoni L, Da Cas R, Aparo UL (1999) The quality of abstracting medical information from the medical record: the impact of training programmes. Int J Qual Health Care 11: 209-213.
64. Lowel H, Lewis M, Hormann A, Keil U (1991) Case finding, data quality aspects and comparability of myocardial infarction registers: results of a south German register study. J Clin Epidemiol 44: 249-260.
65. McGovern PG, Pankow JS, Burke GL, Shahar E, Sprafka JM, et al. (1993) Trends in survival of hospitalized stroke patients between 1970 and 1985. The Minnesota Heart Survey. Stroke 24: 1640-1648.
66. McKinlay SM, Carleton RA, McKenney JL, Assaf AR (1989) A new approach to surveillance for acute myocardial infarction: reproducibility and cost efficiency. Int J Epidemiol 18: 67-75.
67. Moro ML, Morsillo F (2004) Can hospital discharge diagnoses be used for surveillance of surgical-site infections? J Hosp Infect 56: 239-241.
68. Nagtegaal ID, Kranenbarg EK, Hermans J, van de Velde CJ, van Kricken JH (2000) Pathology data in the central databases of multicenter randomized trials need to be based on pathology reports and controlled by trained quality managers. J Clin Oncol 18: 1771-1779.
69. Rawson NS, Robson DL (2000) Concordance on the recording of cancer in the Saskatchewan Cancer Agency Registry, hospital charts and death registrations. Can J Public Health 91: 390-393.
70. Steward WP, Vantongelen K, Verweij J, Thomas D, Van Oosterom AT (1993) Chemotherapy administration and data collection in an EORTC collaborative group-can we trust the results? Eur J Cancer 29A: 943-947.
71. Tennis P, Bombardier C, Malcolm E, Downey W (1993) Validity of rheumatoid arthritis diagnoses listed in the Saskatchewan Hospital Separations Database. J Clin Epidemiol 46: 675-683.
72. Teperi J (1993) Multi method approach to the assessment of data quality in the Finnish Medical Birth Registry. J Epidemiol Community Health 47: 242-247.
73. Tingulstad S, Halvorsen T, Norstein J, Hagen B, Skjeldestad FE (2002) Completeness and accuracy of registration of ovarian cancer in the cancer registry of Norway. Int J Cancer 98: 907-911.
74. van der Putten E, van der Velden JW, Siers A, Hamersma EA (1987) A pilot study on the quality of data management in a cancer clinical trial. Control Clin Trials 8: 96-100.
75. Vantongelen K, Rotmensz N, van der Schueren E (1989) Quality control of validity of data collected in clinical trials. EORTC Study Group on Data Management (SGDM). Eur J Cancer Clin Oncol 25: 1241-1247.
76. Volk T, Hahn L, Hayden R, Abel J, Puterman ML, Tyers, et al. (1997) Reliability audit of a regional cardiac surgery registry. J Thorac Cardiovasc Surg 114: 903-910.
77. Wynn A, Wise M, Wright MJ, Rafaat A, Wang YZ, et al. (2001) Accuracy of administrative and trauma registry databases. J Trauma 51: 464-468.
78. Wang FL, Gabos S, Sibbald B, Lowry RB (2001) Completeness and accuracy of the birth registry data on congenital anomalies in Alberta, Canada. Chronic Dis Can 22: 57-66.
79. Helms RW (2001) Data quality issues in electronic data capture. Drug Inform J 35: 827-837.
80. Fleiss J, Levin BL, Paik M (2003) Statistical Methods for Rates and Proportions. 3rd ed. New York, NY: Wiley.
81. Janes ET (1976) Confidence Intervals vs. Bayesian Intervals. In: Harper WL, Hooker CA, eds. Foundations of Probability Theory, Statistical Inference, and Statistical Theories of Science. Vol 6: D. Reidel.
82. Davis JR, Nolan VT, Woodcock J, Estabrook RW, eds (1999) Assuring Data Quality and Validity in Clinical Trials for Regulatory Decision Making. Workshop Report Roundtable on Research and Development of Drugs, Biologics, and Medical Devices, Division of Health Sciences Policy, Institute of Medicine. Washington DC: National Academy Press.