Assessing the generalizability of prognostic information

Annals of Internal Medicine

Volumn 130, Issue 6, 1999, Pages 515-524

  Justice, Amy C ^a   Covinsky, Kenneth E ^b   Berlin, Jesse A ^c  

^a University Drive   (United States)

^b SAN FRANCISCO VETERANS AFFAIRS MEDICAL CENTER   (United States)

^c UNIVERSITY OF PENNSYLVANIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; CALIBRATION; CANCER STAGING; COLON CANCER; DISEASE ACTIVITY; FOLLOW UP; HUMAN; INFORMATION SYSTEM; MEDICAL ASSESSMENT; PATIENT INFORMATION; PREDICTION; PRIORITY JOURNAL; PROGNOSIS; RECTUM CANCER; REPRODUCIBILITY;

EID: 0033574245     PISSN: 00034819     EISSN: None     Source Type: Journal    
DOI: 10.7326/0003-4819-130-6-199903160-00016     Document Type: Article

References (76)

1. Poller DN, Baxter KJ, Shepherd NA. p53 and Rb1 protein expression: are they prognostically useful in colorectal cancer? Br J Cancer. 1997;75: 87-93.
2. Jass JR, Ajioka Y, Allen JP, Chan YF, Cohen RJ, Nixon JM, et al. Assessment of invasive growth pattern and lymphocytic infiltration in colorectal cancer. Histopathology 1996;28:543-8.
3. Secco GB, Campora E, Fardelli R, Lapertosa G, De Lucchi F, Gianquinto D, et al. Chromogranin-A expression in neoplastic neuroendocrine cells and prognosis in colorectal cancer. Tumori. 1996;82:390-3.
4. Liabakk NB, Talbot I, Smith RA, Wilkinson K, Balkwill F. Matrix metalloprotease 2 (MMP-2) and matrix metalloprotease 9 (MMP-9) type IV collagenases in colorectal cancer. Cancer Res. 1996;56:190-6.
5. Öfner D, Riehemann K, Maier H, Riedmann B, Nehoda H, Totsch M, et al. Immunohistochemically detectable bcl-2 expression in colorectal carcinoma: correlation with tumour stage and patient survival. Br J Cancer, 1995;72: 981-5.
6. Gagliardi G, Stepniewska KA, Hershman MJ, Hawley PR, Talbot IC. New grade-related prognostic variable for rectal cancer. Br J Surg. 1995;82: 599-602.
7. Vecchio FM. The pathologist's role in the diagnosis and therapy of rectal cancer. Rays. 1995;20:15-20.
8. Neoptolemos JP, Oates GD, Newbold KM, Robson AM, McConkey C, Powell J. Cyclin/proliferation cell nuclear antigen immunohistochemistry does not improve the prognostic power of Dukes' or Jass' classifications for colorectal cancer. Br J Surg. 1995;82:184-7.
9. Darzi A, Lewis C, Menzies-Gow N, Guillou PJ, Monson JR. Laparoscopic abdominoperineal excision of the rectum. Surg Endosc. 1995;9:414-7.
10. Gagliardi G, Kandemir O, Liu D, Guida M, Benvestito S, Ruers TG, et al. Changes in E-cadherin immunoreactivity in the adenoma-carcinoma sequence of the large bowel. Virchows Arch. 1995;426:149-54.
11. Harrison JC, Dean PJ, el-Zeky F, Vander Zwaag R. From Dukes through Jass: pathological prognostic indicators in rectal cancer. Hum Pathol. 1994; 25:498-505.
12. Deans GT, Heatley M, Anderson N, Patterson CC, Rowlands BJ, Parks TG, et al. Jass' classification revisited. J Am Coll Surg. 1994;179:11-7.
13. Fucci L, Pirrelli M, Caruso ML. Carcinoma and synchronous hyperplastic polyps of the large bowel. Pathologica. 1994;86:371-5.
14. Öfner D, Totsch M, Sandbichler P, Hallbrucker C, Margreiter R, Mikuz G, et al. Silver stained nucleolar organizer region proteins (Ag-NORs) as a predictor of prognosis in colonic cancer. J Pathol. 1990;162:43-9.
15. Secco GB, Fardelli R, Lapertosa G, Fulcheri E, Rovida S, Ratto GB, et al. [The prognostic value of Jass' histopathological classification of cancer of the left colon and rectum.] Minerva Chir. 1990;45:1347-53.
16. Jass JR. Dukes and Jass systems [Letter]. Dis Colon Rectum. 1990;33:721-2.
17. Fisher ER, Robinsky B, Sass R, Fisher B. Relative prognostic value of the Dukes and the Jass systems in rectal cancer. Findings from the National Surgical Adjuvant Breast and Bowel Projects (Protocol R-01). Dis Colon Rectum. 1989;32:944-9.
18. Stahle E, Enblad P, Pahlman L, Glimelius B. Can mortality from rectal and rectosigmoid carcinoma be predicted from histopathological variables in the diagnostic biopsy? APMIS. 1989;97:513-22.
19. Secco GB, Fardelli R, Campora E, Lapertosa G, Fulcheri E, Rovida S, et al. Prognostic value of the Jass histopathologic classification in left colon and rectal cancer: a multivariate analysis. Digestion 1990;47:71-80.
20. Dukes CE, Bussey HJ. The spread of rectal cancer and its effect on prognosis. Br J Cancer. 1958;12:309-20.
21. Jass JR, Love SB, Northover JM. A new prognostic classification of rectal cancer. Lancet. 1987;1:1303-6.
22. Christakis NA. Prognostication and Death in Medical Thought and Practice. Philadelphia: Univ of Pennsylvania Pr; 1995.
23. Christakis NA, Iwashyna TJ. Attitude and self-reported practice regarding prognostication in a national sample of internists Arch Intern Med. 1998; 158:2389-95.
24. Wagner DP, Knaus WA, Harrell FE, Zimmerman JE, Watts C. Daily prognostic estimates for critically ill adults in intensive care units: results from a prospective, multicenter, inception cohort analysis. Crit Care Med. 1994;22: 1359-72.
25. Braitman LE, Davidoff F. Predicting clinical states in individual patients. Ann Intern Med. 1996;125:406-12.
26. Charlson ME, Pompei P, Ales KL, MacKenzie CR. A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis. 1987;40:373-83.
27. Laupacis A, Wells G, Richardson S, Tugwell P. Users' guides to the medical literature. V. How to use an article about prognosis. Evidence-Based Medicine Working Group. JAMA. 1994;272:234-7.
28. Heckerling PS, Conant RC, Tape TG, Wigton RS. Reproducibility of predictor variables from a validated clinical rule. Med Decis Making. 1992;12: 280-5.
29. Fletcher RH, Fletcher SW, Wagner EH. Clinical Epidemiology. The Essentials. 3d ed. Baltimore: Williams & Wilkins, 1998.
30. Feinstein AR. Clinical biostatistics. XIV. The purposes of prognostic stratification. Clin Pharmacol Ther. 1972;13:285-97.
31. Feinstein AR. Clinical Judgment. Baltimore: Williams & Wilkins; 1967.
32. Wasson JH, Sox HC, Neff RK, Goldman L. Clinical prediction rules. Applications and methodological standards. N Engl J Med. 1985;313:793-9.
33. Laupacis A, Sekar N, Stiell IG. Clinical prediction rules A review and suggested modifications of methodological standards. JAMA. 1997;277:488-94.
34. Senn SJ. Covariate imbalance and random allocation in clinical trials. Stat Med. 1989;8:467-75.
35. Harrell FE Jr, Lee KL, Califf RM, Pryor DB, Rosati RA. Regression modelling strategies for improved prognostic prediction. Stat Med. 1984;3:143-52.
36. Charlson ME, Ales KL, Simon R, MacKenzie R. Why predictive indexes perform less well in validation studies. Is it magic or methods? Arch Intern Med. 1987;1472155-61.
37. Harrell FE Jr, Lee KL, Mark DB. Tutorial in biostatistics. Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stat Med. 1996;15:361-87.
38. Baxt WG. Application of artificial neural networks to clinical medicine. Lancet. 1995;346:1135-8.
39. Wyatt J. Nervous about artificial neural networks? Lancet, 1995;346:1175-7.
40. Hart A, Wyatt J. Evaluating black-boxes as medical decision aids: issues arising from a study of neural networks. Med Inf (Lond). 1990;15:229-36.
41. Ash AS, Shwartz M. Evaluating the performance of risk-adjustment methods: dichotomous measures. In: Iezzoni LI, ed. Risk Adjustment for Measuring Health Care Outcomes. Ann Arbor, MI: Health Administration Pr; 1994:313-46.
42. Poses RM, Cebul RD, Center RM. Evaluating physicians' probabilistic judgments. Med Decis Making. 1988;8:233-40.
43. Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. 1982;143:29-36.
44. Centor RM. A Visicaic program for estimating the area under a receiver operating characteristic (ROC) curve. Med Decis Making. 1985;5:139-48.
45. Diamond GA. What price perfection? Calibration and discrimination of clinical prediction models. J Clin Epidemiol. 1992;45:85-9.
46. Hilden J, Habbema DF, Bjerregaard B. The measurement of performance in probabilistic diagnosis. II. Trustworthiness of the exact values of the diagnostic probabilities. Methods Inform Med. 1978;17:227-37.
47. Hilden J, Habbema DF, Bjerregaard B. The measurement of performance in probabilistic diagnosis III. Methods based on continuous functions of the diagnostic probabilities. Methods Inform Med. 1978;17:238-46.
48. Swets JA. Measuring the accuracy of diagnostic systems. Science. 1988;240: 1285-93.
49. Yates JF. External correspondence: decompositions of the mean probability score. Organizational Behavior and Human Performance. 1982;30:132-56.
50. Lindsay MR, Ehrenberg AS. The design of replicated studies. American Statistician. 1993;47:217-28.
51. Mosteller F, Tukey JW. Data Analysis and Regression: A Second Course in Statistics. Reading, MA: Addison-Wesley; 1977.
52. Breiman L, Friedman JH, Olshen RA, Stone CJ. Classification and Regression Trees. Pacific Grove, CA: Wadsworth and Brooks/Cole Advanced Books and Software; 1984.
53. Concato J, Peduzzi P, Holford TR, Feinstein AR. Importance of events per independent variable in proportional hazards analysis. I. Background, goals, and general strategy. J Clin Epidemiol. 1995;48:1495-501.
54. Justice AC, Feinstein AR, Wells CK. A new prognostic staging system for the acquired immunodeficiency syndrome. N Engl J Med. 1989;320:1388-93.
55. Justice AC, Aiken LH, Smith HL, Turner BJ. The role of functional status in predicting inpatient mortality with AIDS: a comparison with current predictors. J Clin Epidemiol 1996;49:193-201.
56. Stone VE, Seage GR 3d, Hertz T, Epstein AM. The relation between hospital experience and mortality for patients with AIDS. JAMA. 1992;268: 2655-61.
57. Mocroft AJ, Johnson MA, Sabin CA, Lipman M, Elford J, Emery V, et al. Staging system for clinical AIDS patients. Royal Free/Chelsea and Westminster Hospitals Collaborative Group. Lancet. 1995;346:12-7.
58. Cozzi Lepri A, Pezzotti P, Phillips AN, Petrucci A, Rezza G. Clinical staging system for AIDS patients [Letter]. Lancet. 1995;346:1103
59. Deyo RA, Cherkin DC, Ciol MA. Adapting a clinical comorbidity index for use with ICD-9-CM administrative databases. J Clin Epidemiol. 1992;45: 613-9.
60. Ransohoff DF, Feinstein AR. Problems of spectrum and bias in evaluating the efficacy of diagnostic tests. N Engl J Med. 1978;299:926-30.
61. Shea JA, Berlin JA, Escarce JJ, Clarke JR, Kinosian BP, Cabana MD, et al. Revised estimates of diagnostic test sensitivity and specificity in suspected biliary tract disease. Arch Intern Med. 1994;154:2573-81.
62. Lachs MS, Nachamkin I, Edelstein PH, Goldman J, Feinstein AR, Schwartz JS. Spectrum bias in the evaluation of diagnostic tests: lessons from the rapid dipstick test for urinary tract infection. Ann Intern Med. 1992; 117:135-40.
63. Rothman KJ. Modern Epidemiology, Boston: Little, Brown; 1986.
64. Knaus WA, Draper EA, Wagner DP, Zimmerman JE. APACHE II: a severity of disease classification system. Crit Care Med. 1985;13:818-29.
65. Brewster AC, Karlin BG, Hyde LA, Jacobs CM, Bradbury RC, Chae YM. MEDISGPS: a clinically based approach to classifying hospital patients at admission. Inquiry. 1985;22:377-87.
66. Iezzoni LI, Moskowitz MA. A clinical assessment of MedisGroups. JAMA. 1988;260:3159-63.
67. Alemi F, Rice J, Hankins R. Predicting in-hospital survival of myocardial infarction. A comparative study of various severity measures. Med Care. 1990;28:762-75.
68. Lang TA, Secic M. Assessing time to an event as an endpoint. In: How to Report Statistics in Medicine: Annotated Guidelines for Authors, Editors, and Reviewers, Philadelphia: American Coll of Physicians; 1997:137-46.
69. O'Connor AM. Effects of framing and level of probability on patients' preferences for cancer chemotherapy. J Clin Epidemiol. 1989;42:119-26.
70. O'Connor AM, Pennie RA, Dales RE. Framing effects on expectations, decisions, and side effects experienced: the case of influenza immunization. J Clin Epidemiol. 1996;49:1271-6.
71. Mazur DJ, Merz JF. How the manner of presentation of data influences older patients in determining their treatment preferences. J Am Geriatr Soc 1993;41:223-8.
72. Annas GJ. Informed consent, cancer, and truth in prognosis. N Engl J Med. 1994;330:223-5.
73. Smith TJ, Swisher K. Telling the truth about terminal cancer [Editorial]. JAMA. 1998;279:1746-8.
74. Buckman R, Kason Y. How to Break Bad News: A Guide for Health Care Professionals Baltimore: Johns Hopkins Univ Pr; 1992.
75. Brewin TB. Three ways of giving bad news. Lancet. 1991;337:1207-9.
76. Ptacek JT, Eberhardt TL. Breaking bad news. A review of the literature. JAMA. 1996;276:496-502.