Estimating the treatment effect from non-randomized studies: The example of reduced intensity conditioning allogeneic stem cell transplantation in hematological diseases

BMC Blood Disorders

Volumn 12, Issue , 2012, Pages

  Resche Rigon, Matthieu ^a,b,c   Pirracchio, Romain ^a   Robin, Marie ^a   De Latour, Regis P ^a   Sibon, David ^a   Ades, Lionel ^d   Ribaud, Patricia ^a   Fermand, Jean Paul ^a   Thieblemont, Catherine ^a   Socié, Gérard ^a   Chevret, Sylvie ^a,b,c  

^a SAINT LOUIS HOSPITAL   (France)

^b INSERM   (France)

^c UNIVERSITÉ PARIS DESCARTES   (France)

^d AVICENNE HOSPITAL   (France)

Author keywords

Allogeneic stem cell transplantation; Non randomized studies; Propensity score; Treatment effect

Indexed keywords

ADULT; ALLOGENEIC STEM CELL TRANSPLANTATION; ARTICLE; CLINICAL ARTICLE; CONTROLLED STUDY; FOLLICULAR LYMPHOMA; HEMATOLOGIC DISEASE; HODGKIN DISEASE; HUMAN; MULTIPLE MYELOMA; OBSERVATIONAL STUDY; REDUCED INTENSITY CONDITIONING; TREATMENT OUTCOME;

EID: 84864951538     PISSN: None     EISSN: 14712326     Source Type: Journal    
DOI: 10.1186/1471-2326-12-10     Document Type: Article

References (59)

1. Altman DG, Bland JM. Statistics notes. Treatment allocation in controlled trials: why randomise?. BMJ 1999, 318(7192):1209. 1115595, 10221955.
2. Miettinen OS. The need for randomization in the study of intended effects. Stat Med 1983, 2(2):267-271. 10.1002/sim.4780020222, 6648141.
3. Black N. Why we need observational studies to evaluate the effectiveness of health care. BMJ 1996, 312(7040):1215-1218. 10.1136/bmj.312.7040.1215, 2350940, 8634569.
4. Benson K, Hartz AJ. A comparison of observational studies and randomized, controlled trials. Am J Ophthalmol 2000, 130(5):688.
5. Stukel TA, Fisher ES, Wennberg DE, Alter DA, Gottlieb DJ, Vermeulen MJ. Analysis of observational studies in the presence of treatment selection bias: effects of invasive cardiac management on AMI survival using propensity score and instrumental variable methods. JAMA 2007, 297(3):278-285. 10.1001/jama.297.3.278, 2170524, 17227979.
6. Aoudjhane M, Labopin M, Gorin NC, Shimoni A, Ruutu T, Kolb HJ, Frassoni F, Boiron JM, Yin JL, Finke J, et al. Comparative outcome of reduced intensity and myeloablative conditioning regimen in HLA identical sibling allogeneic haematopoietic stem cell transplantation for patients older than 50 years of age with acute myeloblastic leukaemia: a retrospective survey from the Acute Leukemia Working Party (ALWP) of the European group for Blood and Marrow Transplantation (EBMT). Leukemia 2005, 19(12):2304-2312. 10.1038/sj.leu.2403967, 16193083.
7. Giralt S, Estey E, Albitar M, van Besien K, Rondon G, Anderlini P, O'Brien S, Khouri I, Gajewski J, Mehra R, et al. Engraftment of allogeneic hematopoietic progenitor cells with purine analog-containing chemotherapy: harnessing graft-versus-leukemia without myeloablative therapy. Blood 1997, 89(12):4531-4536.
8. Khouri IF, Keating M, Korbling M, Przepiorka D, Anderlini P, O'Brien S, Giralt S, Ippoliti C, von Wolff B, Gajewski J, et al. Transplant-lite: induction of graft-versus-malignancy using fludarabine-based nonablative chemotherapy and allogeneic blood progenitor-cell transplantation as treatment for lymphoid malignancies. J Clin Oncol 1998, 16(8):2817-2824.
9. McSweeney PA, Niederwieser D, Shizuru JA, Sandmaier BM, Molina AJ, Maloney DG, Chauncey TR, Gooley TA, Hegenbart U, Nash RA, et al. Hematopoietic cell transplantation in older patients with hematologic malignancies: replacing high-dose cytotoxic therapy with graft-versus-tumor effects. Blood 2001, 97(11):3390-3400. 10.1182/blood.V97.11.3390, 11369628.
10. Milpied N, Fielding AK, Pearce RM, Ernst P, Goldstone AH. Allogeneic bone marrow transplant is not better than autologous transplant for patients with relapsed Hodgkin's disease. European Group for Blood and Bone Marrow Transplantation. J Clin Oncol 1996, 14(4):1291-1296.
11. Peniket AJ, Ruiz de Elvira MC, Taghipour G, Cordonnier C, Gluckman E, de Witte T, Santini G, Blaise D, Greinix H, Ferrant A, et al. An EBMT registry matched study of allogeneic stem cell transplants for lymphoma: allogeneic transplantation is associated with a lower relapse rate but a higher procedure-related mortality rate than autologous transplantation. Bone Marrow Transplant 2003, 31(8):667-678. 10.1038/sj.bmt.1703891, 12692607.
12. van Besien K, Loberiza FR, Bajorunaite R, Armitage JO, Bashey A, Burns LJ, Freytes CO, Gibson J, Horowitz MM, Inwards DJ, et al. Comparison of autologous and allogeneic hematopoietic stem cell transplantation for follicular lymphoma. Blood 2003, 102(10):3521-3529. 10.1182/blood-2003-04-1205, 12893748.
13. Sarina B, Castagna L, Farina L, Patriarca F, Benedetti F, Carella AM, Falda M, Guidi S, Ciceri F, Bonini A, et al. Allogeneic transplantation improves the overall and progression-free survival of Hodgkin lymphoma patients relapsing after autologous transplantation: a retrospective study based on the time of HLA typing and donor availability. Blood 2010, 115(18):3671-3677. 10.1182/blood-2009-12-253856, 20220116.
14. Slavin S, Nagler A, Naparstek E, Kapelushnik Y, Aker M, Cividalli G, Varadi G, Kirschbaum M, Ackerstein A, Samuel S, et al. Nonmyeloablative stem cell transplantation and cell therapy as an alternative to conventional bone marrow transplantation with lethal cytoreduction for the treatment of malignant and nonmalignant hematologic diseases. Blood 1998, 91(3):756-763.
15. Mohty M, Nagler A, Killmann NM. Reduced-intensity conditioning allogeneic stem cell transplantation: hype, reality or time for a rethink?. Leukemia 2006, 20(10):1653-1654. 10.1038/sj.leu.2404336, 17041634.
16. Bruno B, Rotta M, Patriarca F, Mordini N, Allione B, Carnevale-Schianca F, Giaccone L, Sorasio R, Omede P, Baldi I, et al. A comparison of allografting with autografting for newly diagnosed myeloma. N Engl J Med 2007, 356(11):1110-1120. 10.1056/NEJMoa065464, 17360989.
17. Garban F, Attal M, Michallet M, Hulin C, Bourhis JH, Yakoub-Agha I, Lamy T, Marit G, Maloisel F, Berthou C, et al. Prospective comparison of autologous stem cell transplantation followed by dose-reduced allograft (IFM99-03 trial) with tandem autologous stem cell transplantation (IFM99-04 trial) in high-risk de novo multiple myeloma. Blood 2006, 107(9):3474-3480. 10.1182/blood-2005-09-3869, 16397129.
18. Moreau P, Garban F, Attal M, Michallet M, Marit G, Hulin C, Benboubker L, Doyen C, Mohty M, Yakoub-Agha I, et al. Long-term follow-up results of IFM99-03 and IFM99-04 trials comparing nonmyeloablative allotransplantation with autologous transplantation in high-risk de novo multiple myeloma. Blood 2008, 112(9):3914-3915. 10.1182/blood-2008-07-168823, 18948589.
19. Archimbaud E, Thomas X, Michallet M, Jaubert J, Troncy J, Guyotat D, Fiere D. Prospective genetically randomized comparison between intensive postinduction chemotherapy and bone marrow transplantation in adults with newly diagnosed acute myeloid leukemia. J Clin Oncol 1994, 12(2):262-267.
20. Cornelissen JJ, van der Holt B, Verhoef GE, van't Veer MB, van Oers MH, Schouten HC, Ossenkoppele G, Sonneveld P, van Marwijk Kooy M, et al. Myeloablative allogeneic versus autologous stem cell transplantation in adult patients with acute lymphoblastic leukemia in first remission: a prospective sibling donor versus no-donor comparison. Blood 2009, 113(6):1375-1382. 10.1182/blood-2008-07-168625, 18988865.
21. Logan B, Leifer E, Bredeson C, Horowitz M, Ewell M, Carter S, Geller N. Use of biological assignment in hematopoietic stem cell transplantation clinical trials. Clin Trials 2008, 5(6):607-616. 10.1177/1740774508098326, 2671015, 19029209.
22. Pocock SJ, Elbourne DR. Randomized trials or observational tribulations?. N Engl J Med 2000, 342(25):1907-1909. 10.1056/NEJM200006223422511, 10861329.
23. Grobbee DE, Hoes AW. Confounding and indication for treatment in evaluation of drug treatment for hypertension. BMJ 1997, 315(7116):1151-1154. 10.1136/bmj.315.7116.1151, 2127725, 9374894.
24. Hernan MA. A definition of causal effect for epidemiological research. J Epidemiol Community Health 2004, 58:265-271. BMJ Publishing Group Ltd, 10.1136/jech.2002.006361, 1732737, 15026432.
25. Holland PW, Rubin DB. Causal inference in retrospective studies. Eval Rev 1988, 12:203.
26. Hernan MA, Robins JM. Estimating causal effects from epidemiological data. J Epidemiol Community Health 2006, 60(7):578-586. 10.1136/jech.2004.029496, 2652882, 16790829.
27. Rosenbaum PR, Rubin DB. The central role of the propensity score in observational studies for causal effects. Biometrika 1983, 70(1):41-55.
28. Robins JM, Hernan MA, Brumback B. Marginal structural models and causal inference in epidemiology. Epidemiology 2000, 11(5):550-560. 10.1097/00001648-200009000-00011, 10955408.
29. Zhiqiang T. A distributional approach for causal inference using propensity scores. J Am Stat Assoc 2006, 101(476):1619-1637.
30. Austin PC. The design versus the analysis of observational studies for causal effects: parallels with the design of randomized trials. Stat Med 2007, 26:20-36. 10.1002/sim.2739, 17072897.
31. Mortimer KM, Neugebauer R, van der Laan M, Tager IB. An application of model-fitting procedures for marginal structural models. Am J Epidemiol 2005, 162(4):382-388. 10.1093/aje/kwi208, 16014771.
32. Austin PC. Different measures of treatment effect for different research questions. J Clin Epidemiol 2010, 63(1):9-10. 10.1016/j.jclinepi.2009.07.006, 19837563.
33. Karlin L, Arnulf B, Chevret S, Ades L, Robin M, De Latour RP, Malphettes M, Kabbara N, Asli B, Rocha V, et al. Tandem autologous non-myeloablative allogeneic transplantation in patients with multiple myeloma relapsing after a first high dose therapy. Bone Marrow Transplant 2010, 46(2):250-256.
34. D'Agostino RB. Propensity score methods for bias reduction in the comparison of a treatment to a non-randomized control group. Stat Med 1998, 17(19):2265-2281. 10.1002/(SICI)1097-0258(19981015)17:19<2265::AID-SIM918>3.0.CO;2-B, 9802183.
35. Rosenbaum PR, Rubin DB. Reducing bias in observational studies using subclassification on the propensity score. J Am Stat Assoc 1984, 79(387):516-524.
36. Lunceford JK, Davidian M. Stratification and weighting via the propensity score in estimation of causal treatment effects: a comparative study. Stat Med 2004, 23(19):2937-2960. 10.1002/sim.1903, 15351954.
37. Brookhart MA, Schneeweiss S, Rothman KJ, Glynn RJ, Avorn J, Sturmer T. Variable selection for propensity score models. Am J Epidemiol 2006, 163(12):1149-1156. 10.1093/aje/kwj149, 1513192, 16624967.
38. Rubin DB, Thomas N. Matching using estimated propensity scores: relating theory to practice. Biometrics 1996, 52(1):249-264. 10.2307/2533160, 8934595.
39. Austin PC. Type I error rates, coverage of confidence intervals, and variance estimation in propensity-score matched analyses. Int J Biostat 2009, 5(1):1557-4679. April 2009. http://dx.crossref.org/10.2202%2F1557-4679.1146.
40. Austin PC, Grootendorst P, Anderson GM. A comparison of the ability of different propensity score models to balance measured variables between treated and untreated subjects: a Monte Carlo study. Stat Med 2007, 26(4):734-753. 10.1002/sim.2580, 16708349.
41. Austin PC. Balance diagnostics for comparing the distribution of baseline covariates between treatment groups in propensity-score matched samples. Stat Med 2009, 28(25):3083-3107. 10.1002/sim.3697, 3472075, 19757444.
42. Austin PC, Mamdani MM. A comparison of propensity score methods: a case-study estimating the effectiveness of post-AMI statin use. Stat Med 2005, 25(12):2084-2106.
43. Joffe MM, Ten Have TR, Feldman HI. Model Selection, Confounder Control, and Marginal Structural Models. Am Stat 2004, 58(4):272-279.
44. Hernan MA, Robins JM. Instruments for causal inference: an epidemiologist's dream?. Epidemiology 2006, 17(4):360-372. 10.1097/01.ede.0000222409.00878.37, 16755261.
45. Hernan MA, Brumback B, Robins JM. Marginal structural models to estimate the causal effect of zidovudine on the survival of HIV-positive men. Epidemiology 2000, 11(5):561-570. 10.1097/00001648-200009000-00012, 10955409.
46. Cole SR, Hernan MA. Constructing inverse probability weights for marginal structural models. Am J Epidemiol 2008, 168(6):656-664. 10.1093/aje/kwn164, 2732954, 18682488.
47. Rothman KJ, Greenland S, Lash TL. Modern epidemiology 2008,
48. Rosenbaum PR. Model-based direct adjustment. J Am Stat Assoc 1987, 82(398):387-394.
49. Team RDC R: A Language and Environment for Statistical Computing 2009, Vienna, Austria: R Foundation for Statistical Computing, Team RDC.
50. Ahmed A, Perry GJ, Fleg JL, Love TE, Goff DC, Kitzman DW. Outcomes in ambulatory chronic systolic and diastolic heart failure: a propensity score analysis. Am Heart J 2006, 152(5):956-966. 10.1016/j.ahj.2006.06.020, 2628474, 17070167.
51. Collet D. Modelling survival data in medical research 2003, London, UK: Chapman & Hall/CRC, 2.
52. Concato J, Shah N, Horwitz RI. Randomized, controlled trials, observational studies, and the hierarchy of research designs. N Engl J Med 2000, 342(25):1887-1892. 10.1056/NEJM200006223422507, 1557642, 10861325.
53. Chang YJ, Chen LJ, Chung KP, Lai MS. Application of propensity score model to examine the prognostic significance of lymph node number as a care quality indicator. Surg Oncol 2012, 21(2):e75-e85. 10.1016/j.suronc.2011.12.003, 22221938.
54. Gayat E, Pirracchio R, Resche-Rigon M, Mebazaa A, Mary JY, Porcher R. Propensity scores in intensive care and anaesthesiology literature: a systematic review. Intensive Care Med 2010, 36(12):1993-2003. 10.1007/s00134-010-1991-5, 20689924.
55. Oshima K, Takahashi W, Asano-Mori Y, Izutsu K, Takahashi T, Arai Y, Nakagawa Y, Usuki K, Kurokawa M, Suzuki K, et al. Intensive chemotherapy for elderly patients with acute myelogeneous leukemia: a propensity score analysis by the Japan Hematology and Oncology Clinical Study Group (J-HOCS). Ann Hematol 2012, 1-7.
56. Sanoff HK, Carpenter WR, Freburger J, Li L, Chen K, Zullig LL, Goldberg RM, Schymura MJ, Schrag D. Comparison of adverse events during 5-fluorouracil versus 5-fluorouracil/oxaliplatin adjuvant chemotherapy for stage III colon cancer: A Population-based analysis. Cancer 2012,
57. Rubin DB. Using propensity scores to help design observational studies: application to the tobacco litigation. Health Services and Outcomes Research Methodology 2001, 2(3):169-188.
58. Hirano K, Imbens GW. Estimation of causal effects using propensity score weighting: An application to data on right heart catheterization. Health Services and Outcomes Research Methodology 2001, 2(3):259-278.
59. Kor DJ, Brown MJ, Iscimen R, Brown DR, Whalen FX, Roy TK, Keegan MT. Perioperative statin therapy and renal outcomes after major vascular surgery: a propensity-based analysis. J Cardiothorac Vasc Anesth 2008, 22(2):210-216. 10.1053/j.jvca.2007.12.019, 18375322.