메뉴 건너뛰기




Volumn 258, Issue 2, 2013, Pages 199-207

Trends in worldwide volume and methodological quality of surgical randomized controlled trials

Author keywords

evidence based surgery; level of evidence; methodology of research; randomized controlled trial

Indexed keywords

AFRICA; ARTICLE; HEALTH CARE QUALITY; HUMAN; INTENTION TO TREAT ANALYSIS; MULTICENTER STUDY (TOPIC); NORTH AMERICA; PACIFIC ISLANDS; PRACTICE GUIDELINE; PREVALENCE; PRIORITY JOURNAL; RANDOMIZATION; RANDOMIZED CONTROLLED TRIAL (TOPIC); SAMPLE SIZE; SOUTH AMERICA; SYSTEMATIC ERROR;

EID: 84880569661     PISSN: 00034932     EISSN: 15281140     Source Type: Journal    
DOI: 10.1097/SLA.0b013e31829c7795     Document Type: Article
Times cited : (62)

References (54)
  • 1
    • 0035906286 scopus 로고    scopus 로고
    • Use of the CONSORT statement and quality of reports of randomized trials: A comparative before-and-after evaluation
    • Moher D, Jones A, Lepage L. Use of the CONSORT statement and quality of reports of randomized trials: A comparative before-and-after evaluation. JAMA. 2001;285:1992-1995.
    • (2001) JAMA , vol.285 , pp. 1992-1995
    • Moher, D.1    Jones, A.2    Lepage, L.3
  • 2
    • 0037449502 scopus 로고    scopus 로고
    • When can a clinical trial be called randomized?
    • Berger VW, Bears JD. When can a clinical trial be called "randomized"? Vaccine. 2003;21:468-472.
    • (2003) Vaccine , vol.21 , pp. 468-472
    • Berger, V.W.1    Bears, J.D.2
  • 3
    • 0035822324 scopus 로고    scopus 로고
    • Systematic reviews in health care: Assessing the quality of controlled clinical trials
    • Juni P, Altman DG, Egger M. Systematic reviews in health care: Assessing the quality of controlled clinical trials. BMJ. 2001;323:42-46.
    • (2001) BMJ , vol.323 , pp. 42-46
    • Juni, P.1    Altman, D.G.2    Egger, M.3
  • 4
    • 4344682720 scopus 로고    scopus 로고
    • Opportunities and challenges for improving the quality of reporting clinical research: CONSORT and beyond
    • Moher D, Altman DG, Schulz KF, et al. Opportunities and challenges for improving the quality of reporting clinical research: CONSORT and beyond. CMAJ. 2004;171:349-350.
    • (2004) CMAJ , vol.171 , pp. 349-350
    • Moher, D.1    Altman, D.G.2    Schulz, K.F.3
  • 5
    • 9444255722 scopus 로고    scopus 로고
    • Improving the quality of reporting of randomized controlled trials. The consort statement
    • Begg C, Cho M, Eastwood S, et al. Improving the quality of reporting of randomized controlled trials. The CONSORT statement. JAMA. 1996;276: 637-639.
    • (1996) JAMA , vol.276 , pp. 637-639
    • Begg, C.1    Cho, M.2    Eastwood, S.3
  • 6
    • 0035901583 scopus 로고    scopus 로고
    • The CONSORT statement: Revised recommendations for improving the quality of reports of parallel-group randomized trials
    • Moher D, Schulz KF, Altman DG. The CONSORT statement: Revised recommendations for improving the quality of reports of parallel-group randomized trials. Ann Intern Med. 2001;134:657-662.
    • (2001) Ann Intern Med , vol.134 , pp. 657-662
    • Moher, D.1    Schulz, K.F.2    Altman, D.G.3
  • 7
    • 77950273246 scopus 로고    scopus 로고
    • CONSORT 2010 explanation and elaboration: Updated guidelines for reporting parallel group randomised trials
    • Moher D, Hopewell S, Schulz KF, et al. CONSORT 2010 explanation and elaboration: Updated guidelines for reporting parallel group randomised trials. BMJ. 2010;340:c869.
    • (2010) BMJ , vol.340
    • Moher, D.1    Hopewell, S.2    Schulz, K.F.3
  • 8
    • 33846815302 scopus 로고    scopus 로고
    • Reporting in randomized clinical trials improved after adoption of the CONSORT statement
    • Kane RL,Wang J, Garrard J. Reporting in randomized clinical trials improved after adoption of the CONSORT statement. J Clin Epidemiol. 2007;60:241-249.
    • (2007) J Clin Epidemiol , vol.60 , pp. 241-249
    • Kane, R.L.1    Wang, J.2    Garrard, J.3
  • 9
    • 33751015788 scopus 로고    scopus 로고
    • Why should surgeons care about clinical research methodology?
    • Chang DC, Matsen SL, Simpkins CE.Why should surgeons care about clinical research methodology? J Am Coll Surg. 2006;203:827-830.
    • (2006) J Am Coll Surg , vol.203 , pp. 827-830
    • Chang, D.C.1    Matsen, S.L.2    Simpkins, C.E.3
  • 10
    • 66349110841 scopus 로고    scopus 로고
    • Improvement in the quality of randomized controlled trials among general anesthesiology journals 2000 to 2006: A 6-year follow-up
    • Greenfield ML, Mhyre JM, Mashour GA, et al. Improvement in the quality of randomized controlled trials among general anesthesiology journals 2000 to 2006: A 6-year follow-up. Anesth Analg. 2009;108:1916-1921.
    • (2009) Anesth Analg , vol.108 , pp. 1916-1921
    • Greenfield, M.L.1    Mhyre, J.M.2    Mashour, G.A.3
  • 11
    • 37649005237 scopus 로고    scopus 로고
    • Quality of reporting of key methodological items of randomized controlled trials in clinical ophthalmic journals
    • Lai TY,Wong VW, Lam RF, et al. Quality of reporting of key methodological items of randomized controlled trials in clinical ophthalmic journals. Ophthalmic Epidemiol. 2007;14:390-398.
    • (2007) Ophthalmic Epidemiol , vol.14 , pp. 390-398
    • Lai, T.Y.1    Wong, V.W.2    Lam, R.F.3
  • 12
    • 36749055208 scopus 로고    scopus 로고
    • The reporting quality of randomised controlled trials in surgery: A systematic review
    • Agha R, Cooper D, Muir G. The reporting quality of randomised controlled trials in surgery: A systematic review. Int J Surg. 2007;5:413-422.
    • (2007) Int J Surg , vol.5 , pp. 413-422
    • Agha, R.1    Cooper, D.2    Muir, G.3
  • 13
    • 33745293120 scopus 로고    scopus 로고
    • Quality of reporting of randomized, controlled trials in cerebral palsy
    • Anttila H, Malmivaara A, Kunz R, et al. Quality of reporting of randomized, controlled trials in cerebral palsy. Pediatrics. 2006;117:2222-2230.
    • (2006) Pediatrics. , vol.117 , pp. 2222-2230
    • Anttila, H.1    Malmivaara, A.2    Kunz, R.3
  • 14
    • 0037097838 scopus 로고    scopus 로고
    • Randomised trials in surgery: Problems and possible solutions
    • McCulloch P, Taylor I, SasakoM, et al. Randomised trials in surgery: Problems and possible solutions. BMJ. 2002;324:1448-1451.
    • (2002) BMJ , vol.324 , pp. 1448-1451
    • McCulloch, P.1    Sasakom, T.I.2
  • 15
    • 77649155325 scopus 로고    scopus 로고
    • Randomized controlled trials of surgical interventions
    • Farrokhyar F, Karanicolas PJ, Thoma A, et al. Randomized controlled trials of surgical interventions. Ann Surg. 2010;251:409-416.
    • (2010) Ann Surg. , vol.251 , pp. 409-416
    • Farrokhyar, F.1    Karanicolas, P.J.2    Thoma, A.3
  • 16
    • 62849085020 scopus 로고    scopus 로고
    • The challenges faced in the design, conduct and analysis of surgical randomised controlled trials
    • Cook JA. The challenges faced in the design, conduct and analysis of surgical randomised controlled trials. Trials. 2009;10:9.
    • (2009) Trials , vol.10 , pp. 9
    • Cook, J.A.1
  • 17
    • 0034603353 scopus 로고    scopus 로고
    • Publishing surgery
    • Smith R. Publishing surgery. Lancet. 2000;355:849.
    • (2000) Lancet , vol.355 , pp. 849
    • Smith, R.1
  • 18
    • 0038350309 scopus 로고    scopus 로고
    • Perspectives of evidence-based surgery
    • Wente MN, Seiler CM, Uhl W, et al. Perspectives of evidence-based surgery. Dig Surg. 2003;20:263-269.
    • (2003) Dig Surg. , vol.20 , pp. 263-269
    • Wente, M.N.1    Seiler, C.M.2    Uhl, W.3
  • 19
    • 0029879646 scopus 로고    scopus 로고
    • Surgical research or comic opera: Questions, but fewanswers
    • Horton R. Surgical research or comic opera: Questions, but fewanswers. Lancet. 1996;347:984-985.
    • (1996) Lancet. , vol.347 , pp. 984-985
    • Horton, R.1
  • 20
    • 33749599746 scopus 로고    scopus 로고
    • Comparison of reports of randomized controlled trials and systematic reviews in surgical journals: Literature review
    • Panesar SS, Thakrar R, Athanasiou T, et al. Comparison of reports of randomized controlled trials and systematic reviews in surgical journals: Literature review. J R Soc Med. 2006;99:470-472.
    • (2006) J R Soc Med. , vol.99 , pp. 470-472
    • Panesar, S.S.1    Thakrar, R.2    Athanasiou, T.3
  • 21
    • 0027439484 scopus 로고
    • Clinical studies in surgical journals-have we improved?
    • Solomon MJ, McLeod RS. Clinical studies in surgical journals-have we improved? Dis Colon Rect. 1993;36:43-48.
    • (1993) Dis Colon Rect. , vol.36 , pp. 43-48
    • Solomon, M.J.1    McLeod, R.S.2
  • 22
    • 84887346660 scopus 로고    scopus 로고
    • Cochrane handbook for systematic reviews of interventions
    • Higgins J, Green S. Cochrane Handbook for Systematic Reviews of Interventions. The Cochrane Collaboration; 2008.
    • (2008) The Cochrane Collaboration
    • Higgins, J.1    Green, S.2
  • 24
    • 15744365927 scopus 로고    scopus 로고
    • Epidemiology and reporting of randomised trials published in PubMed journals
    • Chan AW, Altman DG. Epidemiology and reporting of randomised trials published in PubMed journals. Lancet. 2005;365:1159-1162.
    • (2005) Lancet. , vol.365 , pp. 1159-1162
    • Chan, A.W.1    Altman, D.G.2
  • 25
    • 40949113623 scopus 로고    scopus 로고
    • Empirical evidence of bias in treatment effect estimates in controlled trials with different interventions and outcomes: Meta-epidemiological study
    • Wood L, Egger M, Gluud LL, et al. Empirical evidence of bias in treatment effect estimates in controlled trials with different interventions and outcomes: Meta-epidemiological study. BMJ. 2008;336:601-605.
    • (2008) BMJ , vol.336 , pp. 601-605
    • Wood, L.1    Egger, M.2    Gluud, L.L.3
  • 26
    • 85047692188 scopus 로고
    • Empirical evidence of bias Dimensions of methodological quality associated with estimates of treatment effects in controlled trials
    • SchulzKF, Chalmers I, Hayes RJ, et al. Empirical evidence of bias.Dimensions of methodological quality associated with estimates of treatment effects in controlled trials. JAMA. 1995;273:408-412.
    • (1995) JAMA , vol.273 , pp. 408-412
    • Schulz, K.F.1    Chalmers, I.2    Hayes, R.J.3
  • 27
    • 0345583669 scopus 로고    scopus 로고
    • The hazards of scoring the quality of clinical trials for meta-analysis
    • Juni P,Witschi A, Bloch R, et al. The hazards of scoring the quality of clinical trials for meta-analysis. JAMA. 1999;282:1054-1060.
    • (1999) JAMA , vol.282 , pp. 1054-1060
    • Juni, P.1    Witschi, A.2    Bloch, R.3
  • 28
    • 0025600371 scopus 로고
    • An empirical study of the possible relation of treatment differences to quality scores in controlled randomized clinical trials
    • Emerson JD, Burdick E, Hoaglin DC, et al. An empirical study of the possible relation of treatment differences to quality scores in controlled randomized clinical trials. Control Clin Trials. 1990;11:339-352.
    • (1990) Control Clin Trials. , vol.11 , pp. 339-352
    • Emerson, J.D.1    Burdick, E.2    Hoaglin, D.C.3
  • 29
    • 0032944846 scopus 로고    scopus 로고
    • Clinical trials in general surgical journals: Are methods better reported?
    • Schumm LP, Fisher JS, Thisted RA, et al. Clinical trials in general surgical journals: Are methods better reported? Surgery. 1999;125:41-45.
    • (1999) Surgery. , vol.125 , pp. 41-45
    • Schumm, L.P.1    Fisher, J.S.2    Thisted, R.A.3
  • 30
    • 77950278169 scopus 로고    scopus 로고
    • The quality of reports of randomised trials in 2000 and 2006: Comparative study of articles indexed in Pub
    • Hopewell S, Dutton S, Yu LM, et al. The quality of reports of randomised trials in 2000 and 2006: Comparative study of articles indexed in PubMed. BMJ. 2010;340:c723.
    • (2010) Med. BMJ. , vol.340
    • Hopewell, S.1    Dutton, S.2    Yu, L.M.3
  • 31
    • 58749099478 scopus 로고    scopus 로고
    • Trends in the quality of highly cited surgical research over the past 20 years
    • Brooke BS, Nathan H, Pawlik TM. Trends in the quality of highly cited surgical research over the past 20 years. Ann Surg. 2009;249:162-167.
    • (2009) Ann Surg. , vol.249 , pp. 162-167
    • Brooke, B.S.1    Nathan, H.2    Pawlik, T.M.3
  • 32
    • 68349104094 scopus 로고    scopus 로고
    • Randomized trials published in some Chinese journals: How many are randomized?
    • Wu T, Li Y, Bian Z, et al. Randomized trials published in some Chinese journals: How many are randomized? Trials. 2009;10:46.
    • (2009) Trials , vol.10 , pp. 46
    • Wu, T.1    Li, Y.2    Bian, Z.3
  • 33
    • 34548295866 scopus 로고    scopus 로고
    • The quality of reporting of randomized controlled trials of traditional Chinese medicine a survey of 13 randomly selected journals from mainland China
    • Wang G, Mao B, Xiong ZY, et al. The quality of reporting of randomized controlled trials of traditional Chinese medicine: A survey of 13 randomly selected journals from mainland China. Clin Ther. 2007;29:1456-1467.
    • (2007) Clin Ther. , vol.29 , pp. 1456-1467
    • Wang, G.1    Mao, B.2    Xiong, Z.Y.3
  • 34
    • 49749152059 scopus 로고    scopus 로고
    • Chinese authors do need CONSORT reporting quality assessment for five leading Chinese medical journals
    • Xu L, Li J, Zhang M, et al. Chinese authors do need CONSORT: Reporting quality assessment for five leading Chinese medical journals. Contemp Clin Trials. 2008;29:727-731.
    • (2008) Contemp Clin Trials. , vol.29 , pp. 727-731
    • Xu, L.1    Li, J.2    Zhang, M.3
  • 35
    • 84866908603 scopus 로고    scopus 로고
    • Overcoming the funding challenge: The cost of randomized controlled trials in the next decade
    • Shore BJ, Nasreddine AY, Kocher MS. Overcoming the funding challenge: The cost of randomized controlled trials in the next decade. J Bone Joint Surg Am. 2012;94(suppl 1):101-106.
    • (2012) J Bone Joint Surg A.m. , vol.94 , Issue.SUPPL. 1 , pp. 101-106
    • Shore, B.J.1    Nasreddine, A.Y.2    Kocher, M.S.3
  • 36
    • 0033591768 scopus 로고    scopus 로고
    • Why randomized surgical oncology trials are so scarce
    • Reynolds T. Why randomized surgical oncology trials are so scarce. J Natl Cancer Inst. 1999;91:1182-1183.
    • (1999) J Natl Cancer Inst. , vol.91 , pp. 1182-1183
    • Reynolds, T.1
  • 37
    • 70349294326 scopus 로고    scopus 로고
    • Challenges in evaluating surgical innovation
    • Ergina PL, Cook JA, Blazeby JM, et al. Challenges in evaluating surgical innovation. Lancet. 2009;374:1097-1104.
    • (2009) Lancet. , vol.374 , pp. 1097-1104
    • Ergina, P.L.1    Cook, J.A.2    Blazeby, J.M.3
  • 38
    • 70349280608 scopus 로고    scopus 로고
    • No surgical innovation without evaluation: The IDEAL recommendations
    • McCulloch P, Altman DG, Campbell WB, et al. No surgical innovation without evaluation: The IDEAL recommendations. Lancet. 2009;374:1105-1112.
    • (2009) Lancet. , vol.374 , pp. 1105-1112
    • McCulloch, P.1    Altman, D.G.2    Campbell, W.B.3
  • 39
    • 40349102088 scopus 로고    scopus 로고
    • A concept for trial institutions focussing on randomised controlled trials in surgery
    • Rahbari NN, Diener MK, Fischer L, et al. A concept for trial institutions focussing on randomised controlled trials in surgery. Trials. 2008;9:3.
    • (2008) Trials. , vol.9 , pp. 3
    • Rahbari, N.N.1    Diener, M.K.2    Fischer, L.3
  • 40
    • 39449089584 scopus 로고    scopus 로고
    • Probiotic prophylaxis in predicted severe acute pancreatitis: A randomised, double-blind, placebo-controlled trial
    • Besselink MG, van Santvoort HC, Buskens E, et al. Probiotic prophylaxis in predicted severe acute pancreatitis: A randomised, double-blind, placebo-controlled trial. Lancet. 2008;371:651-659.
    • (2008) Lancet. , vol.371 , pp. 651-659
    • Besselink, M.G.1    Van Santvoort, H.C.2    Buskens, E.3
  • 41
    • 77951434634 scopus 로고    scopus 로고
    • Astep-up approach or open necrosectomy for necrotizing pancreatitis
    • van SantvoortHC, BesselinkMG, Bakker OJ, et al.Astep-up approach or open necrosectomy for necrotizing pancreatitis. N Engl J Med. 2010;362:1491-1502.
    • (2010) N Engl J Med. , vol.362 , pp. 1491-1502
    • Van Santvoort, H.C.1    Besselink, M.G.2    Bakker, O.J.3
  • 42
    • 84860190237 scopus 로고    scopus 로고
    • Fibrin sealant for prevention of resection surface-related complications after liver resection: A randomized controlled trial
    • de Boer MT, Klaase JM, Verhoef C, et al. Fibrin sealant for prevention of resection surface-related complications after liver resection: A randomized controlled trial. Ann Surg. 2012;256:229-234.
    • (2012) Ann Surg. , vol.256 , pp. 229-234
    • De Boer, M.T.1    Klaase, J.M.2    Verhoef, C.3
  • 43
    • 84856443426 scopus 로고    scopus 로고
    • Impact of nationwide centralization of pancreaticoduodenectomy on hospital mortality
    • de Wilde RF, Besselink MG, van der Tweel I, et al. Impact of nationwide centralization of pancreaticoduodenectomy on hospital mortality. Br J Surg. 2012;99:404-410.
    • (2012) Br J Surg. , vol.99 , pp. 404-410
    • De Wilde, R.F.1    Besselink, M.G.2    Van Der Tweel, I.3
  • 44
    • 84861158685 scopus 로고    scopus 로고
    • Evidence-based medicine at the point of care: Student utilization and faculty implications
    • Bien M, Simanton E. Evidence-based medicine at the point of care: Student utilization and faculty implications. S D Med. 2012;65:137-139.
    • (2012) S D Med. , vol.65 , pp. 137-139
    • Bien, M.1    Simanton, E.2
  • 45
    • 84859639934 scopus 로고    scopus 로고
    • Educatingmedical students in evidence-based medicine: What we should expect as a starting point for our house officers
    • Kahlon G, Mansi IA, Banks DE. Educatingmedical students in evidence-based medicine: What we should expect as a starting point for our house officers. South Med J. 2012;105:184-188.
    • (2012) South Med J. , vol.105 , pp. 184-188
    • Kahlon, G.1    Mansi, I.A.2    Banks, D.E.3
  • 46
    • 0037160763 scopus 로고    scopus 로고
    • Blinding in randomised trials: Hiding who got what
    • Schulz KF, Grimes DA. Blinding in randomised trials: Hiding who got what. Lancet. 2002;359:696-700.
    • (2002) Lancet. , vol.359 , pp. 696-700
    • Schulz, K.F.1    Grimes, D.A.2
  • 47
    • 43049097832 scopus 로고    scopus 로고
    • Blinding of outcomes in trials of orthopaedic trauma: An opportunity to enhance the validity of clinical trials
    • Karanicolas PJ, Bhandari M, Taromi B, et al. Blinding of outcomes in trials of orthopaedic trauma: An opportunity to enhance the validity of clinical trials. J Bone Joint Surg Am. 2008;90:1026-1033.
    • (2008) J Bone Joint Surg A.m. , vol.90 , pp. 1026-1033
    • Karanicolas, P.J.1    Bhandari, M.2    Taromi, B.3
  • 48
    • 33748671821 scopus 로고    scopus 로고
    • Does the consort checklist improve the quality of reports of randomised controlled trials? A systematic review
    • Plint AC, Moher D, Morrison A, et al. Does the CONSORT checklist improve the quality of reports of randomised controlled trials? A systematic review. Med J Aust. 2006;185:263-267.
    • (2006) Med J Aust. , vol.185 , pp. 263-267
    • Plint, A.C.1    Moher, D.2    Morrison, A.3
  • 49
    • 18444382649 scopus 로고    scopus 로고
    • Endorsement of the CONSORT statement by high impact medical journals: Survey of instructions for authors
    • Altman DG. Endorsement of the CONSORT statement by high impact medical journals: Survey of instructions for authors. BMJ. 2005;330:1056-1057.
    • (2005) BMJ , vol.330 , pp. 1056-1057
    • Altman, D.G.1
  • 50
    • 77957805368 scopus 로고    scopus 로고
    • Assessment of the quality of reporting in abstracts of randomized controlled trials published in five leading Chinese medical journals
    • Chen Y, Li J, Ai C, et al. Assessment of the quality of reporting in abstracts of randomized controlled trials published in five leading Chinese medical journals. PLoS One. 2010;5:e11926.
    • (2010) PLoS One. , vol.5
    • Chen, Y.1    Li, J.2    Ai, C.3
  • 51
    • 43049107191 scopus 로고    scopus 로고
    • Endorsement of the CONSORT statement by high impact factor medical journals: A survey of journal editors and journal instructions to authors
    • Hopewell S, Altman DG, Moher D, et al. Endorsement of the CONSORT statement by high impact factor medical journals: A survey of journal editors and journal "instructions to authors." Trials. 2008;9:20.
    • (2008) Trials , vol.9 , pp. 20
    • Hopewell, S.1    Altman, D.G.2    Moher, D.3
  • 52
    • 19944411435 scopus 로고    scopus 로고
    • An observational study found that authors of randomized controlled trials frequently use concealment of randomization and blinding, despite the failure to report these methods
    • Devereaux PJ, Choi PT, El-Dika S, et al. An observational study found that authors of randomized controlled trials frequently use concealment of randomization and blinding, despite the failure to report these methods. J Clin Epidemiol. 2004;57:1232-1236.
    • (2004) J Clin Epidemiol. , vol.57 , pp. 1232-1236
    • Devereaux, P.J.1    Choi, P.T.2    El-Dika, S.3
  • 53
    • 0028235603 scopus 로고
    • Assessing the quality of randomization from reports of controlled trials published in obstetrics and gynecology journals
    • Schulz KF, Chalmers I, Grimes DA, et al. Assessing the quality of randomization from reports of controlled trials published in obstetrics and gynecology journals. JAMA. 1994;272:125-128.
    • (1994) JAMA , vol.272 , pp. 125-128
    • Schulz, K.F.1    Chalmers, I.2    Grimes, D.A.3
  • 54
    • 0346688601 scopus 로고    scopus 로고
    • Bad reporting does not mean bad methods for randomised trials: Observational study of randomised controlled trials performed by the radiation therapy oncology group
    • Soares HP, Daniels S, Kumar A, et al. Bad reporting does not mean bad methods for randomised trials: Observational study of randomised controlled trials performed by the Radiation Therapy Oncology Group. BMJ. 2004;328: 22-24.
    • (2004) BMJ , vol.328 , pp. 22-24
    • Soares, H.P.1    Daniels, S.2    Kumar, A.3


* 이 정보는 Elsevier사의 SCOPUS DB에서 KISTI가 분석하여 추출한 것입니다.