Key issues in clinical and epidemiological research in complementary and alternative medicine - A systematic literature review

Forschende Komplementarmedizin

Volumn 19, Issue SUPPL 2, 2012, Pages 51-60

  Fischer, H Felix ^a   Junne, Florian ^b   Witt, Claudia ^a   Von Ammon, Klaus ^c   Cardini, Francesco ^d   Fønnebø, Vinjar ^e   Johannessen, Helle ^f   Lewith, George ^g   Uehleke, Bernhard ^h,i   Weidenhammer, Wolfgang ^j   Brinkhaus, Benno ^a  

^a CHARITÉ UNIVERSITÄTSMEDIZIN BERLIN   (Germany)

^b UNIVERSITY HOSPITAL TÜBINGEN   (Germany)

^c UNIVERSITY OF BERN   (Switzerland)

^d Agency for Health and Social Care of Emilia Romagna   (Italy)

^e UNIVERSITY OF TROMSØ   (Norway)

^f UNIVERSITY OF SOUTHERN DENMARK   (Denmark)

^g UNIVERSITY OF SOUTHAMPTON   (United Kingdom)

^h UNIVERSITY HOSPITAL ZURICH   (Switzerland)

ⁱ University of Applied Science in Health and Sports   (Germany)

^j TECHNICAL UNIVERSITY OF MUNICH   (Germany)

more..

Author keywords

Clinical research; Complementary and alternative medicine; Epidemiological research; Research methodology; Systematic review

Indexed keywords

ALTERNATIVE MEDICINE; COMPARATIVE STUDY; CULTURAL FACTOR; EPIDEMIOLOGY; EUROPE; FINANCIAL MANAGEMENT; HUMAN; MEDICAL RESEARCH; ORGANIZATION AND MANAGEMENT; REVIEW; STATISTICS; STATISTICS AND NUMERICAL DATA;

BIOMEDICAL RESEARCH; COMPLEMENTARY THERAPIES; CROSS-CULTURAL COMPARISON; EPIDEMIOLOGIC RESEARCH DESIGN; EUROPE; HUMANS; RESEARCH SUPPORT AS TOPIC;

EID: 84879366419     PISSN: 16614119     EISSN: 16614127     Source Type: Journal    
DOI: 10.1159/000343126     Document Type: Article

References (176)

1. Lewith GT, Jonas WB, Walach H (eds): Clinical Research in Complementary Therapies, ed. 2, Edinburgh, Elsevier, 2011.
2. Caspi O, Burleson KO: Methodological challenges in meditation research. Adv Mind Body Med 2005; 21:4-11.
3. Sherman K, Cherkin D: Developing methods for acupuncture research: rationale for and design of a pilot study evaluating the efficacy of acupuncture for chronic low back pain. Altern Ther Health Med 2003;9:54-60.
4. Vickers A, Cassileth B, Ernst E, Fisher P, Goldman P, Jonas WB, Kang S, Lewith GT, Schulz K, Silagy C: How should we research unconventional therapies? A panel report from the Conference on Complementary and Alternative Medicine Research Methodology, National Institutes of Health. Int J Technol Assess Health Care 1997;13:111-121.
5. Zachariae R, Johannessen H: A methodological framework for evaluating the evidence for complementary and alternative medicine (CAM) for cancer. Cancers 2011;3:773-788.
6. Julliard K, Citkovitz C, McDaniel D: Towards a model for planning clinical research in oriental medicine. Explore 2007;3:118-127.
7. Lewith GT, Holgate S: CAM research and development. Complement Ther Nurs Midwifery 2000;6: 19-24.
8. Jonas WB: Policy, the public, and priorities in alternative medicine research. Ann Am Acad Polit Soc Sci 2002;583:29-43.
9. Mackereth P, Dryden SL, Frankel B: Reflexology: recent research approaches. Complement Ther Nurs Midwifery 2000;6:66-71.
10. Thompson TDB: Can the caged bird sing? Reflections on the application of qualitative research methods to case study design in homeopathic medicine. BMC Med Res Methodol 2004;4:4.
11. Vickers A: The NIH Methodology Conference: the methodology debate in the United Kingdom during the past ten years. J Altern Complement Med 1995;1:209-212.
12. Walach H, Falkenberg T, Fønnebø V, Lewith GT, Jonas WB: Circular instead of hierarchical: methodological principles for the evaluation of complex interventions. BMC Med Res Methodol 2006;6:29.
13. Jonas WB: Building an evidence house: challenges and solutions to research in complementary and alternative medicine. Forsch Komplementarmed Klass Naturheilkd 2005;12:159-167.
14. Vuckovic N: Integrating qualitative methods in randomized controlled trials: the experience of the Oregon Center for Complementary and Alternative Medicine. J Altern Complement Med 2002;8: 225-227.
15. Tamayo C, Boon H, Ghishan F, Trinh K: Research methodology: evaluating complementary and alternative therapies. Drug Information J 2002;36: 535-548.
16. Broom A: Using qualitative interviews in CAM research: a guide to study design, data collection and data analysis. Complement Ther Med 2005;13:65-73.
17. Levin J, Glass T, Kushi L, Schuck J, Steele L, Jonas WB: Quantitative methods in research on complementary and alternative medicine: a methodological manifesto. Med Care 1997;35:1079-1094.
18. Gatterman MI: A patient-centered paradigm: a model for chiropractic education and research. J Altern Complement Med 1995;1:371-386.
19. Macpherson H, Peters D, Zollman C: Closing the evidence gap in integrative medicine. Br Med J 2009;339:b3572-b3572.
20. Verhoef MJ, Lewith GT, Ritenbaugh C, Boon H, Fleishman S, Leis A: Complementary and alternative medicine whole systems research: beyond identification of inadequacies of the RCT. Complement Ther Med 2005;13:206-212.
21. Hardy M: Research in ayurveda: where do we go from here? Altern Ther Health Med 2001;7:34-36.
22. Florczak KL: Gathering information on spirituality: from whose perspective? Nurs Sci Q 2010;23: 201-205.
23. Miller W, Crabtree B, Duffy M, Epstein R, Stange K: Research guidelines for assessing the impact of healing relationships in clinical medicine. Altern Ther Health Med 2003;9:A80-A95.
24. Masters KS, Spielmans GI: Prayer and health: review, meta-analysis, and research agenda. J Behav Med 2007;30:329-338.
25. Coulter ID: Alternative philosophical and investigatory paradigms for chiropractic. J Manipulative Physiol Ther 1993;16:419-424.
26. Hagedorn ME, Zahourek RP: Research paradigms and methods for investigating holistic nursing concerns. Nurs Clin North Am 2007;42:335-353.
27. Heusser P: Probleme von Studiendesigns mit Randomisation, Verblindung und Placebogabe. Forsch Komplementarmed Klass Naturheilkd 1999;6:89-102.
28. Verhoef MJ, Casebeer AL, Hilsden RJ: Assessing efficacy of complementary medicine: adding qualitative research methods to the Gold Standard. J Altern Complement Med 2002;8:275-281.
29. Wyatt G, Post-White J: Future direction of complementary and alternative medicine (CAM) education and research. Semin Oncol Nurs 2005;21:215-224.
30. Harlan WR: New opportunities and proven approaches in complementary and alternative medicine research at the National Institutes of Health. J Altern Complement Med 2001;7(suppl1):53-59.
31. Langevin HM, Wayne PM, Macpherson H, Schnyer R, Milley RM, Napadow V, Lao L, Park J, Harris RE, Cohen M, Sherman KJ, Haramati A, Hammerschlag R: Paradoxes in acupuncture research: strategies for moving forward. Evid Based Complement Alternat Med 2011;2011:180805.
32. Ernst E, White AR: A review of problems in clinical acupuncture research. Am J Chin Med 1997;25: 3-11.
33. Richardson J: The use of randomized control trials in complementary therapies: exploring the issues. J Adv Nurs 2000;32:398-406.
34. Bensoussan A: Contemporary acupuncture: the difficulties of research across scientific paradigms. Am J Acupunct 1991;19:357-365.
35. Ernst E: What's the point of rigorous research on complementary/ alternative medicine? J R Soc Med 2002;95:211-213.
36. Hyland M: Methodology for the scientific evaluation of complementary and alternative medicine. Complement Ther Med 2003;11:146-153.
37. Mehling WE, DiBlasi Z, Hecht F: Bias control in trials of bodywork: a review of methodological issues. J Altern Complement Med 2005;11:333-342.
38. Gatchel R, Maddrey A: Clinical outcome in complementary and alternative medicine: an overview of experimental design and analysis. Altern Ther Health Med 1998;4:36-42.
39. Mason S, Tovey P, Long AF: Evaluating complementary medicine: methodological challenges of randomised controlled trials. BMJ 2002;325:832-834.
40. Endres H, Zenz M, Schaub C, Molsberger A, Haake M, Streitberger K, Skipka G, Maier C: Zur Problematik von Akupunkturstudien am Beispiel der Methodik von Gerac. Schmerz 2005;19:201-213.
41. Sikorskii A, Wyatt G, Victorson D, Faulkner G, Rahbar M: Methodological issues in trials of complementary and alternative medicine interventions. Nurs Res 2009;58:444-451.
42. Targ D: Research methodology for studies of prayer and distant healing. Complement Ther Nurs Midwifery 2002;8:29-41.
43. Walji R, Boon H: Redefining the randomized controlled trial in the context of acupuncture research. Complement Ther Clin Pract 2006;12:91-96.
44. Bell IR, Caspi O, Schwartz GER, Grant KL, Gaudet TW, Rychener D, Maizes V, Weil A: Integrative medicine and systemic outcomes research: issues in the emergence of a new model for primary health care. Arch Intern Med 2002;162:133-140.
45. Nahin RL, Straus SE: Research into complementary and alternative medicine: problems and potential. BMJ 2001;322:161-164.
46. Ernst E: Research priorities in CAM. Complement Ther Med 2001;9:186-187.
47. Ernst E, Filshie J, Hardy J: Evidence-based complementary medicine for palliative cancer care: does it make sense? Palliat Med 2003;17:704.
48. Shea JL: Applying evidence-based medicine to traditional chinese medicine: debate and strategy. J Altern Complement Med 2006;12:255-263.
49. Eskinazi D: Methodologic considerations for research in traditional (alternative) medicine. Oral Surg Oral Med Oral Pathol Oral Radiol Endod 1998;86:678-681.
50. Birch S: Clinical research on acupuncture: part 2. Controlled clinical trials, an overview of their methods. J Altern Complement Med 2004;10:481-498.
51. Ai AL, Peterson C, Gillespie B, Bolling S, Jessup M, Behling A, Pierce F: Designing clinical trials on energy healing: ancient art encounters medical science. Altern Ther Health Med 2001;7:83-90.
52. Walach H, Jonas WB, Lewith GT: The role of outcomes research in evaluating complementary medicine alternative medicine. Altern Ther Health Med 2002;8:88-95.
53. Warber S, Gordon A, Gillespie B, Olson M, Assefi N: Standards for conducting clinical biofield energy healing research. Altern Ther Health Med 2003;9: A54-A64.
54. Berman BM: Seminal studies in acupuncture research. J Altern Complement Med 2001;7(suppl1): 129-137.
55. Berman JD, Straus SE: Implementing a research agenda for complementary and alternative medicine. Annu Rev Med 2004;55:239-254.
56. Brown CK: Methodological problems of clinical research into spiritual healing: the healer's perspective. J Altern Complement Med 2000;6:171-176.
57. Tang JL: Research priorities in traditional Chinese medicine. BMJ 2006;333:391-394.
58. Tang JL, Leung PC: An efficacy-driven approach to the research and development of traditional Chinese medicine: Hong Kong Med J 2001;7:375-380.
59. Block KI, Burns B, Cohen AJ, Dobs AS, Hess SM, Vickers A: Point-counterpoint: using clinical trials for the evaluation of integrative cancer therapies. Integr Cancer Ther 2004;3:66-81.
60. Hyman M: The evolution of research, part 1: meeting the needs of systems medicine. Altern Ther Health Med 2006;12:10-11.
61. Walach H: The efficacy paradox in randomized controlled trials of CAM and elsewhere: beware of the placebo trap. J Altern Complement Med 2001; 73:213-218.
62. Wayne PM, Kaptchuk TJ: Challenges inherent to t'ai chi research: part I-T'ai chi as a complex multicomponent intervention. J Altern Complement Med 2008;14:95-102.
63. Hart A: What is the research question? A case study in the early stages of design of a randomised controlled trial for a complementary therapy. Complement Ther Med 2003;11:42-45.
64. Archer C: Research issues in complementary therapies. Complement Ther Nurs Midwifery 1999;5: 108-114.
65. Ziegler R: Mistletoe preparation Iscador: are there methodological concerns with respect to controlled clinical trials? Evid Based Complement Alternat Med 2009;6:19-30.
66. Riley D, Berman B: Complementary and alternative medicine in outcomes research. Altern Ther Health Med 2002;8:36-37.
67. Anderson R: The efficacy of ethnomedicine: research methods in trouble. Med Anthropol 1991; 13:1-17.
68. Weatherley-Jones E, Thompson E, Thomas K: The placebo-controlled trial as a test of complementary and alternative medicine: observations from research experience of individualised homeopathic treatment. Homeopathy 2004;93:186-189.
69. Edwards R: Our research approaches must meet the goal of improving patient care. Altern Ther Health Med 1997;3:100.
70. Ernst E, Canter PH: Interactions between specific and non-specific treatment effects. Homeopathy 2005;94:67.
71. Boon H, Macpherson H, Fleishman S, Grimsgaard S, Koithan M, Norheim AJ, Walach H: Evaluating complex healthcare systems: a critique of four approaches. Evid Based Complement Alternat Med 2007;4:279-285.
72. Staud R: Effectiveness of CAM therapy: understanding the evidence. Rheum Dis Clin North Am 2011;37:9-17.
73. Zander M, Wargovich M, Herbert J: Methodological considerations in the study of diet as part of complementary and alternative medicine modalities. Altern Ther Health Med 2004;10:56-61.
74. Gaus W, Hoegel J: Studies on the efficacy of unconventional therapies: problems and designs. Arzneimittelforschung 1995;45:88-92.
75. Walach H: Is homeopathy amenable to research? Schweiz Rundschau Med 1994;83:1439-1447.
76. Coulter ID, Khorsan R: Is health services research the holy grail of complementary and alternative medicine research? Altern Ther Health Med 2008; 14:40-44.
77. Margolin A: Liabilities involved in conducting randomized clinical trials of CAM therapies in the absence of preliminary, foundational studies: a case in point. J Altern Complement Med 1999;5:103-104.
78. Walach H, Jonas WB, Ives J, van Wijk R, Weingärtner O: Research on homeopathy: state of the art. J Altern Complement Med 2005;11:813-829.
79. Aickin M: The importance of early phase research. J Altern Complement Med 2007;13:447-450.
80. Brien S, Lachance L, Lewith GT: Are the therapeutic effects of homeopathy attributed to the consultation, the homeopathic remedy, or both? A protocol for a future exploratory feasibility trial in patients with rheumatoid arthritis. J Altern Complement Med 2004;10:499-502.
81. Cardini F, Wade C, Regalia AL, Gui S, Li W, Raschetti R, Kronenberg F: Clinical research in traditional medicine: priorities and methods. Complement Ther Med 2006;14:282-287.
82. Firenzuoli F, Gori L: Herbal medicine today: clinical and research issues. Evid Based Complement Alternat Med 2007;4(Suppl1):37-40.
83. Macpherson H: Pragmatic clinical trials. Complement Ther Med 2004;12:136-140.
84. Dean ME: More trials, fewer placebos, please. Br Homeopath J 2000;89:191-194.
85. MacPherson H: Acupuncture research: time to shift from theoretical to practical questions. J Altern Complement Med 2006;12:837-639.
86. Hammond D: The need for clinically relevant research. Am J Clin Hypn 1998;41:2-6.
87. Witt CM: Weitere Forschung ist die Basis für Integration in die Versorgung. Dtsch Arztebl 2009;106: 1786-1789.
88. Oberbaum M, Vithoulkas G: Clinical trials of classical homeopathy: reflections on appropriate research designs. J Altern Complement Med 2003;9:105-111.
89. Hawk C, Khorsan R, Lisi AJ, Ferrance RJ, Evans MW: Chiropractic care for nonmusculoskeletal conditions: a systematic review with implications for whole systems research. J Altern Complement Med 2007;13:491-512.
90. Hess D: Complementary or alternative? Stronger vs weaker integration policies. Am J Public Health 2002;92:1579-1581.
91. Launsø L, Drageset B, Fønnebø V, Jacobson J, Haahr N, White J, Salamonsen A, Horneber M, Egeland E: Exceptional disease courses after the use of CAM: selection, registration, medical assessment, and research. An international perspective. J Altern Complement Med 2006;12:607-613.
92. Nahin RL: Use of the best case series to evaluate complementary and alternative therapies for cancer: a systematic review. Semin Oncol 2002;29: 552-562.
93. Ezzo J: What can be learned from Cochrane systematic reviews of massage that can guide future research? J Altern Complement Med 2007;13: 291-295.
94. Johnston BC, Mills E: N-of-1 randomized controlled trials: an opportunity for complementary and alternative medicine evaluation. J Altern Complement Med 2004;10:979-984.
95. Sung L, Feldman BM: N-of-1 trials: innovative methods to evaluate complementary and alternative medicines in pediatric cancer. J Pediatr Hematol Oncol 2006;28:263-266.
96. Hart A, Sutton CJ: N-of-1 trials and their combination: suitable approaches for CAM research? Complement Ther Med 2003;11:213-214.
97. Ribeaux P, Spence M: CAM evaluation: what are the research questions? Complement Ther Med 2001;9:188-193.
98. Broom A, Adams J: Current issues and future directions in complementary and alternative medicine (CAM) research. Complement Ther Med 2007;15:217-220.
99. Zick SM, Schwabl H, Flower A, Chakraborty B, Hirschkorn K: Unique aspects of herbal whole system research. Explore 2009;5:97-103.
100. Fonteyn M, Bauer-Wu S: Using qualitative evaluation in a feasibility study to improve and refine a complementary therapy intervention prior to subsequent research. Complement Ther Clin Pract 2005;11:247-252.
101. Walker L: Testing complementary and alternative therapies within a research protocol. Eur J Cancer 1999;35:1614-1618.
102. Moroz A: lssues in acupuncture research: the failure of quantitative methodologies and the possibilities for viable, alternative solutions. Am J Acupunct 1999;27:95-103.
103. Graz B, Falquet J, Morency P: Rapid assessment of alternative medicine through a comparison of the expected and observed progress of patients: a feasibility study of the prognosis/follow-up method. J Altern Complement Med 2003;9:755-761.
104. Potrata B: 'She did, he said': the use of ethnography in CAM research. Complement Ther Med 2005;13:131-138.
105. Schulman D: The unexpected outcomes of acupuncture: case reports in support of refocusing research designs. J Altern Complement Med 2004;10:785-789.
106. Baas C: The challenges of clinical case reporting. Delphi Project Conference, London, 2 April 2003.
107. Homeopathy 2003;92:229-231.
108. Mitchell A: Researching healing: a psychologist's perspective. J Altern Complement Med 2000;6: 181-186.
109. Lewith GT, White PJ, Kaptchuk TJ: Developing a research strategy for acupuncture. Clin J Pain 2006;22:632-638.
110. Anderson R: On quantitative and qualitative research. J Altern Complement Med 1998;4:203-204.
111. Biley FC, Freshwater D: Trends in nursing and midwifery research and the need for change in complementary therapy research. Complement Ther Nurs Midwifery 1999;5:99-102.
112. Ziegler R: Elements of therapeutic research structure. Forsch Komplementarmed Klass Naturheilkd 2004;11(suppl1):5-12.
113. Kirkby R, Calabrese C, Kaltman L, Monnier J, Herscu P: Methodological considerations for future controlled influenza treatment trials in complementary and alternative medicine. J Altern Complement Med 2010;16:275-283.
114. Kirkby R, Herscu P: Homeopathic trial design in influenza treatment. Homeopathy 2010;99:69-75.
115. Post-White J, Hawks R, O'Mara A, Ott MJ: Future directions of CAM research in pediatric oncology. J Pediatr Oncol Nurs 2006;23:265-268.
116. Ramaratnam S: Yoga for epilepsy: methodological issues. Seizure 2001;10:3-6.
117. Ernst E: Research into complementary/alternative medicine: an attempt to dispel the myths. Int J Clin Pract 2001;55:376-379.
118. Chiappelli F, Prolo P, Rosenblum M, Edgerton M, Cajulis OS: Evidence-based research in complementary and alternative medicine. II: the process of evidence-based research. Evid Based Complement Alternat Med 2006;3:3-12.
119. Liang F: Thinking on clinical research of acupuncture. Chin J Integr Med 2007;13:168-169.
120. Fønnebø V, Grimsgaard S, Walach H, Ritenbaugh C, Norheim AJ, MacPherson H, Lewith GT, Launsø L, Koithan M, Falkenberg T, Boon H, Aickin M: Researching complementary and alternative treatments-the gatekeepers are not at home. BMC Med Res Methodol 2007;7:7.
121. Hoffmann I: Transcending reductionism in nutrition research. Am J Clin Nutr 2003;78(suppl3): 514-516.
122. Hufford D: Culturally grounded review of research assumptions. Altern Ther Health Med 1996;2:47-53.
123. Jagtenberg T, Evans S, Grant A, Howden I, Lewis M, Singer J: Evidence-based medicine and naturopathy. J Altern Complement Med 2006; 12:323-328.
124. Watanabe K, Matsuura K, Gao P, Hottenbacher L, Tokunaga H, Nishimura K, Imazu Y, Reissenweber H, Witt CM: Traditional Japanese kampo medicine: clinical research between modernity and traditional medicine-the state of research and methodological suggestions for the future. Evid Based Complement Alternat Med 2011; 2011:513842.
125. Fisher P, van Haselen R, Hardy K, Berkovitz S, McCarney R: Effectiveness gaps: a new concept for evaluating health service and research needs applied to complementary and alternative medicine. J Altern Complement Med 2004;10:627-632.
126. Linder SH: Assessing alternative medicine: methodological and research policy concerns. Int J Technol Assess Health Care 2003;19:435-445.
127. Nahin RL: Identifying and pursuing research priorities at the National Center for Complementary and Alternative Medicine. FASEB J 2005;19: 1209-1215.
128. Witt CM: Clinical research on acupuncture-concepts and guidance on efficacy and effectiveness research. Chin J Integr Med 2011;17:166-172.
129. Herbert CP, Verhoef M, White M, O'Beirne M, Doll R: Complementary therapy and cancer: decision making by patients and their physicians setting a research agenda. Patient Educ Couns 1999;38:87-92.
130. Kelner M, Boon H, Wellman B, Welsh S: Complementary and alternative groups contemplate the need for effectiveness, safety and cost-effectiveness research. Complement Ther Med 2002; 10:235-239.
131. Ritenbaugh C, Verhoef OM, Fleishman S, Leis A: Whole systems research: a discipline for studying complementary and alternative medicine. Altern Ther Health Med 2003;9:32-36.
132. Jonas WB, Chez R: The role and importance of definitions and standards in healing research. Altern Ther Health Med 2003;9(suppl3):5-9.
133. Waldram JB: The efficacy of traditional medicine: current theoretical and methodological issues. Med Anthropol 2000;14:603-625.
134. Jacobson J, Workman S, Kronenberg F: Research on complementary and alternative therapies for cancer: issues and methodological considerations. J Am Med Womens Assoc 1999;54:177-180.
135. Ahn A, Kaptchuk TJ: Advancing acupuncture research. Altern Ther Health Med 2005;11:40-45.
136. Linde K: Invited commentary on Hyland ME: methodology for the scientific evaluation of complementary and alternative medicine. Complement Ther Med 2003;11:154-155.
137. Amundson J, Alladin A, Gill E: Efficacy vs. effectiveness research in psychotherapy: implications for clinical hypnosis. Am J Clin Hypn 2003; 46:11-24.
138. Melchart D: Universitäre Forschung in Naturheilkunde und Komplementärmedizin-Perspektiven und Standortbestimmung. Forsch Komplementarmed Klass Naturheilkd 2003;10:176-178.
139. Lewith GT: Can practitioners be researchers? Complement Ther Med 2004;12:2-5.
140. Aickin M: Comparative effectiveness research and CAM. J Altern Complement Med 2010;6:1-2.
141. Leibrich J: Measurement of efficacy: a case for holistic research. Complement Med Res 1990;4:21-25.
142. Andrews GJ: Addressing efficiency: economic evaluation and the agenda for CAM researchers. Complement Ther Clin Pract 2005;11:253-261.
143. Witt CM: Health economic studies on complementary and integrative medicine. Forsch Komplementarmed Klass Naturheilkd 2011;18:6-9.
144. Lewith GT, Vincent C: Evaluation of the clinical effects of acupuncture. Pain Forum 1995;4:29-39.
145. O'Connell NE, Wand BM, Goldacre B: Interpretive bias in acupuncture research?: A case study. Eval Health Prof 2009;32:393-409.
146. Wayne PM, Hammerschlag R: Resolving paradoxes in acupuncture research: a roundtable discussion. J Altern Complement Med 2009;15:1039-1044.
147. Caspi O, Bell IR: One size does not fit all: aptitude × treatment interaction (ATI) as a conceptual framework for complementary and alternative medicine outcome research. Part II-research designs and their applications. J Altern Complement Med 2004;10:698-705.
148. Caspi O, Bell IR: One size does not fit all: Aptitude × treatment interaction (ATI) as a conceptual framework for complementary and alternative medicine outcome research. Part I-what is ATI research? J Altern Complement Med 2004; 10:580-586.
149. Khorsan R, York A, Coulter ID, Wurzman R, Walter JA, Coeytaux RR: Patient-based outcome assessment instruments in acupuncture research. J Altern Complement Med 2010;16:27-35.
150. Hyman M: The evolution of research. Part 2: the clinician's dilemma-treating systems, not diseases. Altern Ther Health Med 2006;12:10-13.
151. Kiene H: What is cognition-based medicine (in German). Z Arztl Fortbild Qualitatssich 2005;99: 301-306.
152. Paterson C, Dieppe P: Characteristic and incidental (placebo) effects in complex interventions such as acupuncture. BMJ 2005;330:1202-1205.
153. White A, Filshie J, Cummings T: Clinical trials of acupuncture: consensus recommendations for optimal treatment, sham controls and blinding. Complement Ther Med 2001;9:237-245.
154. Smith WB: Research methodology: implications for CAM pain research. Clin J Pain 2004;20:3-7.
155. Trinh K: The challenges of nonpharmacological trials: blinding and other issues using acupuncture research as an example. Drug Information J 2002; 36:509-511.
156. Hammerschlag R: Methodological and ethical issues in clinical trials of acupuncture. J Altern Complement Med 1998;4:159-171.
157. Vickers A: Clinical trials of homeopathy and placebo: analysis of a scientific debate. J Altern Complement Med 2000;6:49-56.
158. Fisher P: The development of methodology in homoeopathy. Complement Ther Nurs Midwifery 1995;1:168-174.
159. Oberle K, Allen M: Clinical trials with complementary therapies. West J Nurs Res 2005;27:232-239.
160. Solomon PR, Michalczuk DE: Toward establishing guidelines for evaluating cognitive enhancement with complementary and alterative medicines. Eval Health Prof 2009;32:370-392.
161. Sloan R, Ramakrishnan R: Science, medicine and intercessory prayer. Perspect Biol Med 2006;49: 504-514.
162. Van Lare JM, Conway PH, Sox HC: Five next steps for a new national program for comparative-effectiveness research. N Engl J Med 2010; 362:970-973.
163. Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M: Developing and evaluating complex interventions: The new Medical Research Council guidance. BMJ 2008;337:979-983.
164. Zwarenstein M, Treweek S, Gagnier JJ, Altman DG, Tunis S, Haynes B, Oxman AD, Moher D: Improving the reporting of pragmatic trials: an extension of the CONSORT statement. BMJ 2008;337:a2390.
165. Assessing Complementary Practice: Building Consensus on Appropriate Research Methods. Report of an Independent Advisory Group. The Kings Fund, London, 2009.
166. Long AF: Outcome measurement in complementary and alternative medicine: unpicking the effects. J Altern Complement Med 2002;8:777-786.
167. Buchanan DR, White JD, O'Mara AM, Kelaghan JW, Smith WB, Minasian LM: Research-design issues in cancer-symptom-management trials using complementary and alternative medicine: lessons from the National Cancer Institute Community Clinical Oncology Program experience. J Clin Oncol 2005;23:6682-6689.
168. Joyce CR: Placebo and complementary medicine. Lancet 1994;344:1279-1281.
169. Koog Y, Min B: Does random participant assignment cause fewer benefits in research participants? Systematic review of partially randomized acupuncture trials. J Altern Complement Med 2009;15:1107-1113.
170. Caspi O, Millen C, Sechrest L: Integrity and research: introducing the concept of dual blindness. How blind are double-blind clinical trials in alternative medicine? J Altern Complement Med 2000;6:493-498.
171. Giordano J, Engebretson J, Garcia MK: Challenges to complementary and alternative medical research: focal issues influencing integration into a cancer care model. Integr Cancer Ther 2005; 4:210-218.
172. Aickin M: Participant-centered analysis in complementary and alternative medicine comparative trials. J Altern Complement Med 2003;9:949-957.
173. Schnyer RN, Allen JJ: Bridging the gap in complementary and alternative medicine research: manualization as a means of promoting standardization and flexibility of treatment in clinical trials of acupuncture. J Altern Complement Med 2002;85:623-634.
174. Paterson C, Baarts C, Launsø L, Verhoef MJ: Evaluating complex health interventions: a critical analysis of the 'outcomes' concept. BMC Complement Altern Med 2009;9:18.
175. Thompson EA, Quinn T, Paterson C, Cooke H, McQuigan D, Butters G: Outcome measures for holistic, complex interventions within the palliative care setting. Complement Ther Clin Pract 2008;14:25-32.
176. Meier PC, Rogers C: The need for traditional Chinese medicine morbidity research. Complement Ther Med 2007;15:284-288.