Clinical attrition due to biased preclinical assessments of potential efficacy

Pharmacology and Therapeutics

Volumn 115, Issue 1, 2007, Pages 148-175

  Lindner, Mark D ^a  

^a NONE   (United States)

Author keywords

Bias; Drug discovery; Efficacy; Expectancy; Preclinical assessments; Productivity

Indexed keywords

2 AMINO 4 (METHYLSULFONYL)BUTYRYLGLUTAMYLHISTIDYLPHENYLALANYL DEXTRO LYSYLPHENYLALANINE; ADAFENOXATE; AMIRIDINE; ANSECULIN; HEPTYLSTIGMINE TARTRATE; LAZABEMIDE; LINOPIRDINE; MILAMELINE; SURITOZOLE; XANOMELINE; ZANEPEZIL;

ATTENTION; CITATION ANALYSIS; CLINICAL ASSESSMENT; CLINICAL EFFECTIVENESS; CLINICAL RESEARCH; CLINICAL TRIAL; CONDITIONING; DECISION MAKING; DRUG MECHANISM; DRUG RESEARCH; EXPERIMENTAL STUDY; FEEDBACK SYSTEM; FOOD AND DRUG ADMINISTRATION; HUMAN; MEDICAL EXPERT; PERCEPTION; PREVALENCE; PRIORITY JOURNAL; PUBLISHING; REVIEW;

ANIMALS; BIAS (EPIDEMIOLOGY); DRUG DESIGN; DRUG EVALUATION, PRECLINICAL; HUMANS; PHARMACOLOGY, CLINICAL; RESEARCH DESIGN;

EID: 34347218910     PISSN: 01637258     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.pharmthera.2007.05.002     Document Type: Review

References (249)

1. Adler, N.E. The influence of experimenter set and subject set on the experimenter expectancy set. 1968. Unpublished AB thesis, Wellesley College.
2. Amir Y., and Sharon I. Replication research: a "must" for the scientific advancement of psychology. J Soc Behav Pers 5 4 (1990) 51-69
3. Anturane re-infarction trial research group. Sulfinpyrazone in the prevention of sudden death after myocardial infarction. The Anturane Reinfarction Trial Research Group. N Engl J Med 302 5 (1980) 250-256
4. Armitage P., McPherson C.K., and Rowe B.C. Repeated significance tests on accumulating data. J R Stat Soc Ser A 132 (1969) 235-244
5. Assmann S.F., Pocock S.J., Enos L.E., and Kasten L.E. Subgroup analysis and other (mis)uses of baseline data in clinical trials. Lancet 355 9209 (2000) 1064-1069
6. Baar J., and Tannock I. Analyzing the same data in two ways: a demonstration model to illustrate the reporting and misreporting of clinical trials. J Clin Oncol 7 7 (1989) 969-978
7. Babbage, C. (1830). Decline of Science in England, Published in the United States by the IndyPublish.com, McLean, VA.
8. Bacon F. Novum Organum: With Other Parts of The Great Instauration (1620), Open Court, Chicago, IL
9. Bailey K.R. Detecting fabrication of data in a multicenter collaborative animal study. Control Clin Trials 12 6 (1991) 741-752
10. Bardy A.H. Bias in reporting clinical trials. Br J Clin Pharmacol 46 2 (1998) 147-150
11. Beach M.L., and Meier P. Choosing covariates in the analysis of clinical trials. Control Clin Trials 10 4 Suppl (1989) 161S-175S
12. Beadle G.W. Mendelism, 1965. In: Brink R.A., and Styles E.D. (Eds). Heritage from Mendel (1967), The University of Wisconsin Press, Madison, Milwaukee
13. Beecher H.K. The powerful placebo. JAMA 159 17 (1955) 1602-1606
14. Begg C.B., and Berlin J.A. Publication bias and dissemination of clinical research. J Natl Cancer Inst 81 2 (1989) 107-115
15. Ben-David J. Organization, social control, and cognitive change in science. In: Ben-David J., and Clark T.N. (Eds). Culture and Its Creators: Essays in Honor of Edward Shils (1977), The University of Chicago Press, Chicago, IL
16. Berkson J., Magath T.B., and Hurn M. The error of estimate of the blood cell count as made with the hemocytometer. Am J Physiol 128 (1940) 309-323
17. Bernard C. An Introduction to the Study of Experimental Medicine (1865), Dover Publications Inc, New York
18. Blass T. The Milgram paradigm after 35 years: some things we now know about obedience to authority. J Appl Soc Psychol 29 5 (1999) 955-978
19. Blumenthal D.S., Burke R., and Shapiro A.K. The validity of "identical matching placebos". Arch Gen Psychiatry 31 2 (1974) 214-215
20. Bornstein R.F. Publication politics, experimenter bias and the replication process in social science research. J Soc Behav Pers 5 (1990) 71-81
21. Broad W., and Wade N. Betrayers of the Truth: Fraud and Deceit in the Halls of Science (1982), Simon and Schuster, New York, NY
22. Brownstein A.L. Biased predecision processing. Psychol Bull 129 4 (2003) 545-568
23. Bruner J.S., and Postman L. On the perception of incongruity; a paradigm. J Pers 18 2 (1949) 206-223
24. Bulthoff I., Bulthoff H., and Sinha P. Top-down influences on stereoscopic depth-perception. Nat Neurosci 1 3 (1998) 254-257
25. Burnham J.R. Experimenter bias and lesion labeling (1966), Purdue University (Unpublished manuscript)
26. Campbell K.E., and Jackson T.T. The role and need for replication research in social psychology. Replication Soc Psychol 1 1 (1979) 3-14
27. Carleton R.A., Sanders C.A., and Burack W.R. Heparin administration after acute myocardial infarction. N Engl J Med 263 (1960) 1002-1005
28. Carroll D., Moore R.A., Mcquay H.J., Fairman F., Tramer M., and Leijon G. Transcutaneous electrical nerve stimulation (TENS) for chronic pain. Cochrane Database Syst Rev 3 (2001) (CD003222)
29. Chaikin A.L., Sigler E., and Derlega V.J. Nonverbal mediators of teacher expectancy effects. J Pers Soc Psychol 30 (1974) 144-149
30. Chalmers T.C., Celano P., Sacks H.S., and Smith Jr. H. Bias in treatment assignment in controlled clinical trials. N Engl J Med 309 22 (1983) 1358-1361
31. Chalmers T.C., Matta R.J., Smith Jr. H., and Kunzler A.M. Evidence favoring the use of anticoagulants in the hospital phase of acute myocardial infarction. N Engl J Med 297 20 (1977) 1091-1096
32. Chapman L.J., and Chapman J.P. Genesis of popular but erroneous psychodiagnostic observations. J Abnorm Psychology 72 3 (1967) 193-204
33. Chapman L.J., and Chapman J.P. Illusory correlation as an obstacle to the use of valid psychodiagnostic signs. J Abnorm Psychology 74 3 (1969) 271-280
34. Chapman L.J. Illusory correlation in observational report. J Verbal Learn Verbal Behav 6 (1967) 151-155
35. Cliff N. Analyzing Multivariate Data (1987), Harcourt Brace Jovanovich, San Diego, CA
36. CMR Internationale. 2006 Global R&D Performance Metrics Programme: Industry Success Rates Report (2006), Centre for Medicines Research International Ltd, Novellus Court, 61 South Street, Epsom, Surrey, KT18 7PX, UK
37. Cochran W.G. Errors of measurement in statistics. Technometrics 10 4 (1968) 637-666
38. Cohen C.M. A path to improved pharmaceutical productivity. Nat Rev Drug Discov 2 9 (2003) 751-753
39. Collins H.M. Changing Order: Replication and Induction in Scientific Practice (1992), University of Chicago Press, Chicago, IL
40. Cordaro L., and Ison J.R. Psychology of the scientist: X. Observer bias in classical conditioning of the planarian. Psychol Rep 13 (1963) 787-789
41. Coursol A., and Wagner E.E. Effect of positive findings on submission and acceptance rates: a note on meta-analysis bias. Prof Psychol 17 (1986) 136-137
42. David P. The system defends itself. Nature 303 2 (1983) 369
43. Dawes R.M., Faust D., and Meehl P.E. Clinical versus actuarial judgment. Science 243 4899 (1989) 1668-1674
44. Diaconis P. Statistical problems in ESP research. Science 201 4351 (1978) 131-136
45. Dickersin K., Chan S., Chalmers T.C., Sacks H.S., and Smith Jr. H. Publication bias and clinical trials. Control Clin Trials 8 4 (1987) 343-353
46. Dickersin K., and Min Y.I. Publication bias: the problem that won't go away. Ann NY Acad Sci 703 (1993) 135-146
47. Dickson M., and Gagnon J.P. The cost of new drug discovery and development. Discov Med 4 22 (2004) 172-179
48. Diehl L.F., and Perry D.J. A comparison of randomized concurrent control groups with matched historical control groups: are historical controls valid?. J Clin Oncol 4 7 (1986) 1114-1120
49. DiMasi J.A. Risks in new drug development: approval success rates for investigational drugs. Clin Pharmacol Ther 69 5 (2001) 297-307
50. DiMasi J.A. The value of improving the productivity of the drug development process: faster times and better decisions. Pharmacoeconomics 20 Suppl 3 (2002) 1-10
51. DiMasi J.A., Hansen R.W., and Grabowski H.G. The price of innovation: new estimates of drug development costs. J Health Econ 22 2 (2003) 151-185
52. Ditto P.H., Munro G.D., Apanovitch A.M., Scepansky J.A., and Lockhart L.K. Spontaneous skepticism: the interplay of motivation and expectation in responses to favorable and unfavorable medical diagnoses. Pers Soc Psychol Bull 29 9 (2003) 1120-1132
53. Djulbegovic B., Lacevic M., Cantor A., Fields K.K., Bennett C.L., Adams J.R., et al. The uncertainty principle and industry-sponsored research. Lancet 356 9230 (2000) 635-638
54. Dunn L. Mendel, his work, and his place in history. Proc Am Philos Soc 109 (1965) 189-198
55. Easterbrook P.J., Berlin J.A., Gopalan R., and Matthews D.R. Publication bias in clinical research. Lancet 337 8746 (1991) 867-872
56. Edwards C.C. Regulations describing scientific content of adequate and well-controlled clinical investigations. Fed Regist 35 90 (1970) 7250-7253
57. Edwards K., and Smith E.E. A disconfirmation bias in the evaluation of arguments. J Pers Soc Psychol 71 (1996) 5-24
58. Einhorn H.J., and Hogarth R.M. Confidence in judgment: persistence of the illusion of validity. Psychol Rev 85 5 (1978) 395-416
59. Ellis R.R., and Lederman S.J. The golf-ball illusion: evidence for top-down processing in weight perception. Perception 27 2 (1998) 193-201
60. Ellson D.G. Hallucinations produced by sensory conditioning. J Exp Psychol 28 (1941) 1-20
61. Engler R.L., Covell J.W., Friedman P.J., Kitcher P.S., and Peters R.M. Misrepresentation and responsibility in medical research. N Engl J Med 317 22 (1987) 1383-1389
62. Epstein W.V. Expectation bias in rheumatoid arthritis clinical trials. The anti-CD4 monoclonal antibody experience. Arthritis Rheum 39 11 (1996) 1773-1780
63. Ernst E., and Resch K.L. Reviewer bias: a blinded experimental study. J Lab Clin Med 124 2 (1994) 178-182
64. Faust D., Hart K., and Guilmette T.J. Pediatric malingering: the capacity of children to fake believable deficits on neuropsychological testing. J Consult Clin Psychol 56 4 (1988) 578-582
65. FDA. Innovation or stagnation: challenge and opportunity on the critical path to new medical products (2004), U.S. Department of Health and Human Services FDA White Paper
66. Fischhoff B. Hindsight ≠ foresight: the effect of outcome knowledge on judgment under uncertainty. J Exp Psychol Hum Percept Perform 1 289 (1975) 299
67. Fischhoff B. Debiasing. In: Kahneman D., Slovic P., and Tversky A. (Eds). Judgment Under Uncertainty (1982), Cambridge University Press, New York
68. Fischhoff B., and Beyth R. "I knew it would happen"-remembered probabilities of once-future things. Organ Behav Hum Perform 13 1 (1975) 16
69. Fischhoff B., Slovic P., and Lichtenstein S. Knowing with certainty: the appropriateness of extreme confidence. J Exp Psychol Hum Percept Perform 3 4 (1977) 552-564
70. Fisher R.A. Has Mendel's work been rediscovered?. Ann Sci 1 (1936) 116-137
71. Fisher R.A. The Design of Experiments (1971), Hafner Publishing Co, New York
72. Fisher S., Cole J.O., Rickels K., and Uhlenhuth E.H. Drug-set interaction: the effect of expectations on drug response in outpatients. In: Bradley P.B., Flugel F., and Hoch P. (Eds). Neuropsychopharmacology (1964), Elsevier, New York
73. Fisher S., and Greenberg R.P. How sound is the double-blind design for evaluating psychotropic drugs?. J Nerv Ment Dis 181 6 (1993) 345-350
74. Fleminger S. Seeing is believing: the role of 'preconscious' perceptual processing in delusional misidentification. Br J Psychiatry 160 (1992) 293-303
75. Foulds G.A. Clinical research in psychiatry. J Ment Sci 104 435 (1958) 259-265
76. Franklin A.D. Millikan's published and unpublished data on oil drops. Hist Stud Phys Sci 11 (1981) 185-201
77. Freedman D., Pisani R., and Purves R. Statistics (1980), W.W. Norton & Company, New York
78. Friedman L.M., Furberg C.D., and DeMets D.L. Fundamentals of Clinical Trials (1998), Springer, New York
79. Friedman N., Kurland D., and Rosenthal R. Experimenter behavior as an unintended determinant of experimental results. J Proj Tech Pers Assess 29 4 (1965) 478-490
80. Furberg C.D., and Morgan T.M. Lessons from overviews of cardiovascular trials. Stat Med 6 3 (1987) 295-306
81. Gilbert J., Henske P., and Singh A. Rebuilding big pharma's business model. In Vivo Business Med Report, Vol. 21(10) (2003) 1-10
82. Gilovich T. How We Know What Isn't So: The Fallibility of Human Reason in Everyday Life (1991), The Free Press, New York
83. Gold H. How to evaluate a new drug. Am J Med 17 (1954) 722-727
84. Gold H., Kwit N.T., and Otto H. The xanthines (theobromine and aminophylline) in the treatment of cardiac pain. JAMA 108 (1937) 2173-2179
85. Gotzsche P.C. Reference bias in reports of drug trials. Br Med J (Clin Res Ed) 295 6599 (1987) 654-656
86. Gotzsche P.C. Methodology and overt and hidden bias in reports of 196 double-blind trials of nonsteroidal antiinflammatory drugs in rheumatoid arthritis. Control Clin Trials 10 1 (1989) 31-56
87. Grace N.D., Muench H., and Chalmers T.C. The present status of shunts for portal hypertension in cirrhosis. Gastroenterology 50 5 (1966) 684-691
88. Green S.B., and Byar D.P. Using observational data from registries to compare treatments: the fallacy of omnimetrics. Stat Med 3 4 (1984) 361-373
89. Greenberg R.P., Bornstein R.F., Greenberg M.D., and Fisher S. A meta-analysis of antidepressant outcome under "blinder" conditions. J Consult Clin Psychol 60 5 (1992) 664-669
90. Greiner T., Gold H., Cattell M., Travell J., Bakst H., Rinzler S.H., et al. A method for the evaluation of the effects of drugs on cardiac pain in patients with angina of effort; a study of khellin (visammin). Am J Med 9 2 (1950) 143-155
91. Gross T.M., Jarvik M.E., and Rosenblatt M.R. Nicotine abstinence produces content-specific Stroop interference. Psychopharmacology (Berl) 110 3 (1993) 333-336
92. Grove W.M., and Lloyd M. Meehl's contribution to clinical versus statistical prediction. J Abnorm Psychology 115 2 (2006) 192-194
93. Grove W.M., Zald D.H., Lebow B.S., Snitz B.E., and Nelson C. Clinical versus mechanical prediction: a meta-analysis. Psychol Assess 12 1 (2000) 19-30
94. Hamilton D.P. Publishing by-and for?-the numbers. Science 250 4986 (1990) 1331-1332
95. Hanson N.R. Observation. In: Patterns of Discovery: An Inquiry into the Conceptual Foundations of Science (1958), Cambridge University Press, Cambridge
96. Hartwig F., and Dearing B.E. Exploratory data analysis. (1979), Sage Publications, Beverly Hills, CA
97. Hendrick C. Replications, strict replications, and conceptual replications: are they important?. J Pers Soc Psychol 5 4 (1990) 41-49
98. Hertwig R., Gigerenzer G., and Hoffrage U. The reiteration effect in hindsight bias. Psychol Rev 104 1 (1997) 194-202
99. Hill A.B. The clinical trial. N Engl J Med 247 (1952) 113-119
100. Hoaglin D.C., Mosteller F., and Tukey J.W. Understanding Robust and Exploratory Data Analysis (1983), John Wiley and Sons, Inc, New York
101. Holton G. Subelectrons, presuppositions, and the Millikan-Ehrenhaft dispute. Hist Stud Phys Sci 9 (1978) 166-224
102. James K.E. Regression toward the mean in uncontrolled clinical studies. Biometrics 29 1 (1973) 121-130
103. Johnson M.L. Seeing's believing. New Biol 15 (1953) 60-80
104. Jonas E., Schulz-Hardt S., Frey D., and Thelen N. Confirmation bias in sequential information search after preliminary decisions: an expansion of dissonance theoretical research on selective exposure to information. J Pers Soc Psychol 80 4 (2001) 557-571
105. Jones P.E., and Roelofsma P.H. The potential for social contextual and group biases in team decision-making: biases, conditions and psychological mechanisms. Ergonomics 43 8 (2000) 1129-1152
106. Juni P., Altman D.G., and Egger M. Systematic reviews in health care: assessing the quality of controlled clinical trials. BMJ 323 7303 (2001) 42-46
107. Kahneman D., and Tversky A. On the psychology of prediction. Psychol Rev 80 4 (1973) 237-251
108. Kant I. Critique of Pure Reason (1787), Barnes and Noble, New York
109. Kaptchuk T.J. Intentional ignorance: a history of blind assessment and placebo controls in medicine. Bull Hist Med 72 3 (1998) 389-433
110. Karlowski T.R., Chalmers T.C., Frenkel L.D., Kapikian A.Z., Lewis T.L., and Lynch J.M. Ascorbic acid for the common cold, a prophylactic and therapeutic trial. JAMA 231 10 (1975) 1038-1042
111. Kast E.C. Alpha-ethyltryptamine acetate in the treatment of depression, a study of the methodology of drug evaluation. J Neuropsychiatry 2 Suppl 1 (1961) 114-118
112. Kennedy J.L., and Uphoff H.F. Experiments on the nature of extra-sensory perception. J Parapsychol 3 (1939) 226-245
113. Kennedy T. Managing the drug discovery/development interface. Drug Discov Today 2 (1997) 436-444
114. Kent R.N., O'Leary K.D., Diament C., and Dietz A. Expectation biases in observational evaluation of therapeutic change. J Consult Clin Psychol 42 6 (1974) 774-780
115. Keppel G. Design and Analysis: A Researcher's Handbook (1982), Prentice-Hall, Inc, Englewood Cliffs, NJ
116. Kerr N.L., MacCoun R.J., and Kramer G. Bias in judgment: comparing individuals and groups. Psychol Rev 103 (1996) 687-719
117. Kerr N.L., and Tindale R.S. Group performance and decision making. Annu Rev Psychol 55 (2004) 623-655
118. Kety S.S. Biochemical theories of schizophrenia. I. Science 129 3362 (1959) 1528-1532
119. Kissin B., Charnoff S.M., and Rosenblatt S.M. Drug and placebo responses in chronic alcoholics. Psychiatr Res Rep Am Psychiatr Assoc 24 (1968) 44-60
120. Kjaergard L.L., and Gluud C. Citation bias of hepato-biliary randomized clinical trials. J Clin Epidemiol 55 4 (2002) 407-410
121. Klayman J., and Brown K. Debias the environment instead of the judge: an alternative approach to reducing error in diagnostic (and other) judgment. Cognition 49 1-2 (1993) 97-122
122. Koehler J.J. The influence of prior beliefs on scientific judgments of evidence quality. Org Behav Hum Decis Process 56 (1993) 28-55
123. Koran L.M. The reliability of clinical methods, data and judgments (first of two parts). N Engl J Med 293 13 (1975) 642-646
124. Koran L.M. The reliability of clinical methods, data and judgments (second of two parts). N Engl J Med 293 14 (1975) 695-701
125. Koshland Jr. D.E. Fraud in science. Science 235 4785 (1987) 141
126. Koyre A. Galileo and the scientific revolution of the seventeenth century. Philos Rev 52 (1943) 333-348
127. Koyre A. Pascal savant. Blaise Pascal, l'homme et l'oeuvre, Vol. 1 (1956) 259-281
128. Koyre A. Galileo's treatise "de motu gravium": the use and abuse of imaginary experiment. Rev Hist Sci 13 (1960) 197-245
129. Kruglanski A.W. Bias and error in human judgement. Eur J Soc Psychol 13 (1983) 1-44
130. Kuhn T.S. The Structure of Scientific Revolutions (1996), The University of Chicago Press, Chicago, IL
131. Kunda Z. The case for motivated reasoning. Psychol Bull 108 3 (1990) 480-498
132. Langmuir I., and Hall R.N. Pathological science. Phys Today 42 10 (1989) 36-48
133. Lehman D.R., Lempert R.O., and Nisbett R.E. The effects of graduate training on reasoning: formal discipline and thinking about everyday-life events. Am Psychol 43 6 (1988) 431-442
134. Lexchin J., Bero L.A., Djulbegovic B., and Clark O. Pharmaceutical industry sponsorship and research outcome and quality: systematic review. BMJ 326 7400 (2003) 1167-1170
135. Lord C.G., Ross L., and Lepper M.R. Biased assimilation and attitude polarization: the effects of prior theories on subsequently considered evidence. J Pers Soc Psychol 37 11 (1979) 2098-2109
136. MacCoun R.J. Biases in the interpretation and use of research results. Annu Rev Psychol 49 (1998) 259-287
137. Mahoney M.J. Publication Prejudices: An Experimental Study of Confirmatory Bias in the Peer Review System. Cogn Ther Res 1 (1977) 161-175
138. Mahoney M.J. Open exchange and epistemic progress. Am Psychol 40 1 (1985) 29-39
139. Mahoney M.J. Scientific publication and knowledge politics. J Soc Behav Pers 2 2 (1987) 165-176
140. Marcel A.J. Conscious and unconscious perception: an approach to the relations between phenomenal experience and perceptual processes. Cogn Psychol 15 2 (1983) 238-300
141. May G.S., DeMets D.L., Friedman L.M., Furberg C., and Passamani E. The randomized clinical trial: bias in analysis. Circulation 64 4 (1981) 669-673
142. Medawar P.B. Is the scientific paper a fraud?. In: Pyke D. (Ed). The Threat and The Glory: Reflections on Science and Scientists. (1991), Oxford University Press, Oxford
143. Merton R.K. The self-fulfilling prophecy. Antioch Rev 8 (1948) 193-210
144. Merton R.K. The Sociology of Science: Theoretical and Empirical Investigations (1973), The University of Chicago Press, Chicago
145. Milgram S. Behavioral study of obedience. J Abnorm Soc Psychol 67 (1963) 371-378
146. Milgram S. Some conditions of obedience and disobedience to authority. Hum Relat 18 (1965) 57-76
147. Miller J.Z., Nance W.E., Norton J.A., Wolen R.L., Griffith R.S., and Rose R.J. Therapeutic effect of vitamin C. A co-twin control study. JAMA 237 3 (1977) 248-251
148. Modell W., and Houde R.W. Factors influencing clinical evaluation of drugs: with special reference to the double-blind technique. JAMA 167 (1958) 190-198
149. Moerman D.E. General medical effectiveness and human biology: placebo effects in the treatment of ulcer disease. Med Anthropol Q 14 4 (1983) 13-16
150. Moertel C.G. Improving the efficiency of clinical trials: a medical perspective. Stat Med 3 4 (1984) 455-468
151. Neuliep J.W., and Crandall R. Editorial bias against replication research. J Soc Behav Pers 5 4 (1990) 85-90
152. Neuliep J.W., and Crandall R. Reviewer bias against replication research. J Soc Behav Pers 8 6 (1993) 21-29
153. Niblack J.F. Why are drug development programs growing in size and cost. A view from industry?. Food Drug Law J 52 2 (1997) 151-154
154. Nisbett R.E., and Borgida E. Attribution and the psychology of prediction. J Pers Soc Psychol 32 (1975) 932-943
155. Nisbett R.E., Fong G.T., Lehman D.R., and Cheng P.W. Teaching reasoning. Science 238 482 (1987) 625-631
156. Nisbett R.E., and Ross L. Human Inference: Strategies and Shortcomings of Social Judgment (1980), Prentice-Hall, Inc, Englewood Cliffs, NJ
157. Noseworthy J.H., Ebers G.C., Vandervoort M.K., Farquhar R.E., Yetisir E., and Roberts R. The impact of blinding on the results of a randomized, placebo-controlled multiple sclerosis clinical trial. Neurology 44 1 (1994) 16-20
158. O'Leary K.D., Kent R.N., and Kanowitz J. Shaping data collection congruent with experimental hypotheses. J Appl Behav Anal 8 (1975) 43-51
159. Orne M.T. The nature of hypnosis: artifact and essence. J Abnorm Psychology 58 3 (1959) 277-299
160. Orne M.T. On the social psychology of the psychological experiment: with particular reference to demand characteristics and their implications. Am Psychol 17 (1962) 776-783
161. Orne M.T. Hypnosis, motivation, and the ecological validity of the psychological experiment. In: W. J. Arnold M.M. (Ed). Nebraska Symposium on Motivation. (1970), University of Nebraska Press, Lincoln
162. Orne M.T., and Evans F.J. Social control in the psychological experiment: antisocial behavior and hypnosis. J Pers Soc Psychol 95 (1965) 189-200
163. Orne M.T., and Scheibe K.E. The contribution of nondeprivation factors in the production of sensory deprivation effects: the psychology of the "panic button". J Abnorm Psychology 68 (1964) 3-12
164. Owen R. Reader bias. JAMA 247 18 (1982) 2533-2534
165. Pavlov I.V. New researches on conditioned reflexes. Science 58 (1923) 359-361
166. Pearson K. On the mathematical theory of errors of judgment, with special reference to the personal equation. Philos Trans R Soc Lond A 198 (1902) 235-299
167. Pfungst O. Clever Hans (The Horse of Mr. von Osten) (1911), Henry Holt and Company, New York
168. Planck, M. (1949). Scientific autobiography and other papers, Philosophical Library, translated from German by Frank Gaynor, New York.
169. Pocock S.J. Clinical trials with multiple outcomes: a statistical perspective on their design, analysis, and interpretation. Control Clin Trials 18 6 (1997) 530-545
170. Pocock S.J., Assmann S.E., Enos L.E., and Kasten L.E. Subgroup analysis, covariate adjustment and baseline comparisons in clinical trial reporting: current practice and problems. Stat Med 21 19 (2002) 2917-2930
171. Pocock S.J., Hughes M.D., and Lee R.J. Statistical problems in the reporting of clinical trials. A survey of three medical journals. N Engl J Med 317 7 (1987) 426-432
172. Polanyi M. The potential theory of adsorption. Science 141 (1963) 1010-1013
173. Popper K. The Logic of Scientific Discovery, Translated to English and reprinted in 1959 by Routledge Classics, New York (1935)
174. Postmes T., Spears R., and Cihangir S. Quality of decision making and group norms. J Pers Soc Psychol 80 6 (2001) 918-930
175. Prentis R.A., Lis Y., and Walker S.R. Pharmaceutical innovation by the seven UK-owned pharmaceutical companies (1964-1985). Br J Clin Pharmacol 25 3 (1988) 387-396
176. Proshansky H., and Murphy G. The effects of reward and punishment on perception. J Psychol 13 (1942) 295-305
177. Pyszczynski T., and Greenberg J. Toward an integration of cognitive and motivational perspectives on social inference: a biased hypothesis-testing model. Adv Exp Soc Psychol 20 (1987) 297-340
178. Pyszczynski T., Greenberg J., and Holt K. Maintaining consistency between self-serving beliefs and available data: a bias in information evaluation. Pers Soc Psychol Bull 11 (1985) 179-190
179. Ravnskov U. Quotation bias in reviews of the diet-heart idea. J Clin Epidemiol 48 5 (1995) 713-719
180. Razran G. Pavlov the empiricist. Science 130 (1959) 916-917
181. Reiser S.J. Overlooking ethics in the search for objectivity and misconduct in science. Acad Med 68 9 Suppl (1993) S84-S87
182. Resch K.I., Ernst E., and Garrow J. A randomized controlled study of reviewer bias against an unconventional therapy. J R Soc Med 93 4 (2000) 164-167
183. Roberts A.H., Kewman D.G., Mercier L., and Hovell M. The power of nonspecific effects in healing: implications for psychosocial and biological treatments. Clin Psychol Rev 13 (1993) 375-391
184. Rose G. Bias. Br J Clin Pharmacol 13 2 (1982) 157-162
185. Rosenthal R. On the social psychology of the psychological experiment: the experimenter's hypothesis as unintended determinent of experimental results. Am Sci 51 (1963) 261-283
186. Rosenthal R. Experimenter outcome-orientation and the results of the psychological experiment. Psychol Bull 61 6 (1964) 405-412
187. Rosenthal R. The effect of the experimenter on the results of psychological research. Prog Exp Pers Res 72 (1964) 79-114
188. Rosenthal R. Experimenter Effects in Behavioral Research, Appleton Century Crofts (1966), Division of Meredith Publishing Co., New York
189. Rosenthal R. Interpersonal expectations: effects of the experimenter's hypothesis. In: Rosenthal R., and Rosnow R.L. (Eds). Artifact in Behavioral Research (1969), Academic Press, New York
190. Rosenthal R. Interpersonal expectancy effects: a follow-up. Experimenter Effects in Behavioral Research: Enlarged Edition. (1976), Irvington Publishers Inc, New York
191. Rosenthal R. Replication in behavioral research. J Soc Behav Pers 5 (1990) 1-30
192. Rosenthal R., and Fode K.L. The effect of experimenter bias on the performance of the albino rat. Behav Sci 8 (1963) 183-189
193. Rosenthal R., Friedman C.J., Johnson C.A., Fode K., Schill T., White R.C., et al. Variables affecting experimenter bias in a group situation. Genet Psychol Monogr 70 (1964) 271-296
194. Rosenthal R., and Halas E.S. Experimenter effect in the study of invertebrate behavior. Psychol Rep 11 (1962) 251-256
195. Rosenthal R., Kohn P., Greenfield P.M., and Carota N. Data desirability, experimenter expectancy, and the results of psychological research. J Pers Soc Psychol 3 1 (1966) 20-27
196. Rosenthal R., and Lawson R. A longitudinal study of the effects of experimenter bias on the operant learning of laboratory rats. J Psychiatr Res 2 (1963) 61-72
197. Rosenthal R., Persinger G.W., Kline L.V., and Mulry R.C. The role of the research assistant in the mediation of experimenter bias. J Pers 31 (1963) 313-335
198. Rosenthal R., and Rubin D.B. Interpersonal expectancy effects: the first 345 studies. Behav Brain Sci 3 (1978) 377-415
199. Ross L., Amabile T.M., and Steinmetz J.L. Social roles, social control, and biases in social-perception processes. J Pers Soc Psychol 35 (1977) 485-494
200. Ross L., Lepper M.R., and Hubbard M. Perseverance in self-perception and social perception: biased attributional processes in the debriefing paradigm. J Pers Soc Psychol 32 5 (1975) 880-892
201. Rostand J. Error and Deception in Science (1960), Basic Books, New York
202. Roth J.A. Hired hand research. Am Sociol (1966) 190-196
203. Sackett D.L. Second thoughts. Proposals for the health sciences: I. Compulsory retirement for experts. J Chronic Dis 36 7 (1983) 545-547
204. Sackett D.L. Rules of evidence and clinical recommendations on the use of antithrombotic agents. Chest 89 2 Suppl (1986) 2S-3S
205. Sacks H., Chalmers T.C., and Smith Jr. H. Randomized versus historical controls for clinical trials. Am J Med 72 2 (1982) 233-240
206. Sams-Dodd F. Target-based drug discovery: is something wrong?. Drug Discov Today 10 2 (2005) 139-147
207. Sanford R.N. The effects of abstinence from food upon imaginal processes: a preliminary experiment. J Psychol 2 (1936) 129-136
208. Sarter M., Hagan J., and Dudchenko P. Behavioral screening for cognition enhancers: from indiscriminate to valid testing: Part I. Psychopharmacology (Berl) 107 2-3 (1992) 144-159
209. Sarter M., Hagan J.J., and Dudchenko P. Behavioral screening for cognition enhancers: from indiscriminate to valid testing: Part II. Psychopharmacology (Berl) 107 (1992) 461-473
210. Schechter P.J., Freidewald W.T., Bronzert D.A., Raff M.S., and Henkin R.I. Idiopathic hypogeusia: a description of the syndrome and a single-blind study with zinc sulfate. Int Rev Neurobiol Suppl. I (1972) 125-140
211. Schulz K.F. Subverting randomization in controlled trials. JAMA 274 18 (1995) 1456-1458
212. Schulz K.F., Chalmers I., Hayes R.J., and Altman D.G. Empirical evidence of bias. Dimensions of methodological quality associated with estimates of treatment effects in controlled trials. JAMA 273 5 (1995) 408-412
213. Schuster D., Laggner C., and Langer T. Why drugs fail-a study on side effects in new chemical entities. Curr Pharm Des 11 27 (2005) 3545-3559
214. Shafer R., and Murphy G. The role of autism in a visual figure-ground relationship. J Exp Psychol 32 (1943) 335-343
215. Shapiro A.K., and Shapiro E. The Powerful Placebo: From Ancient Priest to Modern Physician (1997), The Johns Hopkins University Press, Baltimore
216. Sheffield F.D., Kaufman R.S., and Rhine J.B. A PK experiment at Yale starts a controversy. J Am Soc Psych Res 46 (1952) 111-117
217. Shor R.E. A note on shock tolerances of real and simulating hypnotic subjects. Int J Clin Exp Hypn 12 4 (1964) 258-262
218. Silverman W.A. Suspended judgment. Is the scientific paper a fraud?. Control Clin Trials 12 2 (1991) 273-276
219. Simes R.J. Publication bias: the case for an international registry of clinical trials. J Clin Oncol 4 10 (1986) 1529-1541
220. Simes R.J. Confronting publication bias: a cohort design for meta-analysis. Stat Med 6 1 (1987) 11-29
221. Snow P.J. Effect of propranolol in myocardial infarction. Lancet 286 7412 (1965) 551-553
222. Snyder M. When belief creates reality. Adv Exp Soc Psychol 18 (1984) 248-305
223. Sommer R. The new look on the witness stand. Can Psychol 8 4 (1959) 94-99
224. Staw B.M. Knee deep in the big muddy: a study of escalating committment to a chosen course of action. Organ Behav Hum Perform 16 (1976) 27-44
225. Stephens J.M. The perception of small differences as affected by self interest. Am J Psychol 48 (1936) 480-484
226. Sterling T.D. Publication decisions and their possible effects on inferences drawn from test of significance- or vice versa. JASA 54 (1959) 30-34
227. Sushinsky L.W., and Wener R. Distorting judgments of mental health. J Nerv Ment Dis 161 2 (1975) 82-89
228. Szymkowski D.E. Too many targets, not enough target validation. Drug Discov Today 6 8 (2001) 397
229. Thagard P. How Scientists Explain Disease (1999), Princeton University Press, Princeton, NJ
230. Tollman P., Philippe G., Altshuler J., Flanagan A., and Steiner M. A Revolution in R&D: How Genomics and Genetics are Transforming the Biopharmaceutical Industry (2001), The Boston Consulting Group, Boston, MA
231. Troffer S.A., and Tart C.T. Experimenter bias in hypnotist performance. Science 145 (1964) 1330-1331
232. Tukey J.W. Some thoughts on clinical trials, especially problems of multiplicity. Science 198 4318 (1977) 679-684
233. Turnbull C.M. Some observations regarding the experiences and behavior of the BaMbuti pygmies. Am J Psychol 74 (1961) 304-308
234. Tversky A., and Kahneman D. Judgement under uncertainty: heuristics and biases. Science 185 (1974) 1124-1131
235. Vandenbroucke J.P. 175th anniversary lecture. Medical journals and the shaping of medical knowledge. Lancet 352 9145 (1998) 2001-2006
236. Viamontes J.A. Review of drug effectiveness in the treatment of alcoholism. Am J Psychiatry 128 12 (1972) 1570-1571
237. Waters A.J., and Feyerabend C. Determinants and effects of attentional bias in smokers. Psychol Addict Behav 14 2 (2000) 111-120
238. Weber M. In: Gerth H.H., and Mills C.W. (Eds). Science as a Vocation. In: From Max Weber: Essays in Sociology. (1946), Oxford University Press, New York
239. Westfall R.S. Newton and the fudge factor. Science 179 (1973) 751-758
240. Whyte G. Escalating committment in individual and group decision making: a prospect theory approach. Org Behav Hum Decis Process 54 (1993) 430-455
241. Wilson T.D., and Brekke N. Mental contamination and mental correction: unwanted influences on judgments and evaluations. Psychol Bull 116 1 (1994) 117-142
242. Wilson T.D., DePaulo B.M., Mook D.G., and Klaaren K.J. Scientist's evaluations of research: the biasing effects of the importance of the topic. Psychol Sci 4 (1993) 322-325
243. Wood R.W. The n-rays. Nature 70 1822 (1904) 530-531
244. Wright S. Mendel's ratios. In: Stern C., and Sherwood E. (Eds). The Origin of Genetics: A Mendel Source Book. (1966), W.H. Freeman, San Francisco, CA
245. Wyer R.S., and Frey D. The effects of feedback about self and others on the recall and judgments of feedback-relevant information. J Exp Soc Psychol 19 (1983) 540-559
246. Yusuf S., Wittes J., Probstfield J., and Tyroler H.A. Analysis and interpretation of treatment effects in subgroups of patients in randomized clinical trials. JAMA 266 1 (1991) 93-98
247. Zifferblatt S.M., and Wilbur C.S. A psychological perspective for double-blind trials. Clin Pharmacol Ther 23 (1978) 1-10
248. Zirkle C. Pavlov's beliefs. Science 128 3337 (1958) 1476
249. Zuckerman H. Deviant behavior and social control in science. In: Sagarin E. (Ed). Deviance and Social Change. (1977), SAGE Publications, London