Detecting psychological phenomena: Taking bottom-up research seriously

American Journal of Psychology

Volumn 126, Issue 2, 2013, Pages 135-153

  Haig, Brian D ^a  

^a UNIVERSITY OF CANTERBURY   (New Zealand)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; EMPIRICAL RESEARCH; INFORMATION PROCESSING; METHODOLOGY; PSYCHOLOGY;

DATA COLLECTION; EMPIRICAL RESEARCH; PSYCHOLOGY; RESEARCH DESIGN;

EID: 84881524127     PISSN: 00029556     EISSN: None     Source Type: Journal    
DOI: 10.5406/amerjpsyc.126.2.0135     Document Type: Article

References (99)

1. American Psychological Association. (2010). Publication manual of the American Psychological Association (6th ed.). Washington, DC: Author.
2. Baird, D. (1992). Inductive logic: Probability and statistics. Englewood Cliffs, NJ: Prentice Hall.
3. Behrens, J. T., & Yu, C.-H. (2003). Exploratory data analysis. In J. A. Schinka & W. F. Velicer (Eds.), Handbook of psychology (Vol. 2, pp. 33-64). New York, NY: Wiley.
4. Bem, D. J. (2011). Feeling the future: Experimental evidence for anomalous retroactive influence on cognition and affect. Journal of Personality and Social Psychology, 100, 407-425.
5. Bem, D. J., & Honorton, C. (1994). Does psi exist? Replicable evidence for an anomalous process of information transfer. Psychological Bulletin, 115, 4-18.
6. Bogen, J. (2010). Noise in the world. Philosophy of Science, 77, 778-791.
7. Bogen, J. (2011). "Saving the phenomena" and saving the phenomena. Synthese, 182, 7-22.
8. Bogen, J., & Woodward, J. (1988). Saving the phenomena. Philosophical Review, 97, 303-352.
9. Bogen, J., & Woodward, J. (1992). Observations, theories, and the evolution of the human spirit. Philosophy of Science, 59, 590-611.
10. Brown, J. R. (1994). Smoke and mirrors: How realism maps the world. London, England: Routledge.
11. Burnston, D., Sheredos, B., & Bechtel, W. (2011). HIT on the psychometric approach. Psychological Inquiry, 22, 108-114.
12. Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56, 81-105.
13. Cartwright, N. (1983). How the laws of physics lie. Oxford, England: Oxford University Press.
14. Chang, H. (2004). Inventing temperature: Measurement and scientific progress. New York, NY: Oxford University Press.
15. Chatfield, C. (1985). The initial examination of data. Journal of the Royal Statistical Society, Series A, 148, 214-254.
16. Clark, J. M., & Paivio, A. (1989). Observational and theoretical terms in psychology: A cognitive perspective on scientific language. American Psychologist, 44, 500-512.
17. Cronbach, L. J. (1975). Beyond the two disciplines of scientific psychology. American Psychologist, 30, 116-127.
18. Cummins, R. (2000). "How does it work?" versus "What are the laws?": Two conceptions of psychological explanation. In F. C. Keil & R. A. Wilson (Eds.), Explanation and cognition (pp. 117-144). Cambridge, MA: MIT Press.
19. D'Andrade, R. (1986). Three scientific world views and the covering law model. In D. Fiske & R. Shweder (Eds.), Metatheory in social science: Pluralisms and subjectivities (pp. 19-41). Chicago, IL: University of Chicago Press.
20. Diaconis, P. (1978). Statistical problems in ESP research. Science, 201, 131-136.
21. Dickens, W. T., & Flynn, J. R. (2001). Heritability estimates versus large environmental effects: The IQ paradox resolved. Psychological Review, 108, 346-369.
22. Efron, B., & Tibshirani, R. (1993). An introduction to the bootstrap. New York, NY: Chapman & Hall.
23. Ehrenberg, A. S. C., & Bound, J. A. (1993). Predictability and prediction. Journal of the Royal Statistical Society, Series A, 156, 167-206.
24. Fidell, L. S., & Tabachnick, B. G. (2003). Preparatory data analysis. In J. A. Schinka & W. F. Velicer (Eds.), Handbook of psychology (Vol. 2, pp. 115-121). New York, NY: Wiley.
25. Flynn, J. R. (2009). What is intelligence?: Beyond the Flynn effect (2nd ed.). Cambridge, England: Cambridge University Press.
26. Franklin, A. (1990). Experiment, right or wrong. Cambridge, England: Cambridge University Press.
27. Franklin, A. (1997). Calibration. Perspectives on Science, 5, 31-80.
28. Funder, D. C. (2009). Naïve and obvious questions. Perspectives on Psychological Science, 4, 340-344.
29. Gage, N. L. (1996). Confronting counsels of despair for the behavioral sciences. Educational Researcher, 25, 5-15, 22.
30. Garner, W. R., Hake, H. W., & Eriksen, C. W. (1956). Operationism and the concept of perception. Psychological Review, 63, 149-159.
31. Gergen, K. J. (1973). Social psychology as history. Journal of Personality and Social Psychology, 26, 309-320.
32. Gergen, K. J. (1994). Toward transformation in social knowledge (2nd ed.). Thousand Oaks, CA: Sage.
33. Glymour, B. (2000). Data and phenomena: A distinction reconsidered. Erkenntnis, 52, 29-37.
34. Goldman, A. I. (1986). Epistemology and cognition. Cambridge, MA: Harvard University Press.
35. Hacking, I. (1983). Representing and intervening. Cambridge, England: Cambridge University Press.
36. Hacking, I. (1991). Speculation, calculation, and the creation of phenomena. In G. Munevar (Ed.), Beyond reason: Essays on the philosophy of Paul K. Feyerabend (pp. 131-157). Dordrecht, the Netherlands: Kluwer.
37. Hacking, I. (1999). The social construction of what? Cambridge, MA: Harvard University Press.
38. Haig, B. D. (2005). An abductive theory of scientific method. Psychological Methods, 10, 371-388.
39. Hedges, L. V. (1987). How hard is hard science, how soft is soft science? The empirical cumulativeness of research. American Psychologist, 42, 443-455.
40. Herrnstein, R. J., & Murray, C. (1994). The bell curve: Intelligence and class structure in American life. New York, NY: The Free Press.
41. Hyman, R. (1985). The Ganzfeld psi experiment: A critical appraisal. Journal of Parapsychology, 49, 3-49.
42. Jones, S. R. G. (1992). Was there a Hawthorne effect? American Journal of Sociology, 98, 451-468.
43. Kaiser, M. (1991). From rocks to graphs: The shaping of phenomena. Synthese, 89, 111-133.
44. Kaiser, M. (1996). Empirical versus theoretical progress in science. In R. S. Cohen, R. Hilpen, & Q. Renzong (Eds.), Realism and anti-realism in the philosophy of science (pp. 171-193). Dordrecht, the Netherlands: Kluwer.
45. Kievit, R. A., Romeijn, J.-W., Waldorp, L. J., Wicherts, J. M., Scholte, H. S., & Borsboom, D. (2011). Modeling mind and matter: Reductionism and psychological measurement in cognitive neuroscience. Psychological Inquiry, 22, 139-157.
46. Kline, R. B. (2004). Beyond significance testing: Reforming data analysis methods in behavioral research. Washington, DC: American Psychological Association.
47. Kukla, A. (2001). Methods of theoretical psychology. Cambridge, MA: MIT Press.
48. Lakatos, I. (1970). Falsification and the methodology of scientific research programmes. In I. Lakatos & A. Musgrave (Eds.), Criticism and the growth of knowledge (pp. 91-196). Cambridge, England: Cambridge University Press.
49. Latour, B., & Woolgar, S. (1979). Laboratory life: The social construction of scientific facts. Beverly Hills, CA: Sage.
50. Levins, R. (1968). Evolution in changing environments. Princeton, NJ: Princeton University Press.
51. Lindsay, R. M., & Ehrenberg, A. S. C. (1993). The design of replicated studies. American Statistician, 47, 217-228.
52. Lycan, W. G. (1988). Judgement and justification. Cambridge, England: Cambridge University Press.
53. Lykken, D. T. (1991). What's wrong with psychology anyway? In D. Cicchetti & W. M. Grove (Eds.), Thinking clearly about psychology, Vol. 1: Matters of public interest (pp. 3-39). Minneapolis: University of Minnesota Press.
54. Mäki, U. (2005). Reglobalizing realism by going local, or (how) should our formulations of scientific realism be informed about the sciences? Erkenntnis, 63, 231-251.
55. McAllister, J. W. (1997). Phenomena and patterns in data sets. Erkenntnis, 47, 217-228.
56. Meehl, P. E. (1990). Why summaries of research on theories are often uninterpretable. Psychological Reports, 66(Suppl.), 195-244.
57. Milton J, & Wiseman, R. (1999). Does psi exist? Lack of replication of an anomalous process of information transfer. Psychological Bulletin, 125, 387-391.
58. Muller, K. E., Otto, D. A., & Benignus, V. A. (1983). Design and analysis issues and strategies in psychophysiological research. Psychophysiology, 20, 2012-2018.
59. Nagel, E. (1961). The structure of science: Problems in the logic of scientific explanation. New York, NY: Harcourt, Brace, and World.
60. Norris, S. P., Phillips, L. M., & Korpan, C. A. (2003). University students' interpretation of media reports of science and its relationship to background knowledge, interest, and reading difficulty. Public Understanding of Science, 12, 123-145.
61. Norton, J. D. (2003). A material theory of induction. Philosophy of Science, 70, 647-670.
62. Popper, K. R. (1959). The logic of scientific discovery. New York, NY: Basic Books.
63. Rorer, L. G. (1991). Some myths of science in psychology. In D. Cicchetti & W. M. Grove (Eds.), Thinking clearly about psychology, Vol. 1: Matters of public interest (pp. 61-87). Minneapolis: University of Minnesota Press.
64. Rozeboom, W. W. (1997). Good science is abductive, not hypothetico-deductive. In L. L. Harlow, S. A. Mulaik, & J. H. Steiger (Eds.), What if there were no significance tests? (pp. 335-391). Hillsdale, NJ: Erlbaum.
65. Rozin, P. (2009). What kind of empirical research should we publish, fund, and reward? Perspectives on Psychological Science, 4, 435-439.
66. Samelson, F. (1980). J. B. Watson's little Albert, Cyril Burt's twins, and the need for a critical science. American Psychologist, 35, 619-625.
67. Schindler, S. (2007). Rehabilitating theory: Refusal of the "bottom-up" construction of scientific phenomena. Studies in History and Philosophy of Science, 38, 160-184.
68. Schmidt, F. L. (1992). What do data really mean? Research findings, meta-analysis, and cumulative knowledge in psychology. American Psychologist, 47, 1173-1181.
69. Schmidt, F. L. (1993). Meta-analysis and cumulative knowledge. Contemporary Psychology, 38, 1163-1165.
70. Searle, J. R. (1995). The social construction of reality. New York, NY: The Free Press.
71. Sechrest, L., McKnight, P., & McKnight, K. (1996). Calibration of measures for psychotherapy outcome studies. American Psychologist, 51, 1065-1071.
72. Shapiro, L. A. (1994). Behavior, ISO functionalism, and psychology. Studies in History and Philosophy of Science, Part A, 25, 191-209.
73. Sherman, R. A., & Funder, D. C. (2009). Evaluating correlations in studies of personality and behavior: Beyond the number of significant findings to be expected by chance. Journal of Research in Personality, 43, 1053-1063.
74. Sidman, M. (1960). Tactics of scientific research: Evaluating experimental data in psychology. New York, NY: Basic Books.
75. Skinner, B. F. (1984). Methods and theories in the experimental analysis of behavior. Behavioral and Brain Sciences, 7, 511-546.
76. Slife, B. D., & Williams, R. N. (1997). Toward a theoretical psychology: Should a subdiscipline be formally recognized? American Psychologist, 52, 117-129.
77. Sohn, D. (1996). Meta-analysis and science. Theory & Psychology, 6, 229-246.
78. Stam, H. J. (2006). On the uses of theory. General Psychologist, 41, 30-32.
79. Strauss, A. L. (1987). Qualitative analysis for social scientists. New York, NY: Cambridge University Press.
80. Teasdale, T. W., & Owen, D. R. (2005). A long-term rise and recent decline in intelligence test performance: The Flynn effect in reverse. Personality and Individual Differences, 39, 837-843.
81. Teller, P. (2010). "Saving the phenomena" today. Philosophy of Science, 77, 815-826.
82. Thagard, P. (1992). Conceptual revolutions. Princeton, NJ: Princeton University Press.
83. Thompson, B. (1994). The pivotal role of replication in psychological research: Empirically evaluating the replicability of sample results. Journal of Personality, 62, 157-176.
84. Tucker, W. H. (1994). Fact and fiction in the discovery of Sir Cyril Burt's flaws. Journal of the History of the Behavioral Sciences, 30, 335-347.
85. Tukey, J. W. (1969). Analyzing data: Sanctification or detective work? American Psychologist, 24, 83-91.
86. Tukey, J. W. (1977). Exploratory data analysis. Reading, MA: Addison Wesley.
87. Tukey, J. W. (1980). We need both exploratory and confirmatory. American Statistician, 34, 23-25.
88. Wachtel, P. L. (1980). Investigation and its discontents: Some constraints on progress in psychological research. American Psychologist, 35, 399-408.
89. Wagenmakers, E. J., Wetzels, R., Borsboom, D., & van der Maas, H. L. (2011). Why psychologists must change the way they analyze their data: The case of psi. Journal of Personality and Social Psychology, 100, 426-434.
90. Weber, B. H. (2007). Fact, phenomenon, and theory in the Darwinian research tradition. Biological Theory, 2, 168-178.
91. Weinert, F. (1992). Vicissitudes of laboratory life. British Journal for the Philosophy of Science, 43, 423-429.
92. Wilkinson, L., & the Task Force on Statistical Inference. (1999). Statistical methods in psychology journals: Guidelines and explanations. American Psychologist, 54, 594-604.
93. Wimsatt, W. C. (1981). Robustness, reliability, and overdetermination. In M. Brewer & B. Collins (Eds.), Scientific inquiry and the social sciences (pp. 124-163). San Francisco, CA: Jossey Bass.
94. Wimsatt, W. C. (1994). The ontology of complex systems: Levels of organization, perspectives, and causal thickets. Canadian Journal of Philosophy, 20(Suppl.), 207-274.
95. Woodward, J. (1989). Data and phenomena. Synthese, 79, 393-472.
96. Woodward, J. (2000). Data, phenomena, and reliability. Philosophy of Science, 67(Suppl.), 163-179.
97. Woodward, J. (2010). Data, phenomena, signal, and noise. Philosophy of Science, 77, 792-803.
98. Woodward, J. (2011). Data and phenomena: A restatement and a defense. Synthese, 182, 165-179.
99. Yu, C. H. (2008). Resampling: A conceptual and procedural introduction. In J. W. Osborne (Ed.), Best practices in quantitative methods (pp. 283-298). Los Angeles, CA: Sage.