Extracting a maximum of useful information from statistical research data

Scandinavian Journal of Psychology

Volumn 46, Issue 1, 2005, Pages 69-77

  Sohlberg, Staffan ^a   Andersson, Gerhard ^b  

^a UPPSALA UNIVERSITY   (Sweden)

^b LINKÖPING UNIVERSITY   (Sweden)

Author keywords

Bayes; Confidence interval; Effect size; NHST; Significance; Statistical method

Indexed keywords

ARTICLE; BAYES THEOREM; CONFIDENCE INTERVAL; HUMAN; METHODOLOGY; PSYCHOLOGY; RESEARCH; STANDARD; STATISTICAL ANALYSIS; STATISTICS;

BAYES THEOREM; CONFIDENCE INTERVALS; DATA INTERPRETATION, STATISTICAL; HUMANS; PSYCHOLOGY; RESEARCH;

EID: 13444310998     PISSN: 00365564     EISSN: None     Source Type: Journal    
DOI: 10.1111/j.1467-9450.2005.00436.x     Document Type: Article

References (47)

1. APA (American Psychological Association) (2001). Publication manual (5th edn). Washington DC: APA.
2. Andersson, G. (1999). The role of meta-analysis in the significance test controversy. European Psychologist, 4, 75-82.
3. Andersson, G. (2003). Metaanalys. Metoder, tillämpningar och kontroverser [Meta-analysis: Methods, applications and controversies]. Lund: Studentlitteratur.
4. Carlbring, P., Ekselius, L. & Andersson, G. (2003). Treatment of panic disorder via the Internet: A randomized trial of CBT vs. applied relaxation. Journal of Behavior Therapy and Experimental Psychiatry, 34, 129-140.
5. Chartrand, T. L. & Bargh, J. A. (1999). The chameleon effect: The perception-behavior link and social interaction. Journal of Personality and Social Psychology, 76, 893-910.
6. Chow, S. L. (1996). Statistical significance. Rationale, validity and utility. London: Sage.
7. Cohen, J. (1969). Statistical power analysis for the behavioral sciences. New York: Academic Press.
8. Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd edn). Hillsdale, NJ: Lawrence Erlbaum Associates.
9. Cohen, J. (1994). The Earth is round (p < 0.05). American Psychologist, 49, 997-1003.
10. Cohen, J. & Cohen, P. (1983). Applied multiple regression/ correlation analysis for the behavioral sciences (2nd edn). Hillsdale, NJ: Lawrence Erlbaum Associates.
11. Cook, T. D. & Campbell, D. T. (1979). Quasi-experimentation: Design and analysis issues for field settings. Chicago: Rand McNally Publishing Company.
12. Falk, R. & Greenbaum, C. W. (1995). Significance tests die hard. The amazing persistence of a probabilistic misconception. Theory and Psychology, 5, 75-98.
13. Frick, R. W. (1996). The appropriate use of null hypothesis testing. Psychological Methods, 1, 379-390.
14. Frick, R. W. (1999). Defending the statistical status quo. Theory and Psychology, 9, 183-189.
15. Gigerenzer, G. (1993). The superego, the ego, and the id in statistical reasoning. In G. Keren & C. Lewis (Eds.), A handbook for data analysis in the behavioral sciences (pp. 311-338). Hillsdale, NJ: Lawrence Erlbaum Associates.
16. Greenwald, A. G., Gonzalez, R., Harris, R. J. & Guthrie, D. (1996). Effect sizes and p values: what should be reported and what should be replicated? Psychophysiology, 33, 175-183.
17. Hagen, R. L. (1997). In praise of the null hypothesis statistical test. American Psychologist, 52, 15-24.
18. Haller, H. & Krauss, S. (2002). Misinterpretation of significance: A problem students share with their teachers? Methods of Psychological Research Online, 7, 1-20.
19. Halpern, S. D., Karlawish, J. H. T. & Berlin, J. A. (2002). The continued unethical conduct of underpowered clinical trials. Journal of the American Medical Association, 288, 358-362.
20. Howard, G. S., Maxwell, S. E. & Fleming, K. J. (2000). The proof of the pudding: An illustration of the relative strengths of null hypothesis, meta-analysis, and Bayesian analysis. Psychological Methods, 5, 315-332.
21. Hunter, J. E. & Schmidt, F. L. (1990). Dichotomization of continous variables: The implications for meta-analysis. Journal of Applied Psychology, 75, 334-349.
22. Kirk, R. E. (1996). Practical significance: A concept whose time has come. Educational and Psychological Measurement, 56, 746-759.
23. Kraemer, H. C. (1981). Coping strategies in psychiatric clinical research. Journal of Consulting and Clinical Psychology, 49, 309-319.
24. Krueger, J. I. & Funder, D. C. (in press). Toward a balanced social psychology: Causes, consequences and cures for the problemseeking approach to social behavior and cognition. Behavioral and Brain Sciences.
25. Lehmann, E. L. (1993). The Fisher, Neyman-Pearson theories of testing hypotheses: One theory or two? Journal of the American Statistical Association, 88, 1242-1249.
26. Ogles, B. M., Lunnen, K. M. & Bonesteel, K. (2001). Clinical significance: History, application, and current practice. Clinical Psychology Review, 21, 421-446.
27. Rosenthal, R. (1984). Meta-analytic procedures for social research. Beverly Hills, CA: Sage.
28. Rosenthal, R. (2002). Covert communication in classrooms, clinics, courtrooms, and cubicles. American Psychologist, 57, 839-849.
29. Rosenthal, R. & DiMatteo, M. R. (2001). Meta-analysis: Recent developments in quantitative methods for literature reviews. Annual Review of Psychology, 52, 59-82.
30. Rosenthal, R., Rosnow, R. L. & Rubin, D. B. (2000). Contrasts and effect sizes in behavioral research: A correlational approach. Cambridge, UK: Cambridge University Press.
31. Rothman, K. J. & Greenland, S. (1998). Modern epidemiology. Philadelphia: Lippincott Williams & Wilkins.
32. Sackett, D. L., Strauss, S. E., Richardson, W. S., Rosenberg, W. & Haynes, R. B. (2000). Evidence-based medicine: How to practice and teach EBM (2nd edn). Edinburgh: Churchill Livingstone.
33. Sedlmeier, P. & Gigerenzer, G. (1989). Do studies of statistical power have an effect on the power of studies? Psychological Bulletin, 105, 309-316.
34. Sohlberg, S. & Birgegard, A. (2003). Persistent complex subliminal activation effects. First experimental observations. Journal of Personality and Social Psychology, 85, 302-316.
35. Sohlberg, S., Rosmark, B., Norring, C. & Holmgren, S. (1987). Two-year outcome in anorexia nervosa/bulimia: A controlled study of an eating control program combined with psychoanalytically oriented psychotherapy. International Journal of Eating Disorders, 6, 243-256.
36. Sohlberg, S., Stahlheuer, P. & Tell, P. (1997). Depression, gender and identification. British Journal of Clinical Psychology, 36, 453-455.
37. Sohn, D. (1998). Statistical significance and replicability: Why the former does not presage the latter. Theory and Psychology, 8, 291-311.
38. Spiegelhalter, D. J., Myles, J. P., Jones, D. R. & Abrams, K. R. (2000). Bayesian methods in health technology assessment: A review. Health Technology Assessment Monographs 4 (38). Available from http://www.ncchta.org
39. Taube, A. & Malmquist, J. (2001a). Räkna med vad du tror. Bayes' sats i diagnostiken [Count on what you believe. Bayes theorem in diagnosis]. Läkartidningen, 98, 2910-2913.
40. Taube, A. & Malmquist, J. (2001b). Räkna med vad du tror. Bayes - inte p-värdet - mäter tilltron [Count on what you believe. Bayes - not the p-value - is a measure of confidence]. Läkartidningen, 98, 3208-3211.
41. Tesch, F. E. (1977). Debriefing research participants: Though this be method there is madness to it. Journal of Personality and Social Psychology, 35, 217-224.
42. Thompson, B. (1994). The pivotal role of replication in psychological research: Empirically evaluating the replicability of sample results. Journal of Personality, 62, 158-176.
43. Thompson, B. (2002). What future quantitative social science research could look like: Confidence intervals for effect sizes. Educational Researcher, 31, 24-31.
44. Tryon, W. W. (1998). The inscrutable null hypothesis. American Psychologist, 53, 796-807.
45. Vacha-Haase, T., Nilsson, J. E., Reetz, D. R., Lance, T. S. & Thompson, B. (2000). Reporting practices and APA editorial policies regarding statistical significance and effect size. Theory and Psychology, 10, 413-425.
46. Wilkinson, L. & APA Task Force on Statistical Inference (1999). Statistical methods in psychology journals: Guidelines and explanations. American Psychologist, 54, 594-604.
47. Zuckerman, M., Hodgins, H. S., Zuckerman, A. & Rosenthal, R. (1993). Contemporary issues in the analysis of data: A survey of 551 psychologists. Psychological Science, 4, 49-53.