A measure of creativity or intelligence?: Examining internal and external structure validity evidence of the remote associates test

Psychology of Aesthetics, Creativity, and the Arts

Volumn 8, Issue 4, 2014, Pages 446-460

  Lee, Christine S ^a   Huggins, Anne Corinne ^b   Therriault, David J ^b  

^a CALIFORNIA STATE UNIVERSITY   (United States)

^b UNIVERSITY OF FLORIDA   (United States)

Author keywords

Associative processing; Convergent thinking; Divergent thinking; Item response theory; Remote associates test

Indexed keywords

EID: 84937735434     PISSN: 19313896     EISSN: 1931390X     Source Type: Journal    
DOI: 10.1037/a0036773     Document Type: Article

References (76)

1. Aiello, D. A., Jarosz, A. F., Cushen, P. J., & Wiley, J. (2012). Firing the executive: When an analytic approach to problem solving helps and hurts. The Journal of Problem Solving, 4, Article 7.
2. Akbari Chermahini, S. A., Hickendorff, M., & Hommel, B. (2012). Development and validity of a Dutch version of the Remote Associates Task: An item-response theory approach. Thinking Skills and Creativity, 7, 177-186. doi:10.1016/j.tsc.2012.02.003
3. Ansburg, P. I. (2000). Individual differences in problem solving via insight. Current Psychology, 19, 143-146. doi:10.1007/s12144-000-1011-y
4. Benedek, M., Konen, T., & Neubauer, A. C. (2012). Associative abilities underlying creativity. Psychology of Aesthetics, Creativity, and the Arts, 6, 273-281. doi:10.1037/a0027059
5. Binet, A. (1899). The Psychology of Reasoning: Based on Experimental Researches in Hypnotism. Chicago: Open Court Publishing Company.
6. Bors, D. A., & Stokes, T. L. (1998). Raven's Advanced Progressive Matrices: Norms for first-year university students and the development of a short form. Educational and Psychological Measurement, 58, 382-398. doi:10.1177/0013164498058003002
7. Bowden, E. M., & Jung-Beeman, M. (2003). Normative data for 144 compound remote associates problems. Behavior Research Methods, Instruments & Computers, 35, 634-639. doi:10.3758/BF03195543
8. Brophy, D. R. (2000). Comparing the attributes, activities, and performance of divergent, convergent, and combination thinkers. Creativity Research Journal, 13, 439-455.
9. Cai, L. (2008). SEM of another flavour: Two new applications of the supplemented EM algorithm. British Journal of Mathematical and Statistical Psychology, 61, 309-329. doi:10.1348/000711007X249603
10. Cai, L. (2010). A two-tier full-information item factor analysis model with applications. Psychometrika, 75, 581-612.
11. Cai, L., & Thissen, D. (1997). Local dependence indices for item pairs using item response theory. Journal of Educational and Behavioral Statistics, 22, 265-289. doi:10.2307/1165285
12. Cai, L., Thissen, D., & du Toit, S. H. C. (2011). IRTPRO for Windows [Computer software]. Lincolnwood, IL: Scientific Software International.
13. Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56, 81-105. doi:10.1037/h0046016
14. Conway, A. R., Kane, M. J., Bunting, M. F., Hambrick, D. Z., Wilhem, O., & Engle, R. W. (2005). Working memory span tasks: A methodological review and user's guide. Psychonomic Bulletin & Review, 12, 769-786. doi:10.3758/BF03196772
15. Craig, M., & Manis, M. (1962). Prediction of scores of on the Remote Associates Test by size of response repertoire. Unpublished manuscript.
16. Crocker, L. S., & Algina, J. (1986). Introduction to classical and modern test theory. Fort Worth, TX: Harcourt Brace Jovanovich.
17. Crutchfield, R. (1955). Conformity and character. American Psychologist, 10, 191-198.
18. Datta, L. (1964). A note on the RAT, U.S. culture, and creativity. Journal of Applied Psychology, 48, 184-185.
19. Drewes, D. W. (2000). Beyond the Spearman-Brown: A structural approach to maximal reliability. Psychological Methods, 5, 214-227.
20. Embretson, S. E., & Reise, S. (2000). Item response theory for psychologists. Mahwah, NJ: Erlbaum Publishers.
21. Finke, R. A., Ward, T. B., & Smith, S. M. (1992). Creative cognition:Theory, research, and applications. Cambridge, MA: MIT Press.
22. Fodor, E. M. (1999). Subclinical inclination toward manic-depression and creative performance on the Remote Associates Test. Personality and Individual Differences, 27, 1273-1283. doi:10.1016/S0191-8869(99)00076-8
23. Friedman, N. P., & Miyake, A. (2004). The reading span test and its predictive power for reading comprehension ability. Journal of Memory and Language, 51, 136-158. doi:10.1016/j.jml.2004.03.008
24. Goff, K., & Torrance, E. P. (2002). Abbreviated Torrance Test for Adults Manual. Bensenville, IL: Scholastic Testing Service.
25. Gosling, S. D., Rentfrow, P. J., & Swann, W. B., Jr. (2003). A very brief measure of the Big-Five personality domains. Journal of Research in Personality, 37, 504-528. doi:10.1016/S0092-6566(03)00046-1
26. Guilford, J. P., Merrifield, P. R., & Wilson, R. C. (1958). Unusual uses test. Orange, CA: Sheridan Psychological Services.
27. Hancock, G. R., & Mueller, R. O. (2001). Rethinking construct reliability within latent variable systems. In R. Cudeck, S. du Toit, & D. Sörbom (Eds.), Structural Equation Modeling: Present and Future-A Festschrift in honor of Karl Jöreskog. Lincolnwood, IL: Scientific Software International, Inc.
28. Hommel, B. (2012). Convergent and divergent operations in cognitive search. In: P. M. Todd, T. T. Hills, & T. W. Robbins (eds.), Cognitive search: Evolution, algorithms, and the brain (pp. 221-235). Cambridge, MA: MIT Press.
29. Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Coventional criteria versus new alternatives, Structural Equation Modeling, 6, 1-55. doi:10.1080/10705519909540118
30. Kaufman, J. C. (2009). Creativity 101. New York, NY: Springer.
31. Kaufman, J. C., Plucker, J. A., & Baer, J. (2008). Essentials of creativity assessment. New York, NY: Wiley.
32. Laughlin, P. R., Doherty, M. A., & Dunn, R. P. (1968). Intentional and incidental concept formation as a function of motivation, creativity, intelligence, and sex. Journal of Personality and Social Psychology, 8, 401-409. doi:10.1037/h0025522
33. Lee, C. S., & Therriault, D. J. (2013). The cognitive underpinnings of creative thought: A latent variable analysis exploring the role of intelligence and working memory in three creative thinking processes. Intelligence, 41, 306-320. doi:10.1016/j.intell.2013.04.008
34. Lord, F. M., & Novick, M. R. (1980). Statistical theories of mental test scores. Reading, MA: Addison Wesley Publication Co.
35. MacKinnon, D. W. (1962). The nature and nurture of creative talent. American Psychologist, 17, 484-495. doi:10.1037/h0046541
36. MacKinnon, D. W. (1975). IPAR's contribution to the conceptualization and study of creativity. In I. A. Taylor & J. W. Getzels (Eds.), Perspectives in creativity (pp. 60-89). Chicago, IL: Aldine Publishing Company.
37. Mednick, M. T. (1963). Research creativity in psychology graduate students. Journal of Consulting Psychology, 27, 265-266. doi:10.1037/h0042429
38. Mednick, S. A. (1962). The associative basis of the creative process. Psychological Review, 69, 220-232. doi:10.1037/h0048850
39. Mednick, S. (1968). Some premorbid characteristics related to breakdown in children with schizophrenic mothers. Journal of Psychiatric Research, 6, 267-291.
40. Mednick, S. A., & Mednick, M. T. (1967). Examiner's manual: Remote Associates Test. Boston, MA: Houghton Mifflin.
41. Mendelsohn, G. A. (1976). Associative and attentional processes in creative performance. Journal of Personality, 44, 341-369. doi:10.1111/j .1467-6494.1976.tb00127.x
42. Messick, S. (1989). Validity. In R. L. Linn's (Ed.), Educational measurement (3rd ed., pp. 13-103). New York, NY: American Council on Education/Macmillan.
43. Mikulincer, M., & Sheffi, E. (2000). Adult attachment style and cognitive reactions to positive affect: A test of mental categorization and creative problem solving. Motivation & Emotion, 24, 149-174. doi:10.1023/A:1005606611412
44. Muthén, B. O. (1993). Goodness of fit with categorical and other nonnormal variables. In K. A. Bollen & J. S. Long (Eds.), Testing structural equation models (pp. 205-243). Newbury Park, CA: Sage.
45. Muthén, L. K., & Muthén, B. O. (2012). Mplus User's Guide (7th ed.). Los Angeles, CA: Muthén & Muthén.
46. Osterlind, S. J., & Everson, H. T. (2009). Differential item functioning (2nd ed.). Los Angeles, CA: Sage.
47. Penfield, R. D. (2003). IRT-Lab Version 2: Using software to enhance research and pedagogy in the fields of Rasch mesaurement and IRT. Rasch Measurement Transactions, 17, 925.
48. Plucker, J. A., Beghetto, R. A., & Dow, G. T. (2004). Why isn't creativity more important to educational psychologists? Potentials, pitfalls, and future directions in creativity research. Educational Psychologist, 39, 83-96. doi:10.1207/s15326985ep3902_1
49. Raven, J., Court, J. H., & Raven, J. (1977). The manual for Raven's Progressive Matrices and Vocabulary Scales (Section 3). London, England:H. K. Lewis & Co.
50. Raven, J., Raven, J. C., & Court, J. H. (1998). Manual for Raven's Progressive Matrices and Vocabulary Scales, Section 1: General overview. San Antonio, TX: Harcourt Assessment.
51. Raykov, T. (2004). Point and Interval Estimation of Reliability for Multiple-Component Measuring Instruments via Linear Constraint Covariance Structure Modeling. Structural Equation Modeling, 11, 342-356.
52. R Development Core Team. (2005). R: A language and environment for statistical computing, reference index version 2.2.1. Vienna, Austria: R Foundation for Statistical Computing. Retrieved from http://www.Rproject. org
53. Redick, T. S., Shipstead, Z., Harrison, T. L., Hicks, K. L., Fried, D. E., Hambrick, D. Z., Engle, R. W. (2012). No evidence of intelligence improvement after working memory training: A randomized, placebocontrolled study. Journal of Experimental Psychology General, 142, 359-379.
54. Runco, M. A. (2004). Creativity. Annual Review of Psychology, 55, 657-687. doi:10.1146/annurev.psych.55.090902.141502
55. Schneider, W., Eschman, A., & Zuccolotto, A. (2007). E-Prime getting started guide. Pittsburgh, PA: Psychology Software Tools, Inc.
56. Shah, P., & Miyake, A. (1996). The separability of working memory resources for spatial thinking and language processing: An individual differences approach. Journal of Experimental Psychology: General, 125, 4-27. doi:10.1037/0096-3445.125.1.4
57. Shapiro, R. J. (1965). The integrating of remotely associated concepts as a process in scientific creativity. Psychologia Africana, 11, 40-48.
58. Silvia, P. J. (2011). Subjective scoring of divergent thinking: Examining the reliability of unusual uses, instances, and consequences tasks. Thinking Skills and Creativity, 6, 24-30.
59. Silvia, P. J., Martin, C., & Nusbaum, E. C. (2009). A snapshot of creativity:Evaluating a quick and simple method for assessing divergent thinking. Thinking Skills and Creativity, 4, 79-85. doi:10.1016/j.tsc.2009.06.005
60. Silvia, P. J., Nusbaum, E. C., Berg, C., Martin, C., & O'Conner, A. (2009). Openness to experience, plasticity, and creativity: Exploring lowerorder, higher-order, and interactive effects. Journal of Research in Personality, 43, 1087-1090. doi:10.1016/j.jrp.2009.04.015
61. Silvia, P. J., Winterstein, B. P., Willse, J. T., Barona, C. M., Cram, J. T., Hess, K. I., Richard, C. A. (2008). Assessing creativity with divergent thinking tasks: Exploring the reliability and validity of new subjective scoring methods. Psychology of Aesthetics, Creativity, and the Arts, 2, 68-85. doi:10.1037/1931-3896.2.2.68
62. Spruill, J. (1984). Wechsler Adult Intelligence Scale-Revised. In D. Keyser, M. Storandt, J. Botwinick, & W. L. Danzinger (Eds.), Test Critiques. Kansas City, MO: Test Corporation of America.
63. Storm, B. C., Angello, G., & Bjork, E. L. (2011). Thinking can cause forgetting: Memory dynamics in creative problem solving. Journal of Experimental Psychology: Learning, Memory, and Cognition, 37, 1287-1293. doi:10.1037/a0023921
64. Swiercinsky, D. (1988). WAIS-R, tutorial workbook. Austin, Tex: PROED.
65. Taft, R., & Rossiter, J. (1966). The Remote Associates Test: Divergent or convergent thinking? Psychological Reports, 19, 1313-1314. doi:10.2466/pr0.1966.19.3f.1313
66. Torrance, E. P. (1966). The Torrance Tests of Creative Thinking: Normstechnical manual. Lexington, MA: Personal Press.
67. Torrance, E. P. (1969). Prediction of adult creative achievement among high school seniors. Gifted Child Quarterly, 16, 75-88.
68. Torrance, E. P. (1972). Predictive validity of the Torrance Tests of Creative Thinking. The Journal of Creative Behavior, 6, 236-252. doi:10.1002/j.2162-6057.1972.tb00936.x
69. Torrance, E. P. (1974). The Torrance Tests of Creative Thinking: Normstechnical manual. Princeton, NJ: Personnel Press.
70. Torrance, E. P. (2008). The Torrance Tests of Creative Thinking: Normstechnical manual. Bensenville, IL: Scholastic Testing Services.
71. Treffinger, D. J. (1995). Creative problem solving: Overview and educational implications. Educational Psychology Review, 7, 301-312. doi:10.1007/BF02213375
72. Unworth, N., & Engle, R. W. (2007). On the division of short-term and working memory: An examination of simple and complex span and their relation to higher order abilities. Psychological Bulletin, 133, 1038-1066.
73. Unsworth, N., Redick, T. S., Heitz, R. P., Broadway, J. M., & Engle, R. W. (2009). Complex working memory span tasks and higher-order cognition:A latent-variable analysis of the relationship between processing and storage. Memory, 17, 635-654. doi:10.1080/09658210902998047
74. Vohs, K. D., & Heatherton, T. F. (2001). Self-esteem and threats to self:Implications for self-construals and interpersonal perceptions. Journal of Personality and Social Psychology, 81, 1103-1118. doi:10.1037/0022-3514.81.6.1103
75. Weschler, D. (1958). The measurement and appraisal of adult intelligence (4th ed.). Baltimore, MD: Williams and Wilkins.
76. Wilde, N. J., Strauss, E., & Tulsky, D. S. (2004). Memory span on the Wechsler scales. Journal of Clinical and Experimental Neuropsychological Society, 9, 302.