Assessment of divergent thinking by means of the subjective top-scoring method: Effects of the number of top-ideas and time-on-task on reliability and validity

Psychology of Aesthetics, Creativity, and the Arts

Volumn 7, Issue 4, 2013, Pages 341-349

  Benedek, Mathias ^a   Mühlmann, Caterina ^a   Jauk, Emanuel ^a   Neubauer, Aljoscha C ^a  

^a UNIVERSITY OF GRAZ   (Austria)

Author keywords

Fluency; Originality; Reliability; Time on task; Validity

Indexed keywords

EID: 84877131663     PISSN: 19313896     EISSN: 1931390X     Source Type: Journal    
DOI: 10.1037/a0033644     Document Type: Article

References (39)

1. Amabile, T. (1982). Social psychology of creativity: A consensual assessment technique. Journal of Personality and Social Psychology, 43, 997-1013. doi:10.1037/0022-3514.43.5.997.
2. Beaty, R. E., & Silvia, P. J. (2012). Why do ideas get more creative across time? An executive interpretation of the serial order effect in divergent thinking tasks. Psychology of Aesthetics, Creativity, and the Arts. Advance online publication. doi:10.1037/a0029171.
3. Benedek, M., Fink, A., & Neubauer, A. (2006). Enhancement of ideational fluency by means of computer-based training. Creativity Research Journal, 18, 317-328. doi:10.1207/s15326934crj1803_7.
4. Benedek, M., Franz, F., Heene, M., & Neubauer, A. C. (2012). Differential effects of cognitive inhibition and intelligence on creativity. Personality and Individual Differences, 53, 480-485. doi:10.1016/j.paid.2012.04 .014.
5. Benedek, M., Könen, T., & Neubauer, A. C. (2012). Associative abilities underlying creativity. Psychology of Aesthetics, Creativity, and the Arts, 6, 273-281. doi:10.1037/a0027059.
6. Benedek, M., & Neubauer, A. C. (in press). Revisiting Mednick's model on creativity-related differences in associative hierarchies. Evidence for a common path to uncommon thought. Journal of Creative Behavior. doi:10.1002/jocb.35.
7. Borkenau, P., & Ostendorf, F. (1993). NEO-Fünf-Faktoren Inventar (NEOFFI) nach Costa und McCrae [NEO-Five factor inventory after Costa and McCrae]. Göttingen, Germany: Hogrefe.
8. Clark, P. M., & Mirels, H. L. (1970). Fluency as a pervasive element in the measurement of creativity. Journal of Educational Measurement, 7, 83-86. doi:10.1111/j.1745-3984.1970.tb00699.x.
9. Fink, A., & Benedek, M. (in press). EEG Alpha power and creative ideation. Neuroscience and Biobehavioral Reviews. Advance online publication. doi:10.1016/j.neubiorev.2012.12.002.
10. Gilhooly, K. J., Fioratou, E., Anthony, S. H., & Wynn, V. (2007). Divergent thinking: Strategies and executive involvement in generating novel uses for familiar objects. British Journal of Psychology, 98, 611-625.
11. Guilford, J. P. (1967). The nature of human intelligence. New York, NY: McGraw-Hill.
12. Hocevar, D. (1979a). A comparison of statistical infrequency and subjective judgment as criteria in the measurement of originality. Journal of Personality Assessment, 43, 297-299. doi:10.1207/s15327752 jpa4303_13.
13. Hocevar, D. (1979b). Ideational fluency as a confounding factor in the measurement of originality. Journal of Educational Psychology, 71, 191-196. doi:10.1037/0022-0663.71.2.191.
14. Jauk, E., Benedek, M., Dunst, B., & Neubauer, A. C. (2013). The relationship between intelligence and creativity: New support for the threshold hypothesis by means of empirical breakpoint detection. Intelligence, 41, 212-221. doi:10.1016/j.intell.2013.03.003.
15. Kaufman, J. C., Plucker, J. A., & Baer, J. (2008). Essentials of creativity assessment. Hoboken, NJ: Wiley.
16. Kuhn, J. T., & Holling, H. (2009). Measurement invariance of divergent thinking across gender, age, and school forms. European Journal of Psychological Assessment, 25, 1-7. doi:10.1027/1015-5759.25.1.1.
17. Lau, S., & Cheung, P. C. (2010). Creativity assessment: Comparability of the electronic and paper-and-pencil versions of the Wallach-Kogan Creativity Tests. Thinking Skills and Creativity, 5, 101-107. doi: 10.1016/j.tsc.2010.09.004.
18. Mednick, S. A. (1962). The associative basis of the creative process. Psychological Review, 69, 220-232. doi:10.1037/h0048850.
19. Michael, W. B., & Wright, C. R. (1989). Psychometric issues in the assessment of creativity. In J. A. Glover, R. R. Ronning & C. R. Reynolds (Eds.), Handbook of creativity (pp. 33-52). New York, NY: Plenum Press. doi:10.1007/978-1-4757-5356-1_2.
20. Mouchiroud, C., & Lubart, T. (2001). Children's original thinking: An empirical examination of alternative measures derived from divergent thinking tasks. The Journal of Genetic Psychology: Research and Theory on Human Development, 162, 382-401. doi:10.1080/00221320109597491.
21. Nusbaum, E. C., & Silvia, P. J. (2011). Are intelligence and creativity really so different? Fluid intelligence, executive processes, and strategy use in divergent thinking. Intelligence, 39, 36-45. doi:10.1016/j.intell .2010.11.002.
22. Piers, E. V., & Kirchner, E. P. (1971). Productivity and uniqueness in continued word association as a function of subject creativity and stimulus properties. Journal of Personality, 39(2), 264-276. doi: 10.1111/j.1467-6494.1971.tb00041.x.
23. Plucker, J. A., Qian, M., & Wang, S. (2011). Is originality in the eye of the beholder? Comparison of scoring techniques in the assessment of divergent thinking. The Journal of Creative Behavior, 45, 1-22. doi:10.1002/j.2162-6057.2011.tb01081.x.
24. Reiter-Palmon, R., Illies, M. Y., Cross, L. K., Buboltz, C., & Nimps, T. (2009). Creativity and domain specificity: The effect of task type on multiple indexes of creative problem-solving. Psychology of Aesthetics, Creativity, and the Arts, 3, 73-80. doi:10.1037/a0013410.
25. Runco, M. A. (1986). Maximal performance on divergent thinking tests by gifted, talented, and nongifted children. Psychology in the Schools, 23, 308-315. doi:10.1002/1520-6807(198607)23:3<308::AIDPITS2310230313 >3.0.CO;2-V.
26. Runco, M. A. (2008). Commentary: Divergent thinking is not synonymous with creativity. Psychology of Aesthetics, Creativity, and the Arts, 2, 93-96. doi:10.1037/1931-3896.2.2.93.
27. Runco, M. A., & Acar, S. (2012). Divergent thinking as an indicator of creative potential. Creativity Research Journal, 24, 66-75. doi:10.1080/10400419.2012.652929.
28. Runco, M. A., & Albert, R. S. (1985). The reliability and validity of ideational originality in the divergent thinking of academically gifted and nongifted children. Educational and Psychological Measurement, 45, 483-501.
29. Runco, M. A., & Mraz, W. (1992). Scoring divergent thinking tests using total ideational output and a creativity index. Educational and Psychological Measurement, 52, 213-221.
30. Runco, M. A., Okuda, S. M., & Thurston, B. J. (1987). The psychometric properties of four systems for scoring divergent thinking tests. Journal of Psychoeducational Assessment, 5, 149-156. doi:10.1177/073428298700500206.
31. Runco, M. A., Plucker, J. A., & Lim, W. (2001). Development and psychometric integrity of a measure of ideational behavior. Creativity Research Journal, 13, 393-400. doi:10.1207/S15326934CRJ1334_16.
32. Silvia, P. J. (2008). Discernment and creativity: How well can people identify their most creative ideas? Psychology of Aesthetics, Creativity, and the Arts, 2, 139-146. doi:10.1037/1931-3896.2.3.139.
33. Silvia, P. J. (2011). Subjective scoring of divergent thinking: Examining the reliability of unusual uses, instances, and consequences tasks. Thinking Skills and Creativity, 6, 24-30. doi:10.1016/j.tsc.2010.06.001.
34. Silvia, P. J., Martin, C., & Nusbaum, E. C. (2009). A snapshot of creativity: Evaluating a quick and simple method for assessing divergent thinking. Thinking Skills and Creativity, 4, 79-85. doi:10.1016/j.tsc.2009.06.005.
35. Silvia, P. J., Winterstein, B. P., Willse, J. T., Barona, C. M., Cram, J. T., Hess, K. I.,... Richard, C. A. (2008). Assessing creativity with divergent thinking tasks: Exploring the reliability and validity of new subjective scoring methods. Psychology of Aesthetics, Creativity, and the Arts, 2, 68-85. doi:10.1037/1931-3896.2.2.68.
36. Smith, S. M., Ward, T. B., & Finke, R. A. (1995). The creative cognition approach. Cambridge, MA: MIT Press.
37. Torrance, E. P. (1974). Torrance Tests of Creative Thinking: Normstechnical manual, verbal forms A and B. Bensenville, IL: Scholastic Testing Service.
38. Torrance, E. P. (2008). Torrance Tests of Creative Thinking: Normstechnical manual, verbal forms A and B. Bensenville, IL: Scholastic Testing Service.
39. Velicer, W. F., Eaton, C. A., & Fava, J. L. (2000). Construct explication through factor or component analysis: A review and evaluation of alternative procedures for determining the number of factors or components. In R. D. Goffin & E. Helmes (Eds.), Problems and solutions in human assessment (pp. 41-71). Boston, MA: Kluwer. doi:10.1007/978-1-4615-4397-8_3.