Is originality in the eye of the beholder? Comparison of scoring techniques in the assessment of divergent thinking

Journal of Creative Behavior

Volumn 45, Issue 1, 2011, Pages 1-22

  Plucker, Jonathana ^a   Qian, Meihua ^a   Wang, Shujuan ^b  

^a INDIANA UNIVERSITY   (United States)

^b INSTITUTE OF GEOLOGY AND GEOPHYSICS   (China)

Author keywords

Divergent thinking tests; Objective scoring methods; Reliability; Subjective scoring methods; Validity

Indexed keywords

EID: 84863229453     PISSN: 00220175     EISSN: 21626057     Source Type: Journal    
DOI: 10.1002/j.2162-6057.2011.tb01081.x     Document Type: Article

References (44)

1. AMABILE, T. M. (1982). Social psychology of creativity: A consensual assessment technique. Journal of Personality and Social Psychology, 43, 997-1013.
2. AMABILE, T. M. (1996). Creativity in context: Update to the social psychology of creativity. Boulder, CO: Westview.
3. CLARK, P. M., & MIRELS, H. L. (1970). Fluency as a pervasive element in the measurement of creativity. Journal of Educational Measurement, 7, 83-86.
4. DAVIS, G. A. (1989). Testing for creative potential. Contemporary Educational Psychology, 14, 257-274.
5. HENNESSEY, B. A., & AMABILE, T. M. (1988). Story-telling: A method for assessing children's creativity. Journal of Creative Behavior, 22, 235-246.
6. HOCEVAR, D. (1979a). A comparison of statistical infrequency and subjective judgment as criteria in the measurement of originality. Journal of Personality Assessment, 43, 297-299.
7. HOCEVAR, D. (1979b). Ideational fluency as a confounding factor in the measurement of originality. Journal of Educational Psychology, 71, 191-196.
8. HOCEVAR, D. (1979c). The unidimensional nature of creative thinking in fifth grade children. Child Study Journal, 9, 273-278.
9. HOCEVAR, D. (1981). Measurement of creativity: Review and critique. Journal of Personality Assessment, 45, 450-464.
10. HOCEVAR, D., & BACHELOR, P. (1989). A taxonomy and critique of measurements used in the study of creativity. In J. A. Glover, R. R. Ronning, & C. R. Reynolds (Eds.), Handbook of creativity (pp. 53-75). New York: Plenum Press.
11. HOCEVAR, D., & MICHAEL, W. B. (1979). The effects of scoring formulas on the discriminant validity of tests of divergent thinking. Educational and Psychological Measurement, 39, 917-921.
12. HONG, E., MILGRAM, R. M., & GORSKY, H. (1995). Original thinking as a predictor of creative performance in young children. Roeper Review, 18, 147-149.
13. HUNSAKER, S. L., & CALLAHAN, C. M. (1995). Creativity and giftedness: Published instrument uses and abuses. Gifted Child Quarterly, 39, 110-114.
14. KAUFMAN, J. C., PLUCKER, J. A., & BAER, J. (2008). Essentials of creativity assessment. New York: Wiley.
15. KYLLONEN, P. C., WALTERS, A. M., & KAUFMAN, J. C. (2005). Noncognitive constructs and their assessment in graduate education. Educational Assessment, 10, 153-184. (Pubitemid 41659299)
16. MESSICK, S. (1989). Meaning and values in test validation: The science and ethics of assessment. Educational Researcher, 18, 5-11.
17. MILGRAM, R. M., & HONG, E. (1993). Creative thinking and creative performance in adolescents as predictors of creative attainments in adults: A follow-up study after 18 years. Roeper Review, 15, 135-139.
18. MILLER, H. B., & SAWYERS, J. K. (1989). A comparison of self and teachers' ratings of creativity in fifth-grade children. The Creative Child and Adult Quarterly, 14, 179-185, 229, 238.
19. OKUDA, S. M., RUNCO, M. A., & BERGER, D. E. (1991). Creativity and the finding and solving or real-world problems. Journal of Psychoeducational Assessment, 9, 45-53.
20. PEDHAZUR, E. J., & SCHMELKIN, L. P. (1991). Measurement, design, and analysis: An integrated approach. Hillsdale, NJ: Lawrence Erlbaum Associates.
21. PLUCKER, J. A. (1999a). Is the proof in the pudding? Reanalyses of Torrance's (1958 to Present) longitudinal data. Creativity Research Journal, 12, 103-114.
22. PLUCKER, J. A. (1999b). Reanalyses of student responses to creativity checklists: Evidence of content generality. Journal of Creative Behavior, 33, 126-137.
23. PLUCKER, J. A., & RENZULLI, J. S. (1999). Psychometric approaches to the study of creativity. In R. J. Sternberg (Ed.), Handbook of human creativity (pp. 35-61). New York: Cambridge University Press.
24. PLUCKER, J. A., & RUNCO, M. (1998). The death of creativity measurement has been greatly exaggerated: Current issues, recent advances, and future directions in creativity assessment. Roeper Review, 21, 36-39.
25. RUNCO, M. A. (1984). Teachers' judgments of creativity and social validation of divergent thinking tests. Perceptual and Motor Skills, 59, 711-717.
26. RUNCO, M. A. (1985). Reliability and convergent validity of ideational flexibility as a function of academic achievement. Perceptual and Motor Skills, 61, 1075-1081.
27. RUNCO, M. A. (1987). Interrater agreement on a socially valid measure of students' creativity. Psychological Reports, 61, 1009-1010.
28. RUNCO, M. A. (1991). Divergent thinking. Norwood, NJ: Ablex.
29. RUNCO, M. A. (1992a). Children's divergent thinking and creative ideation. Developmental Review, 12, 233-264.
30. RUNCO, M. A. (1999). Divergent and creative thinking. Cresskill, NJ: Hampton Press.
31. RUNCO, M. A. (2008). Commentary: Divergent thinking is not synonymous with creativity. Psychology of Aesthetics, Creativity, and the Arts, 2, 93-96.
32. RUNCO, M. A., & Albert, R. S. (1985). The reliability and validity of ideational originality in the divergent thinking of academically gifted and nongifted children. Educational and Psychological Measurement, 45, 483-501.
33. RUNCO, M. A., & MRAZ, W. (1992). Scoring divergent thinking tests using total ideational output and a creativity index. Educational and Psychological Measurement, 52, 213-221.
34. RUNCO, M. A., OKUDA, S. M., & THURSTON, B. J. (1987). The psychometric properties of four systems for scoring divergent thinking tests. Journal of Psychoeducational Assessment, 5, 149-156.
35. RUNCO, M. A., & SMITH, W. R. (1992). Interpersonal and intrapersonal evaluations of creative ideas. Personality and Individual Differences, 13, 295-302.
36. SAWYERS, J. K., & CANESTARO, N. C. (1989). Creativity and achievement in design coursework. Creativity Research Journal, 2, 126-133.
37. SEDDON, G. M. (1983). The measurement and properties of divergent thinking ability as a single compound entity. Journal of Educational Measurement, 20, 393-402.
38. SHORE, B. M., CORNELL, D. G., ROBINSON, A., & WARD, V. S. (1991). Recommended practices in gifted education. New York: Teachers College Press.
39. SILVIA, P. J. (2008). Creativity and intelligence revisited: A latent variable analysis of Wallach and Kogan (1965). Creativity Research Journal, 20, 34-39.
40. SILVIA, P. J., WINTERSTEIN, B. P., WILLSE, J. T., BARONA, C. M., CRAM, J. T., HESS, K. I., MARTINEZ, J. L., & RICHARD, C. A. (2008). Assessing creativity with divergent thinking tasks: exploring the reliability and validity of new subjective scoring methods. Psychology of Aesthetics, Creativity, and the Arts, 2, 68-85.
41. TORRANCE, E. P. (1974). Torrance Tests of Creative Thinking: Norms-technical manual. Lexington, MA: Ginn and Company.
42. TORRANCE, E. P. (1988). The nature of creativity as manifest in its testing. In R. J. Sternberg (Ed.), The nature of creativity: Contemporary psychological perspectives (pp. 43-75). New York: Cambridge University Press.
43. WALLACH, M. A., & KOGAN, N. (1965). Modes of thinking in young children: A study of the creativityintelligence distinction. New York: Holt, Rinehart and Winston.
44. WALPOLE, M. B., BURTON, N. W., KANYI, K., & JACKENTHAL, A. (2002). Selecting successful graduate students: In-depth interviews with GRE users. (GRE Board Research Report No.99-1R, ETS Research Report. 02-8) Princeton, NJ: Educational Testing Service.