Assessing problem solving in context

Handbook of Understanding and Measuring Intelligence

Volumn , Issue , 2005, Pages 11-26

  Kyllonen, Patrick C ^a,b   Lee, Soonmook ^c  

^a EDUCATIONAL TESTING SERVICE   (United States)

^b AMERICAN PSYCHOLOGICAL ASSOCIATION   (United States)

^c Sungkyunkwan University   (South Korea)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84951986600     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.4135/9781452233529.n2     Document Type: Chapter

References (54)

1. Bloom, B. S.(Ed.). (1956). Taxonomy of educational objectives: The classification of educational goals: Handbook I, cognitive domain. New York: Longmans, Green.
2. Bransford, J. D., & Stein, B. S. (1984). The IDEAL problem solver: A guide for improving thinking, learning, and creativity. New York: Freeman.
3. Brody, N. (2003). Construct validation of the Sternberg Triarchic Abilities Test: Comment and reanalysis. Intelligence, 31, 319-329.doi:10.1016/S0160-2896(01)00087-3 http://dx.doi.org/10.1016/S0160-2896%2801%2900087-3
4. Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by multitrait-multimethod matrix. Psychological Bulletin, 56, 81-105.doi:10.1037/h0046016 http://dx.doi.org/10.1037/h0046016
5. Carroll, J. B. (1993). Human cognitive abilities: A survey of factor-analytic studies. New York: Cambridge University Press.doi:10.1017/CBO9780511571312 http://dx.doi.org/10.1017/CBO9780511571312
6. Chan, D., & Schmitt, N. (1997). Video-based versus paper-and-pencil method of assessment in situational judgment tests: Subgroup differences in test performance and face validity perceptions. Journal of Applied Psychology, 82, 143-159.doi:10.1037/0021-9010.82.1.143 http://dx.doi.org/10.1037/0021-9010.82.1.143
7. Davies, M., Stankov, L., & Roberts, R. (1998). Emotional intelligence: In search of an elusive construct. Journal of Personality and Social Psychology, 75, 989-1015.doi:10.1037/0022-3514.75.4.989 http://dx.doi.org/10.1037/0022-3514.75.4.989
8. Derry, S., Levin, J. R., & Schauble, L. (1995). Stimulating statistical thinking through situated simulations. Teaching of Psychology, 22, 51-57.doi:10.1207/s15328023top2201_16 http://dx.doi.org/10.1207/s15328023top2201_16
9. Duncker, K. (1935). Zur Psychologie des produktiven Denkens [To the psychology of productive thinking]. Berlin: Springer.
10. Ennis, R. H. (1996). Critical thinking. Upper Saddle River, NJ: Prentice Hall.
11. Erwin, T. D. (1998). Definitions and assessment methods of critical thinking, problem solving, and writing. Washington, DC: U.S. Department of Education.
12. Ettienne, P. M., & Julian, E. R. (2001). Identifying behaviors of successful medical students and residents. Washington, DC: Association of American Medical Colleges.
13. Facione, P. (1990). Critical thinking: A statement of expert consensus for purposes of educational assessment and instruction. Millbrae, CA: California Academic Press.
14. Facione, P., & Facione, N. (1990). California Critical Thinking Dispositions Inventory and California Critical Thinking Skills Test. Millbrae, CA: California Academic Press.
15. Frederickson, N. (1984). The real test bias: Influences of testing on teaching and learning. American Psychologist, 39, 193-202.doi:10.1037/0003-066X.39.3.193 http://dx.doi.org/10.1037/0003-066X.39.3.193
16. Gipps, C. (1999). Socio-cultural aspects of assessment. Review of Research in Education, 24, 355-392.
17. Gonzales, K. (2002). ETS unveils industry’s first outcomes assessment for MBA programs. Princeton, NJ: ETS.
18. Gottfredson, L. S. (2003). Dissecting practical intelligence theory: Its claims and evidence. Intelligence, 31, 343-397.doi:10.1016/S0160-2896(02)00085-5 http://dx.doi.org/10.1016/S0160-2896%2802%2900085-5
19. Hanson, M. A., Horgen, K. E., & Borman, W. C. (1998, November). Situational judgment: An alternative approach to selection test development (Symposium AB-34D). Paper presented at the annual meeting of the International Military Testing Association, Pensacola, FL.
20. Hedge, J. W., Hanson, M. A., Borman, W. C., Bruskiewicz, K. T., & Logan, K. K. (1996, May). Predicting the crew resource management skills of Air Force pilots (Institute Report № 283). Tampa, FL: Personnel Decisions Research Institutes, Inc.
21. Hedlund, J., Plamondon, K., Wilt, J., Nebel, K., Ashford, S., & Sternberg, R. J. (2001, April). Practical intelligence for business: Going beyond the GMAT. Paper presented at the 18th Annual Society for Industrial and Organizational Psychology Conference, San Diego.
22. Holyoak, K. J., & Thagard, P. (1989). Analogical mapping by constraint satisfaction. Cognitive Science, 13, 295-355.doi:10.1207/s15516709cog1303_1 http://dx.doi.org/10.1207/s15516709cog1303_1
23. Holyoak, K. J., & Thagard, P. (1995). Mental leaps. Cambridge: MIT Press.
24. Horvath, J. A., Sternberg, R. J., Forsythe, G. B., Sweeney, P. J., Bullis, R. C., Williams, W. M., et al. (1996). Tacit knowledge in military leadership: Supporting instrument development (U.S. Army Technical Report 1042). Washington, DC: U.S. Army Research Institute for the Behavioral and Social Sciences.
25. Jensen, A. R. (1993). Test validity: g versus "tacit knowledge." Current Directions in Psychological Science, 2, 9-10.doi:10.1111/1467-8721.ep10770493 http://dx.doi.org/10.1111/1467-8721.ep10770493
26. Legree, P. J. (1995). Evidence for an oblique social intelligence factor established with a Likert-based testing procedure. Intelligence, 21, 247-266.doi:10.1016/0160-2896(95)90016-0 http://dx.doi.org/10.1016/0160-2896%2895%2990016-0
27. Lohman, D. F. (1993). Teaching and testing to develop fluid abilities. Educational Researcher, 22, 12-23.
28. MacCann, C., Roberts, R. D., Matthews, G., & Zeidner, M. (2004). Consensus scoring and empirical option weighting of performance-based Emotional Intelligence (EI) tests. Personality and Individual Differences, 36, 645-662.doi:10.1016/S0191-8869(03)00123-5 http://dx.doi.org/10.1016/S0191-8869%2803%2900123-5
29. McCormack, M. (1994). What they don’t teach you at Harvard Business School. New York: Bantam.
30. McDaniel, M. A., Hartman, N. S., & Grubb, W. L., III. (2003, April). Situational judgment tests, knowledge, behavioral tendency. Paper presented at the 18 th Annual Conference of the Society for Industrial and Organizational Psychology, Orlando, FL.
31. McDaniel, M. A., Morgeson, F. P., Finnegan, E. B., Campion, M. A., & Braverman, E. P. (2001). use of situational judgment tests to predict job performance: A clarification of the literature. Journal of Applied Psychology, 86(4), 730-740.doi:10.1037/0021-9010.86.4.730 http://dx.doi.org/10.1037/0021-9010.86.4.730
32. McDaniel, M. A., & Nguyen, N. T. (2001). Situational judgment tests: A review of practice and constructs assessed. International Journal of Selection and Assessment, 9(1-2), 103-113.doi:10.1111/1468-2389.00167 http://dx.doi.org/10.1111/1468-2389.00167
33. Motowidlo, S. J., Dunnette, M. D., & Carter, G. W. (1990). An alternative selection procedure: The low-fidelity simulation. Journal of Applied Psychology, 75, 640-647.doi:10.1037/0021-9010.75.6.640 http://dx.doi.org/10.1037/0021-9010.75.6.640
34. Oswald, F. L., Schmitt, N., Ramsay, L. J., Kim, R. H., & Gillespie, M. A. (2002). Noncognitive predictors of college student success. unpublished manuscript.
35. Ployhart, R. E., & Ehrhart, M. G. (2003). Be careful what you ask for: Effects of response instructions on the construct validity and reliability of situational judgment tests. International Journal of Selection and Assessment, 11, 1-16.doi:10.1111/1468-2389.00222 http://dx.doi.org/10.1111/1468-2389.00222
36. Polya, G. (1957). How to solve it. Princeton, NJ: Princeton University Press.
37. Pulakos, E. D., & Schmitt, N. (1996). An evaluation of two strategies for reducing adverse impact and their effects on criterion-related validity. Human Performance, 9, 241-258.doi:10.1207/s15327043hup0903_4 http://dx.doi.org/10.1207/s15327043hup0903_4
38. Ree, M. J., & Earles, J. A. (1993). g is to psychology what carbon is to chemistry: A reply to Sternberg and Wagner, McClelland, and Calfee. Current Directions in Psychological Science, 2, 11-12.doi:10.1111/1467-8721.ep10770509 http://dx.doi.org/10.1111/1467-8721.ep10770509
39. Sackett, P. R., Schmitt, N., Ellingson, J. E., & Kabin, M. B. (2001). High-stakes testing in employment, credentialing, and higher education: Prospects in a post-affirmative action world. American Psychologist, 56, 302-318.doi:10.1037/0003-066X.56.4.302 http://dx.doi.org/10.1037/0003-066X.56.4.302
40. Schmidt, F. L., & Hunter, J. E. (1993). Tacit knowledge, practical intelligence, general mental ability, and job knowledge. Current Directions in Psychological Science, 2, 8-9.doi:10.1111/1467-8721.ep10770456 http://dx.doi.org/10.1111/1467-8721.ep10770456
41. Sternberg, R. J. (1985). Beyond IQ: A triarchic theory of human intelligence. New York: Cambridge University Press.
42. Sternberg, R. J. (1997). Successful intelligence. New York: Plume.
43. Sternberg, R. J., & Detterman, D. K. (1986). What is intelligence? Norwood, NJ: Ablex.
44. Sternberg, R. J., Forsythe, G. B., Hedlund, J., Horvath, J. A., Wagner, R. K., Williams, W. M., et al. (2000). Practical intelligence in everyday life. New York: Cambridge University Press.
45. Süß, H. M. (1996). Intelligenz, Wissen und Problemlösen. Kognitive Voraussetzungen für erfolgreiches Handeln bei computersimulierten Problemen [Intelligence, knowledge and problem solving: Cognitive conditions for the successful handling of computer-simulated problems]. Göttingen, Germany: Hogrefe.
46. U.S. Department of Education, Office of Educational Research and Improvement. (1995). National assessment of college student learning: Identifying college graduates’essential skills in writing, speech and listening, and critical thinking (NCES Pub. № 95-001). Washington, DC: Government Printing Office.
47. Wagner, R. K., & Sternberg, R. J. (1986). Tacit knowledge and intelligence in the everyday world. In R. J. Sternberg & R. K. Wagner (Eds.), Practical intelligence: Nature and origins of competence in the everyday world (pp. 51-83). Cambridge, UK: Cambridge University Press.
48. Wagner, R. K., & Sternberg, R. J. (1990). Street smarts. In K. E. Clark & M. B. Clark (Eds.), Measures of leadership (pp. 493-504). West Orange, NJ: Leadership Library of America, Inc.
49. Wagner, R. K., & Sternberg, R. J. (1993). TKIM: The commonsense manager, user manual. New York: Harcourt Brace.
50. Watson, G., & Glaser, E. (1980). Watson-Glaser Critical Thinking Appraisal. San Antonio, TX: The Psychological Corporation.
51. Weekley, J. A., & Jones, C. (1997). Video-based situational testing. Personnel Psychology, 50, 25-49.doi:10.1111/j.1744-6570.1997.tb00899.x http://dx.doi.org/10.1111/j.1744-6570.1997.tb00899.x
52. Wertheimer, M. (1945). Productive thinking. New York: Harper.
53. Wiggins, G. P. (1993). Assessing student performance: Exploring the purpose and limits of testing. San Francisco: Jossey-Bass.
54. Wittmann, W. W., & Süß, H. M. (1999). Investigating the paths between working memory, intelligence, knowledge, and complex problemsolving performances via Brunswik-Symmetry. In P. L. Ackerman, P. C. Kyllonen, & R. D. Roberts (Eds.), Learning and individual differences: Process, trait, and content determinants (pp. 77-108). Washington, DC: APA Books.