A Substantive Process Analysis of Responses to Items from the Multistate Bar Examination

Applied Measurement in Education

Volumn 25, Issue 1, 2012, Pages 1-26

  Bonner, Sarah M ^a   D'Agostino, Jerome V ^b  

^a CITY UNIVERSITY OF NEW YORK   (United States)

^b OHIO STATE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84855956137     PISSN: 08957347     EISSN: None     Source Type: Journal    
DOI: 10.1080/08957347.2012.635472     Document Type: Article

References (40)

1. Aldisert, R. J. 1997. Logic for lawyers: A guide to clear legal thinking, 3rd, South Bend, IN: National Institute for Trial Advocacy.
2. American Bar Association (1992). An educational continuum-Report of the task force on law schools and the profession: Narrowing the gap. ("MacCrate Report"). Section of Legal Education and Admissions to the Bar. http://www.abanet.org/legaled/publications/onlinepubs/maccrate.html (http://www.abanet.org/legaled/publications/onlinepubs/maccrate.html)
3. Blasi, G. L. 1995. What lawyers know: Lawyering expertise, cognitive science, and the functions of theory. Journal of Legal Education, 45(3): 313-397.
4. Bloom, B. S. and Broder, L. J. 1950. Problem-solving processes of college students, Chicago, IL: University of Chicago Press.
5. Bond, L. 1990. "Understanding the black/white student gap on measures of quantitative reasoning". In Mental health of ethnic minorities, Edited by: Serafica, P., Schwebel, A. I., Isaac, P. D., Russell, R. K. and Meyers, L. B. 89-107. New York, NY: Prager.
6. Borsboom, D., Mellenbergh, G. J. and van Heerden, J. 2004. The concept of validity. Psychological Review, 111(4): 1060-1071.
7. Bransford, J. D. and Stein, B. S. 1993. The ideal problem solver: A guide for improving thinking, learning, and creativity/, 2nd Edited by: Freeman, W. H. New York, NY
8. Chi, M. T. H. 1997. Quantifying qualitative analyses of verbal data: A practical guide. The Journal of the Learning Sciences, 6(3): 271-315.
9. Chi, M. T. H., Feltovich, P. J. and Glaser, R. 1981. Categorization and representation of physics problems by experts and novices. Cognitive Science, 5: 121-152.
10. Chung, G. K. W. K., de Vries, L. F., Cheak, A. M., Stevens, R. H. and Bewley, W. L. 2002. Cognitive process validation of an online problem solving assessment. Computers in Human Behavior, 18: 669-684.
11. Complete guide to law schools (2005). New York: U.S. News and World Report L. P. http://www.usnews.com (http://www.usnews.com)
12. Cronbach, L. J. 1971. "Test validation". In Educational measurement, 2nd, Edited by: Thorndike, R. L. 443-507. Washington, DC: American Council on Education.
13. De Tocqueville, A. 1975. Democracy in America, Edited by: Mayer, J. P. Garden City, NY: Doubleday. (Original work published in 1835).
14. Elstein, A. S., Shulman, L. S. and Sprafka, S. A. 1978. Medical problem solving: An analysis of clinical reasoning, Cambridge, MA: Harvard University Press.
15. Elstein, A. S., Shulman, L. S. and Sprafka, S. A. 1990. Medical problem solving: A ten-year retrospective. Evaluation & the Health Professions, 13(1): 5-36.
16. Ericsson, K. A. 1996. "The acquisition of expert performance: An introduction to some of its issues". In The road to excellence: The acquisition of expert performance in the arts and sciences, sports, and games, Edited by: Ericsson, K. A. 1-50. Mahwah, NJ: Erlbaum.
17. Ericsson, K. A. 1987. "Theoretical implications from protocol analysis on testing and measurement". In The influence of cognitive psychology on testing, Edited by: Ronning, R. R., Glover, J. A., Conoley, J. C. and Witt, J. C. 191-228. Hillsdale, NJ: Erlbaum.
18. Ericsson, K. A. and Simon, H. A. 1993. Protocol analysis: Verbal reports as data, Rev., Cambridge, MA: MIT Press.
19. Gantt, L. O. N. II. 2007. Deconstructing thinking like a lawyer: Analyzing the cognitive components of the analytical mind. Campbell Law Review, 29: 413-481.
20. Hamilton, L. S. April 1994. Validating hands-on science assessments through an investigation of response processes, April, New Orleans, LA: Paper presented at the annual meeting of the American Educational Research Association.
21. Hamilton, L. S., Nussbaum, E. M. and Snow, R. E. 1997. Interview procedures for validating science assessments. Applied Measurement in Education, 10(2): 181-201.
22. Kane, M. T. 2005. The role of licensure tests. The Bar Examiner, 74(1): 27-38.
23. Katz, I. R., Bennett, R. E. and Berger, A. E. 2000. Effects of response format on difficulty of SAT-Mathematics items: It's not the strategy. Journal of Educational Measurement, 37(1): 39-57.
24. Klein, S. P. 1993. Summary of research on the multistate bar examination, Chicago, IL: National Conference of Bar Examiners.
25. Krieger, S. H. 2006. The development of legal reasoning skills in law students: An empirical study. Journal of Legal Education, 56(3): 332-355.
26. Leighton, J. P. 2005. Avoiding misconception, misuse, and missed opportunities: The collection of verbal reports in educational achievement testing. Educational Measurement: Issues and Practice, 23(4): 6-15.
27. Leighton, J. P. and Gierl, M. J. 2007. Defining and evaluating models of cognition used in educational measurement to make inferences about examinees' thinking processes. Educational Measurement: Issues and Practice, 26(2): 3-16.
28. Mayer, R. E. 1998. Cognitive, metacognitive, and motivational aspects of problem solving. Instructional science, 26: 49-63.
29. Messick, S. 1989. "Validity". In Educational measurement, 3rd, Edited by: Linn, R. L. 13-103. Washington, DC: American Council on Education & National Council on Measurement in Education.
30. Mislevy, R. J. 2006. "Cognitive psychology and educational assessment". In Educational measurement, 4th, Edited by: Brennan, R. L. 257-305. Westport, CT: Praeger.
31. National Research Council. (2002). In J. Pellegrino, N. Chudowsky, & R. Glaser (Eds.), Knowing what students know. Washington, DC: National Academy Press. http://www.nap.edu/books/0309072727/html (http://www.nap.edu/books/0309072727/html)
32. Newell, A. and Simon, H. A. 1972. Human problem solving, Englewood Cliffs, NJ: Prentice-Hall.
33. Nisbett, R. E. and Wilson, T. D. 1977. Telling more than we can know: Verbal reports on mental processes. Psychological Review, 84(3): 231-259.
34. Norris, S. P. 1990. Effect of eliciting verbal reports on thinking on critical thinking test performance. Journal of Educational Measurement, 27(1): 41-58.
35. Perkins, D. N. and Salomon, G. 1989. Are cognitive skills context-bound?. Educational Researcher, 18(1): 16-25.
36. Richman, H. B., Gobet, F., Staszewski, J. J. and Simon, H. A. 1996. "Perceptual and memory processes in the acquisition of expert performance: The EPAM model". In The road to excellence: The acquisition of expert performance in the arts and sciences, sports, and games, Edited by: Ericsson, K. A. 167-188. Mahwah, NJ: Erlbaum.
37. Russo, J. E., Johnson, E. J. and Stephens, D. L. 1989. The validity of verbal protocols. Memory and Cognition, 17(6): 759-769.
38. Schoenfeld, A. H. and Herrmann, D. J. 1982. Problem perception and knowledge structure in expert and novice mathematical problem solvers. Journal of Experimental Psychology: Learning, Memory, and Cognition, 8(5): 484-494.
39. Van Someren, M. W., Barnard, Y. F. and Sandberg, J. A. C. 1994. The think aloud method: A practical guide to modeling cognitive processes, London, England: Academic Press.
40. Yepes-Baraya, M. April 1996. A cognitive study based on the National Assessment of Educational Progress (NAEP) science assessment, April, New York: Paper presented at the annual meeting of the National Council on Measurement in Education.