No special K! A signal detection framework for the strategic regulation of memory accuracy

Journal of Experimental Psychology: General

Volumn 136, Issue 1, 2007, Pages 1-22

  Higham, Philip A ^a  

^a UNIVERSITY OF SOUTHAMPTON   (United Kingdom)

Author keywords

Metacognition; SAT; Scholastic Aptitude Test accuracy; Strategic regulation of accuracy; Type 2 signal detection theory

Indexed keywords

ADULT; ARTICLE; COGNITION; DECISION MAKING; EDUCATION; FEMALE; HUMAN; MALE; MEMORY; PERCEPTIVE DISCRIMINATION; PSYCHOLOGICAL MODEL; PSYCHOLOGICAL THEORY;

ADULT; CHOICE BEHAVIOR; COGNITION; EDUCATIONAL MEASUREMENT; FEMALE; HUMANS; MALE; MEMORY; MODELS, PSYCHOLOGICAL; PSYCHOLOGICAL THEORY; SIGNAL DETECTION (PSYCHOLOGY);

EID: 33847676165     PISSN: 00963445     EISSN: None     Source Type: Journal    
DOI: 10.1037/0096-3445.136.1.1     Document Type: Article

References (56)

1. Alhanese, M. A. (1986). The correction for guessing: A further analysis of Angoff and Shrader. Journal of Educational Measurement, 23, 225-235.
2. Angoff, W. H. (1989). Does guessing really help? Journal of Educational Measurement, 26, 323-336.
3. Angoff, W. H., & Schrader, W. B. (1981). A study of alternative methods for equating rights scores to formula scores (Research Rep. No. 81-8). Princeton, NJ: Educational Testing Service.
4. Angoff, W. H., & Schrader. W. D. (1984). A study of hypotheses basic to the use of rights and formula scores. Journal of Educational Measurement, 21, 1-17.
5. Banks, W. P. (1970). Signal detection theory and human memory. Psychological Bulletin, 74, 81-99.
6. Ben-Shakhar, G., & Sinai, Y. (1991). Gender differences in multiplechoice tests: The role of differential guessing tendencies. Journal of Educational Measurement, 28, 23-35.
7. Bliss, L. B. (1980). A test of Lord's assumption regarding examinee guessing behavior on multiple-choice tests using elementary school students. Journal of Educational Measurement, 17, 147-153.
8. Budescu, D., & Bar-Hillel, M. (1993). To guess or not to guess: A decision-theoretic view of formula scoring. Journal of Educational Measurement, 30, 277-291.
9. Burton, R. F. (2002). Misinformation, partial knowledge and guessing in true/false tests. Medical Education, 36, 805-811.
10. Burton, R. F. (2004). Multiple-choice and true/false tests: Reliability measures and some implications of negative marking. Assessment & Evaluation in Higher Education, 29, 585-595.
11. Burton, R. F. (2005). Multiple-choice and true/false tests: Myths and misapprehensions. Assessment & Evaluation in Higher Education, 30, 65-72.
12. Burton, R. F., & Miller, D. J. (1999). Statistical modelling of multiple-choice and true/false tests: Ways of considering, and of reducing, the uncertainties attributable to guessing. Assessment &, Evaluation in Higher Education, 24, 399-411.
13. Claman, C. (Ed.). (1997). 10 real SATs. New York: College Entrance Examination Board.
14. Clarke, F. R., Birdsall, T. G., & Tanner, W. P. (1959). Two types of ROC curves and definitions of parameters. Journal of the Acoustical Society of America, 31, 629-630.
15. Cross, L. H., & Frary, R. B. (1977). An empirical test of Lord's theoretical results regarding formula scoring of multiple-choice tests. Journal of Educational Measurement, 14, 313-321.
16. Debner, J. A., & Jacoby, L. L. (1994). Unconscious perception: Attention, awareness, and control. Journal of Experimental Psychology: Learning, Memory, and Cognition, 20, 304-317.
17. DeCarlo, L. T. (2003). Using the PLUM procedure of SPSS to fit unequal variance and generalized signal-detection models. Behavior Research Methods, Instruments, & Computers, 35, 49-56.
18. Diamond, J., & Evans, W. (1973). The correction for guessing. Review of Educatioml Research, 43, 181-191.
19. Dienes, Z., & Berry, D. C. (1997). Implicit learning: Below the subjective threshold. Psychonomic Bulletin & Review, 4, 3-23.
20. Ebel, R. L. (1968). Blind guessing on objective achievement tests. Journal of Educational Measurement, 5, 321-325.
21. Galvin, S. J., Podd, J. V., Drga, V., & Whitmore, J. (2003). Type 2 tasks in the theory of signal detectability: Discrimination between correct and incorrect decisions. Psychonomic Bulletin & Review, 10, 843-876.
22. Goldsmith, M., Koriat, A., & Pansky, A. (2005). Strategic regulation of grain size in memory reporting over time. Journal of Memory and language, 52, 505-525.
23. Harden, R. M., Brown, R. A., Biran, L. A., Dallas Ross, W. P., & Wakeford, R. E. (1976). Multiple choice questions: To guess or not to guess. Medical Education, 10, 27-32.
24. Healy, A. F., & Jones, C. (1973). Criterion shifts in recall. Psychological Bulletin, 79, 335-340.
25. Higham, P. A. (2002). Strong cues are not necessarily weak: Thomson and Tulving (1970) and the encoding specificity principle revisited. Memory & Cognition, 30, 67-80.
26. Higham, P. A., & Arnold, M. M. (in press). How many questions should I answer? Using bias profiles to estimate optimal bias and maximum score on formula-scored tests. European Journal of Cognitive Psychology.
27. Higham, P. A., & Gerrard. C. (2005). Not all errors are created equal: Metacognition and changing answers on multiple-choice tests. Canadian Journal of Experimental Psychology, 59, 28-34.
28. Higham, P. A., & Tarn, H. (2005). Generation failure: Estimating metacognition in cued recall. Journal of Memory and Language, 52, 595-617.
29. Higham, P. A., & Tam, H. (2006). Release from generation failure: The role of study list structure. Memory & Cognition, 34, 148-157.
30. Higham, P. A., Vokey, J. R., & Pritchard, J. L. (2000). Beyond dissociation logic: Evidence for controlled and automatic influences in artificial grammar learning. Journal of Experimental Psychology: General, 129, 457-470.
31. Holzinger, K. J. (1924). On scoring multiple-choice tests. Journal of Educational Measurement, 15, 445-447.
32. Kelley, C. M., & Sahakyan, L. (2003). Memory, monitoring, and control in the attainment of memory accuracy. Journal of Memory and Language, 48, 704-721.
33. Koriat, A., & Goldsmith, M. (1994). Memory in naturalistic and laboratory contexts: Distinguishing the accuracy-oriented and quantity-oriented approaches to memory assessment. Journal of Experimental Psychology: General, 123, 297-315.
34. Koriat, A., & Goldsmith, M. (1996a). Memory as something that can be counted versus memory as something that can be counted on. In D. Hermann, C. McEvoy, C. Hertzog, P. Hertel, & M. Johnson (Eds.), Basic and applied memory research: Practical applications (Vol. 2, pp. 3-18). Hillsdale, NJ: Erlbaum.
35. Koriat, A., & Goldsmith, M. (1996b). Memory metaphors and the laboratory/real-life controversy: Correspondence versus storehouse views of memory. Behavioral and Brain Sciences, 19, 167-228.
36. Koriat, A., & Goldsmith, M. (1996c). Monitoring and control processes in the strategic regulation of memory accuracy. Psychological Review, 103, 490-517.
37. Krantz, D. H. (1969). Threshold theories of signal detection. Psychological Review, 76, 308-324.
38. Kunimoto, C., Miller, J. K., & Pashler, H. (2001). Confidence and accuracy of near-threshold discrimination responses. Consciousness and Cognition, 10, 294-340.
39. Lord, F. M. (1975). Formula scoring and number-right scoring. Journal of Educational Measurement, 12, 7-11.
40. Mattson, D. (1965). The effects of guessing on the standard error of measurement and the reliability of test scores. Educational and Psychological Measurement, 25, 727-730.
41. Muijtjens, A. M. M., van Manieren, H., & Hoogenboom, R. J. I. (1999). The effect of a "don't know" option on test scores: Number-right and formula scoring compared. Medical Education, 33, 267-275.
42. Murdock, B. B. (1966). The criterion problem in short-term memory. Journal of Experimental Psychology, 72, 317-324.
43. Prieto, G., & Delgado, A. R. (1999). The role of instructions in the variability of sex-related differences in multiple-choice tests. Personality and Individual Differences, 27, 1067-1077.
44. Rhodes, M. G., & Kelley, C. M. (2005). Executive processes, memory accuracy, and memory monitoring: An aging and individual difference analysis. Journal of Memory and language, 52, 578-594.
45. Rogers, H. J. (1999). Guessing in multiple-choice tests. In G. N. Masters & J. P. Keeves (Eds.), Advances in measurement in educational research and assessment (pp. 235-245). Oxford, England: Pergamon Press.
46. Rowley, G. L., & Traub, R. E. (1977). Formula scoring, number-right scoring, and test-taking strategy. Journal of Educational Measurement, 14, 15-22.
47. Sanderson, P. H. (1973). The 'don't know' option in MCQ examinations. British Journal of Medical Education, 7, 25-29.
48. Sax, G., & Collet, L. (1968). The effects of differing instructions and guessing formulas on reliability and validity. Educational and Psychological Measurement, 28, 1127-1136.
49. Shanks, D. R., & St. John, M. F. (1994). Characteristics of dissociable human learning systems. Behavioural and Brain Sciences, 17, 367-447.
50. Sheriffs, A. C., & Boomer, D. S. (1954). Who is penalized by the penalty for guessing? Journal of Educational Psychology, 45, 81-90.
51. Slakter, M. J. (1968a). The effect of guessing strategy on objective test scores. Journal of Educational. Measurement, 5, 217-222.
52. Slakter, M. J. (1968b). The penalty for not guessing. Journal of Educational Measurement, 5, 141-144.
53. Thorndike, R. L. (1982). Applied psychometrics. Boston: Houghton Mifflin.
54. Thurstone, L. L. (1919). A method for scoring tests. Psychological Bulletin, 16, 235-240.
55. Traub, R. E., Hambleton, R. K., & Singh, B. (1969). Effects of promised reward and threatened penalty on performance of a multiple-choice vocabulary test. Educational and Psychological Measurement, 29, 847-862.
56. Weiskrante, L., Warrington, E. K., Sanders, M. D., & Marshall, J. (1974). Visual capacity in the hemianopic field following a restricted occipital ablation. Brain, 97, 709-728.