Estimating the accuracy of neurocognitive effort measures in the absence of a "gold standard"

Psychological Assessment

Volumn 24, Issue 4, 2012, Pages 815-822

  Mossman, Douglas ^a   Wygant, Dustin B ^b   Gervais, Roger O ^c,d  

^a UNIVERSITY OF CINCINNATI COLLEGE OF MEDICINE   (United States)

^b EASTERN KENTUCKY UNIVERSITY   (United States)

^c Neurobehavioural Associates   (Canada)

^d UNIVERSITY OF ALBERTA   (Canada)

Author keywords

Bayesian inference; Gold standard; Malingering; Neuropsychological testing; ROC analysis

Indexed keywords

ADULT; AGED; ARTICLE; BAYES THEOREM; COMPUTERIZED ASSESSMENT OF RESPONSE BIAS; CONTROLLED STUDY; DIAGNOSTIC ACCURACY; DIAGNOSTIC TEST; DIAGNOSTIC TEST ACCURACY STUDY; DISEASE CLASSIFICATION; DSM-IV; FALSE POSITIVE RESULT; FEMALE; FORENSIC PSYCHIATRY; GOLD STANDARD; HUMAN; LATENT CLASS MODELING; MAJOR CLINICAL STUDY; MALE; MONTE CARLO METHOD; NAMED INVENTORIES, QUESTIONNAIRES AND RATING SCALES; OUTPATIENT; PSYCHOLOGIC ASSESSMENT; RECEIVER OPERATING CHARACTERISTIC; SIMULATION; STATISTICAL MODEL; SYMPTOM VALIDITY TEST; TEST OF MEMORY MALINGERING; WORD MEMORY TEST;

ADULT; BAYES THEOREM; DATA INTERPRETATION, STATISTICAL; FEMALE; FORENSIC PSYCHIATRY; HUMANS; MALE; MIDDLE AGED; NEUROPSYCHOLOGY;

EID: 84874500757     PISSN: 10403590     EISSN: 1939134X     Source Type: Journal    
DOI: 10.1037/a0028195     Document Type: Article

References (37)

1. Akaike, H. (1974). A new look at the statistical model identification. IEEE Transactions on Automatic Control, 19, 716-723.
2. Albert, P. S. (2007). Random effects modeling approaches for estimating ROC curves from repeated ordinal tests without a gold standard. Bio metrics, 63, 593-602. doi:10.1111/j.1541-0420.2006.00712.x
3. Allen, L., Conder, R. L., Green, P., & Cox, D. R. (1997). CARB '97 Manual for the Computerized Assessment of Response Bias. Durham, NC: CogniSyst.
4. American Psychiatric Association. (1994). Diagnostic and statistical manual of mental disorders (4th ed.). Washington, DC: Author.
5. American Psychiatric Association. (2000). Diagnostic and statistical manual of mental disorders (4th ed., text rev.). Washington, DC: Author.
6. Bianchini, K. J., Greve, K. W., & Glynn, G. (2005). On the diagnosis of malingered pain related disability: Lessons from cognitive malingering research. Spine Journal, 5, 404-417. doi:10.1016/j.spinee.2004.11.016
7. Butcher, J. N., Graham, J. R., Ben Porath, Y. S., Tellegen, A., Dahlstrom, W. G., & Kaemmer, B. (2001). Minnesota Multiphasic Personality Inventory 2: Manual for administration, scoring, and interpretation (rev. ed.). Minneapolis, MN: University of Minnesota Press.
8. Carlin, B. P., & Louis, T. A. (2000). Bayes and empirical Bayesian methods for data analysis. London, England: Chapman & Hall/CRC.
9. Choi, Y. K., Johnson, W. O., Collins, M. T., & Gardner, I. A. (2006). Bayesian inferences for receiver operating characteristic curves in the absence of a gold standard. Journal of Agricultural, Biological, and Environmental Statistics, 11, 210-229. doi:10.1198/108571106X110883
10. Fox, D. D. (2011). Symptom validity test failure indicates invalidity of neuropsychological tests. Clinical Neuropsychologist, 25, 488-495. doi: 10.1080/13854046.2011.554443
11. Frederick, R. I., & Bowden, S. C. (2009). The test validation summary. Assessment, 16, 215-236. doi:10.1177/1073191108325005
12. Frederick, R. I., & Crosby, R. D. (2000). Development and validation of the Validity Indicator Profile. Law and Human Behavior, 24, 59-82. doi:10.1023/A:1005426803586
13. Gelfand, A. E., & Smith, A. F. M. (1990). Sampling based approaches to calculating marginal densities. Journal of the American Statistical Association, 85, 389-409.
14. Geman, S., & Geman, D. (1984). Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images. IEEE Transactions on Pattern Analysis and Machine Intelligence, 6, 721-741.
15. Gervais, R. O., Rohling, M. L., Green, P., & Ford, W. (2004). A compar ison of WMT, CARB, and TOMM failure rates in non head injury disability claimants. Archives of Clinical Neuropsychology, 19, 475- 487. doi:10.1016/j.acn.2003.05.001
16. Green, P. (2003). Green's Word Memory Test for Windows: User's man ual. Edmonton, Alberta, Canada: Green's.
17. Green, P., Allen, L., & Astner, K. (1996). The Word Memory Test: A user's guide to the oral and computer administered forms, US Version 1.1. Durham, NC: CogniSyst.
18. Green, P., Flaro, L., & Courtney, J. (2009). Examining false positives on the Word Memory Test in adults with mild traumatic brain injury. Brain Injury, 23, 741-750. doi:10.1080/02699050903133962
19. Henkelman, R. M., Kay, I., & Bronskill, M. J. (1990). Receiver operator characteristic (ROC) analysis without truth. Medical Decision Making, 10, 24-29. doi:10.1177/0272989X9001000105
20. Lunn, D., Spiegelhalter, D., Thomas, A., & Best, N. (2009). The BUGS project: Evolution, critique and future directions. Statistics in Medicine, 28, 3049-3067. doi:10.1002/sim.3680
21. Menten, J., Boelaert, M., & Lesaffre, E. (2008). Bayesian latent class models with conditionally dependent diagnostic tests: A case study. Statistics in Medicine, 27, 4469-4488. doi:10.1002/sim.3317
22. Metropolis, N., Rosenbluth, A., Rosenbluth, M., Teller, A., & Teller, E. (1953). Equations of state calculations by fast computing machines. Journal of Chemical Physics, 21, 1087-1091.
23. Mossman, D., Bowen, M. D., Vanness, D. J., Bienenfeld, D., Correll, T., Kay, J.,Lehrer, D. S. (2010). Quantifying the accuracy of forensic examiners in the absence of a "gold standard." Law and Human Behav ior 34, 402-417 doi:10.1007/s10979-009-9197-5
24. Müller, B., Vounatsou, P., Ngandolo, B. N., Diguimbaye Djaïbe, C., Schil ler, I., Marg Haufe, B.,Zinsstag, J. (2009). Bayesian receiver operating characteristic estimation of multiple tests for diagnosis of bovine tuberculosis in Chadian cattle. PLoS One, 4, e8215. doi:10.1371/ journal.pone.0008215
25. Resnick, P. J., & Knoll, J. L. IV. (2008). Malingered psychosis. In R. Rogers (Ed.), Clinical assessment of malingering and deception (3rd ed., pp. 51-68). New York, NY: Guilford Press.
26. Resnick, P. J., West, S., & Payne, J. W. (2008). Malingering of posttraumatic stress disorders. In R. Rogers (Ed.), Clinical assessment of malingering and deception (3rd ed., pp. 109-127). New York, NY: Guil ford Press.
27. Rogers, R. (2008). Clinical assessment of malingering and deception (3rd ed.). New York, NY: Guilford Press.
28. Slick, D. J., Sherman, E. M. S., & Iverson, G. L. (1999). Diagnostic criteria for malingered neurocognitive dysfunction: Proposed standards for clinical practice and research. Clinical Neuropsychologist, 13, 545-561. doi:10.1076/1385-4046(199911)13:04;1-Y;FT545
29. Spencer, B. D. (2011). When do latent class models overstate accuracy for diagnostic and other classifiers in the absence of a gold standard? Biometrics. Advance online publication. doi:10.1111/j.1541- 0420.2011.01694.x
30. Spiegelhalter, D. J., Best, N. G., Carlin, B. P., & Van der Linde, A. (2002). Bayesian measures of model complexity and fit. Journal of the Royal Statistical Society, Series B, 64, 583-639. doi:10.1111/1467- 9868.00353
31. Tombaugh, T. N. (1996). The Test of Memory Malingering. Toronto, Ontario, Canada: Multi Health Systems.
32. Tombaugh, T. N. (2003). The Test of Memory Malingering in forensic psychology. In J. Hom & R. L. Denney (Eds.), Detection of response bias in forensic neuropsychology (Vol. 2, pp. 69-96). Binghamton, NY: Haworth Medical Press.
33. Uebersax, J. S. (1988). Validity inferences from interobserver agreement. Psychological Bulletin, 104, 405-416. doi:10.1037/0033-2909.104 .3.405
34. Uebersax, J. S., & Grove, W. M. (1990). Latent class analysis of diagnostic agreement. Statistics in Medicine, 9, 559-572. doi:10.1002/sim .4780090509
35. Walters, G. D., Berry, D. T. R., Lanyon, R., Murphy, M. (2009). Are exaggerated health complaints continuous or categorical? A taxometric analysis of the Health Problem Overstatement Scale. Psychological Assessment, 21, 219-226. doi:10.1037/a0015306
36. Walters, G. D., Berry, D. T. R., Rogers, R., Payne, J. W.,Granacher, R. P. (2009). Feigned neurocognitive deficit: Taxon or dimension? Journal of Clinical and Experimental Neuropsychology, 31, 584-593. doi:10.1080/13803390802363728
37. Wilkinson, G. S., & Robertson, G. J. (2006).Wide Range Achievement Test (4th ed.). Lutz, FL: Psychological Assessment Resources.