Best practices for remote psychological assessment via telehealth technologies

Professional Psychology: Research and Practice

Volumn 45, Issue 1, 2014, Pages 27-35

  Luxton, David D ^a,b   Pruitt, Larry D ^a   Osenbach, Janyce E ^a  

^a UNIVERSITY OF KANSAS   (United States)

^b UNIVERSITY OF WASHINGTON SCHOOL OF MEDICINE   (United States)

Author keywords

Mobile devices; Psychological assessment; Telehealth; Telemental health; Video conferencing

Indexed keywords

EID: 84897592736     PISSN: 07357028     EISSN: None     Source Type: Journal    
DOI: 10.1037/a0034547     Document Type: Article

References (83)

1. American Psychological Association. (2010a). Telepsychology is on the rise. Monitor on Psychology, 41, 11.
2. American Psychological Association. (2010b). American Psychological Association ethical principles of psychologists and code of conduct. Retrieved from http://www.apa.org/ethics/code
3. American Telemedicine Association. (2009). Practice guidelines for videoconferencing-based telemental health. Retrieved from http://www .americantelemed.org/practice/standards/ata-standards-guidelines
4. American Telemedicine Association. (2013). Practice guidelines for videoconferencing-based online mental health services. Retrieved from http://www.americantelemed.org/practice/standards/ata-standardsguidelines
5. Backhaus, A., Agha, Z., Maglione, M. L., Repp, A., Ross, B., Zuest, D., & Thorp, S. R. (2012). Videoconferencing psychotherapy: A systematic review. Psychological Services, 9, 111-131. doi:10.1037/a0027924
6. Ball, C., & Puffett, A. (1998). The assessment of cognitive function in the elderly using videoconferencing. Journal of Telemedicine and Telecare, 4, 36-38. doi:10.1258/1357633981931362
7. Ball, C., Tyrrell, J., & Long, C. (1999). Scoring written material from the Mini-Mental State Examination: A comparison of face-to-face, fax and video-linked scoring. Journal of Telemedicine and Telecare, 5, 253-256. doi:10.1258/1357633991933819
8. Barak, A., & Buchanan, T. (2004). Internet-based psychological testing and assessment. In R. Kraus, G. Stricker, & C. Speyer (Eds.), Online counseling: A handbook for mental health professionals (pp. 4217- 4239). San Diego, CA: Elsevier Academic Press.
9. Barak, A., & English, N. (2002). Prospects and limitation of psychological testing on the internet. Journal of Technology in Human Services, 19, 65-89. doi:10.1300/J017v19n02_06
10. Barak, A., Hen, L., Boniel-Nissim, M., & Shapira, N. (2008). A comprehensive review and a meta-analysis of the effectiveness of internet-based psychotherapeutic interventions. Journal of Technology in Human Services, 26, 109-160. doi:10.1080/15228830802094429
11. Beck, A. T., Steer, R. A., & Brown, G. K. (1996). Manual for the Beck Depression Inventory-II. San Antonio, TX: Psychological Corporation. Bordnick, P. S., Carter, B. L., & Traylor, A. C. (2011). What virtual reality research in addictions can tell us about the future of obesity assessment and treatment. Journal of Diabetes Science and Technology, 5, 265-271.
12. Bordnick, P. S., Carter, B. L., & Traylor, A. C. (2011). What virtual reality research in addictions can tell us about the future of obesity assessment and treatment. Journal of Diabetes Science and Technology, 5, 265-271.
13. Brooks, E., Spargo, G., Yellowlees, P., O'Neill, P., & Shore, J. H. (2013). Integrating culturally appropriate care into telemental health practice. In K. Myers & C. L. Turvey (Eds.), Telemental Health: Clinical, Technical, and Administrative Foundations for Evidenced-Based Practice (pp. 63- 79). Waltham, MA: Elsevier.
14. Buchanan, T. (2001). Online personality assessment. In U.-D. Reips & M. Bosnjak (Eds.), Dimensions of Internet Science (pp. 57-74). Lengerich, DE: Pabst Science Publishers.
15. Buchanan, T. (2002). Online assessment: Desirable or dangerous? Professional Psychology: Research and Practice, 33, 148-154. doi:10.1037/ 0735-7028.33.2.148
16. Buchanan, T. (2003). Internet-based questionnaire assessment: Appropriate use in clinical contexts. Cognitive Behaviour Therapy, 32, 100-109. doi:10.1080/16506070310000957
17. Buchanan, T., Johnson, J. A., & Goldberg, L. R. (2005). Implementing a five-factor personality inventory for use on the internet. European Journal of Psychological Assessment, 21, 115-127. doi:10.1027/1015-5759 .21.2.115
18. Bush, N. E., Skopp, N. A., Smolenski, D., Crumpton, R., & Fairall, J. (in press).Behavioral screening measures delivered with a smartphone "app": Psychometric properties and user preference. Journal of Nervous and Mental Disease.
19. Chen, M. (2002). Leveraging the asymmetric sensitivity of eye contact for videoconferencing. In L. Terveen (Ed.), Proceedings of the SIGCHI Conference on Human Factors in Computing Systems 2002 (pp. 49-56). Minneapolis, MN: ACM Press.
20. Cowain, T. (2001). Cognitive-behavioural therapy via videoconferencing to a rural area. Australian and New Zealand Journal of Psychiatry, 35, 62-64. doi:10.1046/j.1440-1614.2001.00853.x
21. Cronbach, L. J. (1970). Essentials of psychological testing (3rd ed.). New York, NY: Harper & Row.
22. Cullum, C. M., Weiner, M. F., Gehrmann, H. R., & Hynan, L. S. (2006). Feasibility of telecognitive assessment in dementia. Assessment, 13, 385-390. doi:10.1177/1073191106289065
23. DeAngelis, T. (2012, March). A second life for practice? Monitor on Psychology, 43, 48. Retrieved from http://www.apa.org/monitor/2012/ 03/avatars.aspx
24. Dwight-Johnson, M., Aisenberg, E., Golinelli, D., Hong, S., O'Brien, M., & Ludman, E. (2011). Telephone-based cognitive-behavioral therapy for Latino patients living in rural areas: A randomized pilot study. Psychiatric Services, 62, 936-942. doi:10.1176/appi.ps.62.8.936
25. Elhai, J. D., Sweet, J. J., Guidotti Breting, L. M., & Kaloupek, D. (2012). In J. J. Vasterling, R. A. Bryant, & T. M. Keane (Eds.), PTSD and mild traumatic brain injury (pp. 174-198). New York, NY: The Guilford Press.
26. Folen, R. A., James, L. C., Earles, J. E., & Andrasik, F. (2001). Biofeedback via telehealth: A new frontier for applied psychophysiology. Applied Psychophysiology and Biofeedback, 26, 195-204. doi:10.1023/A: 1011346103638
27. Germain, V., Marchand, A., Bouchard, S. Drouin, M. S., & Guay, S. (2009). Effectiveness of cognitive behavioural therapy administered by videoconference for posttraumatic stress disorder. Cognitive Behaviour Therapy, 38, 42-53. doi:10.1080/16506070802473494
28. Glaze, R., & Cox, J. L. (1991). Validation of a computerized version of the 10-item (self-rating) Edinburgh postnatal depression scale. Journal of Affective Disorders, 22, 73-77. doi:10.1016/0165-0327(91)90086-8
29. Glueck, D. (2013). Establishing therapeutic rapport in telemental health. In K. Myers, & C. L. Turvey (Eds.), Telemental health: Clinical, technical and administrative foundations for evidence-based practice (pp. 29- 46). Waltham, MA: Elsevier.
30. Grady, B. J., & Melcer, T. (2005). A retrospective evaluation of telemental healthcare services for remote military populations. Telemedicine and e-Health, 11, 551-558. doi:10.1089/tmj.2005.11.551
31. Grady, B., Myers, K. M., Nelson, E-L., Belz, N., Bennett, L., Carnahan, L., & Voyles, D. (2011). Evidence-based practice for telemental health. Telemedicine and e-Health, 17, 131-148. doi:10.1089/tmj.2010.0158
32. Grayson, D. M., & Monk, A. F. (2003). Are you looking at me? Eye contact and desktop video conferencing. ACM Transactions on Computer-Human Interaction, 10, 221-243. doi:10.1145/937549 .937552
33. Grob, P., Weintraub, D., Sayles, D., Raskin, A., & Ruskin, P. (2001). Psychiatric assessment of a nursing home population using audiovisual telecommunication. Journal of Geriatric Psychiatry and Neurology, 14, 63-65. doi:10.1177/089198870101400203
34. Gros, D. F., Veronee, K., Strachan, M., Ruggiero, K. J., & Acierno, R. (2011). Managing suicidality in home-based telehealth. Journal of Telemedicine and Telecare, 17, 332-335. doi:10.1258/jtt.2011.101207
35. Hamilton, M. (1967). Development of a rating scale for primary depressive illness. British Journal of Social & Clinical Psychology, 6, 278-296. doi:10.1111/j.2044-8260.1967.tb00530.x
36. Hildebrand, R., Chow, H., Williams, C., Nelson, M., & Wass, P. (2004). Feasibility of neuropsychological testing of older adults via videoconference: Implications for assessing the capacity for independent living. Journal of Telemedicine and Telecare, 10, 130-134. doi:10.1258/ 135763304323070751
37. Hilty, D. M., Nesbitt, T. S., Kuenneth, C. A., Cruz, G. M., Hales, R. E. (2007). Rural versus suburban primary care needs, utilization, and satisfaction with telepsychiatric consultation. The Journal of Rural Health, 23, 163-165. doi:10.1111/j.1748-0361.2007.00084.x
38. Holloway, K. M., & Reger, G. M. (2012). T2 virtual PTSD experience: A virtual worlds environment to educate Service Members and Veterans about combat-related post-traumatic stress disorder. International Journal of Human-Computer Interaction. Advance online publication. doi: 10.1080/10447318.2012.735186
39. Hyler, S. E., Gangure, D. P., & Batchelder, S. T. (2005). Can telepsychiatry replace in-person psychiatric assessments? A review and meta-analysis of comparison studies. CNS Spectrums, 10, 403-413.
40. Jones, B. N., Johnston, D., Reboussin, B., & McCall, W. V. (2001). Reliability of telepsychiatry assessments: Subjective versus observational ratings. Journal of Geriatric Psychiatry and Neurology, 14, 66- 71. doi:10.1177/089198870101400204
41. Kirkwood, K. T., Peck, D. F., & Bennie, L. (2000). The consistency of neuropsychological assessments performed via telecommunication and face to face. Journal of Telemedicine and Telecare, 6, 147-151. doi: 10.1258/1357633001935239
42. Kobak, K. A. (2004). A comparison of face-to-face and videoconference administration of the Hamilton Depression Rating Scale. Journal of Telemedicine and Telecare, 10, 231-235. doi:10.1258/1357633041424368
43. Kobak, K. A., Williams, J. B., & Engelhardt, N. (2008). A comparison of face-to-face and remote assessment of inter-rater reliability on the Hamilton Depression Rating Scale via videoconferencing. Psychiatry Research, 158, 99-103. doi:10.1016/j.psychres.2007.06.025
44. Kramer, G. K., Ayers, T., Mishkind, M., & Norem, A. (2011). DoD Telemental Health Guidebook. Tacoma, WA: National Center for Telehealth and Technology. Retrieved from http://t2health.org/sites/default/ files/cth/guidebook/tmh-guidebook_06-11.pdf
45. Kramer, G. M., Mishkind, M. C., Luxton, D. D., & Shore, J. H. (2013). Managing risk and protecting privacy in telemental health: An overview of legal, regulatory, and risk management issues. In K. Myers & C. L. Turvey (Eds.) Telemental health: Clinical, technical and administrative foundations for evidence-based practice (pp. 83-107). Waltham, MA: Elsevier.
46. Loh, P. K., Donaldson, M., Flicker, L., Maher, S., & Goldswain, P. (2007). Development of a telemedicine protocol for the diagnosis of Alzheimer's disease. Journal of Telemedicine and Telecare, 13, 90-94. doi: 10.1258/135763307780096159
47. Loh, P. K., Ramesh, P., Maher, S., Saligari, J., Flicker, L., & Goldswain, P. (2004). Can patients with dementia be assessed at a distance? The use of telehealth and standardised assessments. Internal Medicine Journal, 34, 239-242. doi:10.1111/j.1444-0903.2004.00531.x
48. Luxton, D. D. (2013a). Considerations for planning and evaluating economic analyses of telemental health. Psychological Services, 10, 276- 282. doi:10.1037/a0030658
49. Luxton, D. D. (2013b). Artificial intelligence in psychological practice: Current and future applications and implications. Professional Psychology: Research and Practice. doi:10.1037/a0034559 Luxton, D. D., Kayl, R. A., & Mishkind, M. C. (2012). mHealth data security: The need for HIPAA-compliant standardization. Telemedicine and e-Health, 18, 284-288.
50. Luxton, D. D., Kayl, R. A., & Mishkind, M. C. (2012). mHealth data security: The need for HIPAA-compliant standardization. Telemedicine and e-Health, 18, 284-288.
51. Luxton, D. D., McCann, R. A., Bush, N. E., Mishkind, M. C., & Reger, G. M. (2011). mHealth for mental health: Integrating smartphone technology in behavioral healthcare. Professional Psychology: Research and Practice, 42, 505-512. doi:10.1037/a0024485
52. Luxton, D. D., Mishkind, M. C., Crumpton, R. M., Ayers, T. D., & Mysliwiec, V. (2012). Usability and feasibility of smartphone video capabilities for telehealth care in the U.S. Military. Telemedicine and e-Health, 18, 409-412. doi:10.1089/tmj.2011.0219
53. Luxton, D. D., O'Brien, K., McCann, R. A., & Mishkind, M. C. (2012). Home-based telemental healthcare safety planning: What you need to know. Telemedicine and e-Health, 18, 629-633. doi:10.1089/tmj.2012 .0004
54. Luxton, D. D., Sirotin, A. P., & Mishkind, M. C. (2010). Safety of telemental healthcare delivered to clinically unsupervised settings: A systematic review. Telemedicine and e-Health, 16, 705-711. doi: 10.1089/tmj.2009.0179
55. Maheu, M. M., & Mcmenamin, J. (2013, March 28). Telepsychiatry: The perils of using Skype. Psychiatric Times. Retrieved from http://www .psychiatrictimes.com/blog/telepsychiatry-perils-using-skype
56. Maheu, M., Pulier, M., McMenamin, J., & Posen, L. (2012). The future of telepsychology, telehealth, and various technologies in psychological research. Professional Psychology: Research and Practice, 43, 613- 621. doi:10.1037/a0029458
57. Modai, I., Jabarin, M., Kurs, R., Barak, P., Hanan, I., & Kitain, L. (2006). Cost effectiveness, safety, and satisfaction with video telepsychiatry versus face-to-face care in ambulatory settings. Telemedicine and e-Health, 12, 515-520. doi:10.1089/tmj.2006.12.515
58. Montani, C., Billaud, N., Couturier, P., Fluchaire, I., Lemaire, R., Malterre, C., Franco, A. (1996). "Telepsychometry": A remote psychometry consultation in clinical gerontology: Preliminary study. Telemedicine Journal, 2, 145-150. doi:10.1089/tmj.1.1996.2.145
59. Naglieri, J. A., Drasgow, F., Schmit, M., Handler, L., Prifitera, A., & Margolis, A., & Velasquez, R. (2004). Psychological testing on the Internet: New problems, old issues. American Psychologist, 59, 150- 162. doi:10.1037/0003-066X.59.3.150
60. Nieves, J. E., & Stack, K. M. (2007). Hispanics and telepsychiatry. Psychiatric Services, 58, 877. doi:10.1176/appi.ps.58.6.877 Overall, J. E., & Gorham, D. R. (1962). The brief psychiatric rating scale. Psychological Reports, 10, 799-812. doi:10.2466/pr0.1962.10.3.799
61. Overall, J. E., & Gorham, D. R. (1962). The brief psychiatric rating scale. Psychological Reports, 10, 799-812. doi:10.2466/pr0.1962.10.3.799
62. Parsons, T. D., Kenny, P., Ntuen, C. A., Pataki, C. S., Pato, M. T., Rizzo, A. A. . . . (2008). Objective structured clinical interview training using a virtual human patient. Studies in Health Technology and Informatics, 132, 357-362.
63. Parsons, T. D., Silva, T. M., Pair, J., & Rizzo, A. A. (2008). Virtual environment for assessment of neurocognitive functioning: Virtual re-ality cognitive performance assessment test. Studies in Health Technology and Informatics, 132, 351-356.
64. Peterson, L., Johannsson, V., & Carlsson, S. G. (1996). Computerized testing in a hospital setting: Psychometric and psychological effects. Computers in Human Behavior, 12, 339 -350. doi:10.1016/0747- 5632(96)00012-X
65. Pope, K. S. (1992). Responsibilities in providing psychological test feedback to clients. Psychological Assessment, 4, 268-271. doi:10.1037/ 1040-3590.4.3.268
66. Reips, U-D. (2000). The web experiment method: Advantages, disadvantages, and solutions. In M. H. Birnbaum (Ed.), Psychochological experiments on the internet (pp. 89-117). San Diego, CA: Academic Press. doi:10.1016/B978-012099980-4/50005-8
67. Richardson, L. K., Frueh, B. C., Grubaugh, A. L., Egede, L., & Elhai, J. D. (2009). Current directions in videoconferencing tele-mental health research. Clinical Psychology: Science and Practice, 16, 323-338. doi: 10.1111/j.1468-2850.2009.01170.x
68. Riva, G., Wiederhold, B., & Molinari, E. (1998). Virtual environments in clinical psychology and neuroscience: Methods and techniques in advanced patient-therapist interaction. (Vol. 58). Amsterdam, NL: IOS Press.
69. Rogers, R. (2001). Handbook of diagnostic and structured interviewing. New York, NY: The Guilford Press.
70. Rohland, B. M., Saleh, S. S., Rohrer, J. E., & Romitti, P. A. (2000). Acceptability of telepsychiatry to a rural population. Psychiatric Services, 51, 672-674. doi:10.1176/appi.ps.51.5.672
71. Ruskin, P. E., Reed, S., Kumar, R., Kling, M. A., Siegel, E., Rosen, M., & Hauser, P. (1998). Reliability and acceptability of psychiatric diagnosis via telecommunication and audiovisual technology. Psychiatric Services, 49, 1086-1088.
72. Saligari, J., Flicker, L., Loh, P. K., Maher, S., Ramesh, P., & Goldswain, P. (2002). The clinical achievements of a geriatric telehealth project in its first year. Journal of Telemedicine and Telecare, 8(Suppl 3), 53-55. doi:10.1258/13576330260440862
73. Savin, D., Glueck, D. A., Chardavoyne, J., Yager, J., & Novins, D. K. (2011). Bridging cultures: Child psychiatry via videoconferencing. Child and Adolescent Psychiatric Clinics of North America, 20, 125-134. doi:10.1016/j.chc.2010.09.002
74. Schulenberg, S. E., & Yutrzenka, B. A. (1999). The equivalence of computerized and paper-and-pencil psychological instruments: Implications for measures of negative affect. Behavior Research Methods, Instruments & Computers, 31, 315-321. doi:10.3758/BF03207726
75. Shore, J., Brooks, E., Savin, D., Orton, H., Grigsby, J., & Manson, S. (2008). Acceptability of telepsychiatry in American Indians. Telemedicine and e-Health, 14, 461-466. doi:10.1089/tmj.2007.0077
76. Shore, J. H., Savin, D., Orton, H., Beals, J., & Manson, S. M. (2007). Diagnostic reliability of telepsychiatry in American Indian veterans. The American Journal of Psychiatry, 164, 115-118. doi:10.1176/appi.ajp .164.1.115
77. Simpson, S., Bell, L., Knox, J., & Britton, P. (2005). Therapy via videoconferencing: A route to client empowerment? Clinical Psychology & Psychotherapy, 12, 156-165. doi:10.1002/cpp.436
78. Spitzer, R. L., Williams, J. B. W., Gibbon, M., & First, M. B. (1990). Structured Clinical Interview for DSM-III-R: Patient Edition/Non- Patient Edition (SCID-P/SCID-NP). Washington, DC: American Psychiatric Press.
79. Tam, T., Cafazzo, J. A., Seto, E., Salenieks, M. E., & Rossos, P. G. (2007). Perception of eye contact in video teleconsultation. Journal of Telemedicine and Telecare, 13, 35-39.
80. Tschirch, P., Walker, G., & Calvacca, L. T. (2006). Nursing in tele-mental health. Journal of Psychosocial Nursing and Mental Health Services, 44, 20-27. doi:10.1089/tmj.2010.0158
81. Wechsler, D. (2008). Wechsler Adult Intelligence Scale-Fourth Edition (WAIS-IV). San Antonio, TX: Pearson.
82. Yeung, A., Hails, K., Chang, T., Trinh, N., & Fava, M. (2011). A study of the effectiveness of telepsychiatry-based culturally sensitive collaborative treatment of depressed Chinese Americans. BMC Psychiatry, 11, 1-8. doi:10.1186/1471-244X-11-154
83. Yoshino, A., Shigemura, J., Kobayashi, Y., Nomura, S., Shishikura, K., Den, R., & Ashida, H. (2001). Telepsychiatry: Assessment of televideo psychiatric interview reliability with present- and next-generation internet infrastructures. Acta Psychiatrica Scandinavica, 104, 223-226. doi: 10.1034/j.1600-0447.2001.00236.x