Assessing clients in their natural environments with electronic diaries: Rationale, benefits, limitations, and barriers

Psychological Assessment

Volumn 19, Issue 1, 2007, Pages 25-43

  Piasecki, Thomas M ^a   Hufford, Michael R ^b,c   Solhan, Marika ^a   Trull, Timothy J ^a  

^a UNIVERSITY OF MISSOURI   (United States)

^b Invivodata Inc   (United States)

^c AMYLIN PHARMACEUTICALS INC   (United States)

Author keywords

Clinical assessment; Ecological momentary assessment; Electronic diary; Experience sampling; Self report

Indexed keywords

ARTICLE; DOCUMENTATION; ELECTRONICS; EXPERIENCE; INFORMATION PROCESSING DEVICE; MEDICAL INFORMATICS; MOBILE PHONE; TREATMENT PLANNING;

COMPUTERS, HANDHELD; HUMANS; MEDICAL RECORDS SYSTEMS, COMPUTERIZED; MENTAL DISORDERS; PATIENT COMPLIANCE; PERSONALITY ASSESSMENT; REPRODUCIBILITY OF RESULTS; SELF DISCLOSURE; SOCIAL ENVIRONMENT; SOFTWARE; TECHNOLOGY ASSESSMENT, BIOMEDICAL;

EID: 33947324254     PISSN: 10403590     EISSN: None     Source Type: Journal    
DOI: 10.1037/1040-3590.19.1.25     Document Type: Article

References (86)

1. Affleck, G., Zautra, A., Tennen, H., & Armelli, S. (1999). Multilevel daily process designs for clinical and consulting psychology: A preface for the perplexed. Journal of Consulting and Clinical Psychology, 67, 746-754.
2. Anhøj, J., & Nielsen, L. (2004). Quantitative and qualitative usage data of an Internet-based asthma monitoring tool. Journal of Medical Internet Research, 6, e23.
3. Beck, A. T. (2005). The current state of cognitive therapy: A 40-year retrospective. Archives of General Psychiatry, 62, 953-959.
4. Benjamin, L. T., Jr. (2005). A history of clinical psychology as a profession in America (and a glimpse at its future). Annual Review of Clinical Psychology, 1, 1-30.
5. Bolger, N., Davis, A., & Rafaeli, E. (2003). Diary methods: Capturing life as it is lived. Annual Review of Psychology, 54, 579-616.
6. Bradburn, N. M. (2000). Temporal representation and event dating. In A. A. Stone, J. S. Turkkan, C. A. Bachrach, J. B. Jobe, H. S. Kurtzman, & V. S. Cain (Eds.), The science of self-report: Implications for research and practice (pp. 49-61). Mahwah, NJ: Erlbaum.
7. Brandon, T. H., Copeland, A. L., & Saper, Z. L. (1995). Programmed therapeutic messages as a smoking treatment adjunct: Reducing the impact of negative affect. Health Psychology, 14, 41-47.
8. Broderick, J. E., Schwartz, J. E., Shiffman, S., Hufford, M. R., & Stone, A. A. (2003). Signaling does not adequately improve diary compliance. Annals of Behavioral Medicine, 26, 139-148.
9. Broderick, J. E., & Stone, A. A. (2006). Paper and electronic diaries: Too early for conclusions on compliance rates and their effects - Comment on Green, Rafaeli, Bolger, Shrout, and Reis (2006). Psychological Methods, 11, 106-111.
10. Broderick, J. E., Stone, A. A., Calvanese, P., Schwartz, J. E., & Turk, D. C. (2006). Recalled pain ratings: A complex and poorly defined task. The Journal of Pain, 7, 142-149.
11. Burnett, K. F., Taylor, C. B., & Agras, W. S. (1985). Ambulatory computer-assisted therapy for obesity: A new frontier for behavior therapy. Journal of Consulting and Clinical Psychology, 53, 689-703.
12. Camara, W. J., Nathan, J. S., & Puente, A. E. (2000). Psychological test usage: Implications in professional psychology. Professional Psychology: Research and Practice, 31, 141-154.
13. Collins, R. L., Kashdan, T. B., & Gollnisch, G. (2003). The feasibility of using cellular phones to collect ecological momentary assessment data: Application to alcohol consumption. Experimental and Clinical Psychopharmacology, 11, 73-78.
14. Collins, R. L., Morsheimer, E. T., Shiffman, S., Paty, J. A., Gnys, M., & Papandonatos, G. D. (1998). Ecological momentary assessment in a behavioral drinking moderation training program. Experimental and Clinical Psychopharmacology, 6, 306-315.
15. Conner, T. (2006). The experience sampling resource page. Retrieved June 9, 2006, from http://psychiatry.uchc.edu/faculty/files/conner/ESM.htm
16. Conner Christensen, T., Feldman Barrett, L., Bliss-Moreau, E., Lebo, K., & Kaschub, C. (2003). A practical guide to experience sampling procedures. Journal of Happiness Studies, 4, 53-78.
17. Conner Christensen, T., Wood, J. V., & Feldman Barrett, L. (2003). Remembering everyday experience through the prism of self esteem. Personality and Social Psychology Bulletin, 29, 51-62.
18. Csikszentmihaly, M., & Larson, R. (1987). Validity and reliability of the experience-sampling method. Journal of Nervous and Mental Disease, 175, 526-537.
19. Delespaul, P. A. E. G. (1992). Technical note: Devices and time-sampling procedures. In M. deVries (Ed.), The experience of psychopathology: Investigating mental disorders in their natural settings (pp. 363-373). New York: Cambridge University Press.
20. Donner, E. (1992). Expanding the experiential parameters of cognitive therapy. In M. deVries (Ed.), The experience of psychopathology: Investigating mental disorders in their natural settings (pp. 260-269). New York: Cambridge University Press.
21. Gaertner, J., Elsner, F., Pollmann-Dahmen, K., Radbruch, L., & Sabatowski, R. (2004). Electronic pain diary: A randomized crossover study. Journal of Pain and Symptom Management, 28, 259-267.
22. Gilbert, D. G., McClernon, F. J., Rabinovich, N. E., Plath, L. C., Jensen, R. A., & Meliska, C. J. (1998). Effects of smoking abstinence on mood and craving in men: Influences of negative-affect-related personality traits, habitual nicotine intake, and repeated measures. Personality and Individual Differences, 25, 399-423.
23. Green, A. S., Rafaeli, E., Bolger, N., Shrout, P. E., & Reis, H. T. (2006). Paper or plastic? Data equivalence in paper and electronic diaries. Psychological Methods, 11, 87-105.
24. Groth-Marnat, G. (1999). Financial efficacy of clinical assessment: Rational guidelines and issues for future research. Journal of Clinical Psychology, 55, 813-824.
25. Hammersley, R. (1994). A digest of memory phenomena for addiction research. Addiction, 89, 283-293.
26. Hammond, D., Fong, G. T., Cummings, K. M., & Hyland, A. (2005). Smoking topography, brand-switching, and nicotine delivery: Results from an in vivo study. Cancer Epidemiology Biomarkers & Prevention, 14, 1370-1375.
27. Hayes, S. C., Nelson, R. O., & Jarrett, R. B. (1987). The treatment utility of assessment: A functional approach to evaluating assessment quality. American Psychologist, 42, 963-974.
28. Haynes, S. N., Leisen, M. B., & Blaine, D. D. (1997). Design of individualized behavioral treatment programs using functional analytic clinical case models. Psychological Assessment, 9, 334-348.
29. Haynes, S. N., & Yoshioka, D. T. (2007). Clinical assessment applications of ambulatory biosensors. Psychological Assessment, 19, 44-57.
30. Helzer, J. E., Badger, G. J., Rose, G. L., Mongeon, J. A., & Searles, J. S. (2002). Decline in alcohol consumption during two years of daily reporting. Journal of Studies on Alcohol, 63, 551-558.
31. Hufford, M. R. (in press). Special methodological challenges and opportunities in ecological momentary assessment. In A. A. Stone, S. Shiffman, A. Autienza, & L. Nebeling (Eds.), The science of real-time data capture: Self-reports in health research. New York: Oxford University Press.
32. Hufford, M. R., Shields, A. L., Shiffman, S., Paty, J. A., & Balabanis, M. (2002). Reactivity to ecological momentary assessment: An example using undergraduate problem drinkers. Psychology of Addictive Behaviors, 16, 205-211.
33. Hufford, M. R., & Shiffman, S. (2003). Patient-reported outcomes: Assessment methods. Disease Management & Health Outcomes, 11, 77-86.
34. Hyland, M. E., Kenyon, C. A. P., Allen, R., & Howarth, P. (1993). Diary keeping in asthma: Comparison of written and electronic methods. British Medical Journal, 306, 487-489.
35. Kanfer, F. H. (1970). Self-monitoring: Methodological limitations and clinical applications. Journal of Abnormal Psychology, 35, 148-152.
36. Kihlstrom, J. F., Eich, E., Sandbrand, D., & Tobias, B. A. (2000). Emotion and memory: Implications for self-report. In A. A. Stone, J. S. Turkkan, C. A. Bachrach, J. B. Jobe, H. S. Kurtzman, & V. S. Cain (Eds.), The science of self-report: Implications for research and practice (pp. 81-99). Mahwah, NJ: Erlbaum.
37. Lauritsen, K., Degl'Innocenti, A., Hendel, L., Praest, J., Lytje, M. F., Clemmensen-Rotne, K., & Wiklund, I. (2004). Symptom recording in a randomized clinical trial: Paper diaries vs. electronic or telephone data capture. Controlled Clinical Trials, 25, 585-597.
38. Lindsley, O. R. (1968). A reliable wrist counter for recording behavior rates. Journal of Applied Behavior Analysis, 1, 77-78.
39. Litt, M. D., Cooney, N. L., & Morse, P. (1998). Ecological momentary assessment (EMA) with treated alcoholics: Methodological problems and potential solutions. Health Psychology, 17, 48-52.
40. Mahoney, K. (1974). Count on it: A simple self-monitoring device. Behavior Therapy, 5, 701-703.
41. Mazze, R. S., Shamoon, H., Pasmantier, R., Lucido, D., Murphy, J., Hartmann, K., Kuykendall, V., & Lopatin, W. (1984). Reliability of blood glucose monitoring by subjects with diabetes mellitus. The American Journal of Medicine, 77, 211-217.
42. McFall, R. M., & Hammen, C. (1971). Motivation, structure, and self-monitoring: Role of nonspecific factors in smoking reduction. Journal of Consulting and Clinical Psychology, 37, 80-86.
43. Mehl, M. R., Pennebaker, J. W., Crow, D. M., Dabbs, J., & Price, J. H. (2001). The Electronically Activated Recorder (EAR): A device for sampling naturalistic daily activities and conversations. Behavior Research Methods, Instruments, & Computers, 33, 517-523.
44. Menon, G., & Yorkston, E. A. (2000). The use of memory and contextual cues in the formation of behavioral frequency judgments. In A. A. Stone, J. S. Turkkan, C. A. Bachrach, J. B. Jobe, H. S. Kurtzman, & V. S. Cain (Eds.), The science of self-report: Implications for research and practice (pp. 63-79). Mahwah, NJ: Erlbaum.
45. Moses, E. B., & Barlow, D. B. (2006). A new unified treatment approach for emotional disorders based on emotion science. Current Directions in Psychological Science, 15, 146-150.
46. Mundt, J. C., Ferber, K. L., Rizzo, M., & Greist, J. H. (2001). Computer-automated dementia screening using a touch-tone telephone. Archives of Internal Medicine, 161, 2481-2487.
47. Niaura, R., Abrams, D. B., Shadel, W. G., Rohsenow, D. J., Monti, P. M., & Sirota, A. D. (1999). Cue exposure treatment for smoking relapse prevention: A controlled clinical trial. Addiction, 94, 685-695.
48. Nosek, B. A., Banaji, M. R., & Greenwald, A. G. (2002). E-research: Ethics, security, design, and control in psychological research on the Internet. Journal of Social Issues, 58, 161-176.
49. Nyholm, D., Kowalski, J., & Aquilonius, S. (2004). Wireless real-time electronic data capture for self-assessment of motor function and quality of life in Parkinson's disease. Movement Disorders, 19, 446-451.
50. O'Hara, M. W., & Rehm, L. P. (1979). Self-monitoring, activity levels, and mood in the development and maintenance of depression. Journal of Abnormal Psychology, 88, 450-453.
51. Palmblad, M., & Tiplady, B. (2004). Electronic diaries and questionnaires: Designing user interfaces that are easy for all patients to use. Quality of Life Research, 13, 1199-1207.
52. Paty, J. A., Kassel, J., & Shiffman, S. (1992). The importance of assessing base rates for clinical studies: An example of stimulus control of smoking. In M. deVries (Ed.), The experience of psychopathology: Investigating mental disorders in their natural settings (pp. 347-352). New York: Cambridge University Press.
53. Peeters, F., Nicolson, N. A., Berkhof, J., Delespaul, P., & de Vries, M. (2003). Effects of daily events on mood states in major depressive disorder. Journal of Abnormal Psychology, 112, 203-211.
54. Phelps, R., Eisman, E. J., & Kohut, J. (1998). Psychological practice and managed care: Results of the CAPP Practitioner Survey. Professional Psychology: Research and Practice, 29, 31-36.
55. Piotrowski, C. (1999). Assessment practices in the era of managed care: Current status and future directions. Journal of Clinical Psychology, 55, 787-796.
56. Redelmeier, D. A., & Kahneman, D. (1996). Patients' memories for painful medical treatments: Real time and retrospective evaluations of two minimally invasive procedures. Pain, 66, 3-8.
57. Reis, H. T., & Gable, S. L. (2000). Event sampling and other methods for studying everyday experience. In H. T. Reis & C. M. Judd (Eds.), Handbook of research methods in social and personality psychology (pp. 190-222). New York: Cambridge University Press.
58. Robinson, M. D., & Clore, G. L. (2002). Belief and feeling: Evidence for an accessibility model of emotional self-report. Psychological Bulletin, 128, 934-960.
59. Schmitz, J. M., Sayre, S. L., Stotts, A. L., Rothfleisch, J., & Mooney, M. E. (2005). Medication compliance during a smoking cessation clinical trial: A brief intervention using MEMS feedback. Journal of Behavioral Medicine, 28, 139-147.
60. Schwartz, J. E., & Stone, A. A. (1998). Strategies for analyzing ecological momentary assessment data. Health Psychology, 17, 6-16.
61. Schwarz, N. (1990). Assessing frequency reports of mundane behaviors: Contributions of cognitive psychology to questionnaire construction. In C. Hendrick & M. S. Clark (Eds.), Research methods in personality and social psychology (pp. 98-119). Newbury Park, CA: Sage.
62. Schwarz, N., & Oyserman, D. (2001). Asking questions about behavior: Cognition, communication, and questionnaire construction. American Journal of Evaluation, 22, 127-160.
63. Scollon, C. N., Kim-Prieto, C., & Diener, E. (2003). Experience sampling: Promises and pitfalls, strengths and weaknesses. Journal of Happiness Studies, 4, 5-34.
64. Sharpe, J. P., & Gilbert, D. G. (1998). Effects of repeated administration of the Beck Depression Inventory and other measures of negative mood states. Personality and Individual Differences, 24, 457-463.
65. Shiffman, S. (1988). Behavioral assessment. In D. M. Donovan & G. A. Marlatt (Eds.), Assessment of addictive behaviors (pp. 139-188). New York: Guilford.
66. Shiffman, S., Dresler, C. M., Hajek, P., Gilburt, S. J. A., Targett, D. A., & Strahs, K. R. (2002). Efficacy of a nicotine lozenge for smoking cessation. Archives of Internal Medicine, 162, 1267-1276.
67. Shiffman, S., Gwaltney, C. J., Balabanis, M. H., Liu, K. S., Paty, J. A., Kassel, J. D., et al. (2002). Immediate antecedents of cigarette smoking: An analysis from ecological momentary assessment. Journal of Abnormal Psychology, 111, 531-545.
68. Shiffman, S., Hufford, M., Hickcox, M., Paty, J. A., Gnys, M., & Kassel, J. D. (1997). Remember that? A comparison of real-time versus retrospective recall of smoking lapses. Journal of Consulting and Clinical Psychology, 65, 292-300.
69. Shiffman, S., Paty, J. A., Gnys, M., Kassel, J. A., & Hickcox, M. (1996). First lapses to smoking: Within-subjects analysis of real-time reports. Journal of Consulting and Clinical Psychology, 64, 366-379.
70. Shiffman, S., Paty, J. A., Gwaltney, C. J., & Dang, Q. (2004). Immediate analysis of cigarette smoking: An analysis of unrestricted smoking patterns. Journal of Abnormal Psychology, 113, 166-171.
71. Stone, A. A., Broderick, J. E., Schwartz, J. E., Shiffman, S., Litcher-Kelly, L., & Calvanese, P. (2003). Intensive momentary reporting of pain with an electronic diary: Reactivity, compliance, and patient satisfaction. Pain, 104, 343-351.
72. Stone, A. A., Broderick, J. E., Shiffman, S. S., & Schwartz, J. E. (2004). Understanding recall of weekly pain from a momentary assessment perspective: Absolute agreement, between- and within-person consistency, and judged change in weekly pain. Pain, 107, 61-69.
73. Stone, A. A., & Shiffman, S. (1994). Ecological momentary assessment (EMA) in behavioral medicine. Annals of Behavioral Medicine, 16, 199-202.
74. Stone, A. A., & Shiffman, S. (2002). Capturing momentary self-report data: A proposal for reporting guidelines. Annals of Behavioral Medicine, 24, 236-243.
75. Stone, A. A., Shiffman, S., Schwartz, J. E., Broderick, J. E., & Hufford, M. R. (2002). Patient non-compliance with paper diaries. British Medical Journal, 324, 1193-1194.
76. Stone, A. A., Shiffman, S., Schwartz, J., Broderick, J. E., & Hufford, M. R. (2003). Patient compliance with electronic and paper diaries. Controlled Clinical Trials, 24, 182-199.
77. Sutton, S. (1993). Is wearing clothes a high risk situation for relapse? The base rate problem in relapse research. Addiction, 88, 725-727.
78. Swift, R. M. (2000). Studies of a wearable, electronic, transdermal ethanol sensor. Alcoholism: Clinical and Experimental Research, 24, 422-423.
79. Takarangi, M. K. T., Garry, M., & Loftus, E. F. (2006). Dear diary, is plastic better than paper? I can't remember: Comment on Green, Rafaeli, Bolger, Shrout, & Reis (2006). Psychological Methods, 11, 119-122.
80. Tennen, H., Affleck, G., Coyne, J. C., Larsen, R. J., & DeLongis, A. (2006). Paper and plastic in daily diary research: Comment on Green, Rafaeli, Bolger, Shrout, and Reis (2006). Psychological Methods, 11, 112-118.
81. Turner, J. A., Mancl, L., & Aaron, L. A. (2005). Brief cognitive-behavioral therapy for temporomandibular disorder pain: Effects on daily electronic outcome and process measures. Pain, 117, 377-387.
82. Vansteelandt, K., Pieters, G., Vandereycken, W., Claes, L., Probst, M., & Van Mechelen, I. (2004). Hyperactivity in anorexia nervosa: A case study using experience sampling methodology. Eating Behaviors, 5, 67-74.
83. Williams, D. A., Gendreau, M., Hufford, M. R., Groner, K., Gracely, R. H., & Clauw, D. J. (2004). Pain assessment in patients with fibromyalgia syndrome: A consideration of methods for clinical trials. Clinical Journal of Pain, 20, 348-356.
84. Wirtz, D., Kruger, J., Scollon, C. N., & Diener, E. (2003). What to do on spring break? The role of predicted, on-line, and remembered experience in future choice. Psychological Science, 14, 520-524.
85. Witkiewitz, K., & Marlatt, G. A. (2004). Relapse prevention for alcohol and drug problems: That was zen, this is tao. American Psychologist, 59, 224-235.
86. Wood, J. M., Garb, H. N., Lillienfeld, S. O., & Nezworski, M. T. (2002). Clinical assessment. Annual Review of Psychology, 53, 519-543.