Reliability, validity and sensitivity of a computerized visual analog scale measuring state anxiety

Journal of Behavior Therapy and Experimental Psychiatry

Volumn 45, Issue 4, 2014, Pages 447-453

  Abend, Rany ^a   Dan, Orrie ^b   Maoz, Keren ^a   Raz, Sivan ^b   Bar Haim, Yair ^a  

^a TEL AVIV UNIVERSITY   (Israel)

^b THE MAX STERN YEZREEL VALLEY COLLEGE   (Israel)

Author keywords

Anxiety; Electronic scale; State anxiety; Stress; VAS; Visual analog scale

Indexed keywords

ADULT; ANXIETY DISORDER; ARTICLE; CONVERGENT VALIDITY; DISCRIMINANT VALIDITY; FEMALE; HUMAN; LIEBOWITZ SOCIAL ANXIETY SCALE; MALE; PATIENT HEALTH QUESTIONNAIRE 9; PUBLIC SPEAKING; RELIABILITY; SOCIAL PHOBIA; SOCIAL STRESS; STATE ANXIETY; STATE TRAIT ANXIETY INVENTORY; STATE-TRAIT ANGER EXPRESSION INVENTORY; VISUAL ANALOG SCALE; ANXIETY; COMPUTER ASSISTED DIAGNOSIS; DIAGNOSIS; PSYCHOLOGY; PSYCHOMETRY; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; YOUNG ADULT;

ADULT; ANXIETY; DIAGNOSIS, COMPUTER-ASSISTED; FEMALE; HUMANS; MALE; PSYCHOMETRICS; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; VISUAL ANALOG SCALE; YOUNG ADULT;

EID: 84903636822     PISSN: 00057916     EISSN: 18737943     Source Type: Journal    
DOI: 10.1016/j.jbtep.2014.06.004     Document Type: Article

References (82)

1. E.P. Ahearn The use of visual analog scales in mood disorders: a critical review Journal of Psychiatric Research 31 5 1997 569 579 10.1016/S0022-3956(97) 00029-0 (Pubitemid 27443117)
2. R.C.B. Aitken Measurement of feelings using visual analogue scales Proceedings of the Royal Society of Medicine-London 62 10 1969 989 993
3. A. Allenby, J. Matthews, J. Beresford, and S.A. McLachlan The application of computer touch-screen technology in screening for psychosocial distress in an ambulatory oncology setting European Journal of Cancer Care 11 4 2002 245 253 10.1046/j.1365-2354.2002.00310.x
4. American Psychiatric Association Diagnostic criteria from DSM-IV-TR 2000 American Psychiatric Association Washington, D.C.
5. N. Amir, G. Weber, C. Beard, J. Bomyea, and C.T. Taylor The effect of a single-session attention modification program on response to a public-speaking challenge in socially anxious individuals Journal of Abnormal Psychology 117 4 2008 860 868 10.1037/a0013445
6. P.E. Bijur, W. Silver, and E.J. Gallagher Reliability of the visual analog scale for measurement of acute pain Academic Emergency Medicine 8 12 2001 1153 1157 10.1111/j.1553-2712.2001.tb01132.x (Pubitemid 33108207)
7. F.L. Bishop, G. Lewis, S. Harris, N. McKay, P. Prentice, and H. Thiel et al. A within-subjects trial to test the equivalence of online and paper outcome measures: the Roland Morris disability questionnaire BMC Musculoskeletal Disorders 11 2010 113 10.1186/1471-2474-11-113
8. A. Bond, P. Shine, and M. Bruce Validation of visual analog scales in anxiety International Journal of Methods in Psychiatric Research 5 1 1995 1 9
9. J.E. Broderick, and G. Vikingstad Frequent assessment of negative symptoms does not induce depressed mood Journal of Clinical Psychology in Medical Settings 15 4 2008 296 300 10.1007/s10880-008-9127-6
10. K. Buhr, and M.J. Dugas The role of fear of anxiety and intolerance of uncertainty in worry: an experimental manipulation Behaviour Research and Therapy 47 3 2009 215 223 10.1016/j.brat.2008.12.004
11. C. Burton, D. Weller, and M. Sharpe Functional somatic symptoms and psychological states: an electronic diary study Psychosomatic Medicine 71 1 2009 77 83 10.1097/PSY.0b013e31818f2acb
12. D.F. Cella, and S.W. Perry Reliability and concurrent validity of three visual-analogue mood scales Psychological Reports 59 2 Pt 2 1986 827 833
13. L.L. Chlan Relationship between two anxiety instruments in patients receiving mechanical ventilatory support Journal of Advanced Nursing 48 5 2004 493 499 10.1111/j.1365-2648.2004.03231.x (Pubitemid 39540309)
14. S.J. Coons, C.J. Gwaltney, R.D. Hays, J.J. Lundy, J.A. Sloan, and D.A. Revicki et al. Recommendations on evidence needed to support measurement equivalence between electronic and paper-based patient-reported outcome (PRO) measures: ISPOR ePRO good research practices task force report Value in Health 12 4 2009 419 429 10.1111/j.1524-4733.2008.00470.x
15. B.J. Corby, and W.W. Tryon Validating a new method for quantifying traits: the computer-administered visual analog Journal of Research in Personality 40 3 2006 285 312 10.1016/j.jrp.2005.01.002 (Pubitemid 43677126)
16. H.M. Davey, A.L. Barratt, P.N. Butow, and J.J. Deeks A one-item question with a Likert or Visual Analog Scale adequately measured current anxiety Journal of Clinical Epidemiology 60 4 2007 356 360 http://dx.doi.org/10.1016/j. jclinepi.2006.07.015 (Pubitemid 46341708)
17. A.G.E.M. de Boer, J.J.B. van Lanschot, P.F.M. Stalmeier, J.W. van Sandick, J.B.F. Hulscher, and J.C.J.M. de Haes et al. Is a single-item visual analogue scale as valid, reliable and responsive as multi-item scales in measuring quality of life? Quality of Life Research 13 2 2004 311 320 (Pubitemid 38392259)
18. S.S. Deschenes, M.J. Dugas, K. Fracalanza, and N. Koerner The role of anger in generalized anxiety disorder Cognitive Behaviour Therapy 41 3 2012 261 271 10.1080/16506073.2012.666564
19. R.A. Deyo, P. Diehr, and D.L. Patrick Reproducibility and responsiveness of health status measures. Statistics and strategies for evaluation Controlled Clinical Trials 12 4 Suppl 1991 142S 158S
20. S. Dockray, N. Grant, A.A. Stone, D. Kahneman, J. Wardle, and A. Steptoe A comparison of affect ratings obtained with ecological momentary assessment and the day reconstruction method Social Indicators Research 99 2 2010 269 283 10.1007/s11205-010-9578-7
21. L.S. Elwood, K. Wolitzky-Taylor, and B.O. Olatunji Measurement of anxious traits: a contemporary review and synthesis Anxiety, Stress & Coping 25 6 2012 647 666 10.1080/10615806.2011.582949
22. L. Farrer, A. Gulliver, J.K. Chan, P.J. Batterham, J. Reynolds, and A. Calear et al. Technology-based interventions for mental health in tertiary students: systematic review Journal of Medical Internet Research 15 5 2013 e101 10.2196/jmir.2639
23. D.M. Fresco, M.E. Coles, R.G. Heimberg, M.R. Liebowitz, S. Hami, and M.B. Stein et al. The Liebowitz Social Anxiety Scale: a comparison of the psychometric properties of self-report and clinician-administered formats Psychological Medicine 31 6 2001 1025 1035 10.1017/S003329170105405 (Pubitemid 32725348)
24. A.G. Gift Visual analogue scales: measurement of subjective phenomena Nursing Research 38 5 1989 286 288 (Pubitemid 19247822)
25. B. Grafton, B. Mackintosh, T. Vujic, and C. MacLeod When ignorance is bliss: explicit instruction and the efficacy of CBM-a for anxiety Cognitive Therapy and Research 2013 1 17 10.1007/s10608-013-9579-3
26. C.J. Gwaltney, A.L. Shields, and S. Shiffman Equivalence of electronic and paper-and-pencil administration of patient-reported outcome measures: a meta-analytic review Value in Health 11 2 2008 322 333 10.1111/j.1524-4733.2007. 00231.x (Pubitemid 351473608)
27. E. Hedman, B. Ljotsson, and N. Lindefors Cognitive behavior therapy via the Internet: a systematic review of applications, clinical efficacy and cost-effectiveness Expert Review of Pharmacoeconomics & Outcomes Research 12 6 2012 745 764 10.1586/erp.12.67
28. R.G. Heimberg, K.J. Horner, H.R. Juster, S.A. Safren, E.J. Brown, and F.R. Schneier et al. Psychometric properties of the liebowitz social anxiety scale Psychological Medicine 29 1 1999 199 212 (Pubitemid 29034537)
29. O. Hirsch, F. Hauschild, M.H. Schmidt, E. Baum, and H. Christiansen Comparison of Web-based and paper-based administration of ADHD questionnaires for adults Journal of Medical Internet Research 15 3 2013 e47 10.2196/jmir.2225
30. P.J. Hollen, R.J. Gralla, J.A. Stewart, J.M. Meharchand, R. Wierzbicki, and N. Leighl Can a computerized format replace a paper form in PRO and HRQL evaluation? Psychometric testing of the computer-assisted LCSS instrument (eLCSS-QL) Supportive Care in Cancer 21 1 2013 165 172 10.1007/s00520-012-1507-7
31. A.R. Hornblow, and M.A. Kidson The visual analogue scale for anxiety: a validation study Australian and New Zealand Journal of Psychiatry 10 4 1976 339 341 (Pubitemid 8021011)
32. R.N. Jamison, R.H. Gracely, S.A. Raymond, J.G. Levine, B. Marino, and T.J. Herrmann et al. Comparative study of electronic vs. paper VAS ratings: a randomized, crossover trial using healthy volunteers Pain 99 1-2 2002 341 347 10.1016/S0304-3959(02)00178-1 (Pubitemid 35247557)
33. R.N. Jamison, S.A. Raymond, J.G. Levine, E.A. Slawsby, S.S. Nedeljkovic, and N.P. Katz Electronic diaries for monitoring chronic pain: 1-year validation study Pain 91 3 2001 277 285 DOI: S0304395900004504 [pii] (Pubitemid 32241149)
34. U. Junker, R. Freynhagen, K. Langler, U. Gockel, U. Schmidt, and T.R. Tolle et al. Paper versus electronic rating scales for pain assessment: a prospective, randomised, cross-over validation study with 200 chronic pain patients Current Medical Research and Opinion 24 6 2008 1797 1806 10.1185/03007990802121059 (Pubitemid 351929077)
35. E. Kaltenthaler, J. Brazier, E. De Nigris, I. Tumur, M. Ferriter, and C. Beverley et al. Computerised cognitive behaviour therapy for depression and anxiety update: a systematic review and economic evaluation Health Technology Assessment 10 33 2006 1 168 10.3310/hta10330 iii, xi-xiv
36. M. Kellner, K. Wiedemann, A. Yassouridis, and C. Muhtz Non-response of cortisol during stressful exposure therapy in patients with obsessive-compulsive disorder-Preliminary results Psychiatry Research 199 2 2012 111 114 10.1016/j.psychres.2012.04.029
37. F. Kendel, M. Wirtz, A. Dunkel, E. Lehmkuhl, R. Hetzer, and V. Regitz-Zagrosek Screening for depression: Rasch analysis of the dimensional structure of the PHQ-9 and the HADS-D Journal of Affective Disorders 122 3 2010 241 246 10.1016/j.jad.2009.07.004
38. C.H. Kindler, C. Harms, F. Amsler, T. Ihde-Scholl, and D. Scheidegger The visual analog scale allows effective measurement of preoperative anxiety and detection of patients' anesthetic concerns Anesthesia & Analgesia 90 3 2000 706 712 10.1097/00000539-200003000-00036 (Pubitemid 30117536)
39. C. Kirschbaum, K.M. Pirke, and D.H. Hellhammer The 'Trier Social Stress Test'-a tool for investigating psychobiological stress responses in a laboratory setting Neuropsychobiology 28 1-2 1993 76 81 doi: 119004, [pii] 119004 (Pubitemid 23283755)
40. S.M. Kongsved, M. Basnov, K. Holm-Christensen, and N.H. Hjollund Response rate and completeness of questionnaires: a randomized study of Internet versus paper-and-pencil versions Journal of Medical Internet Research 9 3 2007 e25 10.2196/jmir.9.3.e25
41. K. Kroenke, R.L. Spitzer, and J.B. Williams The PHQ-9: validity of a brief depression severity measure Journal of General Internal Medicine 16 9 2001 606 613 10.1046/j.1525-1497.2001.016009606.x (Pubitemid 32823891)
42. T.K. Kvien, P. Mowinckel, T. Heiberg, K.L. Dammann, O. Dale, and G.J. Aanerud et al. Performance of health status measures with a pen based personal digital assistant Annals of the Rheumatic Diseases 64 10 2005 1480 1484 10.1136/ard.2004.030437 (Pubitemid 41623861)
43. M.R. Liebowitz Social phobia Modern Problems of Pharmacopsychiatry 22 1987 141 173
44. G.I. Liverant, M.K. Suvak, S.L. Pineles, and P.A. Resick Changes in posttraumatic stress disorder and depressive symptoms during cognitive processing therapy: evidence for concurrent change Journal of Consulting and Clinical Psychology 80 6 2012 957 967 10.1037/a0030485
45. U. Lueken, M. Muehlhan, R. Evens, H.U. Wittchen, and C. Kirschbaum Within and between session changes in subjective and neuroendocrine stress parameters during magnetic resonance imaging: a controlled scanner training study Psychoneuroendocrinology 37 8 2012 1299 1308 10.1016/j.psyneuen.2012.01.003
46. N.H. Luyk, F.M. Beck, and J.M. Weaver A visual analogue scale in the assessment of dental anxiety Anesthesia Progress 35 3 1988 121 123
47. C. MacLeod, and A. Mathews Cognitive bias modification approaches to anxiety Annual Review of Clinical Psychology 8 2012 189 217 10.1146/annurev- clinpsy-032511-143052
48. C. MacLeod, E. Rutherford, L. Campbell, G. Ebsworthy, and L. Holker Selective attention and emotional vulnerability: assessing the causal basis of their association through the experimental manipulation of attentional bias Journal of Abnormal Psychology 111 1 2002 107 123 10.1037/0021-843X.111.1.107 (Pubitemid 34150828)
49. K. Maoz, R. Abend, N.A. Fox, D.S. Pine, and Y. Bar-Haim Subliminal attention bias modification training in socially anxious individuals Frontiers in Human Neuroscience 7 2013 389 10.3389/fnhum.2013.00389
50. H.M. McCormack, D.J. Horne, and S. Sheather Clinical applications of visual analogue scales: a critical review Psychological Medicine 18 4 1988 1007 1019
51. D.S. Mennin, D.M. Fresco, R.G. Heimberg, F.R. Schneier, S.O. Davies, and M.R. Liebowitz Screening for social anxiety disorder in the clinical setting: using the Liebowitz Social Anxiety Scale Journal of Anxiety Disorders 16 6 2002 661 673 (Pubitemid 35292104)
52. N. Moerman, F.S. van Dam, M.J. Muller, and H. Oosting The Amsterdam preoperative anxiety and information scale (APAIS) Anesthesia & Analgesia 82 3 1996 445 451 (Pubitemid 26072941)
53. J. Mouthaan, M. Sijbrandij, J.B. Reitsma, B.P. Gersons, and M. Olff Internet-based prevention of posttraumatic stress symptoms in injured trauma patients: design of a randomized controlled trial European Journal of Psychotraumatology 2 2011 10.3402/ejpt.v2i0.8294
54. T.M. Palermo, D. Valenzuela, and P.P. Stork A randomized trial of electronic versus paper pain diaries in children: impact on compliance, accuracy, and acceptability Pain 107 3 2004 213 219 DOI: S0304395903004135 [pii] (Pubitemid 38083376)
55. S.Z. Poma, S. Milleri, L. Squassante, G. Nucci, M. Bani, and G.I. Perini et al. Characterization of a 7% carbon dioxide (CO2) inhalation paradigm to evoke anxiety symptoms in healthy subjects Journal of Psychopharmacology 19 5 2005 494 503 10.1177/0269881105056533 (Pubitemid 41392304)
56. S.C. Reid, S.D. Kauer, P. Dudgeon, L.A. Sanci, L.A. Shrier, and G.C. Patton A mobile phone program to track young people's experiences of mood, stress and coping. Development and testing of the mobiletype program Social Psychiatry and Psychiatric Epidemiology 44 6 2009 501 507 10.1007/s00127-008- 0455-5
57. V. Rossi, and G. Pourtois Transient state-dependent fluctuations in anxiety measured using STAI, POMS, PANAS or VAS: a comparative review Anxiety, Stress & Coping 25 6 2012 603 645 10.1080/10615806.2011.582948
58. J.M. Ryan, J.R. Corry, R. Attewell, and M.J. Smithson A comparison of an electronic version of the SF-36 General Health Questionnaire to the standard paper version Quality of Life Research 11 1 2002 19 26 (Pubitemid 34293383)
59. N.K. Rytwinski, D.M. Fresco, R.G. Heimberg, M.E. Coles, M.R. Liebowitz, and S. Cissell et al. Screening for social anxiety disorder with the self-report version of the Liebowitz Social Anxiety Scale Depression and Anxiety 26 1 2009 34 38 10.1002/da.20503
60. F. Salaffi, S. Gasparini, and W. Grassi The use of computer touch-screen technology for the collection of patient-reported outcome data in rheumatoid arthritis: comparison with standardized paper questionnaires Clinical and Experimental Rheumatology 27 3 2009 459 468
61. A. Schaffer, D. Kreindler, C. Reis, and A.J. Levitt Use of mental health telemetry to enhance identification and predictive value of early changes during augmentation treatment of major depression Journal of Clinical Psychopharmacology 33 6 2013 10.1097/JCP.0b013e31829e8359
62. S.E. Schulenberg, and B.A. Yutrzenka The equivalence of computerized and paper-and-pencil psychological instruments: implications for measures of negative affect Behavior Research Methods, Instruments, & Computers 31 2 1999 315 321
63. S.M. Schulz, G.W. Alpers, and S.G. Hofmann Negative self-focused cognitions mediate the effect of trait social anxiety on state anxiety Behaviour Research and Therapy 46 4 2008 438 449 10.1016/j.brat.2008.01.008
64. K. Seddon, K. Morris, J. Bailey, J. Potokar, A. Rich, and S. Wilson et al. Effects of 7.5% CO2 challenge in generalized anxiety disorder Journal of Psychopharmacology 25 1 2011 43 51 10.1177/0269881110364270
65. S. Shiffman, A.A. Stone, and M.R. Hufford Ecological momentary assessment Annual Review of Clinical Psychology 4 2008 1 32 10.1146/annurev.clinpsy.3. 022806.091415 (Pubitemid 351688514)
66. C.D. Spielberger Manual for the State-Trait Anxiety Inventory (Form Y) self-evaluation questionnaire 1983 Consulting Psychologists Press Palo Alto, CA
67. C.D. Spielberger State-Trait Anger Expression Inventory-2: STAXI-2 professional manual 1999 Psychological Assessment Resources Odessa, FL
68. C.D. Spielberger, R.L. Gorsuch, and R.E. Lushene Manual for the State-Trait Anxiety Inventory 1970 Consulting Psychologists Press Palo Alto, CA
69. C.D. Spielberger, and S.J. Sydeman State-trait anxiety inventory and state-trait anger expression inventory M.E. Maruish, The use of psychological testing for treatment planning and outcome assessment 1994 Lawrence Erlbaum Associates, Inc Hillsdale, NJ 292 321
70. R.L. Spitzer, K. Kroenke, and J.B. Williams Validation and utility of a self-report version of PRIME-MD: the PHQ primary care study. Primary Care Evaluation of Mental Disorders. Patient Health Questionnaire Journal of the American Medical Association 282 18 1999 1737 1744 DOI: joc90770 [pii] (Pubitemid 29533604)
71. A.A. Stone, S. Shiffman, J.E. Schwartz, J.E. Broderick, and M.R. Hufford Patient compliance with paper and electronic diaries Controlled Clinical Trials 24 2 2003 182 199 10.1016/S0197-2456(02)00320-3 (Pubitemid 36412017)
72. R.J. Stratton, R.J. Stubbs, D. Hughes, N. King, J.E. Blundell, and M. Elia Comparison of the traditional paper visual analogue scale questionnaire with an Apple Newton electronic appetite rating system (EARS) in free living subjects feeding ad libitum European Journal of Clinical Nutrition 52 10 1998 737 741 (Pubitemid 28477344)
73. R.J. Stubbs, D.A. Hughes, A.M. Johnstone, E. Rowley, C. Reid, and M. Elia et al. The use of visual analogue scales to assess motivation to eat in human subjects: a review of their reliability and validity with an evaluation of new hand-held computerized systems for temporal tracking of appetite ratings British Journal of Nutrition 84 4 2000 405 415 10.1017/S0007114500001719
74. P. Sylvers, S.O. Lilienfeld, and J.L. LaPrairie Differences between trait fear and trait anxiety: Implications for psychopathology Clinical Psychology Review 31 1 2011 122 137 10.1016/j.cpr.2010.08.004
75. C.T. Taylor, J. Bomyea, and N. Amir Attentional bias away from positive social information mediates the link between social anxiety and anxiety vulnerability to a social stressor Journal of Anxiety Disorders 24 4 2010 403 408 10.1016/j.janxdis.2010.02.004
76. S. Thorpe, P.M. Salkovskis, and A. Dittner Claustrophobia in MRI: the role of cognitions Magnetic Resonance Imaging 26 8 2008 1081 1088 doi: 10.1016/j.mri.2008.01.022 S0730-725X(08)00043-X [pii]
77. B.W. Van Voorhees, J. Fogel, M.A. Reinecke, T. Gladstone, S. Stuart, and J. Gollan et al. Randomized clinical trial of an Internet-based depression prevention program for adolescents (Project CATCH-IT) in primary care: 12-week outcomes Journal of Developmental & Behavioral Pediatrics 30 1 2009 23 37 10.1097/DBP.0b013e3181966c2a
78. D. Watson, and A. Tellegen Toward a consensual structure of mood Psychological Bulletin 98 2 1985 219 235
79. M.E. Wewers, and N.K. Lowe A critical review of visual analogue scales in the measurement of clinical phenomena Research in Nursing & Health 13 4 1990 227 236
80. S. Whybrow, J.R. Stephen, and R.J. Stubbs The evaluation of an electronic visual analogue scale system for appetite and mood European Journal of Clinical Nutrition 60 4 2006 558 560 10.1038/sj.ejcn.1602342
81. S.R. Woody, and B.F. Rodriguez Self-focused attention and social anxiety in social phobics and normal controls Cognitive Therapy and Research 24 4 2000 473 488 (Pubitemid 30625695)
82. M. Zimmerman, W. McDermut, and J.I. Mattia Frequency of anxiety disorders in psychiatric outpatients with major depressive disorder American Journal of Psychiatry 157 8 2000 1337 1340 10.1176/appi.ajp.157.8.1337 (Pubitemid 30659823)