Test-retest reliability of self-reported diabetes diagnosis in the Norwegian Women and Cancer Study: A population-based longitudinal study (n =33,919)

SAGE Open Medicine

Volumn 4, Issue , 2016, Pages

  Sheikh, Mashhood Ahmed ^a   Lund, Eiliv ^a   Braaten, Tonje ^a  

^a UNIVERSITY OF TROMSØ   (Norway)

Author keywords

Kappa; Kvinner og kreft; Metabolic syndrome; Norway; Norwegian women and cancer; Questionnaires; Reproducibility; Test retest reliability; Type 1 diabetes; Type 2 diabetes

Indexed keywords

ADULT; ARTICLE; BODY MASS; DATA ANALYSIS; DIAGNOSTIC VALUE; FEMALE; HUMAN; INSULIN DEPENDENT DIABETES MELLITUS; LONGITUDINAL STUDY; MASS SCREENING; MIDDLE AGED; NON INSULIN DEPENDENT DIABETES MELLITUS; NORWAY; PATIENT-REPORTED OUTCOME; PHYSICAL ACTIVITY; PREGNANCY DIABETES MELLITUS; PRIORITY JOURNAL; QUESTIONNAIRE; SENSITIVITY ANALYSIS; SMOKING; SOCIAL STATUS; TEST RETEST RELIABILITY; VALIDATION STUDY;

EID: 84974719228     PISSN: None     EISSN: 20503121     Source Type: Journal    
DOI: 10.1177/2050312115622857     Document Type: Article

References (80)

1. Beckett M, Weinstein M, Goldman N, et al. Do health interview surveys yield reliable data on chronic illness among older respondents? Am J Epidemiol 2000; 151(3): 315-323.
2. Feinstein AR and Horwitz RI. Double standards, scientific methods, and epidemiologic research. N Engl J Med 1982; 307(26): 1611-1617.
3. Goldman N, Lin I-f, Weinstein M, et al. Evaluating the quality of self-reports of hypertension and diabetes. Office of Population Research working paper no. 2002-3, http://westoff. princeton.edu/papers/opr0203.pdf
4. De Burgos-Lunar C, Salinero-Fort M, Cardenas-Valladolid J, et al. Validation of diabetes mellitus and hypertension diagnosis in computerized medical records in primary health care. BMC Med Res Methodol 2011; 11: 146.
5. Robinson JR, Young TK, Roos LL, et al. Estimating the burden of disease: comparing administrative data and self-reports. Med Care 1997; 35(9): 932-947.
6. Heliövaara M, Aromaa A, Klaukka T, et al. Reliability and validity of interview data on chronic diseases. The mini-Finland Health Survey. J Clin Epidemiol 1993; 46(2): 181-191.
7. Harlow SD and Linet MS. Agreement between questionnaire and medical records. Am J Epidemiol 1989; 129(2): 233-248.
8. Huerta JM, José Tormo M, Egea-Caparrós JM, et al. Accuracy of self-reported diabetes, hypertension, and hyperlipidemia in the adult Spanish population. DINO study findings. Rev Esp Cardiol 2009; 62(2): 143-152.
9. Midthjell K, Holmen J, Bjorndal A, et al. Is questionnaire information valid in the study of a chronic disease such as diabetes? The Nord-Trøndelag diabetes study. J Epidemiol Community Health 1992; 46(5): 537-542.
10. Kriegsman DMW, Penninx BWJH, Van Eijk JTM, et al. Selfreports and general practitioner information on the presence of chronic diseases in community dwelling elderly: a study on the accuracy of patients’ self-reports and on determinants of inaccuracy. J Clin Epidemiol 1996; 49(12): 1407-1417.
11. Parr C, Veierød M, Laake P, et al. Test-retest reproducibility of a food frequency questionnaire (FFQ) and estimated effects on disease risk in the Norwegian Women and Cancer Study (NOWAC). Nutr J 2006; 5(1): 4.
12. Veierød MB, Parr CL, Lund E, et al. Reproducibility of selfreported melanoma risk factors in a large cohort study of Norwegian women. Melanoma Res 2008; 18(1): 1-9.
13. Tretli S, Lund-Larsen PG and Foss OP. Reliability of questionnaire information on cardiovascular disease and diabetes: cardiovascular disease study in Finnmark county. J Epidemiol Community Health 1982; 36(4): 269-273.
14. Jacobsen BK and Bønaa KH. The reproducibility of dietary data from a self-administered questionnaire. The Tromsø study. Int J Epidemiol 1990; 19(2): 349-353.
15. Johansson L, Solvoll K, Opdahl S, et al. Response rates with different distribution methods and reward, and reproducibility of a quantitative food frequency questionnaire. Eur J Clin Nutr 1997; 51(6): 346-353.
16. Hjemdal O, Friborg O, Stiles TC, et al. Resilience predicting psychiatric symptoms: a prospective study of protective factors and their role in adjustment to stressful life events. Clin Psychol Psychother 2006; 13(3): 194-201.
17. Solberg T, Olsen J-A, Ingebrigtsen T, et al. Health-related quality of life assessment by the EuroQol-5D can provide cost-utility data in the field of low-back surgery. Eur Spine J 2005; 14(10): 1000-1007.
18. Holm I, Friis A, Storheim K, et al. Measuring self-reported functional status and pain in patients with chronic low back pain by postal questionnaires: a reliability study. Spine 2003; 28(8): 828-833.
19. Svege I, Kolle E and Risberg M. Reliability and validity of the Physical Activity Scale for the Elderly (PASE) in patients with hip osteoarthritis. BMC Musculoskelet Disord 2012; 13(1): 26.
20. Sørlie T and Sexton HC. The factor structure of “The Ways of Coping Questionnaire” and the process of coping in surgical patients. Pers Indiv Differ 2001; 30(6): 961-975.
21. Bjertnaes O, Iversen H and Kjollesdal J. PIPEQ-OS-an instrument for on-site measurements of the experiences of inpatients at psychiatric institutions. BMC Psychiatr 2015; 15: 234.
22. Nordberg SS, Moltu C and Råbu M. Norwegian translation and validation of a routine outcomes monitoring measure: the treatment outcome package. Nordic Psychology. Epub ahead of print 15 September 2015. DOI: 10.1080/19012276.2015.1071204.
23. Bjørnarå HB, Hillesund ER, Torstveit MK, et al. An assessment of the test-retest reliability of the New Nordic Diet score. Food Nutr Res 2015; 59: 28397.
24. Moljord IEO, Lara-Cabrera ML, Perestelo-Pérez L, et al. Psychometric properties of the Patient Activation Measure-13 among out-patients waiting for mental health treatment: a validation study in Norway. Patient Educ Couns 2015; 98(11): 1410-1417.
25. Myr R, Bere E and Overby N. Test-retest reliability of a new questionnaire on the diet and eating behavior of one year old children. BMC Res Notes 2015; 8(1): 16.
26. Røysamb E, Vittersø J and Tambs K. The relationship satisfaction scale-psychometric properties. Norsk Epidemiologi 2014; 24(1-2): 187-194.
27. Øverby NC, Hillesund ER, Sagedal LR, et al. The Fit for Delivery study: rationale for the recommendations and testretest reliability of a dietary score measuring adherence to 10 specific recommendations for prevention of excessive weight gain during pregnancy. Matern Child Nutr 2015; 11(1): 20-32.
28. Bjertnaes O, Skudal KE, Iversen HH, et al. The Patient-Reported Incident in Hospital Instrument (PRIH-I): assessments of data quality, test-retest reliability and hospital-level reliability. BMJ Qual Saf 2013; 22(9): 743-751.
29. Johansen JB, Roe C, Bakke E, et al. Reliability and responsiveness of the Norwegian version of the Neck Disability Index. Scand J Pain 2014; 5(1): 28-33.
30. Nordtorp HL, Nyquist A, Jahnsen R, et al. Reliability of the Norwegian Version of the Children’s Assessment of Participation and Enjoyment (CAPE) and Preferences for Activities of Children (PAC). Phys Occup Ther Pediatr 2013; 33(2): 199-212.
31. Løchting I, Grotle M, Storheim K, et al. Individualized quality of life in patients with low back pain: reliability and validity of the Patient Generated Index. J Rehabil Med 2014; 46(8): 781-787.
32. Iversen M, Espehaug B, Rokne B, et al. Psychometric properties of the Norwegian version of the Audit of Diabetes-Dependent Quality of Life. Qual Life Res 2013; 22(10): 2809-2812.
33. Haldorsen B, Svege I, Roe Y, et al. Reliability and validity of the Norwegian version of the Disabilities of the Arm, Shoulder and Hand questionnaire in patients with shoulder impingement syndrome. BMC Musculoskelet Disord 2014; 15: 78.
34. Aaby C and Heimdal J-H. The voice-related quality of life (V-RQOL) measure-a study on validity and reliability of the Norwegian version. J Voice 2013; 27(2): 258.e29-258.e33.
35. Tavoly M, Jelsness-Jørgensen L-P, Wik H, et al. Quality of life after pulmonary embolism: first cross-cultural evaluation of the pulmonary embolism quality-of-life (PEmb-QoL) questionnaire in a Norwegian cohort. Qual Life Res 2015; 24(2): 417-425.
36. Kapstad H, Nelson M, Øverås M, et al. Validation of the Norwegian short version of the Body Shape Questionnaire (BSQ-14). Nord J Psychiatry 2015; 69(7): 509-514.
37. Klokkerud M, Grotle M, Løchting I, et al. Psychometric properties of the Norwegian version of the patient generated index in patients with rheumatic diseases participating in rehabilitation or selfmanagement programmes. Rheumatology 2013; 52: 924-932.
38. Amble I, Gude T, Stubdal S, et al. Psychometric properties of the outcome questionnaire-45.2: the Norwegian version in an international context. Psychother Res 2014; 24(4): 504-513.
39. Agerup T, Lydersen S, Wallander J, et al. Maternal and paternal psychosocial risk factors for clinical depression in a Norwegian community sample of adolescents. Nord J Psychiatry 2015; 69(1): 35-41.
40. Skre I, Friborg O, Elgaroy S, et al. The factor structure and psychometric properties of the Clinical Outcomes in Routine Evaluation-Outcome Measure (CORE-OM) in Norwegian clinical and non-clinical samples. BMC Psychiatr 2013; 13: 99.
41. Erdvik IB, Øverby NC and Haugen T. Translating, reliability testing, and validating a Norwegian Questionnaire to Assess Adolescents’ Intentions to be Physically Active After High School Graduation. SAGE Open. Epub ahead of print 13 April 2015. DOI: 10.1177/2158244015580374.
42. Bergland Å, Hofoss D, Kirkevold M, et al. Person-centred ward climate as experienced by mentally lucid residents in long-term care facilities. J Clin Nurs 2015; 24(3-4): 406-414.
43. Østerås N, Garratt A, Grotle M, et al. Patient-reported quality of care for osteoarthritis: development and testing of the osteoarthritis quality indicator questionnaire. Arthritis Care Res 2013; 65(7): 1043-1051.
44. Trochim WMK. Types of reliability, http://www.socialresearchmethods. net/kb/reltypes.php (2006, accessed 24 December 2011).
45. Andresen EM, Malmstrom TK, Miller DK, et al. Retest reliability of self-reported function, self-care, and disease history. Med Care 2005; 43(1): 93-97.
46. Yount BW, Wyrwich KW and Brownson RC. The reliability of a questionnaire-based metabolic syndrome surveillance tool. Metab Syndr Relat Disord 2007; 5(3): 282-289.
47. Brownson RC, Jackson-Thompson J, Wilkerson JC, et al. Reliability of information on chronic disease risk factors collected in the Missouri Behavioral Risk Factor Surveillance System. Epidemiology 1994; 5(5): 545-549.
48. Starr GJ, Grande ED, Taylor AW, et al. Reliability of selfreported behavioural health risk factors in a South Australian telephone survey. Australian N Z J Public Health 1999; 23(5): 528-530.
49. Bosetti C, Tavani A, Negri E, et al. Reliability of data on medical conditions, menstrual and reproductive history provided by hospital controls. J Clin Epidemiol 2001; 54(9): 902-906.
50. Bowlin SJ, Morrill BD, Nafziger AN, et al. Reliability and changes in validity of self-reported cardiovascular disease risk factors using dual response: the behavioral risk factor survey. J Clin Epidemiol 1996; 49(5): 511-517.
51. Khardori R. Type 2 diabetes mellitus, http://emedicine. medscape.com/article/117853-overview (2011, accessed 24 December 2011).
52. Sheikh MA, Lund E and Braaten T. The predictive effect of body mass index on type 2 diabetes in the Norwegian women and cancer study. Lipids Health Dis 2014; 13: 164.
53. Lund E. The Norwegian Women and Cancer study, NOWAC, http://site.uit.no/nowac/; http://uit.no/ (accessed 14 October 2011).
54. The Norwegian Women and Cancer study (NOWAC). The Norwegian Women and Cancer study. Tromsø: Department of Community medicine, Faculty of medicine, The University of Tromsø, 2008 (updated 4 July 2008), http://site.uit.no/nowac/ (accessed 21 December 2015).
55. Lund E, Dumeaux V, Braaten T, et al. Cohort profile: the Norwegian Women and Cancer Study-NOWAC-Kvinner og kreft. Int J Epidemiol 2008; 37(1): 36-41.
56. Lund E, Kumle M, Braaten T, et al. External validity in a population-based national prospective study-the Norwegian Women and Cancer Study NOWAC. Cancer Causes Control 2003; 14(10): 1001-1008.
57. Skeie G, Mode N, Henningsen M, et al. Validity of selfreported body mass index among middle-aged participants in the Norwegian Women and Cancer study. Clin Epidemiol 2015; 7: 313-323.
58. Hjartåker A, Andersen LF and Lund E. Comparison of diet measures from a food-frequency questionnaire with measures from repeated 24-hour dietary recalls. The Norwegian Women and Cancer Study. Public Health Nutr 2007; 10(10): 1094-1103.
59. Brustad M, Skeie G, Braaten T, et al. Comparison of telephone vs face-to-face interviews in the assessment of dietary intake by the 24h recall EPIC SOFT program-the Norwegian calibration study. Eur J Clin Nutr 2003; 57(1): 107-113.
60. Fleiss JL, Levin B and Paik MC. Statistical methods for rates and proportions (ed WA Shewart and SS Wilks). 3rd ed. Hoboken, NJ: John Wiley & Sons, 2003, 800 pp.
61. Reichenheim ME. Confidence intervals for the kappa statistic. Stata J 2004; 4(4): 421-428.
62. Simon S. What is a kappa coefficient? (Cohen’s kappa). Kansas City, MO: Children’s Mercy Hospitals and Clinics, 2008 (updated 14 July 2008), http://www.childrensmercy.org/ stats/definitions/kappa.htm (accessed 24 December 2011).
63. StatsDirect Limited. Kappa and Maxwell. Altrincham: StatsDirect Limited, 2011. (updated 2011), http://www.ukph.org/help/statsdirect. htm#agreement/kappa.htm (accessed 24 December 2011).
64. Lab Tests Online. Diabetes, http://labtestsonline.org/understanding/ conditions/diabetes?start=1 (accessed 24 December 2011).
65. World Health Organization (WHO). Diabetes. Geneva: WHO, 2011 (updated August 2011), http://www.who.int/mediacentre/ factsheets/fs312/en/index.html (accessed 23 December 2011).
66. Chyun DA, Wackers FJ, Inzucchi SE, et al. Autonomic dysfunction independently predicts poor cardiovascular outcomes in asymptomatic individuals with type 2 diabetes in the DIAD study. SAGE Open Med. Epub ahead of print 24 February 2015. DOI: 10.1177/2050312114568476.
67. AL-Aboudi IS, Hassali MA, Shafie AA, et al. A cross-sectional assessment of health-related quality of life among type 2 diabetes patients in Riyadh, Saudi Arabia. SAGE Open Med. Epub ahead of print 9 October 2015. DOI: 10.1177/2050312115610129.
68. Shaw J. Epidemiology of childhood type 2 diabetes and obesity. Pediatr Diabetes 2007; 8: 7-15.
69. Jenssen TG, Tonstad S, Claudi T, et al. The gap between guidelines and practice in the treatment of type 2 diabetes: a nationwide survey in Norway. Diabetes Res Clin Pract 2008; 80(2): 314-320.
70. World Health Organization (WHO) Regional Office for Europe. Facts and figures Copenhagen, http://www.euro.who. int/en/what-we-do/health-topics/noncommunicable-diseases/ diabetes/facts-and-figures (2011, accessed 24 December 2011).
71. Ben-Haroush A, Yogev Y and Hod M. Epidemiology of gestational diabetes mellitus and its association with Type 2 diabetes. Diabet Med 2004; 21(2): 103-113.
72. Nasjonalt folkehelseinstituttet (Norwegian Institute of Public Health). Forekomsten av type 1-diabetes har økt med omlag 30 prosent 2008, http://www.fhi.no/eway/default.aspx?pid=233&trg=MainLeft_5565&MainArea_5661=5565: 0: 15,1212: 1: 0: 0::: 0: 0&MainLeft_5565=5544: 64250:: 1: 5569: 1::: 0: 0 (accessed 24 December 2011).
73. Sheikh MA, Abelsen B and Olsen JA. Role of respondents’ education as a mediator and moderator in the association between childhood socio-economic status and later health and wellbeing. BMC Public Health 2014; 14(1): 1172.
74. Royston P and White IR. Multiple Imputation by Chained Equations (MICE): implementation in Stata. J Stat Software 2011; 45(4): 1-20.
75. White IR, Royston P and Wood AM. Multiple imputation using chained equations: issues and guidance for practice. Stat Med 2011; 30(4): 377-399.
76. Carpenter JR and Kenward MG. Multiple imputation and its application. Sussex: John Wiley & Sons, 2013, 364 pp.
77. StataCorp. Stata 14 multiple-imputation reference manual. College Station, TX: Stata Press, 2015, http://www.stata.com/ manuals14/mi.pdf
78. Uebersax J. Kappa coefficients: John Uebersax Enterprises LLC (updated 18 March 2010), http://www.john-uebersax. com/stat/kappa.htm (2010, accessed 24 December 2011).
79. Schneider ALC, Pankow JS, Heiss G, et al. Validity and reliability of self-reported diabetes in the Atherosclerosis Risk in Communities Study. Am J Epidemiol 2012; 176(8): 738-743.
80. Kargman DE, Sacco RL, Boden-Albala B, et al. Validity of telephone interview data for vascular disease risk factors in a racially mixed urban community: the Northern Manhattan Stroke Study. Neuroepidemiology 1999; 18(4): 174-184.