Does it matter whom and how you ask? Inter- and intra-rater agreement in the Ontario Health Survey

Journal of Clinical Epidemiology

Volumn 50, Issue 2, 1997, Pages 127-135

  Grootendorst, Paul V ^a,b   Feeny, David H ^b   Furlong, William ^b  

^a CENTRE FOR EVALUATION OF MEDICINES   (Canada)

^b MCMASTER UNIVERSITY   (Canada)

Author keywords

Health status indices; Health surveys; Inter rater agreement; Population health; Survey administration; Survey methodology

Indexed keywords

ARTICLE; HEALTH; HEALTH STATUS; HEALTH SURVEY; HUMAN; INTERVIEW; METHODOLOGY; PRIORITY JOURNAL; PROBLEM SOLVING; QUESTIONNAIRE;

HEALTH STATUS; HEALTH SURVEYS; HUMANS; INTERVIEWS; OBSERVER VARIATION; ONTARIO; PAIN MEASUREMENT; QUESTIONNAIRES; REPRODUCIBILITY OF RESULTS;

EID: 0030934456     PISSN: 08954356     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0895-4356(96)00314-9     Document Type: Article

References (32)

1. Davidson R, MacKinnon JG. Estimation and Inference in Econometrics. New York: Oxford University Press; 1993.
2. Cartwright A. The effect of obtaining information from different informants on a family morbidity inquiry. Appl Stat 1957; 6: 18-25.
3. Herjanic B, Reich W. Development of a structured psychiatric interview for children: Agreement between child and parent on individual symptoms. J Ab Child Psych 1982; 10: 307-324.
4. Magaziner J, Simonsick EM, Kashner TM, Hebel JR. Patient-proxy response comparability on measures of patient health status and functional status. J Clin Epidemiol 1988; 41: 1065-1074.
5. Cannell CF, Marquis KH, Laurent A. A Summary of Research Studies of Interviewing Methodology, 1959-1970. Washington, D.C.: U.S. Government Printing Office; 1977.
6. Clarridge BR, Massagli MP. The use of female spouse proxies in common symptom reporting. Med Care 1989; 27: 352-366.
7. Epstein AM, Hall JA, Tognetti J, Son LH, Conant L. Using proxies to evaluate quality of life. Can they provide valid information about patients' health status and satisfaction with medical care? Med Care 1989; 27, supplement: S91-S98.
8. Bassett SS, Magaziner J, Hebel JR. Reliability of proxy response on mental health indices for aged, community-dwelling women. Psych Aging 1990; 5: 127-132.
9. Anderson JP, Bush JW, Berry CC. Classifying function for health outcome and quality-of-life evaluation: Self versus interviewer models. Med Care 1986; 24: 454-469.
10. McHorney CA, Kosinski M, Ware Jr JE. Comparisons of the costs and quality of norms for the SF-36 health survey collected by mail versus telephone interview: Results from a national survey. Med Care 1994; 32: 551-567.
11. Anderson JP, Bush JW, Berry CC. Internal consistency analysis: A method for studying the accuracy of function assessment for health outcome and quality of life evaluation. J Clin Epidemiol 1988; 41: 127-137.
12. Hochstim JR. A critical comparison of three strategies of collecting data from households. J Am Stat Assoc 1967; 62: 976-983.
13. Siemiatycki J. A comparison of mail, telephone and home interview strategies for household health surveys. Am J Public Health 1979; 69: 238-245.
14. Chambers LW, Haight M, Norman G, MacDonald L. Sensitivity to change and the effect of mode of administration on health status measurement. Med Care 1987; 25: 470-480.
15. Siemiatycki J, Campbell S. Nonresponse bias and early versus all responders in mail and telephone surveys. Am J Epidemiol 1984; 120: 291-301.
16. Cannell CC, Groves RM, Miller PV. The effects of mode of data collection on health survey data. J Am Stat Assoc Proc Section Soc Stat 1981; 1.
17. Siemiatycki J, Campbell S, Richardson L, Aubert D. Quality of response in different population groups in mail and telephone surveys. Am J Epidemiol 1984; 120: 302-314.
18. Rose G, McCartney P, Reid DD. Self-administration of a questionnaire on chest pain and intermittent claudication. Br J Preventiv Soc Med 1977; 31: 42-48.
19. Aquilono WS, Lo Sciuto LA. Effects of interview mode on self-reported drug use. Pub Opin Quart 1990; 54: 362-381.
20. Dillman DA, Tarnai J. Mode effects of cognitively designed recall questions: A comparison of answers to telephone and mail surveys. In: Biemer RP, Groves RM, Lyberg LE, et al., Eds. Measurement Error in Surveys. New York: John Wiley & Sons; 1991: 73-91.
21. Ware J Jr. Data Collection Models. Medical Outcomes Trust Bulletin 1995; 2: 2.
22. Ontario Health Survey, 1990, User's Guide. Vol 1: Documentation. Toronto, Ontario: Ontario Ministry of Health; 1991.
23. Feeny DH, Torrance GW, Goldsmith CH, Furlong W, Boyle M. A multi-attribute approach to population health status. In: Proceedings of the 153rd Annual Meeting of the American Statistical Association. Alexandria, VA: American Statistical Association; 1994: 161-166.
24. Feeny DH, Furlong W, Boyle M, Torrance GW. Multi-attribute preference health status classification systems: Health Utilities Index. Pharmacoeconomics 1995; 7: 490-502.
25. Torrance GW, Furlong W, Feeny D, Boyle M. Multi-attribute preference functions: Health Utilities Index. Pharmacoeconomics 1995; 7: 503-520.
26. Feeny DH, Torrance GW, Furlong W. Health Utilities Index. In: Spilker B, Ed. Quality of Life and Pharmacoeconomics in Clinical Trials. Second Edition. Philadelphia: Lippincott-Raven Press; 1996: 239-252.
27. Cohen J. A coefficient of agreement for nominal scales. Educational and Psychological Measurement 1960; 20: 37-46.
28. Cohen J. Weighted kappa: nominal scale agreement with provision for scaled disagreement or partial credit. Psych Bull 1968; 70: 213-220.
29. Grootendorst PV, Feeny D, Furlong W. Does it matter whom and how you ask? A technical report on inter- and intra-rater agreement in the Ontario Health Survey. McMaster University Centre for Health Economics and Policy Analysis Working Paper 94-12; 1994.
30. Boyle MH, Furlong W, Feeny D, Torrance GW, Hatcher J. Reliability of the Health Utilities Index - Mark III used in the 1991 Cycle 6 Canadian General Social Survey health questionnaire. Quality of Life Research 1995; 4: 249-257.
31. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics 1977; 33: 159-174.
32. Streiner DL, Norman GR. Health Measurement Scales: A Practical Guide to Their Development and Use. Oxford: Oxford University Press; 1989.