Stochastic curtailment of health questionnaires: A method to reduce respondent burden

Statistics in Medicine

Volumn 30, Issue 16, 2011, Pages 1989-2004

  Finkelman, Matthew D ^a   He, Yulei ^b   Kim, Wonsuk ^c   Lai, Albert M ^d  

^a TUFTS UNIVERSITY SCHOOL OF DENTAL MEDICINE   (United States)

^b HARVARD MEDICAL SCHOOL   (United States)

^c Measured Progress   (United States)

^d OHIO STATE UNIVERSITY   (United States)

Author keywords

Conditional power; Interim analysis; Respondent burden; Stochastic curtailment

Indexed keywords

ACCURACY; ANALYTICAL PARAMETERS; ARTICLE; CLASSIFICATION; COHORT ANALYSIS; COMPUTER SYSTEM; DATA ANALYSIS; HEALTH SURVEY; HUMAN; LOGISTIC REGRESSION ANALYSIS; MEDICARE; NON INSULIN DEPENDENT DIABETES MELLITUS; OUTCOME ASSESSMENT; QUESTIONNAIRE; RESPONDENT BURDEN; SEQUENTIAL ANALYSIS; SIMULATION; STOCHASTIC CURTAILMENT;

AGED; BIOSTATISTICS; CLINICAL TRIALS AS TOPIC; DATA INTERPRETATION, STATISTICAL; FEMALE; HEALTH SURVEYS; HUMANS; MALE; MEDICARE; QUESTIONNAIRES; STOCHASTIC PROCESSES; UNITED STATES;

EID: 79959205505     PISSN: 02776715     EISSN: 10970258     Source Type: Journal    
DOI: 10.1002/sim.4231     Document Type: Article

References (62)

1. Wald A. Sequential Analysis. Wiley: New York, 1947.
2. Armitage P. Sequential Medical Trials (2nd edn). Wiley: New York, 1975.
3. O'Brien PC, Fleming TR. A multiple testing procedure for clinical trials. Biometrics 1979; 35(3):549-556.
4. Pocock SJ. Group sequential methods in the design and analysis of clinical trials. Biometrika 1977; 64(2):191-199. DOI:10.1093/biomet/64.2.191.
5. Jennison C, Turnbull BW. Group Sequential Methods with Applications to Clinical Trials. Chapman & Hall/CRC: Boca Raton, FL, 2000.
6. Lan KKG, Simon R, Halperin M. Stochastically curtailed tests in long-term clinical trials. Communications in Statistics-Sequential Analysis 1982; 1(3):207-219. DOI: 10.1080/07474948208836014.
7. Davis BR, Hardy RJ. Data monitoring in clinical trials: the case for stochastic curtailment. Journal of Clinical Epidemiology 1994; 47(9):1033-1042. DOI: 10.1016/0895-4356(94)90119-8.
8. Leung DH-Y, Wang Y-G, Amar D. Early stopping by using stochastic curtailment in a three-arm sequential trial. Applied Statistics 2003; 52(2):139-152. DOI: 10.1111/1467-9876.00394.
9. Lin DY, Yao Q, Ying Z. A general theory on stochastic curtailment for censored survival data. Journal of the American Statistical Association 1999; 94(446):510-521.
10. McMahon RP, Waclawiw MA, Geller NL, Barton FB, Terrin ML, Bonds DR. An extension of stochastic curtailment for incompletely reported and classified recurrent events: the Multicenter Study of Hydroxyurea in Sickle Cell Anemia (MSH). Controlled Clinical Trials 1997; 18:420-430. DOI: 10.1016/S0197-2456(97)00014-7.
11. Snapinn S, Chen M-G, Jiang Q, Koutsoukos T. Assessment of futility in clinical trials. Pharmaceutical Statistics 2006; 5:273-281. DOI: 10.1002/pst.216.
12. Siegmund D. Sequential Analysis: Tests and Confidence Intervals. Springer: New York, 1985.
13. Eisenberg B, Simons G. On weak admissibility of tests. The Annals of Statistics 1978; 6(2):319-332. DOI:10.1214/aos/1176344127.
14. Eisenberg B, Ghosh BK. Curtailed and uniformly most powerful sequential tests. The Annals of Statistics 1980; 8(5):1123-1131. DOI:10.1214/aos/1176345149.
15. Jennison C, Turnbull BW. Statistical approaches to interim monitoring of medical trials: a review and commentary. Statistical Science 1990; 5(3):299-317. DOI: 10.1214/ss/1177012099.
16. Pepe MS, Anderson GL. Two-stage experimental designs: early stopping with a negative result. Journal of the Royal Statistical Society, Series C 1992; 41(1):181-190.
17. Herson J. Predictive probability early termination plans for Phase II clinical trials. Biometrics 1979; 35(4):775-783.
18. Spiegelhalter D, Freedman L, Blackburn P. Monitoring clinical trials: conditional or predictive power? Controlled Clinical Trials 1986; 7(1):8-17. DOI:10.1016/0197-2456(86)90003-6.
19. 0 based on conditional power: approximations and comparisons. Biometrics 1997; 53(3):794-806.
20. Thompson NA. A practitioner's guide for variable-length computerized classification testing. Practical Assessment Research & Evaluation 2007; 12(1). Available from.
21. Finkelman M. On using stochastic curtailment to shorten the SPRT in sequential mastery testing. Journal of Educational and Behavioral Statistics 2008; 33(4):442-463. DOI: 10.3102/1076998607308573.
22. Finkelman M. Variations on stochastic curtailment in sequential mastery testing. Applied Psychological Measurement 2010; 34(1):27-45. DOI: 10.1177/0146621609336113.
23. Placencia M, Sander JWAS, Shorvon SD, Ellison RH, Cascante SM. Validation of a screening questionnaire for the detection of epileptic seizures in epidemiological studies. Brain 1992; 115(3):783-794. DOI:10.1093/brain/115.3.783.
24. Ruige JB, de Neeling JN, Kostense PJ, Bouter LM, Heine RJ. Performance of an NIDDM screening questionnaire based on symptoms and risk factors. Diabetes Care 1997; 20(4):491-496. DOI: 10.2337/diacare.20.4.491.
25. Chung F, Yegneswaran B, Liao P, Chung SA, Valravanathan S, Islam S, Khajehdehi A, Shapiro CM. STOP Questionnaire: a tool to screen patients for obstructive sleep apnea. Anesthesiology 2008; 108(5):812-821. DOI: 10.1097/ALN.0b013e31816d83e4.
26. Haffer SC, Bowen SE. Measuring and improving health outcomes in Medicare: the Medicare HOS program. Health Care Financing Review 2004; 25(4):1-3.
27. Rogers WH, Gandek B, Sinclair SJ. Calculating Medicare Health Outcomes Survey performance measurement results. Technical Report. Available from: (retrieved April 6 2010). February 2004.
28. Scientific Advisory Committee of the Medical Outcomes Trust. Assessing health status and quality-of-life instruments: attributes and review criteria. Quality of Life Research 2002; 11(3):193-205. DOI: 10.1023/A:1015291021312.
29. Adams LM, Gale D. Solving the quandary between questionnaire length and response rate in educational research. Research in Higher Education 1982; 17(3):231-240. DOI: 10.1007/BF00976700.
30. Herzog AR, Bachman JG. Effects of questionnaire length on response quality. Public Opinion Quarterly 1980; 45(4):549-559.
31. ©). Journal of Clinical Epidemiology 2002; 55(2):164-175.
32. Raghunathan TE, Grizzle JE. A split questionnaire survey design. Journal of the American Statistical Association 1995; 90(429):54-63.
33. Barndorff-Nielsen OE, Cox DR. Asymptotic Techniques for Use in Statistics. Chapman & Hall: London, 1989.
34. Cooper JK, Kohlmann T, Michael JA, Haffer SC, Stevic M. Health outcomes. New quality measure for Medicare. International Journal for Quality in Health Care 2001; 13(1):9-16. DOI: 10.1093/intqhc/13.1.9.
35. Baker F, Haffer SC, Denniston M. Health-related quality of life of cancer and noncancer patients in Medicare managed care. Cancer 2003; 97(3):674-681. DOI: 10.1002/cncr.11085.
36. Kuo YF, Raji MA, Peek MK, Goodwin JS. Health-related social disengagement in elderly diabetic patients: association with subsequent disability and survival. Diabetes Care 2004; 27(7):1630-1637. DOI: 10.2337/diacare.27.7.1630.
37. Little RJA, Rubin DB. Statistical Analysis with Missing Data (2nd edn). Wiley: Hoboken, NJ, 2002.
38. Raghunathan T, Lepkowski JM, Van Hoewyk J, Solenberger PW. A sequential regression imputation for survey data. Survey Methodology 2001; 27(2):85-96.
39. van Buuren S, Boshuizen HC, Knook DL. Multiple imputation of missing blood pressure covariates in survival analysis. Statistics in Medicine 1999; 18(6):681-694. DOI: 10.1002/(SICI)1097-0258(19990330)18:6 <681::AID-SIM71 >3.0.CO;2-R.
40. Schenker N, Raghunathan TE, Chiu PL, Makuc DM, Zhang G, Cohen AJ. Multiple imputation for missing income data in the National Health Interview Survey. Journal of the American Statistical Association 2006; 101(475):924-933. DOI: 10.1198/016214505000001375.
41. He Y, Zaslavsky AM, Harrington DP, Catalano P, Landrum MB. Multiple imputation in a large-scale complex survey: a practical guide. Statistical Methods in Medical Research 2010; in press.
42. Hosmer DW, Lemeshow S. Applied Logistic Regression. Wiley: New York, 1989.
43. van der Linden WJ, Glas CA. Computerized Adaptive Testing: Theory and Practice. Kluwer Academic Publisher: Enschede, The Netherlands, 2000.
44. Wainer H. Computerized Adaptive Testing: A Primer. Erlbaum: Mahwah, NJ, 1990.
45. Weiss DJ. New Horizons in Testing: Latent Trait Test Theory and Computerized Adaptive Testing. Academic Press: New York, 1983.
46. Moreno KE, Wetzel CD, McBride JR, Weiss DJ. Relationship between corresponding Armed Services Vocational Aptitude Battery and computerized adaptive testing subtests. Applied Psychological Measurement 1984; 8(2):155-163. DOI: 10.1177/014662168400800203.
47. Weiss DJ. Improving measurement quality and efficiency with adaptive testing. Applied Psychological Measurement 1982; 6(4):473-492. DOI: 10.1177/014662168200600408.
48. Gibbons RD, Weiss DJ, Kupfer DJ, Frank E, Fagiolini A, Grochocinski VJ, Bhaumik DK, Stover A, Bock RD, Immekus JC. Using computerized adaptive testing to reduce the burden of mental health assessment. Psychiatric Services 2008; 59(4):361-368. DOI: 10.1176/appi.ps.59.4.361.
49. Eggen TJHM. Item selection in adaptive testing with the sequential probability ratio test. Applied Psychological Measurement 1999; 23(3):249-261. DOI: 10.1177/01466219922031365.
50. Thompson NA. Item selection in computerized classification testing. Educational and Psychological Measurement 2009; 69(5):778-793. DOI: DOI: 10.1177/0013164408324460.
51. Ader DN. Developing the Patient-reported Outcomes Measurement Information System (PROMIS). Medical Care 2007; 45(Suppl 1):S1-S2. DOI: 10.1097/01.mlr.0000260537.45076.74.
52. Cella D, Yount S, Rothrock N, Gershon R, Cook K, Reeve B et al.The Patient-reported Outcomes Measurement Information System (PROMIS): progress of an NIH roadmap cooperative group during its first two years. Medical Care 2007; 45(Suppl 1):S3-S11. DOI: 10.1097/01.mlr.0000258615.42478.55.
53. Reeve BB, Hays RD, Bjorner JB, Cook KF, Crane PK, Teresi JA, Thissen D, Revicki DA, Weiss DJ, Hambleton RK, Liu H, Gershon R, Reise SP, Lai J-S, Cella D. on behalf of the PROMIS Cooperative Group. Psychometric evaluation and calibration of health-related quality of life item banks: Plans for the Patient-Reported Outcomes Measurement Information System (PROMIS). Medical Care 2007; 45(Suppl 1):S22-S31. DOI: 10.1097/01.mlr.0000250483.85507.04.
54. Choi SW, Reise SP, Pilkonis PA, Hays RD, Cella D. Efficiency of static and computer adaptive short forms compared to full-length measures of depressive symptoms. Quality of Life Research 2010; 19(1):125-136. DOI: 10.1007/s11136-009-9560-5.
55. Fries JF, Cella D, Rose M, Krishnan E, Bruce B. Progress in assessing physical function in arthritis: PROMIS short forms and computerized adaptive testing. Journal of Rheumatology 2009; 36(9):2061-2066. DOI: 10.3899/jrheum.090358.
56. Bjorner J, Chang CH, Thissen D, Reeve BB. Developing tailored instruments: item banking and computerized adaptive assessment. Quality of Life Research 2007; 16(Suppl 1):S95-S108. DOI: 10.1007/s11136-007-9168-6.
57. Cella D, Gershon R, Lai JS, Choi SW. The future of outcomes measurement: item banking, tailored short-forms, and computerized adaptive assessment. Quality of Life Research 2007; 16(Suppl 1):S133-S141. DOI: 10.1007/s11136-007-9204-6.
58. Chakravarty EF, Bjorner JB, Fries JF. Improving patient reported outcomes using item response theory and computerized adaptive testing. Journal of Rheumatology 2007; 34(6):1426-1431.
59. Cook KF, Choi SW, Crane PK, Deyo RA, Johnson KL, Amtmann D. Letting the CAT out of the bag: Comparing computer adaptive tests and an 11-item short form of the Roland-Morris Disability Questionnaire. Spine 2008; 33(12):1378-1383. DOI: 10.1097/BRS.0b013e3181732acb.
60. Thissen D, Reeve BB, Bjorner JB, Chang CH. Methodological issues for building item banks and computerized adaptive scales. Quality of Life Research 2007; 16(Suppl 1):109-119. DOI: 10.1007/s11136-007-9169-5.
61. Spray JA, Reckase MD. The selection of test items for decision making with a computer adaptive test. Paper presented at the Annual Meeting of the National Council on Measurement in Education, New Orleans, LA, 1994.
62. Agresti A. An Introduction to Categorical Data Analysis. Wiley: New York, 1996.