Web-based assessments of physical activity in youth: Considerations for design and scale calibration

Journal of Medical Internet Research

Volumn 16, Issue 12, 2014, Pages

  Saint Maurice, Pedro F ^a,b   Welk, Gregory J ^a  

^a IOWA STATE UNIVERSITY   (United States)

^b UNIVERSITY OF MINHO   (Portugal)

Author keywords

Measurement; Questionnaire; Youth Activity Profile

Indexed keywords

ADOLESCENT; CALIBRATION; FEMALE; HUMAN; INFORMATION PROCESSING; INTERNET; MALE; METHODOLOGY; MOTOR ACTIVITY; PHYSIOLOGY; QUESTIONNAIRE;

ADOLESCENT; CALIBRATION; DATA COLLECTION; FEMALE; HUMANS; INTERNET; MALE; MOTOR ACTIVITY; RESEARCH DESIGN; SURVEYS AND QUESTIONNAIRES;

EID: 84918575167     PISSN: None     EISSN: 14388871     Source Type: Journal    
DOI: 10.2196/jmir.3626     Document Type: Article

References (84)

1. Corder K, Ekelund U, Steele RM, Wareham NJ, Brage S. Assessment of physical activity in youth. J Appl Physiol (1985) 2008 Sep; 105(3):977-987 [FREE Full text] [doi: 10.1152/japplphysiol.00094.2008] [Medline: 18635884]
2. Rowlands Av. Accelerometer assessment of physical activity in children: an update. Pediatr Exerc Sci 2007 Aug; 19(3):252-266. [Medline: 18019585]
3. Bauman A, Phongsavan P, Schoeppe S, Owen N. Physical activity measurement-a primer for health promotion. Promot Educ 2006;13(2):92-103. [Medline: 17017286]
4. Troiano RP. A timely meeting: objective measurement of physical activity. Med Sci Sports Exerc 2005 Nov; 37 (11 Suppl):S487-S489. [Medline: 16294111]
5. Trost SG, Ward DS, Moorehead SM, Watson PD, Riner W, Burke JR. Validity of the computer science and applications (CSA) activity monitor in children. Med Sci Sports Exerc 1998 Apr; 30(4):629-633. [Medline: 9565947]
6. Eston RG, Rowlands AV, Ingledew DK. Validity of heart rate, pedometry, and accelerometry for predicting the energy cost of children's activities. J Appl Physiol (1985) 1998 Jan; 84(1):362-371 [FREE Full text] [Medline: 9451658]
7. Puyau MR, Adolph AL, Vohra FA, Butte NF. Validation and calibration of physical activity monitors in children. Obes Res 2002 Mar; 10(3):150-157. [doi: 10.1038/oby.2002.24] [Medline: 11886937]
8. Ekelund U, Sjöström M, Yngve A, Poortvliet E, Nilsson A, Froberg K, et al. Physical activity assessed by activity monitor and doubly labeled water in children. Med Sci Sports Exerc 2001 Feb; 33(2):275-281. [Medline: 11224818]
9. Treuth MS, Schmitz K, Catellier DJ, McMurray RG, Murray DM, Almeida MJ, et al. Defining accelerometer thresholds for activity intensities in adolescent girls. Med Sci Sports Exerc 2004 Jul; 36(7):1259-1266 [FREE Full text] [Medline: 15235335]
10. Mattocks C, Leary S, Ness A, Deere K, Saunders J, Tilling K, et al. Calibration of an accelerometer during free-living activities in children. Int J Pediatr Obes 2007;2(4):218-226. [doi: 10.1080/17477160701408809] [Medline: 17852552]
11. Schmitz KH, Treuth M, Hannan P, McMurray R, Ring KB, Catellier D, et al. Predicting energy expenditure from accelerometry counts in adolescent girls. Med Sci Sports Exerc 2005 Jan; 37(1):155-161 [FREE Full text] [Medline: 15632682]
12. Bowles HR. Measurement of active and sedentary behaviors: closing the gaps in self-report methods. J Phys Act Health 2012 Jan; 9 Suppl 1:S1-S4. [Medline: 22287442]
13. Troiano RP, Pettee Gabriel KK, Welk GJ, Owen N, Sternfeld B. Reported physical activity and sedentary behavior: why do you ask? J Phys Act Health 2012 Jan; 9 Suppl 1:S68-S75. [Medline: 22287450]
14. Spook JE, Paulussen T, Kok G, Van Empelen P. Monitoring dietary intake and physical activity electronically: feasibility, usability, and ecological validity of a mobile-based Ecological Momentary Assessment tool. J Med Internet Res 2013;15(9):e214 [FREE Full text] [doi: 10.2196/jmir.2617] [Medline: 24067298]
15. Riebl SK, Paone AC, Hedrick VE, Zoellner JM, Estabrooks PA, Davy BM. The comparative validity of interactive multimedia questionnaires to paper-administered questionnaires for beverage intake and physical activity: pilot study. JMIR Res Protoc 2013;2(2):e40 [FREE Full text] [doi: 10.2196/resprot.2830] [Medline: 24148226]
16. Da Costa FF, Schmoelz CP, Davies VF, Di Pietro PF, Kupek E, De Assis MA. Assessment of diet and physical activity of brazilian schoolchildren: usability testing of a web-based questionnaire. JMIR Res Protoc 2013;2(2):e31 [FREE Full text] [doi: 10.2196/resprot.2646] [Medline: 23958804]
17. Pearce PF, Williamson J, Harrell JS, Wildemuth BM, Solomon P. The children's computerized physical activity reporter: children as partners in the design and usability evaluation of an application for self-reporting physical activity. Comput Inform Nurs 2007;25(2):93-105. [doi: 10.1097/01. NCN.0000263979.54048.85] [Medline: 17356331]
18. Calabro MA, Welk GJ, Carriquiry AL, Nusser SM, Beyler NK, Mathews CE. Validation of a computerized 24-hour physical activity recall (24PAR) instrument with pattern-recognition activity monitors. J Phys Act Health 2009 Mar; 6(2):211-220. [Medline: 19420399]
19. Namba H, Yamaguchi Y, Yamada Y, Tokushima S, Hatamoto Y, Sagayama H, et al. Validation of Web-based physical activity measurement systems using doubly labeled water. J Med Internet Res 2012;14(5):e123 [FREE Full text] [doi: 10.2196/jmir.2253] [Medline: 23010345]
20. Pfaeffli L, Maddison R, Jiang Y, Dalleck L, Löf M. Measuring physical activity in a cardiac rehabilitation population using a smartphone-based questionnaire. J Med Internet Res 2013;15(3):e61 [FREE Full text] [doi: 10.2196/jmir.2419] [Medline: 23524251]
21. Kipnis V, Carroll RJ, Freedman LS, Li L. Implications of a new dietary measurement error model for estimation of relative risk: application to four calibration studies. Am J Epidemiol 1999 Sep. 15; 150(6):642-651 [FREE Full text] [Medline: 10490004]
22. Nusser SM, Beyler NK, Welk GJ, Carriquiry AL, Fuller WA, King B. Modeling errors in physical activity recall data. J Phys Act Health 2012 Jan; 9 Suppl 1:S56-S67. [Medline: 22287449]
23. Nusser SM, Carriquiry AL, Dodd KW, Fuller WA. A semiparametric transformation approach to estimating usual daily intake distributions. Journal of the American Statistical Association 1996;91:1440-1449.
24. Tooze JA, Troiano RP, Carroll RJ, Moshfegh AJ, Freedman LS. A measurement error model for physical activity level as measured by a questionnaire with application to the 1999-2006 NHANES questionnaire. Am J Epidemiol 2013 Jun. 1; 177(11):1199-1208 [FREE Full text] [doi: 10.1093/aje/kws379] [Medline: 23595007]
25. Neuhouser ML, Di C, Tinker LF, Thomson C, Sternfeld B, Mossavar-Rahmani Y, et al. Physical activity assessment: biomarkers and self-report of activity-related energy expenditure in the WHI. Am J Epidemiol 2013 Mar. 15; 177(6):576-585 [FREE Full text] [doi: 10.1093/aje/kws269] [Medline: 23436896]
26. Crocker PR, Bailey DA, Faulkner RA, Kowalski KC, McGrath R. Measuring general levels of physical activity: preliminary evidence for the Physical Activity Questionnaire for Older Children. Med Sci Sports Exerc 1997 Oct; 29(10):1344-1349. [Medline: 9346166]
27. Kowalski K, Crocker P, Faulkner RA. Validation of the Physical Activity Questionnaire for Older Children. Pediatr Exerc Sci 1997;9:174-186.
28. Kowalski C, Crocker P, Kowalski NP. Convergent validity of the physical activity questionnaire for adolescents. Pediatr Exerc Sci 1997;9:342-352.
29. Bailey DA. The Saskatchewan Pediatric Bone Mineral Accrual Study: bone mineral acquisition during the growing years. Int J Sports Med 1997 Jul; 18 Suppl 3:S191-S194. [doi: 10.1055/s-2007-972713] [Medline: 9272847]
30. Crocker PR, Eklund RC, Kowalski KC. Children's physical activity and physical self-perceptions. J Sports Sci 2000 Jun; 18(6):383-394. [doi: 10.1080/02640410050074313] [Medline: 10902673]
31. Moore JB, Hanes JC, Barbeau P, Gutin B, Treviño RP, Yin Z. Validation of the Physical Activity Questionnaire for Older Children in children of different races. Pediatr Exerc Sci 2007 Feb; 19(1):6-19. [Medline: 17554153]
32. Janz KF, Lutuchy EM, Wenthe P, Levy SM. Measuring activity in children and adolescents using self-report: PAQ-C and PAQ-A. Med Sci Sports Exerc 2008 Apr; 40(4):767-772. [doi: 10.1249/MSS.0b013e3181620ed1] [Medline: 18317366]
33. Martínez-Gómez D, Martínez-de-Haro V, Pozo T, Welk GJ, Villagra A, Calle ME, et al. Reliability and validity of the PAQ-A questionnaire to assess physical activity in Spanish adolescents. Revista Espanola de Salud Publica 2009;83:427-439.
34. Carroll R, Ruppert D, Stefanski L, Crainiceanu C. Regression calibration. In: Measurement Error in Nonlinear Models: A Modern Perspective 2nd edition. Boca Raton, FL: Taylor and Francis Group; 2006:65-95.
35. Cradock AL, Barrett JL, Carter J, McHugh A, Sproul J, Russo ET, et al. Impact of the Boston Active School Day policy to promote physical activity among children. Am J Health Promot 2014;28 (3 Suppl):S54-S64. [doi: 10.4278/ajhp. 130430-QUAN-204] [Medline: 24380467]
36. Mendoza JA, Watson K, Nguyen N, Cerin E, Baranowski T, Nicklas TA. Active commuting to school and association with physical activity and adiposity among US youth. J Phys Act Health 2011 May; 8(4):488-495 [FREE Full text] [Medline: 21597121]
37. Ruch N, Joss F, Jimmy G, Melzer K, Hänggi J, Mäder U. Neural network versus activity-specific prediction equations for energy expenditure estimation in children. J Appl Physiol (1985) 2013 Nov. 1; 115(9):1229-1236 [FREE Full text] [doi: 10.1152/japplphysiol.01443.2012] [Medline: 23990244]
38. Pober DM, Staudenmayer J, Raphael C, Freedson PS. Development of novel techniques to classify physical activity mode using accelerometers. Med Sci Sports Exerc 2006 Sep; 38(9):1626-1634. [doi: 10.1249/01.mss.0000227542.43669.45] [Medline: 16960524]
39. Choi L, Liu Z, Matthews CE, Buchowski MS. Validation of accelerometer wear and nonwear time classification algorithm. Med Sci Sports Exerc 2011 Feb; 43(2):357-364 [FREE Full text] [doi: 10.1249/MSS.0b013e3181ed61a3] [Medline: 20581716]
40. Lee IM, Shiroma EJ. Using accelerometers to measure physical activity in large-scale epidemiological studies: issues and challenges. Br J Sports Med 2014 Feb; 48(3):197-201. [doi: 10.1136/bjsports-2013-093154] [Medline: 24297837]
41. Arvidsson D, Slinde F, Larsson S, Hulthén L. Energy cost of physical activities in children: validation of SenseWear Armband. Med Sci Sports Exerc 2007 Nov; 39(11):2076-2084. [doi: 10.1249/mss.0b013e31814fb439] [Medline: 17986918]
42. Jakicic JM, Marcus M, Gallagher KI, Randall C, Thomas E, Goss FL, et al. Evaluation of the SenseWear Pro Armband to assess energy expenditure during exercise. Med Sci Sports Exerc 2004 May; 36(5):897-904. [Medline: 15126727]
43. Bassett DR, Rowlands A, Trost SG. Calibration and validation of wearable monitors. Med Sci Sports Exerc 2012 Jan; 44 (1 Suppl 1):S32-S38 [FREE Full text] [doi: 10.1249/MSS.0b013e3182399cf7] [Medline: 22157772]
44. Welk GJ. Principles of design and analyses for the calibration of accelerometry-based activity monitors. Med Sci Sports Exerc 2005 Nov; 37 (11 Suppl):S501-S511. [Medline: 16294113]
45. Gracia-Marco L, Ortega FB, Ruiz JR, Williams CA, Hagströmer M, Manios Y, Helena Study Group. Seasonal variation in physical activity and sedentary time in different European regions. The HELENA study. J Sports Sci 2013;31(16):1831-1840. [doi: 10.1080/02640414.2013.803595] [Medline: 24050788]
46. Whitlock G, Clark T, Vander Hoorn S, Rodgers A, Jackson R, Norton R, et al. Random errors in the measurement of 10 cardiovascular risk factors. Eur J Epidemiol 2001;17(10):907-909. [Medline: 12188008]
47. Carroll RJ, Ruppert D, Stefanski LA, Crainiceanu CM. Linear regression and atenuation. In: Measurement Error in Nonlinear Models: A Modern Perspective. Volume 2. Boca Raton, FL: Chapman & Hall/CRC; 2006:41-64.
48. Ferrari P, Friedenreich C, Matthews CE. The role of measurement error in estimating levels of physical activity. Am J Epidemiol 2007 Oct. 1; 166(7):832-840 [FREE Full text] [doi: 10.1093/aje/kwm148] [Medline: 17670910]
49. Harrell JS, McMurray RG, Baggett CD, Pennell ML, Pearce PF, Bangdiwala SI. Energy costs of physical activities in children and adolescents. Med Sci Sports Exerc 2005 Feb; 37(2):329-336. [Medline: 15692331]
50. Ridley K, Olds TS. Assigning energy costs to activities in children: a review and synthesis. Med Sci Sports Exerc 2008 Aug; 40(8):1439-1446. [doi: 10.1249/MSS.0b013e31817279ef] [Medline: 18614948]
51. Esliger DW, Copeland JL, Barnes JD, Tremblay MS. Standardizing and optimizing the use of accelerometer data for free-living physical activity monitoring. J Phys Act Health 2005;3:366-383.
52. De Meester F, De Bourdeaudhuij I, Deforche B, Ottevaere C, Cardon G. Measuring physical activity using accelerometry in 13-15-year-old adolescents: the importance of including non-wear activities. Public Health Nutr 2011 Dec; 14(12):2124-2133. [doi: 10.1017/S1368980011001868] [Medline: 21835080]
53. Ottevaere C, Huybrechts I, De Meester F, De Bourdeaudhuij I, Cuenca-Garcia M, De Henauw S. The use of accelerometry in adolescents and its implementation with non-wear time activity diaries in free-living conditions. J Sports Sci 2011 Jan; 29(1):103-113. [doi: 10.1080/02640414.2010.521169] [Medline: 21104522]
54. Mâsse LC, Fuemmeler BF, Anderson CB, Matthews CE, Trost SG, Catellier DJ, et al. Accelerometer data reduction: a comparison of four reduction algorithms on select outcome variables. Med Sci Sports Exerc 2005 Nov; 37 (11 Suppl):S544-S554. [Medline: 16294117]
55. Toftager M, Kristensen PL, Oliver M, Duncan S, Christiansen LB, Boyle E, et al. Accelerometer data reduction in adolescents: effects on sample retention and bias. Int J Behav Nutr Phys Act 2013;10:140 [FREE Full text] [doi: 10.1186/1479-5868-10-140] [Medline: 24359480]
56. Hallal PC, Reichert FF, Clark VL, Cordeira KL, Menezes AM, Eaton S, et al. Energy expenditure compared to physical activity measured by accelerometry and self-report in adolescents: a validation study. PLoS One 2013;8(11):e77036 [FREE Full text] [doi: 10.1371/journal.pone.0077036] [Medline: 24223707]
57. Corder K, Van Sluijs EM, Wright A, Whincup P, Wareham NJ, Ekelund U. Is it possible to assess free-living physical activity and energy expenditure in young people by self-report? Am J Clin Nutr 2009 Mar; 89(3):862-870 [FREE Full text] [doi: 10.3945/ajcn. 2008.26739] [Medline: 19144732]
58. Saint-Maurice PF, Welk GJ, Beyler NK, Bartee RT, Heelan KA. Calibration of self-report tools for physical activity research: the Physical Activity Questionnaire (PAQ). BMC Public Health 2014;14:461 [FREE Full text] [doi: 10.1186/1471-2458-14-461] [Medline: 24886625]
59. Scholes S, Coombs N, Pedisic Z, Mindell JS, Bauman A, Rowlands AV, et al. Age- and sex-specific criterion validity of the health survey for England Physical Activity and Sedentary Behavior Assessment Questionnaire as compared with accelerometry. Am J Epidemiol 2014 Jun. 15; 179(12):1493-1502 [FREE Full text] [doi: 10.1093/aje/kwu087] [Medline: 24863551]
60. Wang C, Chen P, Zhuang J. Validity and reliability of International Physical Activity Questionnaire-Short Form in Chinese youth. Res Q Exerc Sport 2013 Dec; 84 Suppl 2:S80-S86. [doi: 10.1080/02701367.2013.850991] [Medline: 24527570]
61. Medina C, Barquera S, Janssen I. Validity and reliability of the International Physical Activity Questionnaire among adults in Mexico. Rev Panam Salud Publica 2013 Jul; 34(1):21-28 [FREE Full text] [Medline: 24006016]
62. Manios Y, Androutsos O, Moschonis G, Birbilis M, Maragkopoulou K, Giannopoulou A, et al. Criterion validity of the Physical Activity Questionnaire for Schoolchildren (PAQ-S) in assessing physical activity levels: the Healthy Growth Study. J Sports Med Phys Fitness 2013 Oct; 53(5):502-508. [Medline: 23903530]
63. Matthews CE, Keadle SK, Sampson J, Lyden K, Bowles HR, Moore SC, et al. Validation of a previous-day recall measure of active and sedentary behaviors. Med Sci Sports Exerc 2013 Aug; 45(8):1629-1638 [FREE Full text] [doi: 10.1249/MSS.0b013e3182897690] [Medline: 23863547]
64. Dyrstad SM, Hansen BH, Holme IM, Anderssen SA. Comparison of self-reported versus accelerometer-measured physical activity. Med Sci Sports Exerc 2014 Jan; 46(1):99-106. [doi: 10.1249/MSS.0b013e3182a0595f] [Medline: 23793232]
65. Walker E, Nowacki AS. Understanding equivalence and noninferiority testing. J Gen Intern Med 2011 Feb; 26(2):192-196 [FREE Full text] [doi: 10.1007/s11606-010-1513-8] [Medline: 20857339]
66. Robinson AP, Froese RE. Model validation using equivalence tests. Ecological Modelling 2004 Sep; 176(3-4):349-358. [doi: 10.1016/j.ecolmodel.2004.01.013]
67. Schuirmann DJ. A comparison of the two one-sided tests procedure and the power approach for assessing the equivalence of average bioavailability. J Pharmacokinet Biopharm 1987 Dec; 15(6):657-680. [Medline: 3450848]
68. Midha KK, McKay G. Bioequivalence; its history, practice, and future. AAPS J 2009 Dec; 11(4):664-670 [FREE Full text] [doi: 10.1208/s12248-009-9142-z] [Medline: 19806461]
69. Hall R, Hanna P. The impact of web page text-background colour combinations on readability, retention, aesthetics and behavioural intention. Behaviour & Information Technology 2004;23:183-195.
70. Gnambs T, Appel M, Batinic B. Color red in web-based knowledge testing. Computers in Human Behavior 2010;26:1625-1631.
71. Baranowski T, Thompson WO, Du Rant RH, Baranowski J, Puhl J. Observations on physical activity in physical locations: age, gender, ethnicity, and month effects. Res Q Exerc Sport 1993 Jun; 64(2):127-133. [doi: 10.1080/02701367.1993.10608789] [Medline: 8341835]
72. Tucker P, Gilliland J. The effect of season and weather on physical activity: a systematic review. Public Health 2007 Dec; 121(12):909-922. [doi: 10.1016/j.puhe.2007.04.009] [Medline: 17920646]
73. Welk GJ, Corbin CB, Dale D. Measurement issues in the assessment of physical activity in children. Res Q Exerc Sport 2000 Jun; 71 (2 Suppl):S59-S73. [Medline: 10925827]
74. Welk GJ, McClain J, Ainsworth BE. Protocols for evaluating equivalency of accelerometry-based activity monitors. Med Sci Sports Exerc 2012 Jan; 44 (1 Suppl 1):S39-S49. [doi: 10.1249/MSS.0b013e3182399d8f] [Medline: 22157773]
75. Welk GJ, Kim Y, Stanfill B, Osthus DA, Calabro MA, Nusser SM, et al. Validity of 24-h physical activity recall: physical activity measurement survey. Med Sci Sports Exerc 2014 Oct; 46(10):2014-2024. [doi: 10.1249/MSS.0000000000000314] [Medline: 24561818]
76. Tucker JM, Welk G, Nusser SM, Beyler NK, Dzewaltowski D. Estimating minutes of physical activity from the previous day physical activity recall: validation of a prediction equation. J Phys Act Health 2011 Jan; 8(1):71-78. [Medline: 21297187]
77. Osthus D, Beyler NK, Stanfill B, Nusser SM, Fuller WA, Carriquiry AL, et al. Estimating the distribution of usual daily energy expenditure for subpopulations from a probability sample. Statistics in Medicine 2014:1-16.
78. Hallal PC, Andersen LB, Bull FC, Guthold R, Haskell W, Ekelund U, Lancet Physical Activity Series Working Group. Global physical activity levels: surveillance progress, pitfalls, and prospects. Lancet 2012 Jul. 21; 380(9838):247-257. [doi: 10.1016/S0140-6736 (12) 60646-1] [Medline: 22818937]
79. Sousa VD, Rojjanasrirat W. Translation, adaptation and validation of instruments or scales for use in cross-cultural health care research: a clear and user-friendly guideline. J Eval Clin Pract 2011 Apr; 17(2):268-274. [doi: 10.1111/j.1365-2753.2010.01434.x] [Medline: 20874835]
80. Bull FC, Maslin TS, Armstrong T. Global physical activity questionnaire (GPAQ): nine country reliability and validity study. J Phys Act Health 2009 Nov; 6(6):790-804. [Medline: 20101923]
81. Tomioka K, Iwamoto J, Saeki K, Okamoto N. Reliability and validity of the International Physical Activity Questionnaire (IPAQ) in elderly adults: the Fujiwara-kyo Study. J Epidemiol 2011;21(6):459-465 [FREE Full text] [Medline: 21946625]
82. Dahl-Petersen IK, Hansen AW, Bjerregaard P, Jørgensen ME, Brage S. Validity of the international physical activity questionnaire in the arctic. Med Sci Sports Exerc 2013 Apr; 45(4):728-736. [doi: 10.1249/MSS.0b013e31827a6b40] [Medline: 23190587]
83. Lachat CK, Verstraeten R, Khanh Le NB, Hagströmer M, Khan NC, Van Ndo A, et al. Validity of two physical activity questionnaires (IPAQ and PAQA) for Vietnamese adolescents in rural and urban areas. Int J Behav Nutr Phys Act 2008;5:37 [FREE Full text] [doi: 10.1186/1479-5868-5-37] [Medline: 18616798]
84. De Vera MA, Ratzlaff C, Doerfling P, Kopec J. Reliability and validity of an internet-based questionnaire measuring lifetime physical activity. Am J Epidemiol 2010 Nov. 15; 172(10):1190-1198 [FREE Full text] [doi: 10.1093/aje/kwq273] [Medline: 20876666]