Examining the construct validity of affective judgments of physical activity measures

Psychological Assessment

Volumn 28, Issue 9, 2016, Pages 1128-1141

  Chmielewski, Michael ^a   Sala, Margarita ^a   Tang, Rui ^a   Baldwin, Austin ^a  

^a SOUTHERN METHODIST UNIVERSITY   (United States)

Author keywords

Affective judgments of physical activity; BREQ 2; Construct validity; MPAM R; PACES

Indexed keywords

CONSTRUCT VALIDITY; CONVERGENT VALIDITY; CRONBACH ALPHA COEFFICIENT; DECISION MAKING; DISCRIMINANT VALIDITY; EXERCISE; HEALTH BEHAVIOR; HUMAN; HUMAN EXPERIMENT; MEASUREMENT ERROR; PHYSICAL ACTIVITY; PSYCHOLOGY; SELF CONCEPT; STUDENT; THEORETICAL MODEL; ADULT; ATTITUDE TO HEALTH; FEMALE; MALE; MIDDLE AGED; PSYCHOLOGIC TEST; PSYCHOMETRY; REPRODUCIBILITY; SELF REPORT; VALIDATION STUDY;

ADULT; ATTITUDE TO HEALTH; EXERCISE; FEMALE; HEALTH BEHAVIOR; HUMANS; JUDGMENT; MALE; MIDDLE AGED; PSYCHOLOGICAL TESTS; PSYCHOMETRICS; REPRODUCIBILITY OF RESULTS; SELF EFFICACY; SELF REPORT;

EID: 84982295392     PISSN: 10403590     EISSN: 1939134X     Source Type: Journal    
DOI: 10.1037/pas0000322     Document Type: Article

References (71)

1. American Psychological Association. (Ed.). (2014). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.
2. Anastasi, A., & Urbina, S. (1997). Psychological testing (7th ed.). Upper Saddle River, NJ: Prentice Hall.
3. Baldwin, A. S., Baldwin, S. A., Loehr, V. G., Kangas, J. L., & Frierson, G. M. (2013). Elucidating satisfaction with physical activity: An examination of the day-to-day associations between experiences with physical activity and satisfaction during physical activity initiation. Psychology & Health, 28, 1424-1441. http://dx.doi.org/10.1080/08870446.2013.822078
4. Baldwin, A. S., Rothman, A. J., Hertel, A. W., Keenan, N. K., & Jeffery, R. W. (2009). Longitudinal associations between people's cessationrelated experiences and their satisfaction with cessation. Psychology & Health, 24, 187-201. http://dx.doi.org/10.1080/08870440701639377
5. Baldwin, A. S., Rothman, A. J., & Jeffery, R. W. (2009). Satisfaction with weight loss: Examining the longitudinal covariation between people's weight-loss-related outcomes and experiences and their satisfaction. Annals of Behavioral Medicine, 38, 213-224. http://dx.doi.org/10.1007/s12160-009-9148-x
6. Bryan, A. D., & Rocheleau, C. A. (2002). Predicting aerobic versus resistance exercise using the theory of planned behavior. American Journal of Health Behavior, 26, 83-94. http://dx.doi.org/10.5993/AJHB.26.2.1
7. Buhrmester, M., Kwang, T., & Gosling, S. D. (2011). Amazon's Mechanical Turk: A new source of inexpensive, yet high-quality, data? Perspectives on Psychological Science, 6, 3-5.
8. Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56, 81-105. http://dx.doi.org/10.1037/h0046016
9. Cash, T. F., Now, P. L., & Grant, J. R. (1994). Why do women exercise? Factor analysis and further validation of the Reasons for Exercise Inventory. Perceptual and Motor Skills, 78, 539-544. http://dx.doi.org/10.2466/pms.1994.78.2.539
10. Cattell, R. B., Eber, H. W., & Tatsuoka, M. M. (1970). Handbook for the sixteen personality factor questionnaire (16 PF): In clinical, educational, industrial, and research psychology, for use with all forms of the test. Savoy, IL: Institute for Personality and Ability Testing.
11. Center for Disease Control and Prevention. (2009). Behavioral risk factor surveillance system survey data. Atlanta, GA.
12. Center for Disease Control and Prevention. (2013). Behavioral risk factor surveillance system survey data. Atlanta, GA: U. S. Department of Health and Human Services.
13. Chen, G., Gully, S. M., & Eden, D. (2001). Validation of a new general self-efficacy scale. Organizational Research Methods, 4, 62-83. http://dx.doi.org/10.1177/109442810141004
14. Chmielewski, M., & Watson, D. (2009). What is being assessed and why it matters: The impact of transient error on trait research. Journal of Personality and Social Psychology, 97, 186-202. http://dx.doi.org/10.1037/a0015618
15. Clark, L. A., & Watson, D. (1995). Constructing validity: Basic issues in objective scale development. Psychological Assessment, 7, 309-319. http://dx.doi.org/10.1037/1040-3590.7.3.309
16. Conner, M., Rhodes, R. E., Morris, B., McEachan, R., & Lawton, R. (2011). Changing exercise through targeting affective or cognitive attitudes. Psychology & Health, 26, 133-149. http://dx.doi.org/10.1080/08870446.2011.531570
17. Cortina, J. M. (1993). What is coefficient alpha? An examination of theory and applications. Journal of Applied Psychology, 78, 98-104. http://dx.doi.org/10.1037/0021-9010.78.1.98
18. Courneya, K. S., Vallance, J. K., Jones, L. W., & Reiman, T. (2005). Correlates of exercise intentions in non-Hodgkin's lymphoma survivors: An application of the Theory of Planned Behavior. Journal of Sport & Exercise Psychology, 27, 335.
19. Crites, S. L., Fabrigar, L. R., & Petty, R. E. (1994). Measuring the affective and cognitive properties of attitudes: Conceptual and methodological issues. Personality and Social Psychology Bulletin, 20, 619-634. http://dx.doi.org/10.1177/0146167294206001
20. Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16, 297-334. http://dx.doi.org/10.1007/BF02310555
21. Cronbach, L. J., & Meehl, P. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52, 281-302. http://dx.doi.org/10.1037/h0040957
22. Ekkekakis, P. (2013). Redrawing the model of the exercising human in exercise prescriptions. From headless manikin to a creature with feelings. Lifestyle Medicine (2nd ed.). Hoboken, NJ: Wiley Blackwell.
23. Ekkekakis, P., Parfitt, G., & Petruzzello, S. J. (2011). The pleasure and displeasure people feel when they exercise at different intensities: Decennial update and progress towards a tripartite rationale for exercise intensity prescription. Sports Medicine, 41, 641-671. http://dx.doi.org/10.2165/11590680-000000000-00000
24. Fleig, L., Lippke, S., Pomp, S., & Schwarzer, R. (2011). Exercise maintenance after rehabilitation: How experience can make a difference. Psychology of Sport and Exercise, 12, 293-299. http://dx.doi.org/10.1016/j.psychsport.2011.01.003
25. Friedman, H. S., & Kern, M. L. (2014). Personality, well-being, and health. Psychology, 65, 719-742. http://dx.doi.org/10.1146/annurev-psych-010213-115123
26. Glasgow, R. E., & Riley, W. T. (2013). Pragmatic measures: What they are and why we need them. American Journal of Preventive Medicine, 45, 237-243. http://dx.doi.org/10.1016/j.amepre.2013.03.010
27. Gnambs, T. (2014). A meta-analysis of dependability coefficients (test-retest reliabilities) for measures of the Big Five. Journal of Research in Personality, 52, 20-28. http://dx.doi.org/10.1016/j.jrp.2014.06.003
28. Goodman, J. K., Cryder, C. E., & Cheema, A. (2013). Data collection in a flat world: The strengths and weaknesses of Mechanical Turk samples: Data collection in a flat world. Journal of Behavioral Decision Making, 26, 213-224. http://dx.doi.org/10.1002/bdm.1753
29. Green, S. B. (2003). A coefficient alpha for test-retest data. Psychological Methods, 8, 88-101.
30. Hardy, C. J., & Rejeski, W. J. (1989). Not what, but how one feels: The measurement of affect during exercise. Journal of Sport & Exercise Psychology, 11, 304-317.
31. John, O. P., Naumann, L. P., & Soto, C. J. (2008). Paradigm shift to the integrative Big Five trait taxonomy: History, measurement, and conceptual issues. In L. A. Pervin & O. A. John (Eds.), Handbook of personality: Theory and research (3rd ed., pp. 114-158). New York, NY: Guilford Press.
32. John, O. P., & Soto, C. J. (2007). The importance of being valid. In R. C. Fraley (Ed.), Handbook of research methods in personality psychology (pp. 461-494). New York, NY: Guilford Press.
33. John, O. P., & Srivastava, S. (1999). The Big Five trait taxonomy: History, measurement, and theoretical perspectives. Handbook of Personality: Theory and Research, 2, 102-138.
34. Kassavou, A., Turner, A., Hamborg, T., & French, D. P. (2014). Predicting maintenance of attendance at walking groups: Testing constructs from three leading maintenance theories. Health Psychology, 33, 752-756. http://dx.doi.org/10.1037/hea0000015
35. Kendzierski, D., & DeCarlo, K. J. (1991). Physical Activity Enjoyment Scale: Two validation studies. Journal of Sport & Exercise Psychology, 13, 50-64.
36. Kiviniemi, M. T., Voss-Humke, A. M., & Seifert, A. L. (2007). How do I feel about the behavior? The interplay of affective associations with behaviors and cognitive beliefs as influences on physical activity behavior. Health Psychology, 26, 152-158. http://dx.doi.org/10.1037/0278-6133.26.2.152
37. Klein, W. M. P., Bloch, M., Hesse, B. W., McDonald, P. G., Nebeling, L., O'Connell, M. E., Tesauro, G. (2014). Behavioral research in cancer prevention and control: A look to the future. American Journal of Preventive Medicine, 46, 303-311. http://dx.doi.org/10.1016/j.amepre.2013.10.004
38. Kwan, B. M., & Bryan, A. (2010). In-task and post-task affective response to exercise: Translating exercise intentions into behaviour. British Journal of Health Psychology, 15, 115-131. http://dx.doi.org/10.1348/135910709X433267
39. Linde, J. A., Rothman, A. J., Baldwin, A. S., & Jeffery, R. W. (2006). The impact of self-efficacy on behavior change and weight change among overweight participants in a weight loss trial. Health Psychology, 25, 282-291. http://dx.doi.org/10.1037/0278-6133.25.3.282
40. Loevinger, J. (1957). Objective Tests as Instruments of Psychological Theory. Psychological Reports, 3, 635-694. http://dx.doi.org/10.2466/PR0.3.7.635-694
41. Marcus, B. H., Rakowski, W., & Rossi, J. S. (1992). Assessing motivational readiness and decision making for exercise. Health Psychology, 11, 257-261. http://dx.doi.org/10.1037/0278-6133.11.4.257
42. Markland, D., & Tobin, V. (2004). A modification to the behavioural regulation in exercise questionnaire to include an assessment of amotivation. Journal of Sport & Exercise Psychology, 26, 191-196.
43. Marsh, H. W., Lüdtke, O., Muthén, B., Asparouhov, T., Morin, A. J. S., Trautwein, U., & Nagengast, B. (2010). A new look at the big five factor structure through exploratory structural equation modeling. Psychological Assessment, 22, 471-491. http://dx.doi.org/10.1037/a0019227
44. McCrae, R. R., Kurtz, J. E., Yamagata, S., & Terracciano, A. (2011). Internal consistency, retest reliability, and their implications for personality scale validity. Personality and Social Psychology Review, 15, 28-50. http://dx.doi.org/10.1177/1088868310366253
45. Messick, S. (1995). Validity of psychological assessment: Validation of inferences from persons' responses and performances as scientific inquiry into score meaning. American Psychologist, 50, 741-749. http://dx.doi.org/10.1037/0003-066X.50.9.741
46. Mullan, E., Markland, D., & Ingledew, D. K. (1997). A graded conceptualisation of self-determination in the regulation of exercise behaviour: Development of a measure using confirmatory factor analytic procedures. Personality and Individual Differences, 23, 745-752. http://dx.doi.org/10.1016/S0191-8869(97)00107-4
47. Murphy, K. R., & Davidshofer, C. O. (2005). Psychological testing: Principles and applications (6th ed.). Upper Saddle River, N.J: Pearson/Prentice Hall.
48. Nunnally, J. C. (1978). Psychometric theory (2nd ed.). New York, NY: McGraw-Hill.
49. Osburn, H. G. (2000). Coefficient alpha and related internal consistency reliability coefficients. Psychological Methods, 5, 343-355. http://dx.doi.org/10.1037/1082-989X.5.3.343
50. Rhodes, R. E., & Blanchard, C. M. (2007). What do confidence items measure in the physical activity domain? Journal of Applied Social Psychology, 37, 759-774. http://dx.doi.org/10.1111/j.1559-1816.2007.00184.x
51. Rhodes, R. E., Blanchard, C. M., & Matheson, D. H. (2006). A multicomponent model of the theory of planned behaviour. British Journal of Health Psychology, 11, 119-137. http://dx.doi.org/10.1348/135910705X52633
52. Rhodes, R. E., & Courneya, K. S. (2003). Self-efficacy, controllability and intention in the theory of planned behavior: measurement redundancy or causal independence? Psychology & Health, 18, 79-91. http://dx.doi.org/10.1080/0887044031000080665
53. Rhodes, R. E., Fiala, B., & Conner, M. (2009). A review and meta-analysis of affective judgments and physical activity in adult populations. Annals of Behavioral Medicine: A Publication of the Society of Behavioral Medicine, 38, 180-204.
54. Rhodes, R. E., Plotnikoff, R. C., & Spence, J. C. (2004). Creating parsimony at the expense of precision? Conceptual and applied issues of aggregating belief-based constructs in physical activity research. Health Education Research, 19, 392-405. http://dx.doi.org/10.1093/her/cyg043
55. Rhodes, R. E., Williams, D. M., & Mistry, C. D. (2015). Using short vignettes to disentangle perceived capability from motivation: A test using walking and resistance training behaviors. Psychology Health and Medicine, 37, 1-13. http://dx.doi.org/10.1080/13548506.2015.1074710
56. Rothman, A. J., Baldwin, A. S., Hertel, A. W., & Fuglestad, P. (2011). Self-regulation and behavior change: Disentangling behavioral initiation and behavioral maintenance: Research, theory, and applications. In K. D. Vohs & R. F. Baumeister (Eds.), Handbook of self-regulation: Research, theory, and applications (2nd ed., pp. 106-124). New York, NY: Guilford Press.
57. Ryan, R. M., Frederick, C. M., Lepes, D., Rubio, N., & Sheldon, K. M. (1997). Intrinsic motivation and exercise adherence. International Journal of Sport Psychology, 28, 335-354.
58. Schmidt, F. L., Le, H., & Ilies, R. (2003). Beyond alpha: An empirical examination of the effects of different sources of measurement error on reliability estimates for measures of individual differences constructs. Psychological Methods, 8, 206-224. http://dx.doi.org/10.1037/1082-989X.8.2.206
59. Schmitt, N. (1996). Uses and abuses of coefficient alpha. Psychological Assessment, 8, 350-353. http://dx.doi.org/10.1037/1040-3590.8.4.350
60. Sears, S. R., & Stanton, A. L. (2001). Expectancy-value constructs and expectancy violation as predictors of exercise adherence in previously sedentary women. Health Psychology, 20, 326-333. http://dx.doi.org/10.1037/0278-6133.20.5.326
61. Shapiro, D. N., Chandler, J., & Mueller, P. A. (2013). Using Mechanical Turk to study clinical populations. Clinical Psychological Science. [Epub ahead of print]. http://dx.doi.org/10.1177/2167702612469015
62. Smith, G. T., McCarthy, D. M., & Anderson, K. G. (2000). On the sins of short-form development. Psychological Assessment, 12, 102-111. http://dx.doi.org/10.1037/1040-3590.12.1.102
63. Strauss, M. E., & Smith, G. T. (2009). Construct validity: Advances in theory and methodology. Annual Review of Clinical Psychology, 5, 1-25. http://dx.doi.org/10.1146/annurev.clinpsy.032408.153639
64. Urbina, S. (2014). Essentials of psychological testing (2nd ed.). Hoboken, NJ: Wiley.
65. Watson, D. (2004). Stability versus change, dependability versus error: Issues in the assessment of personality over time. Journal of Research in Personality, 38, 319-350. http://dx.doi.org/10.1016/j.jrp.2004.03.001
66. Watson, D. (2012). Objective tests as instruments of psychological theory and research. In H. Cooper, P. M. Camic, D. L. Long, A. T. Panter, D. Rindskopf, & K. J. Sher (Eds.), APA handbook of research methods in psychology, Vol 1: Foundations, planning, measures, and psychometrics (pp. 349-369). Washington, DC: American Psychological Association. http://dx.doi.org/10.1037/13619-019
67. Watson, D., O'Hara, M. W., Simms, L. J., Kotov, R., Chmielewski, M., McDade-Montez, E. A., Stuart, S. (2007). Development and validation of the Inventory of Depression and Anxiety Symptoms (IDAS). Psychological Assessment, 19, 253-268. http://dx.doi.org/10.1037/1040-3590.19.3.253
68. Watson, D., Wiese, D., Vaidya, J., & Tellegen, A. (1999). The two general activation systems of affect: Structural findings, evolutionary considerations, and psychobiological evidence. Journal of Personality and Social Psychology, 76, 820-838. http://dx.doi.org/10.1037/0022-3514.76.5.820
69. Williams, D. M. (2008). Exercise, affect, and adherence: An integrated model and a case for self-paced exercise. Journal of Sport & Exercise Psychology, 30, 471-496.
70. Williams, D. M., Dunsiger, S., Jennings, E. G., & Marcus, B. H. (2012). Does affective valence during and immediately following a 10-min walk predict concurrent and future physical activity? Annals of Behavioral Medicine, 44, 43-51. http://dx.doi.org/10.1007/s12160-012-9362-9
71. Williams, D. M., & Evans, D. R. (2014). Current emotion research in health behavior science. Emotion Review, 6, 277-287. http://dx.doi.org/10.1177/1754073914523052