Quality and quantity in test validity: How can we be sure that psychological tests measure what they have to?

Quality and Quantity

Volumn 41, Issue 3, 2007, Pages 359-374

  Sartori, Riccardo ^a,b   Pasini, Margherita ^a  

^a UNIVERSITY OF VERONA   (Italy)

^b C/o Centro Docimologico ^*  (Italy)

Author keywords

Measurement; Psychological testing; Reliability; Test validity

Indexed keywords

EID: 34247628054     PISSN: 00335177     EISSN: 15737845     Source Type: Journal    
DOI: 10.1007/s11135-006-9006-x     Document Type: Article

References (52)

1. Alderson, J. C. Clapham, C. & Wall, D. (1995). Language Test Construction and Evaluation. Cambridge: University Press.
2. Allen, M. & Yen, W. M. (1979). Introduction to Measurement Theory. Monterey, CA: Brooks/Cole.
3. Anastasi, A. (1988). Psychological Testing. New York, NY: Macmillan.
4. Anastasi, A. & Urbina, S. (1997). Psychological Testing. 7th edn. Upper Saddle River, NJ: Prentice Hall.
5. Angoff, W. H. (1988). Validity: an evolving concept. In: H. Wainer and H. I. Braun (eds.), Test Validity, Hillsdale, NJ: Lawrence Erlbaum Associates, pp. 19-32.
6. Bachman, L. F. (1990). Fundamental Considerations in Language Testing. Oxford: Oxford University Press.
7. Borsboom, D., Mellenbergh, G. J. & van Heerden, J. (2004). The concept of validity. Psychological Review 111(4): 1061-1071.
8. Buck, G. (2001). Validities. Message posted on L-TESL Online Forum. Available: http://f05n16.cac.psu.edu/archives/ltest-1.html.
9. Campbell, D. T. & Fiske, D. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin 56: 81-104.
10. Carmines, E. G. & Zeller, R. A. (1979). Reliability and Validity Assessment. Beverly Hills: Sage.
11. Carroll, B. J. (1985). Second language performance testing for university and professional contexts. In: P. C. Hauptman, R. LeBlanc and M. B. Wesche (eds.), Second Language Performance Testing, Ottawa: University of Ottawa Press.
12. Cattell, R. B. (1946). Description and Measurement of Personality. New York: World Book Company.
13. Cronbach, L. J. (1971). Validity. In: R. L. Thorndike (ed.), Educational Measurement, 2nd edn. Washington, DC: American Council on Education, pp. 443-597.
14. Cronbach, L. J. (1984). Essentials of Psychological Testing. 4th edn. New York: Harper and Row.
15. Cronbach, L. J. & Meehl, P. E. (1955). Construct validity in psychological tests. Psychological Bulletin 52: 281-302.
16. Davies, A., Brown, A. & Elder, C. (1999). Dictionary of Language Testing. Cambridge: Cambridge University Press.
17. Dipboye, R. L., Smith, C. S. & Howell, W. C. (1994). Understanding Industrial and Organizational Psychology: An Integrated Approach. Harcourt Brace College Publishers.
18. Fink, A. (1995). How to Ask Survey Questions. Thousand Oaks, CA: Sage.
19. Groth-Marnat, G. (1990). Handbook of Psychological Assessment. 2nd edn. New York: Wiley.
20. Guion, R. M. (1977). Content validity-the source of my discontent. Applied Psychological Measurement 1: 1-10.
21. Guion, R. M. (1978). "Content validity" in moderation. Personal Psychology 31: 205-213.
22. Guttman, L. (1954). A new approach to factor analysis: The radex. In: P. F. Lazarsfeld (ed.), Mathematical thinking in the social sciences, Glencoe, IL: Free Press, pp. 258-348.
23. Hajipournezhad, G. (2002). Which one speaks louder in language testing, actions or words? Proceedings of the Nov. 23-25, 2001 JALT Conference in Kita Kyushu, pp. 805-811, Japan. Tokyo: JALT.
24. Haynes, S. N., Richard, D. C. S. & Kubany, E. S. (1995). Content validity in psychological assessment: A functional approach to concepts and methods. Psychological Assessment 7: 238-247.
25. Ingram, E. (1977). Basic concepts in testing. In: J. P. B. Allen and A. Davies (eds.), Testing and Experimental Methods, London: Oxford University Press.
26. Kelley, T. L. (1927). Interpretation of Educational Measurement. New York: Macmillan.
27. Kerlinger, F. N. (1974). Foundations of Behavioural Research. New York: Holt, Rinehart and Winston.
28. Kline, P. (1998). The New Psychometrics. London: Routledge.
29. Lacity, M. & Jansen, M. A. (1994). Understanding qualitative data: a framework of text analysis methods. Journal of Management Information Systems 11: 137-166.
30. Lennon, R. T. (1956). Assumption underlying the use of content validity. Educational and Psychological Measurement 16:294-304.
31. Messick, S. (1980). Test validity and the ethics of measurement. American Psychologist 30: 955-966.
32. Messick, S. (1993). Validity. In: R. L. Linn (ed.), Educational Measurement. 2nd edn. Phoenix: American Council on Education and Oryx Press, pp. 13-104.
33. Messick, S. (1995). Validity of psychological assessment: validation of inferences from persons' responses and performances as scientific inquiry into score meaning. American Psychologist 50: 741-749.
34. Messick, S. (1998). Test validity: a matter of consequence. Social Indicators Research 45: 35-44.
35. McDonald, R. P. (1999). Test Theory. Mahwah, NJ: Lawrence Erlbaum Associates.
36. Mitchell, J. V. Jr. (1986). Measurement in the larger context: critical current issues. Professional Psychology: Research and Practice 17: 544-550.
37. Mosier, C. I. (1947). A critical examination of the concepts of face validity. Educational and Psychological Measurement 7: 191-205.
38. Nevo, B. (1985). Face validity revisited. Journal of Educational Meaurement 22: 287-293.
39. Newfields, T. (2002). Challenging the notion of face validity. SHIKEN: The JALT Testing and Evaluation SIG Newsletter 6(3): 19. Available: http://www.jalt.Org/test/new_2.htm.
40. Nunnally, J. C. (1978). Psychometric Theory. New York: McGraw-Hill.
41. Nunnally, J. C. & Bernstein, I.H. (1994). Psychometric Theory. 3rd edn. New York: McGraw-Hill.
42. Roberts, D. M. (2000). Face validity: is there a place for this in measurement? SHIKEN: The JALT Testing and Evaluation SIG Newsletter 4(2): 5. Available: http://www.jalt.org/test/rob_1.htm.
43. Standards for Educational and Psychological Testing (1985). Washington, DC: American Psychological Association.
44. Sternberg, R. J. (1997). Successful Intelligence. New York: Plume.
45. Sternberg, R. J. (2000). Implicit theories of intelligence as exemplar stories of success. Psychology, Public Policy, and Law 6(1): 159-167.
46. Suen, H. K. (1990). Principles of Test Theories. Hillsdale, NJ: Erlbaum.
47. Tallent, N. (1992). The Practice of Psychological Assessment. Englewood Cliffs, NJ: Prenctice-Hall.
48. Trochim, W. (2002). Measurement Validity Types. [Online] Available: http://trochim.omni.cornell.edu/kb/ [17 April 2002].
49. Vernon, P. E. (1963). Personality Assessment. London: Metheun.
50. Vernon, P. E. & Parry, J. A. (1949). Personnel Selection in the British Forces. London: London University Press.
51. Walsh, W. B. (1995). Tests and Assessment. New York: Prentice-Hall.
52. Wiggins, J. S., Steiger, J. H. & Gaelick, L. (1981). Evaluating circumplexity in personality data. Multivariate Behavioral Research 16: 263-289.