A teacher's guide to educational assessment

A Teacher's Guide to Educational Assessment

Volumn , Issue , 2009, Pages 1-356

  Lamprianou, Iasonas ^a,b   Athanasou, James A ^c  

^a EUROPEAN UNIVERSITY CYPRUS   (Cyprus)

^b UNIVERSITY OF MANCHESTER   (United Kingdom)

^c UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 85177078489     PISSN: None     EISSN: None     Source Type: Book    
DOI: None     Document Type: Book

References (115)

1. Stiggins, R. J., & Conklin, N. F. (1988). Teacher training in assessment. Portland, OR: Northwest Regional Educational Laboratory.
2. Source: http://www.schools.nsw.edu.au/, accessed March 2002.
3. Source: http://www.vcaa.vic.edu.au/glossary.htm, accessed March 2002.
4. Source: http://www.ku.edu/kansas/medieval/108/lectures/capitalism.html, accessed March 2002.
5. Source: http://www.edweek.com/ew/vol-18/40tests.h18, accessed March 2002.
6. Broadfoot, P. (1979). Assessment, schools and society. London: Methuen.
7. Eggleston, J. (1991). Teaching teachers to assess. European Journal of Education, 26, 231-237, p. 236.
8. Joint Committee on Testing Practices. (1988). Code of fair testing practices in education. Washington, DC: Author.
9. Lombardi, M. M. (2008). Making the grade: The role of assessment in authentic learning. EDUCAUSE Learning Initiative, ELI Paper 1:2008.
10. Linn, R. L. (1993). Educational assessment: Expanded expectations and challenges. Educational Evaluation and Policy Analysis, 15, 1-16, p. 9.
11. Education Week on the Web, Source: http://www.teachermagazine.org/context/glossary/perfbase.htm, Accessed March 2000.
12. Baker, E. L., O'Neil H. F., & Linn, R. L. (1993). Policy and validity prospects for performance based assessment. American Psychologist, 48, 1210-1218, p. 1210.
13. Cox, K. (1990). No Oscar for OSCA. Medical Education, 24, 540-545.
14. Scriven, M. (1991). Evaluation thesaurus (4th ed.). Newbury Park, CA: Sage.
15. Scriven, M. (1991). Evaluation thesaurus (4th ed.). Newbury Park, CA: Sage.
16. Source: http://www.unesco.org/education/educprog/ste/projects/2000/formative.htm
17. Glaser, R., & Nitko, A. J. (1971). Measurement in learning and instruction. In R. L. Thorndike (Ed.), Educational measurement (2nd ed., pp. 625-670). Washington, DC: American Council on Education.
18. Lamprianou, I. (in press). Comparability of examination standards between subjects: An international perspective. Oxford Review of Education, Accepted, scheduled for June 2009.
19. American Educational Research Association, American Psychological Association and National Council on Measurement in Education. (1999). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.
20. Gronlund, N. E. (1982). Constructing achievement tests (3rd ed.). Englewood Cliffs, NJ: Prentice-Hall.
21. Cronbach, L. J. (1971). Test validation. In R. L. Thorndike (Ed.), Educational measurement (2nd ed., pp. 443-507). Washington, DC: American Council on Education.
22. Newble, D. I., & Swanson, D. B. (1988). Psychometric characteristics of the objective structured clinical examination. Medical Education, 22, 325-334, p. 331.
23. Nungester, R. J., Dawson-Saunders, B., Kelley, P. R., & Volle, R. L. (1990). Score reporting on NBME Examinations. Academic Medicine, 65, 723-729, p. 725.
24. Athanasou. (1996c). A report on the academic progression 1992-1995 of students selected for commercial data processing at the Sydney Institute of Technology. Sydney: NSW TAFE Commission.
25. Assessment Research & Development Unit. (1988b). Manual for examiners and assessors. (Revised May 1988) Sydney: NSW Department of Technical and Further Education.
26. Ryan, J. J., Prifitera, A., & Powers, L. (1983). Scoring reliability on the WAIS-R. Journal of Consulting and Clinical Psychology, 51, 460.
27. American Educational Research Association, American Psychological Association and National Council on Measurement in Education. (1999). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.
28. This index was proposed by Hambleton, R. K., & Novick, M. R. (1973). Toward an integration of theory and method for criterion-referenced tests. Journal of Educational Measurement, 10, 159-170.
29. Berk, R. A. (1980). A consumer's guide to criterion-referenced test reliability. Journal of Educational Measurement, 17, 323-349.
30. Linn, R. L. (1982). Admissions testing on trial. American Psychologist, 37, 279-291.
31. Newble, D. I., & Swanson, D. B. (1988). Psychometric characteristics of the objective structured clinical examination. Medical Education, 22, 325-334.
32. Brennan, R. L. (1972). A generalized upper-lower item discrimination index. Educational and Psychological Measurement, 32, 289-303.
33. Shepard, L. A., Camilli, G., & Averill, M. (1981). Comparison of six procedures for detecting test item bias using both internall and external ability criteria. Journal of Educational Statistics, 6, 317-375.
34. Pollitt, A., Hutchinson, C., Entwistle, N., & De Luca, C. (1985). What makes exam questions difficult? Edinburgh: Scottish Academic Press.
35. Berk, R. A. (Ed.), (1982). Hanbook of methods for detecting item bias. Baltimore: The Johns Hopkins Univesrity Press.
36. Wright, B. D., & Mok, M. (2000). Rasch models overview. Journal of Applied Measurement, 1, 83-106, p. 96.
37. Wright, B. D., & Linacre, J. M. (1985). Reasonable mean-square fit values. Rasch Measurement Transactions, 8(3), 370-371.
38. Karabatsos, G. (2000). A critique of Rasch residual fit statistics. Journal of Applied Measurement, 1, 152-176.
39. Bejar, I. I. (1983). Achievement testing: Recent advances. Beverly Hills, CA: Sage.
40. Bond, T. G., & Fox, C. M. (2001). Applying the Rasch model: Fundamental measurement in the human sciences. London: Lawrence Erlbaum.
41. Board of Studies, Business Services Curriculum Framework Stage 6 Syllabus, http://www.boardofstudies. nsw.edu.au/surveys/bus_serv_part_a_frame_1.html, accessed March 2002.
42. James, A., & Olabisi Olasehinde. (2002). Male and female differences in self-report cheating. Practical Assessment, Research & Evaluation, 8(5). Retrieved March 13, 2009 from http://PAREonline.net/getvn.asp?v=8&n=5
43. Cizek, G. J. (1999). Cheating on tests: How to do it, detect it and prevent it. Mahwah, NJ: Lawrence Erlbaum.
44. Newstead, S. E., Franklyn-Stokes, A., & Armstead, P. (1996). Individual differences in student cheating. Journal of Educational Psychology, 88, 229-241.
45. Baird, J. S. (1980). Current trends in college cheating. Psychology in the Schools, 17, 515-522.
46. Cizek, G. J. (1999). Cheating on tests: How to do it, detect it and prevent it. Mahwah, NJ: Lawrence Erlbaum, p. 39.
47. Newstead, S. E., Franklyn-Stokes, A., & Armstead, P. (1996). Individual differences in student cheating. Journal of Educational Psychology, 88, 229-241, p. 232.
48. Traub, J. (2002, April 7). The test mess. The New York Times.
49. Source: http://www.nytimes.com/ 2002/04/07/.. ,/07TESTING.html
50. Conlan, G. (1978). How the essay in the College Board English Composition Test is scored. Princeton, NJ: Educational Testing Service.
51. Wergin, J. F. (1988). New directions for teaching and learning. Assessing Students' Learning, 34, 517, p. 13.
52. This discussion is adapted from Rudner, L. L. (1992). Reducing errors due to the use of judges. Practical Assessment, Research and Evaluation, 3(3). Available online http://ericae/net/pare/ getvn.asp?v=3&n=3
53. Vernon, P. E., & Millican, G. D. (1954). A further study on the reliability of English essays. British Journal of Statistical Psychology, 7, 65-74.
54. Findlayson, D. S. (1951). The reliability of the marking of essays. British Journal of Educational Psychology, 21, 126-134.
55. Rudner, L., & Gagne, P. (2001). An overview of three approaches to scoring written essays by computer. Practical Assessment Research and Evaluation, 7(26). Available online http://ericae.net/ pare/getvn.asp?v=7&n=26
56. Houston, W. M., Raymond, M. R., & Svec, J. C. (1991). Adjustments for rater effects. Applied Psychological Measurement, 15(4), 409-421.
57. Stanley, J. C. (1962). Analysis of variance principles applied to the grading of essay tests. Journal of Experimental Education, 30, 279-283.
58. Lamprianou, I. (2006). The stability of marker characteristics across tests of the same subject and across subjects. Journal of Applied Measurement, 7(2), 192-200.
59. Godshalk, F. I., Swineford, F., & Coffman, W. E. (1966). The measurement of writing ability. NY: College Entrance Examination Board. for an analysis of five independent markers on 20 and 40 minute essays [reliability coefficients for five independent markers: one 20 minute essay, 0.48; two essays (40 minutes), 0.65; one 40 minute essay ,0.59].
60. Meyer, G. (1934). An experimental study of the old and new types of examination: I. The effect of examination set on memory. Journal of Educational Psychology, 25, 641-661.
61. Meyer, G. (1935). An experimental study of the old and new types of examination: II. Methods of study. Journal of Educational Psychology, 26, 30-40.
62. Fowler, F. J., & Cannell, C. F. (1996). Using behavioral coding to identify cognitive problems with survey questions. In N. Schwarz & S. Sudman (Eds.), Answering questions (p. 15). San Francisco: Jossey-Bass.
63. Miller, W. R., & Rose, H. C. (1975). Instructors and their jobs. Chicago: American Technical Society.
64. Downing, S. M. (1992). True-false and alternate choice item formats: A review of research. Educational Measurement: Issues and Practices, 11, 27-30.
65. Rowley, G. R., & Traub, R. (1977). Formula scoring, number-right scoring and test-taking strategy. Journal of Educational Measurement, 14, 15-22.
66. Dunstan, M. (1970). A reply to some criticisms of objective tests. Bulletin No. 2. Tertiary Education Research Centre, University of New South Wales.
67. Haladyna, T. M. (1994). Developing and validating multiple-choice test items. Hillsdale, NJ: Lawrence Erlbaum Associates.
68. Miller, W. R., & Rose, H. C. (1975). Instructors and their jobs. Chicago: American Technical Society.
69. Cornford, I. R., & Athanasou, J. A. (1995). Developing expertise through practical training. Industrial & Commercial Training, 27,10-18.
70. Jones, A., & Whittaker, P. (1975). Testing industrial skills. Essex: Gower Press.
71. De Cecco, J. P., & Crawford, W. R. (1974). The psychology of learning and instruction (2nd ed.). Englewood-Cliffs, NJ: Prentice-Hall.
72. Crossman, E. R. F. W., & Seymour, W. D. (1957). The nature and acquisition of industrial skills. London: Department of Scientific and Industrial Research.
73. Fitts, P. M. (1964). Perceptual skill learning. In A. W. Melton (Ed.), Categories of skill learning (pp. 65). NY: Academic Press.
74. Fitts, P. M. (1968). Factors in complex training. In G. Kuhlen (Ed.), Studies in educational psychology (pp. 390-404). Waltham, MA: Blaisdell Publishing Company.
75. Fitts, P. M. (1968). Factors in complex training. In G. Kuhlen (Ed.), Studies in educational psychology (p. 399). Waltham, MA: Blaisdell Publishing Company.
76. Field, J. E., & Field, T. F. (1992). Classification of jobs. Athens, GA: Elliott & Fitzpatrick.
77. Gonczi A., Hager P., & Athanasou, J. (1993). A Guide to the development of competency-based assessment strategies for professions. National Office of Overseas Skills Recognition Research Paper, DEET. Canberra: Australian Government Publishing Service.
78. Hager, P., Athanasou, J. A., & Gonczi, A. (1994). Assessment technical manual. Canberra: Australian Government Publishing Service.
79. Sadler, D. R. (1987). Specifying and promulgating achievement standards. Oxford Review of Education, 13, 191-209.
80. Sadler, D. R. (1987). Specifying and promulgating achievement standards. Oxford Review of Education, 13, 191-209, pp. 200-201.
81. Scriven, M. (2000). The logic and methodology of checklists. Retrieved March 2002, from http://www.wmich.edu/evalctr/checklists/logic_methodology.htm. The following paragraphs are based on Scriven's outline of checklists.
82. Saskatchewan Education. (1999). Autobody 10, A20, B20, A30, B30, Curriculum Guide. Retrieved March 2002, from http://www.sasked.gov.sk.ca/docs/paa/autobody/appendixd.html
83. Krathwohl, D. R., et al. (1964). Taxonomy of educational learning outcomes: Handbook II, Affective domain. NY: D. McKay.
84. Bloom, B. S., Hastings, J. T., & Madaus, G. F. (1971). Handbook on formative and summative evaluation of student learning. NY: McGraw-Hill.
85. Edwards, A. L. (1955). Techniques of attitude scale construction. New York: Appleton Century Crofts.
86. Source: Accessed March 2002, from http://arch.k12.hi.us/school/sqs/.
87. Department of Educational Accountability (February, 1996). Parent and student satisfaction with elementary schools in Montgomery County. Rockville, MD: Montgomery County Public Schools.
88. Source: Accessed March 2002, from http://www.dpsnc.com/dps/schools/CustSat/YESmithCustSat.html
89. Abrami, P. C. (1989). How should we use student ratings to evaluate teaching? Research in Higher Education, 30, 221-227.
90. Abrami, P. C., d'Apollonia, S., & Cohen P. A. (1990). Validity of student ratings of instruction: What we know and what we do not know. Journal of Educational Psychology, 82, 219-231.
91. L'Hommedieu, R., Menges, R. J., & Brinko, K. T. (1990). Methodological explanations for the modest effects of feedback from student ratings. Journal of Educational Psychology, 82, 232-241.
92. Athanasou, J. A. (1994). Some effects of career interests, subject preferences and quality of teaching on the educational achievement of Australian technical and further education students. Journal of Vocational Education Research, 19, 23-38.
93. Athanasou, J. A., & Petoumenos, K. (1998). Which components of instruction influence student interest?. Australian Journal of Teacher Education, 23, 51-57.
94. Likert, R. (1932). A technique for the measurement of attitudes. Archives of Psychology, 140.
95. Low, G. D. (1988). The semantics of questionnaire rating scales. Evaluation and Research in Education, 2, 69-70.
96. Amoo, T., & Friedman, H. H. (2001). Do numeric values influence subjects' responses to rating scales?. Journal of International Marketing and Marketing Research, 26, 41-46.
97. Holt, J. (1971). What do I do Monday? London: Pitman Publishing.
98. Gage, N. L., & Berliner, D. C. (1975). Educational psychology. Chicago: Rand McNally.
99. Guilford, J. P. (1954). Psychometric methods (2nd ed.). NY: McGraw-Hill). but this is cumbersome for practical use.
100. Nedelsky, L. (1954). Absolute grading standards for objective tests. Educational and Psychological Measurement, 14, 3-19.
101. Angoff, W. H. (1971). Scales, norms and equivalent scores. In R. L. Thorndike (Ed.), Educational measurement. Washington, DC: American Council on Education.
102. Korbula, G. (1992). Setting cut-off points for numeracy skills using the Angoff method. Unpublished B.Ed project. University of Technology, Sydney.
103. Hager, P., Athanasou, J. A., & Gonczi, A. (1994). Assessment technical manual. Canberra: Australian Government Publishing Service.
104. Angoff, W. H. (1984/1971). Scales, norms and equivalent scores. In R. L. Thorndike (Ed.), Educational measurement (2nd ed., pp. 508-600). Washington, DC: American Council on Education.
105. Lord, F. M. (1982). The standard error of equipercentile equating. Journal of Educational Statistics, 7, 165-174.
106. Marco, G. L. (1981). Equating tests in an era of test disclosure. In B. F. Green (Ed.), Issues in testing: Coaching, disclosure, and ethnic bias. San Francisco: Jossey-Bass.
107. Petersen, N. C., Kolen, M. J., & Hoover, H. D. (1993). Scaling, norming and equating. In Linn, L. R. (Ed.), Educational measurement (3rd ed.). Phoenix, AZ: Oryx Press.
108. Klein, L. W., & Jarjoura, D. (1985). The importance of content representation for common-item equating with nonrandom groups. Journal of Educational Measurement, 22(3), 197-206.
109. Braun, H. I., & Holland, P. W. (1982). Observed score test equating: a mathematical analysis of some ETS equating procedures. In P. W. Holland & D. B. Rubin (Eds.), Test equating (pp. 9-49). New York: Academic Press.
110. Kiek, L. A. (1998). Data analysis of the key stage 2&3 pilot mental mathematics tests. Report for ACCAC. University of Cambridge.
111. Angoff, W. H. (1984b). Scales, norms, and equivalent scores. Princeton, NJ: Educational Testing Service.
112. Kolen, M. J. (1984). Effectiveness of analytic smoothing in equipercentile equating. Journal of Educational Statistics, 9(1), 25-44.
113. Braun, H. I., & Holland, P. W. (1982). Observed score test equating: a mathematical analysis of some ETS equating procedures. In P. W. Holland & D. B. Rubin (Eds.), Test equating (pp. 9-49). New York: Academic Press.
114. Petersen, N. C., Kolen, M. J., & Hoover, H. D. (1993). Scaling, norming and equating. In Linn, L. R. (Ed.), Educational measurement (3rd ed., p. 247). Phoenix, AZ: Oryx Press.
115. Mislevy, R. J., Sheehan, K. M., & Wingersky, M. (1993). How to equate tests with little or no data. Journal of Educational Measurement, 30(1), 55-78.