Measuring teaching ability with the rasch model by scaling a series of product and performance tasks

Journal of Applied Measurement

Volumn 7, Issue 3, 2006, Pages 239-259

  Wilkerson, Judy R ^a   Lang, William Steve ^b,c  

^a FLORIDA GULF COAST UNIVERSITY   (United States)

^b UNIVERSITY OF SOUTH FLORIDA   (United States)

^c UNIVERSITY OF SOUTH FLORIDA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

HUMAN; PROFESSIONAL COMPETENCE; REVIEW; STANDARD; STATISTICAL MODEL; TASK PERFORMANCE; UNITED STATES; UNIVERSITY;

FACULTY; FLORIDA; HUMANS; MODELS, STATISTICAL; PROFESSIONAL COMPETENCE; TASK PERFORMANCE AND ANALYSIS;

EID: 33746885528     PISSN: 15297713     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Review

References (44)

1. American Board for Certification of Teacher Excellence (2004, June). Retrieved November 16, 2005, from http://www.abcte.org/index.html
2. American Educational Research Association, American Psychological Association, and National Council of Measurement in Education (1999). Standards for educational and psychological testing. Washington, DC: Author.
3. Bohlig, M., Fisher, W. P., Jr., Masters, G. N., and Bond, T. (1998) Content validity and misfitting items. Rasch Measurement Transactions, 72(1), 607.
4. Briggs, D. C., and Wilson, M. (2004). An introduction to multidimensional measurement using Rasch Models. In E. V. Smith and R. M. Smith (Eds.), Introduction to Rasch measurement (pp. 322-341). Maple Grove, MN: JAM Press.
5. Darling-Hammond, L., and Sykes, G. (2003). Wanted: A national teacher supply policy for education: the right way to meet the "highly qualified teacher" challenge. Education Policy Analysis Archives, 11(33).
6. Elder, C., McNamara, T., and Congdon, P. (2004). Rasch techniques for detecting bias in performance assessments: an example comparing the performance of native and non-native speakers on a test of academic English. In E. V. Smith and R. M. Smith (Eds.), Introduction to Rasch measurement (pp. 419-444). Maple Grove, MN: JAM Press.
7. Engelhard, G. (1994). Resolving the attenuation paradox. Rasch Measurement Transactions, 8(3), 379.
8. Florida Alternative Certification System (2004, October). Retrieved November 16, 2005 from http://www.altcertflorida.org/
9. Fisher, W. P., Jr. (2001). Invariant thinking vs. invariant measurement. Rasch Measurement Transactions, 14(4), 778-781.
10. Fisher, W. P., Jr. (1994). The Rasch debate: Validity and revolution in educational measurement. In M. Wilson (Ed.), Objective measurement: Theory into practice (Vol. 2, pp. 36-72). Norwood, NJ: Ablex.
11. Hudgens, S., Dineen, K. W., Lai, J., and Cella, D. (2004). Assessing statistically and clinically meaningful construct deficiency/saturation: Recommended criteria for content coverage and item writing. Rasch Measurement Transactions, 17(4), 954-955.
12. Ingersoll, G. M. and Scannell, D. P. (2002). Performance-based teacher certification: Creating a comprehensive unit assessment system. Golden, CO: Fulcrum.
13. Kirkpatrick, S. (2005). Lazy guide to net culture: Hack the vote. Retrieved December 6, 2005 from http://news.scotsman.com/opinion.cfm?id= 1300022004
14. Lang, W. S. (2002). Alternative certification program alignment tasks to ed-ventures and the survival guide content validity review. Report: Bureau of Teacher Certification, Florida Department of Education, Tallahassee, FL.
15. Linacre, J. M. (2003). A user's guide to WINSTEPS Rasch-model computer programs. Chicago: Winsteps.com.
16. Linacre, J. M. (1996). True-score reliability or Rasch statistical validity? Rasch Measurement Transaction, 9(4), 455-456.
17. Linacre, J. M. (2004). Optimizing rating scale category effectiveness. In E. V. Smith and R. M. Smith (Eds.), Introduction to Rasch measurement (pp. 258-278). Maple Grove, MN: JAM Press.
18. Journal of Educational and Behavioral Statistics (2004). 29(1). (entire issue)
19. Myford, C. M., and Wolfe, E. W. (2003). Detecting and measuring rater effects using manyfacet Rasch measurement: Part 1. Journal of Applied Measurement, 4, 386-421.
20. Overton, W. F. (1999, August). Construct validity: A forgotten concept in psychology? Paper presented at the annual meeting of the American Psychological Association, Boston, MA.
21. Popham, J. W. (2004). All about accountability / why assessment illiteracy is professional suicide. Educational Leadership, 62(1), 82-83.
22. Rudner, L. M. (2004). Measurement decision theory. Retrieved October 30, 2004 from http://edres.org/mdt/
23. Smith, E. V. (2004a). Evidence for the reliability of measures and validity of measure interpretation: a Rasch measurement perspective. In E. V. Smith and R. M. Smith (Eds.), Introduction to Rasch measurement (pp. 93-122). Maple Grove, MN: JAM Press.
24. Smith, E. V. (2004b). Detecting and evaluating the impact of multidimensionality using item fit statistics and principal component analysis of residuals. In E. V. Smith and R. M. Smith (Eds.), Introduction to Rasch measurement (pp. 575-600). Maple Grove, MN: JAM Press.
25. Smith, R. M. (1996). A comparison of methods for determining dimensionality in Rasch measurement. Structural Equation Modeling, 3, 25-40.
26. Smith, R. M. (2004). Fit analysis in latent trait measurement models. In E. V. Smith and R. M. Smith (Eds.), Introduction to Rasch measurement (pp. 73-92). Maple Grove, MN: JAM Press.
27. Stiggins, R. (2000). Specifications for a performance-based assessment system for teacher preparation. National Council for Accreditation of Teacher Education, Washington, DC. Retrieved June 15, 2004 from http://www.ncate.org/ resources/ commissioned%20papers/stiggins.pdf
28. Stone, G. E. (2001). Objective standard setting (or truth in advertising). Journal of Applied Measurement, 2(2), 187-201.
29. nd ed). Retrieved November 16, 2005, from http://www.social research methods.net/kb/index.htm
30. Wilkerson, J. (2003). Performance assessment with teacher standards (PATS). In E. Elliott (Ed.) Assessing candidates for education professions: A review of assessments used in preparation of teachers and other professional educators (pp. 84-87). National Council for Accreditation of Teacher Education, Washington, DC.
31. Wilkerson, J., Lang, S., Egley, R., Hewitt, M., and Stoddard, K. (February 2003). Standards-based performance assessment: A web-based approach. Thematic session presented at the annual meeting of the Association of Teacher Educators in Jacksonville, FL.
32. Wilkerson, J. R. (2002). TeacherNET: Performance assessment system for students: Florida Department of Education [Principal Investigator].
33. Wilkerson, J., Lang, W. S., Hewitt, M., Egley, R., and Stoddard, K. (2002). Florida alternative certification program assessment system. Bureau of Teacher Certification, Florida Department of Education, Tallahassee, FL.
34. Wilkerson, J., and Lang, W. S. (2003a). Alternative certification program alignment of instructional activities with FEAPs and critical skills; content validity review #2. Report: Bureau of Teacher Certification, Tallahassee, FL.
35. Wilkerson, J. R., and Lang, W. S. (2003b). Florida 's alternative certification program assessment system: analysis of district coordinators 'validity questionnaire on assessment tasks. Report: Bureau of Teacher Certification, Florida Department of Education, Tallahassee, FL.
36. Wilkerson, J. R., and Lang, W. S. (2003c). Portfolios, the Pied Piper of teacher certification assessments: Legal and psychometric issues. Education Policy Analysis Archives, 11(45). Retrieved December 20, 2003 from http:// epaa.asu.edu/epaa/v11n45/
37. Wilkerson, J., and Lang, W. S. (2004a, February). Designing standards-based tasks and scoring instruments to collect and analyze data for decision-making. Workshop for the Annual Meeting of the American Association of Teacher Educators in Washington, DC.
38. Wilkerson, J. R., and Lang, W.S. (2004b). A standards-driven, task-based assessment approach for teacher credentialing with potential for college accreditation. Practical Assessment, Research and Evaluation, 9(12). Retrieved June 20, 2004 from http://PAREonline.net/getvn.asp?v=9andn=12
39. Wilkerson, J. R., and Lang, W. S. (2004c). Florida 's alternative certification program assessment system: Analysis of district coordinators 'validity workshop on assessment tasks. Report: Bureau of Teacher Certification, Florida Department of Education, Tallahassee, FL.
40. Wilkerson, J., and Lang, W. S. (2004d, June). Measuring teacher ability: An application of the Rasch model to teacher certification using performance measures. Paper preparedfor presentation at the XII International Objective Measurement Workshop, Cairns, AU.
41. Wilson, M. (2005). Constructing measures: An item response modelling approach. Mahwah, NJ: Lawrence Erlbaum.
42. Wright, B. D., and Panchapakesan, N. A. (1969). A procedure for sample free item analysis. Educational and Psychological Measurement, 29, 23-48.
43. Wright, B. D., and Stone, M. H. (2004). Making Measures. Chicago: Phaneron Press.
44. Wright, B. D., and Mok, M. C. (2004). An overview of the family of Rasch measurement models. In E. V. Smith and R. M. Smith (Eds.), Introduction to Rasch measurement (pp. 124). Maple Grove, MN: JAM Press.