Uneducated guesses: Using evidence to uncover misguided education policies

Uneducated Guesses: Using Evidence to Uncover Misguided Education Policies

Volumn , Issue , 2011, Pages

  Wainer, Howard ^a,b  

^a National Board of Medical Examiners   (United States)

^b UNIVERSITY OF PENNSYLVANIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84861868059     PISSN: None     EISSN: None     Source Type: Book    
DOI: None     Document Type: Book

References (94)

1. Angoff, W. H. 1972. A technique for the investigation of cultural differences. Paper presented at the meeting of the American Psychological Association, Honolulu. ERIC Document Reproduction Service No. ED 069686.
2. Angoff, W. H., and L. L. Cook. 1988. Equating the Scores of the Prueba de Aptitud Academica and the Scholastic Aptitude Test. College Board Report No. 88-2. New York: College Entrance Examination Board.
3. Angoff, W. H., and C. C. Modu. 1973. Equating the Scales of the Prueba de Aptitud Academica and the Scholastic Aptitude Test. Research Report 3. New York: College Entrance Examination Board.
4. Avery, C., M. Glickman, C. Hoxby, and A. Metrick. 2004. A revealed preference ranking of U.S. colleges and universities. NBER Working Paper No. 10803. Cambridge, MA: National Bureau of Economic Research.
5. Ballou, D., W. Sanders, and P. Wright. 2004. Controlling for student background in value-added assessment of teachers. Journal of Educational and Behavioral Statistics 29 (1): 37-65.
6. Beaton, A. E., and R. Zwick. 1990. Disentangling the NAEP 1985-86 Reading Anomaly. Princeton, NJ: Educational Testing Service.
7. Beller, M., N. Gafni, and P. Hanani. 2005. Constructing, adapting, and validating admissions tests in multiple languages: The Israeli case. In R. K. Hambleton, P. Merenda, and C. Spielberger, eds., Adapting Educational and Psychological Tests for Cross-Cultural Assessment. Hillsdale, NJ: Erlbaum, 297-319.
8. Bracey, G. W. 1991. Why can't they be like we were? Phi Delta Kappan 73:104-117.
9. Bracey, G. W. 1998. The eighth Bracey report on the condition of public education. Phi Delta Kappan 80:112-131.
10. Bradlow, E. T., H. Wainer, and X. Wang. 1999. A Bayesian random effects model for testlets. Psychometrika 64:153-168.
11. Brigham, C. C. 1934. The Reading of the Comprehensive Examination in English. Princeton, NJ: Princeton University Press.
12. Camara, W. J. 1997. The Relationship of PSAT/NMSQT Scores and AP Examination Grades. Research Note RN-02. New York: The College Board, Office of Research and Development.
13. Camara, W. J., and R. Millsap. 1998. Using the PSAT/NMSQT and Course Grades in Predicting Success in the Advanced Placement Program. College Board Report No. 98-4. New York: The College Board.
14. Carson, C. C., R. M. Huelskamp, and T. D. Woodall. 1993. Perspectives on education in America. Journal of Educational Research 86:259-311.
15. Cizek, G. J. 1993. Rethinking psychometricians' beliefs about learning. Educational Researcher 22:4-9.
16. College Entrance Examination Board. 1905. Various entrance tests. Stored in the ETS test archives.
17. Davier, A. A. von, P. W. Holland, and D. T. Thayer. 2004. The Kernel Method of Test Equating. New York: Springer-Verlag.
18. DeMauro. G. E. 1991. The effects of the availability of alternatives and the use of multiple choice or essay anchor tests on constructed response constructs. Draft report. Princeton, NJ: Educational Testing Service.
19. Dunn, M. C., J. B. Kadane, and J. R. Garrow. 2003. Comparing harm done by mobility and class absence: Missing students and missing data. Journal of Educational and Behavioral Statistics 28 (3): 269-288.
20. Feynman, R. P. 1965. The Character of Physical Law. Cambridge: MIT Press.
21. Finn, C. E., Jr. 1991. We Must Take Charge: Our Schools and Our Future. New York: Free Press.
22. Fitzpatrick, A. R., and W. M. Yen. 1993. The psychometric characteristics of choice items. Paper presented at the Annual Meeting of the National Council on Measurement in Education, April 13, Atlanta.
23. Fremer, J., R. Jackson, and M. McPeek. 1968. Review of the psychometric characteristics of the Advanced Placement tests in Chemistry, American History, and French. Internal memorandum. Princeton, NJ: Educational Testing Service.
24. Gelman, A., J. B. Carlin, H. S. Stern, and D. B. Rubin. 1995. Bayesian Data Analysis. London: Chapman & Hall.
25. Gulliksen, H. O. 1950. A Theory of Mental Tests, New York: John Wiley & Sons. Reprinted Hillsdale, NJ: Lawrence Erlbaum Associates, 1987.
26. Haag, C. H. 1985. Using the PSAT/NMSQT to Help Identify Advanced Placement Students. Publication 273678. Princeton, NJ: Advanced Placement Program, The College Board.
27. Hambleton, R. K. 1993. Translating achievement tests for use in cross-national studies. European Journal of Psychological Assessment 9:57-68.
28. Heubert, H., and R. M. Hauser, eds. 1999. High Stakes: Testing for Tracking, Promotion, and Graduation. Washington, DC: National Academies Press.
29. Holland, P. W. 2005. Counterfactuals. In Encyclopedia of Statistics in Behavioral Science. Chichester, UK: John Wiley & Sons, 420-422.
30. Holland, P. W., and D. B. Rubin. 1983. On Lord's paradox. In H. Wainer and S. Messick, eds., Principals of Modern Psychological Measurement. Hillsdale, NJ: Lawrence Erlbaum Associates, 3-25.
31. Hume, D. 1955. An Inquiry Concerning Human Understanding. Indianapolis: Bobbs-Merrill.
32. Jensen, A. R. 1998. The G Factor: The Science of Mental Ability. Westport, CT: Praeger.
33. Kant, I. 1998. Religion Within the Boundaries of Mere Reason: And Other Writings. Edited by Robert M. Adams and George Di Giovanni, translated by George Di Giovanni. New York: Cambridge University Press.
34. Kierkegaard, S. 1986. Either/Or. New York: Harper & Row.
35. Lawrence, I. 1992. Effect of Calculator Use on SAT-M Score Conversions and Equating. Draft Report. Princeton, NJ: Educational Testing Service.
36. Lichten, W., and H. Wainer. 2000. The aptitude-achievement function: An aid for allocating educational resources, with an advanced placement example. Educational Psychology Review 12 (2): 201-228.
37. Little, R.J.A., and D. B. Rubin. 1987. Statistical Analysis with Missing Data. New York: Wiley.
38. Lombard, H. C. 1835. De l'influence des professions sur la durée de la vie. Annales d'Hygiéne Publique et de Médecine Légale 14:88-131.
39. Lord, F. M. 1967. A paradox in the interpretation of group comparisons. Psychological Bulletin 68:304-305.
40. Luce, R. D. 1959. Individual Choice Behavior. Wiley: New York.
41. Lukhele, R., D. Thissen, and H. Wainer. 1994. On the relative value of multiplechoice, constructed response, and examinee-selected items on two achievement tests. Journal of Educational Measurement 31:234-250.
42. Lunz, M. E., and B. A. Bergstrom. 1994. An empirical study of computerized adaptive test administration conditions. Journal of Educational Measurement 31:251-263.
43. Lunz, M. E., B. A. Bergstrom, and B. D. Wright. 1992. The effect of review on student ability and test efficiency for computerized adaptive tests. Applied Psychological Measurement 16:33-40.
44. Madden, R. R. 1833. The Infirmities of Genius, Illustrated by Referring the Anomalies in Literary Character to the Habits and Constitutional Peculiarities of Men of Genius. London: Saunders and Otley.
45. Mangel, M., and F. J. Samaniego. 1984. Abraham Wald's work on aircraft survivability. Journal of the American Statistical Association 79:259-267.
46. Massey, D. S., and N. A. Denton. 1993. American Apartheid: Segregation and the Making of the Underclass. Cambridge: Harvard University Press.
47. Mathews, J. 1988. Escalante: The Best Teacher in America. New York: Holt.
48. Mathews, J. 1998. Class Struggle. New York: Times Books.
49. National Association for College Admission Counseling. 2008. Report of the Commission on the Use of Standardized Tests in Undergraduate Admission. Arlington, VA: NACAC. http://www.nacacnet.org/PublicationsResources/Research/Documents/TestingComission_FinalReport.pdf.
50. National Committee on Excellence in Education. 1983. A Nation at Risk: The Imperative for Educational Reform. Washington, DC: U.S. Department of Education.
51. Newrick, P. G., E. Affie, and R.J.M. Corrall. 1990. Relationship between longevity and lifeline: A manual study of 100 patients. Journal of the Royal Society of Medicine 83:499-501.
52. Nieves, E. 1999. Civil rights groups suing Berkeley over admissions policy. New York Times, February 3, A1.
53. Papanastasiou, E. C., and M. D. Reckase. 2007. A "rearrangement procedure" for scoring adaptive tests with review options. International Journal of Testing 7:387-407.
54. Pomplun, M., R. Morgan, and A. Nellikunnel. 1992. Choice in Advanced Placement Tests. ETS Statistical Report SR -92-51. Princeton, NJ: Educational Testing Service.
55. Poortinga, Y. H., and F.J.R. van de Vijver. 1991. Culture-free measurement in the history of cross-cultural psychology. Bulletin of the International Test Commission 18:72-87.
56. Popham, W. J. 1987. The merits of measurement-driven instruction. Phi delta kappan 68:679-682.
57. Powers, D. E., M. E. Fowles, M. Farnum, and K. Gerritz. 1992. Giving a Choice of Topics on a Test of Basic Writing Skills: Does It Make Any Difference? Research Report RR 92-19, Princeton, NJ: Educational Testing Service.
58. Pressley, M., K. Hilden, and R. Shankland. 2002. An Evaluation of End-Grade-3 Dynamics Indicators of Basic Early Literacy Skills (DIBELS): Speed Reading Without Comprehension. Technical Report. East Lansing, MI: Literacy Achievement Research Center.
59. Ravitch, D. 1985. The Schools We Deserve: Reflections on the Educational Crises of Our Time. New York: Basic.
60. Reckase, M. 2004. The real world is more complicated than we would like. Journal of Educational and Behavioral Statistics 29 (1): 117-120.
61. Ree, M. J., and J. A. Earles. 1991a. Predicting training success: Not much more than g. Personnel Psychology 44:321-332.
62. Ree, M. J., and J. A. Earles. 1991b. The stability of convergent estimates of g. Intelligence 15:271-278.
63. Ree, M. J., and J. A. Earles. 1992. Intelligence is the best predictor of job performance. Current Directions in Psychological Science 1:86-89.
64. Ree, M. J., and J. A. Earles. 1993. G is to psychology what carbon is to chemistry: A reply to Sternberg and Wagner, McClelland, and Calfee. Current Directions in Psychological Science 2:11-12.
65. Rosenbaum, P. R. 1995. Observational Studies. New York: Springer-Verlag.
66. Rosenbaum, P. R. 2002. Observational Studies. 2nd ed. New York: Springer-Verlag.
67. Rosenfeld, S. 1999. Cal hit with race-bias suit. San Francisco Examiner, February 2, A1.
68. Rubin, D. B., E. A. Stuart, and E. L. Zanutto. 2004. A potential outcomes view of value-added assessment in education. Journal of Educational and Behavioral Statistics 29 (1): 103-116.
69. Salganik, L. H., R. P. Phelps, L. Bianchi, D. Nohara, and T. M. Smith. 1993. Education in States and Nations: Indicators Comparing U.S. States with the OECD Countries in 1988. NCES Report No. 93-237. Washington, DC: National Center for Education Statistics.
70. Sanders, W. L., A. M. Saxton, and S. P. Horn. 1997. The Tennessee Value-Added Educational Assessment System (TVAAS): A quantitative, outcomes-based approach to educational assessment. In J. Millman, ed., Grading Teachers, Grading Schools: Is Student Achievement a Valid Evaluation Measure? Thousand Oaks, CA: Corwin Press, 137-162.
71. Schmidt, W. 2004. The role of content in value-added. Talk presented at the conference Value-Added Modeling: Issues with Theory and Application, University of Maryland, College Park, October 22.
72. Sireci, S. G. 1997. Problems and issues in linking assessments across languages. Educational Measurement: Issues and Practice 16 (1): 12-19, 29.
73. Sireci, S. G., B. Bastari, and A. Allalouf. 1998. Evaluating construct equivalence across adapted tests. Paper presented at the Annual Meetings of the American Psychological Association, San Francisco, August 14-18.
74. Thompson, D. W. 1917. On Growth and Form. Cambridge: Cambridge University Press.
75. Thurber, J. 1939. Fables for Our Time. New York: Harper & Row.
76. Tukey, J. W. 1977. Exploratory Data Analysis. Reading, MA: Addison-Wesley.
77. van de Vijver, F.J.R., and Y. H. Poortinga. 1997. Toward an integrated analysis of bias in cross-cultural assessment. European Journal of Psychological Assessment 13:29-37.
78. Vispoel, W. P. 1998. Reviewing and changing answers on computer-adaptive and self-adaptive vocabulary tests. Journal of Educational Measurement 35:328-347.
79. Wainer, H. 1986. Drawing Inferences from Self-Selected Samples. New York: Springer-Verlag.
80. Wainer, H. 1991. Adjusting for differential base-rates: Lord's paradox again. Psychological Bulletin 109:147-151.
81. Wainer, H. 1993. Some practical considerations when converting a linearly administered test to an adaptive format. Educational Measurement: Issues and Practice 12 (1): 15-20.
82. Wainer, H. 1999. The most dangerous profession: A note on nonsampling error. Psychological Methods 4 (3): 250-256.
83. Wainer, H. 2000. Computerized Adaptive Testing: A Primer. 2nd ed. Hillsdale, NJ: Lawrence Erlbaum Associates.
84. Wainer, H. 2005. Graphic Discovery: A Trout in the Milk and Other Visual Adventures. Princeton, NJ: Princeton University Press.
85. Wainer, H., and L. Brown. 2004. Two statistical paradoxes in the interpretation of group differences: Illustrated with medical school admission and licensing data. American Statistician 58:117-123.
86. Wainer, H., S. Palmer, and E. T. Bradlow. 1998. A selection of selection anomalies. Chance 11 (2): 3-7.
87. Wainer, H., and L. S. Steinberg. 1992. Sex differences in performance on the mathematics section of the Scholastic Aptitude Test: A bidirectional validity study. Harvard Educational Review 62:323-336.
88. Wainer, H., and D. Thissen. 1993. Combining multiple choice and constructed response test scores: Toward a Marxist theory of test construction. Applied Measurement in Education 6:103-118.
89. Wainer, H., and D. Thissen. 1994. On examinee choice in educational testing. Review of Educational Research 64:1-40.
90. Wainer, H., X. Wang, and D. Thissen. 1994. How well can we compare scores on test forms that are constructed by examinees' choice? Journal of Educational Measurement 31:183-199.
91. Wald, A. 1980. A reprint of "A method of estimating plane vulnerability based on damage of survivors." CRC 432, July. http://cna.org/sites/default/files/research/0204320000.pdf.
92. Wang, X., H. Wainer, and D. Thissen. 1993. On the viability of some untestable assumptions in equating exams that allow examinee choice. Applied Measurement in Education 8:211-225.
93. Willingham, W. W. 1985. Success in College: The Role of Personal Qualities and Academic Ability. New York: The College Board.
94. Willingham, W. W., C. Lewis, R. Morgan, and L. Ramist. 1990. Predicting College Grades: An Analysis of Institutional Trends over Two Decades. Princeton, NJ: Educational Testing Service.