We All Need Help: “Big Data” and the Mismeasure of Public Administration

Public Administration Review

Volumn 76, Issue 6, 2016, Pages 864-872

  Lavertu, Stéphane ^a  

^a OHIO STATE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 84940056189     PISSN: 00333352     EISSN: 15406210     Source Type: Journal    
DOI: 10.1111/puar.12436     Document Type: Article

References (78)

1. Arndt, Christiane. 2008. Politics of Governance Ratings. International Public Management Journal 11(3): 275–97.
2. Barzelay, Michael, and Fred Thompson. 2010. Back to the Future: Making Public Administration a Design Science. Special issue, Public Administration Review 70: S295–97.
3. Bozeman, Barry. 2007. Public Values and Public Interest: Counterbalancing Economic Individualism. Washington, DC: Georgetown University Press.
4. Bryson, John M., Barbara C. Crosby, and Laura Bloomberg. 2014. Public Value Governance: Moving Beyond Traditional Public Administration and the New Public Management. Public Administration Review 74(4): 445–56.
5. Carlson, Deven, and Stéphane Lavertu. 2015. The Effect of School Closure on Student Achievement: Evidence from Ohio's Automatic Charter School Closure Law. Research paper, John Glenn School of Public Affairs, The Ohio State University. http://glenn.osu.edu/educational-governance/research/ [accessed July 14, 2015].
6. Chakrabarti, Rajashri. 2014. Incentives and Response under No Child Left Behind: Credible Threats and the Role of Competition. Journal of Public Economics 110(1): 124–46.
7. Charbonneau, Étienne, and Gregg G. Van Ryzin. 2012. Performance Measures and Parental Satisfaction with New York City Schools. American Review of Public Administration 42(1): 54–65.
8. Chetty, Raj, John N. Friedman, and Jonah E. Rockoff. 2014a. Measuring the Impact of Teachers I: Evaluating Bias in Teacher Value-Added Estimates. American Economic Review 104(9): 2593–2632.
9. Chetty, Raj, John N. Friedman, and Jonah E. Rockoff. 2014b. Measuring the Impact of Teachers II: Evaluating Bias in Teacher Value-Added Estimates. American Economic Review 104(9): 2633–79.
10. Chingos, Matthew M., Michael Henderson, and Martin R. West. 2012. Citizen Perceptions of Government Service Quality: Evidence from Public Schools. Quarterly Journal of Political Science 7(4): 411–45.
11. Cook, Thomas D. 2014. “Big Data” in Research on Social Policy. Journal of Policy Analysis and Management 33(2): 544–47.
12. Dahl, Adam, and Joe Soss. 2014. Neoliberalism for the Common Good? Public Value Governance and the Downsizing of Democracy. Public Administration Review 74(4): 496–504.
13. Davidson, Elizabeth, Randall Reback, Jonah Rockoff, and Heather L. Schwartz. 2013. Fifty Ways to Leave a Child Behind: Idiosyncrasies and Discrepancies in States’ Implementation of NCLB. Working Paper no. 18988, National Bureau of Economic Research. http://www.nber.org/papers/w18988 [accessed July 14, 2015].
14. Dee, Thomas S., and Brian Jacob. 2011. The Impact of No Child Left Behind on Student Achievement. Journal of Policy Analysis and Management 30(3): 418–46.
15. Dieterle, Steven, Cassandra M. Cuarino, Mark D. Reckase, and Jeffrey M. Wooldridge. 2015. How Do Principals Assign Students to Teachers? Finding Evidence in Administrative Data and the Implications for Value Added. Journal of Policy Analysis and Management 34(1): 32–58.
16. Dixit, Avinash. 2002. Incentives and Organizations in the Public Sector. Journal of Human Resources 37(4): 696–727.
17. Deming, David J., Justine S. Hastings, Thomas J. Kane, and Douglas O. Staiger. 2014. School Choice, School Quality, and Postsecondary Attainment. American Economic Review 104(3): 991–1013.
18. Downey, Douglas B., Paul T. von Hippel, and Melanie Hughes. 2008. Are “Failing” Schools Really Failing? Using Seasonal Comparison to Evaluate School Effectiveness. Sociology of Education 81(3): 242–70.
19. Downs, Anthony. 1957. An Economic Theory of Democracy. New York: Harper.
20. Dror, Yehezkel. 1967. Policy Analysts: New Professional Role in Government Service. Public Administration Review 27(3): 197–203.
21. Farr, James, Jacob S. Hacker, and Nicole Kazee. 2006. The Policy Scientist of Democracy: The Discipline of Harold D. Lasswell. American Political Science Review 100(4): 579–87.
22. Favero, Nathan, and Kenneth J. Meier. 2013. Evaluating Urban Public Schools: Parents, Teachers, and State Assessments. Public Administration Review 73(3): 401–12.
23. Fischer, Frank. 2009. Democracy and Expertise: Reorienting Policy Inquiry. Oxford, UK: Oxford University Press.
24. Fung, Archon. 2013. Infotopia: Unleashing the Democratic Power of Transparency. Politics and Society 41(2): 183–212.
25. George, Gerry, Martine Hass, and Alex Pentland. 2014. Big Data and Management. Academy of Management Journal 57(2): 321–26.
26. Gerrish, Edwin. 2016. The Impact of Performance Management on Performance in Public Organizations: A Meta-Analysis. Public Administration Review 76(1): 48–66.
27. Gormley, William T., and David L. Weimer. 1999. Organizational Report Cards. Cambridge, MA: Harvard University Press.
28. Grissom, Jason A., and Stephanie Andersen. 2012. Why Superintendents Turn Over. American Educational Research Journal 49(6): 1146–80.
29. Grissom, Jason A., Demetra Kalogrides, and Susanna Loeb. 2015. Using Student Test Scores to Measure Principal Performance. Educational Evaluation and Policy Analysis 37(1): 3–28.
30. Hanushek, Eric A., Paul E. Peterson, and Ludger Woessmann. 2013. Endangering Prosperity: A Global View of the American School. Washington, DC: Brookings Institution Press.
31. Harris, Douglas N. 2011. Value-Added Measures in Education: What Every Educator Needs to Know. Cambridge, MA: Harvard Education Press.
32. Heckman, James J., Carolyn J. Heinrich, Pascal Courty, Gerald Marschke, and Jeffrey Smith. 2011. The Performance of Performance Standards. Kalamazoo, MI: W. E. Upjohn Institute for Employment Research.
33. Heinrich, Carolyn J., and Gerald Marschke. 2010. Incentives and Their Dynamics in Public Sector Performance Management Systems. Journal of Policy Analysis and Management 29(1): 183–208.
34. Hess, Frederick M., and Olivia Meeks. 2010. School Boards circa 2010: Governance in the Accountability Era. https://www.nsba.org/sites/default/files/SBcirca2010_WEB.pdf [accessed July 14, 2015].
35. Holmstrom, Bengt, and Paul Milgrom. 1991. Multitask Principal–Agent Analyses: Incentive Contracts, Asset Ownership, and Job Design. Special issue, Journal of Law, Economics, and Organization 7: 24–52.
36. Hood, Christopher, Ruth Dixon, and Craig Beeston. 2008. Rating the Rankings: Assessing International Rankings of Public Service Performance. International Public Management Journal 11(3): 298–328.
37. Howe, Kenneth R., and Kevin Murray. 2015. Why School Report Cards Merit a Failing Grade. Report, National Education Policy Center, University of Colorado Boulder. http://nepc.colorado.edu/publication/why-school-report-cards-fail [accessed July 14, 2015].
38. Jacobsen, Rebecca, Jeffrey W. Snyder, and Andrew Saultz. 2013. When Accountability Strategies Collide: Do Policy Changes That Raise Accountability Standards Also Erode Public Satisfaction? Education Policy 27(2): 360–89.
39. Jacobsen, Rebecca, Jeffrey W. Snyder, and Andrew Saultz. 2014a. Informing or Shaping Public Opinion? The Influence of School Accountability Data Format on Public Perceptions of School Quality. American Journal of Education 121(1): 1–27.
40. Jacobsen, Rebecca, Jeffrey W. Snyder, and Andrew Saultz. 2014b. Understanding Satisfaction with Schools: The Role of Expectations. Journal of Public Administration Research and Theory 25(3): 831–48.
41. Kogan, Vladimir, Stéphane Lavertu, and Zachary Peskowitz. 2015a. The Impact of Local Tax Referenda on School District Administration and Student Achievement. Research paper, John Glenn School of Public Affairs, The Ohio State University. http://glenn.osu.edu/educational-governance/research/ [accessed July 14, 2015].
42. Kogan, Vladimir, Stéphane Lavertu, and Zachary Peskowitz. 2015b. Performance Federalism and Local Democracy: Theory and Evidence from School Tax Referenda. American Journal of Political Science. Published electronically on (May 6), doi: 10.1111/ajps.12184.
43. Kogan, Vladimir, Stéphane Lavertu, and Zachary Peskowitz. 2015c. Do School Report Cards Produce Accountability through the Ballot Box? Research paper, John Glenn School of Public Affairs, The Ohio State University. http://glenn.osu.edu/educational-governance/research/ [accessed July 14, 2015].
44. Kurzweil, Ray. 2005. The Singularity Is Near: When Humans Transcend Biology. New York: Viking Press.
45. Langbein, Laura, and Stephen Knack. 2010. The World Governance Indicators: Six, One, or None? Journal of Development Studies 46(2): 350–70.
46. Lasswell, Harold D. 1951. The Policy Orientation. In The Policy Sciences: Recent Developments in Scope and Method, edited by Daniel Lerner, and Harold D. Lasswell, 3–43. Stanford, CA: Stanford University Press.
47. Lindblom, Charles E. 1959. The Science of “Muddling Through.”. Public Administration Review 19(2): 79–88.
48. Lorinskas, Robert A., Brett W. Hawkins, and Stephen D. Edwards. 1969. The Persistence of Ethnic Voting in Urban and Rural Areas: Results from a Controlled Election Method. Social Science Quarterly 49(3): 491–99.
49. Manna, Paul. 2006. School's In: Federalism and the National Education Agenda. Washington, DC: Georgetown University Press.
50. Manna, Paul. 2011. Collision Course: Federal Education Policy Meets State and Local Realities. Washington, DC: CQ Press.
51. Matson, Marsha, and Terry Susan Fine. 2006. Gender, Ethnicity, and Ballot Information: Ballot Cues in Low-Information Elections. State Politics and Policy Quarterly 6(1): 49–71.
52. McAfee, Andrew, and Erik Brynjolfsson. 2012. Big Data: The Management Revolution. Harvard Business Review 90(10): 60–66, 68, 128.
53. McDermott, Monika L. 1997. Voting Cues in Low-Information Elections: Candidate Genders as a Social Information Variable in Contemporary United States Elections. American Journal of Political Science 41(1): 270–83.
54. McGuinn, Patrick J. 2006. No Child Left Behind and the Transformation of Federal Education Policy, 1965–2005. Lawrence: University Press of Kansas.
55. Moore, Mark H. 2013. Recognizing Public Value. Cambridge, MA: Harvard University Press.
56. Moore, Mark H. 2014. Public Value Accounting: Establishing the Philosophical Basis. Public Administration Review 74(4): 465–77.
57. Moynihan, Donald P. 2008. The Dynamics of Performance Management: Constructing Information and Reform. Washington, DC: Georgetown University Press.
58. Moynihan, Donald P., Sergio Fernandez, Soonhee Kim, Kelly M. LeRoux, Suzanne J. Piotrowski, Bradley E. Wright, and Kaifeng Yang. 2011. Performance Regimes amidst Complexity. Supplement 1. Journal of Public Administration Research and Theory 21: i141–55.
59. National Council on Teacher Quality (NCTQ). 2012. State of the States 2012: Teacher Effectiveness Policies. http://www.nctq.org/dmsView/State_of_the_States_2012_Teacher_Effectiveness_Policies_NCTQ_Report [accessed July 14, 2015].
60. Olsen, Asmus Leth. 2015. Citizen (Dis)satisfaction: An Experimental Equivalence Framing Study. Public Administration Review 75(3): 469–78.
61. O'Malley, Martin. 2014. Doing What Works: Governing in the Age of Big Data. Public Administration Review 74(5): 555–56.
62. Pirog, Maureen A. 2014. Data Will Drive Innovation in Public Policy and Management Research in the Next Decade. Journal of Policy Analysis and Management 33(2): 537–43.
63. President's Committee on Administrative Management (PCAM). 1937. Administrative Management in the Government of the United States. Washington, DC: U.S. Government Printing Office.
64. Raadschelders, Jos C.N. 2011. Public Administration: The Interdisciplinary Study of Government. Oxford, UK: Oxford University Press.
65. Radin, Beryl A. 2000. Beyond Machiavelli: Policy Analysis Comes of Age. Washington, DC: Georgetown University Press.
66. Radin, Beryl A. 2006. Challenging the Performance Movement. Washington, DC: Georgetown University Press.
67. Radin, Beryl A. 2015. Baltimore: When Good Intentions Bring Negative Consequences. Public Administration Review 75(4): 511–12.
68. Reback, Randall, Jonah Rockoff, and Heather L. Schwartz. 2014. Under Pressure: Job Security, Resource Allocation, and Productivity in Schools under No Child Left Behind. American Economic Journal: Economic Policy 6(3): 207–41.
69. Reschenthaler, G.B., and Fred Thompson. 1996. The Information Revolution and the New Public Management. Journal of Public Administration Research and Theory 6(1): 125–44.
70. Rosenbloom, David H. 2007. Reinventing Administrative Prescriptions: The Case for Democratic-Constitutional Impact Statements and Scorecards. Public Administration Review 67(1): 28–39.
71. Rothstein, Jesse. 2014. Revisiting the Impacts of Teachers. Working paper, Goldman School of Public Policy and Department of Economics, University of California, Berkeley. http://eml.berkeley.edu/~jrothst/workingpapers/rothstein_cfr.pdf [accessed July 14, 2015].
72. Sass, Tim R., Anastasia Semykina, and Douglas N. Harris. 2014. Value-Added Models and the Measurement of Teacher Productivity. Economics of Education Review 38(1): 9–23.
73. Thaler, Richard, and Cass Sunstein. 2008. Nudge: Improving Decisions about Health, Wealth, and Happiness. New Haven, CT: Yale University Press.
74. Van de Walle, Steven, and Roberts Alasdair. 2008. Publishing Performance Information: An Illusion of Control?. In Performance Information in the Public Sector: How It Is Used, edited by Wouter Van Dooren, and Steven Van de Walle, 211–26. Basingstoke, UK: Palgrave Macmillan.
75. Weil, David, Mary Graham, and Archon Fung. 2013. Targeting Transparency. Science 340(6139): 1410–11.
76. Weimer, David L., and Aidan R. Vining. 2011. Policy Analysis: Concepts and Practice. Upper Saddle River, NJ: Longman.
77. West, Martin R. 2014. Why Do Americans Rate Their Local Public Schools So Favorably? Paper, Brookings Institution. http://www.brookings.edu/research/papers/2014/10/23-local-public-schools-west [accessed July 14, 2015].
78. Wichowsky, Amber, and Donald P. Moynihan. 2008. Measuring How Administration Shapes Citizenship: A Policy Feedback Perspective on Performance Management. Public Administration Review 68(5): 908–20.