Doubly robust internal benchmarking and false discovery rates for detecting racial bias in police stops

Journal of the American Statistical Association

Volumn 104, Issue 486, 2009, Pages 661-668

  Ridgeway, Greg ^a   Macdonald, John M ^b  

^a RAND CORPORATION   (United States)

^b UNIVERSITY OF PENNSYLVANIA   (United States)

Author keywords

Propensity score weighting; Racial profiling; Risk management systems

Indexed keywords

EID: 66549105133     PISSN: 01621459     EISSN: None     Source Type: Journal    
DOI: 10.1198/jasa.2009.0034     Document Type: Article

References (45)

1. Alpert, G., Smith, M., and Dunham, R. (2004), "Toward a Better Benchmark: Assessing the Utility of Not-at-Fault Traffic Crash Data in Racial Profiling Research," Justice Research and Policy, 6(2), 44-69.
2. Ayres, I. (2002), "Outcome Tests of Racial Disparities in Police Practices," Justice Research and Policy, 4(1), 131-142.
3. Bang, H., and Robins, J. (2005), "Doubly Robust Estimation in Missing Data and Causal Inference Models." Biometrics 61, 962-972. Corrected in 2008, Biometrics, 64, 650.
4. Benjamini, Y., and Hochberg, Y. (1995), "Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing," Journal of the Royal Statistical Society: Series B, 57, 289-300.
5. Birotte, A. (2007, November), "Training Evaluation and Management System (TEAMS) II Audit, Phase I (Fiscal Year 2007/2008)," Technical Report, Office of the Inspector General, Los Angeles Police Department, Los Angeles, CA. Available at http://www.lacity.org/oig/Reports/TEAMS2F1Report- 11-06-07.pdf.
6. Efron, B. (2004), "Large-Scale Simultaneous Hypothesis Testing: The Choice of a Null Hypothesis," Journal of the American Statistical Association, 99, 96-104.
7. -(2007), "Correlation and Large-Scale Simultaneous Significance Testing," Journal of the American Statistical Association, 102 (477), 93-103.
8. Efron, B., Hastie, T, Johnstone, I., and Tibshirani, R. (2004), "Least Angle Regression," Annals of Statistics, 32(2), 407-499.
9. Efron, B., Turnbull, B., and Narasimhan, B. (2008), locfdr 1.1 Package Manual. R project.
10. Fagan, J., and Davies, G. (2000), "Street Stops and Broken Windows: Terry, Race andDisorderinNewYorkCity," The Fordham Urban Law Journal, 28, 457-504.
11. Fridell, L. A. (2004), By the Numbers: A Guide for Analyzing Race Data from Vehicle Stops, Washington, DC: Police Executive Research Forum.
12. Friedman, J. (2001), "Greedy Function Approximation: A Gradient Boosting Machine," The Annals of Statistics, 29(5), 1189-1232.
13. Gelman, A., Fagan, J., and Kiss, A. (2007), "An Analysis of the New York City Police Department's "Stop-and-Frisk" Policy in the Context of Claims of Racial Bias," Journal of the American Statistical Association, 102, 813-823.
14. Grogger, J., and Ridgeway, G (2006), "Testing for Racial Profiling in Traffic Stops From Behind a Veil of Darkness," Journal of the American Statistical Association, 101(475), 878-887.
15. Hernández-Murillo, R., and Knowles, J. (2004), "Racial Profiling or Racist Policing? Testing in Aggregated Data," International Economic Review, 45(3), 959-989.
16. Hirano, K., and Imbens, G (2001), "Estimation of Causal Effects Using Propensity Score Weighting: An Application to Data on Right Heart Catheterization," Health Services and Outcomes Research Methodology, 2, 259-278.
17. Huber, P.J. (1967), "The Behavior of Maximum Likelihood Estimates Under Nonstandard Conditions," in Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability, Volume I, Berkeley: University of California Press, pp. 221-233.
18. Kang, J., and Schafer, J. (2007), "Demystifying Double Robustness: A Comparison of Alternative Strategies for Estimating a Population Mean From Incomplete Data," Statistical Science, 22(4), 523-580.
19. Kennedy, R. (1997), Race, Crime, and the Law, New York: Pantheon Books.
20. Klinger, D. A. (1997), "Negotiating Order in Patrol Work: An Ecological Theory of Police Response to Deviance," Criminology, 35(2), 277-306.
21. Knowles, J., Persico, N, and Todd, P. (2001), "Racial Bias in Motor Vehicle Searches: Theory and Evidence," The Journal of Political Economy, 109, 203-229.
22. Lamberth, J. (1994), "Revised Statistical Analysis of the Incidence of Police Stops and Arrests of Black Drivers/Travelers on the New Jersey Turnpike Between Exits or Interchanges 1 and 3 From the Years 1988 Through 1991," Technical Report, Temple University, Department of Psychology.
23. McConnell, E. H., and Scheidegger, A. R. (2001), "Race and Speeding Citations: Comparing Speeding Citations Issued by Air Traffic Officers With Those Issued by Ground Traffic Officers," in Annual Meeting of the Academy of Criminal Justice Sciences, Washington, D.C.
24. McCaffrey, D., Ridgeway, G., and Morral, A. (2004), "Propensity Score Estimation With Boosted Regression for Evaluating Causal Effects in Observational Studies," Psychological Methods, 9(4), 403-425.
25. Mease, D., Wyner, A., and Buja, A. (2007), "Boosted Classification Trees and Class Probability/Quantile Estimation," Journal of Machine Learning Research, 8, 409-439.
26. Montgomery County Department of Police (2002), Traffic Stop Data Collection Analysis, (3rd report), Montgomery County Department of Police.
27. National Research Council (2003), Fairness and Effectiveness in Policing: The Evidence, Washington, DC: The National Academies Press.
28. New York Civil Liberties Union (2007, February), "Long-Awaited "Stop-and-Frisk"Data Raises Questions About Racial Profiling and Overly AggressivePolicing, NYCLU says,"Press Release, Available at http://www.nyclu.org/node/919..
29. Persico, N. (2002), "Racial Profiling, Fairness, and Effectiveness of Policing," The American Economic Review, 92(5), 1472-1497.
30. Ridgeway, G (2006), "Assessing the Effect of Race Bias in Post-Traffic Stop Outcomes Using Propensity Scores," Journal of Quantitative Criminology, 22(1), 1-26.
31. -(2007a), "Analysis of Racial Disparities in the New York Police Department's Stop, Question, and Frisk Practices," Technical Report TR-534-NYCPF, RAND Corporation.
32. -(2007b), GBM 1.6-3 Package Manual, R Project.
33. Ridgeway, G, Schell, T. L., Riley, K. J., Turner, S., and Dixon, T. L. (2006) "Police-Community Relations in Cincinnati: Year Two Evaluation Report," Technical Report TR-445-CC, RAND Corporation, Santa Monica, CA. Available at http://www.rand.org/pubs/technical-reports/TR445/.
34. Rosenbaum, P., and Rubin, D. (1983), "The Central Role of the Propensity Score in Observational Studies for Causal Effects," Biometrika, 70, 41-55.
35. Russell-Brown, K. (1998), The Color of Crime: Racial Hoaxes, White Fear, Black Protectionism, Police Harassment and Other Macro-Aggressions, New York: New York University Press.
36. Sherman, L. W (1978), Scandal and Reform: Controlling Police Corruption, Berkeley: University of California Press.
37. Smith, M. R. (2005), "Depoliticizing Racial Profiling: Suggestions for the Limited Use and Management of Race in Police Decision-Making," George Mason University Civil Rights Law Journal, 15(2), 219-260.
38. Steward, D. (2004), Racial Profiling: Texas Traffic Stops and Searches, Technical Report, Steward Research Group, Austin, TX.
39. Tibshirani, R. (1995), "Regression Selection and Shrinkage Via the Lasso," Journal of the Royal Statistical Society: Series B, 57, 267-288.
40. Walker, S. (2001), "Searching for the Denominator: Problems with Police Traffic Stop Data and an Early Warning System Solution," Justice Research and Policy, 3(2), 63-95.
41. -(2002), "The Citizen's Guide to Interpreting Traffic Stop Data: Unraveling the Racial Profiling Controversy," unpublished manuscript.
42. -(2003a, "Early Intervention Systems for Law Enforcement Agencies: A Planning and Management Guide," Technical Report, Office of Community Oriented Policing Services, U.S. Department of Justice, Washington DC. Available at http://www.cops.usdoj.gov/html/cd-rom/inaction1/pubs/ EarlyInterventionSystemsLawEnforcement.pdf
43. -(2003b), "Internal Benchmarking for Traffic Stop Data: An Early Intervention System Approach," Technical Report, Police Executive Research Forum.
44. Weiss, A., and Grumet-Morris, A. (2005, July), "Illinois Traffic Stop Statistics Act Report for the Year 2004," Technical Report, Northwestern University Center for Public Safety, Evanston, IL. Available at http://www.dot.state.il.us/trafficstop/2004summary.pdf.
45. Wooldridge, J. (2001), Econometric Analysis of Cross Section and Panel Data, Cambridge: MIT Press.