Discrimination discovery in scientific project evaluation: A case study

Expert Systems with Applications

Volumn 40, Issue 15, 2013, Pages 6064-6079

  Romei, Andrea ^a   Ruggieri, Salvatore ^a   Turini, Franco ^a  

^a UNIVERSITY OF PISA   (Italy)

Author keywords

Case study; Data mining; Discrimination discovery; Gender bias; KDD process; Situation testing

Indexed keywords

DISCRIMINATION DISCOVERY; GENDER BIAS; GENDER DISCRIMINATION; KDD PROCESS; KNOWLEDGE DISCOVERY IN DATABASE; SCIENTIFIC RESEARCHES; STATISTICAL REGRESSION; TECHNIQUES OF ANALYSIS;

DATA MINING; DATA PROCESSING; PROJECT MANAGEMENT; STATISTICAL TESTS;

RESEARCH;

EID: 84878901742     PISSN: 09574174     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.eswa.2013.05.016     Document Type: Article

References (45)

1. M. Bendick Situation testing for employment discrimination in the United States of America Horizons Stratégiques 3 5 2007 17 39
2. Bentley, J.T., & Adamson, R. (2003). Gender differences in the careers of academic scientists and engineers: A literature review. Special report, National Science Foundation < http://www.nsf.gov >.
3. L. Bornmann, and H.-D. Daniel Selection of research fellowship recipients by committee peer review: Reliability, fairness and predictive validity of Board of Trustees' decisions Scientometrics 63 2 2005 297 320 (Pubitemid 43477819)
4. L. Bornmann, and H.-D. Daniel The state of h index research EMBO Reports 10 1 2009 2 6
5. L. Bornmann, R. Mutz, and H.-D. Daniel Latent markov modeling applied to grant peer review Journal of Informetrics 2 3 2008 217 228
6. L. Breiman Statistical modeling: The two cultures Statistical Science 16 3 2001 199 231 (Pubitemid 33636349)
7. M. Brouns The gendered nature of assessment procedures in scientific research funding: The Dutch case Higher Education in Europe 25 2 2000 193 199
8. T. Calders, and S. Verwer Three naive bayes approaches for discrimination-free classification Data Mining & Knowledge Discovery 21 2 2010 277 292
9. S.J. Ceci, and W.M. Williams Understanding current causes of women's underrepresentation in science Proceedings of the National Academy of Sciences 108 8 2011 3157 3162
10. W.W. Cohen Fast effective rule induction Proceedings of International Conference on Machine Learning (ICML 1998) 1995 Morgan Kaufmann 115 123
11. Council of the E.U. (1999). Resolution 1999/C 201/01 on women and science < http://www.eur-lex.europa.eu >.
12. B.H.M. Custers, T. Calders, B.W. Schermer, and T.Z. Zarsky Discrimination and privacy in the information society Studies in applied philosophy, epistemology and rational ethics Vol. 3 2013 Springer
13. Equal Employment Opportunity Commission (1978). Uniform guidelines on employee selection procedure. 43 FR 38295 < http://www.gpo.gov >.
14. European Commission (2009). The gender challenge in research funding: Assessing the European national scenes. Directorate General for Research, Science, Economy and Society, Unit L.4 < http://www.ec.europa.eu >.
15. European Commission (2012). Meta-analysis of gender and science research. Directorate General for Research and Innovation, Sector B6.2 < http://www.genderandscience.org >.
16. D. Firth Bias reduction of maximum likelihood estimates Biometrika 80 1 1993 27 38
17. E. Frank, and I.H. Witten Generating accurate rule sets without global optimization Proceedings of International Conference on Machine Learning (ICML 1998) 1998 Morgan Kaufmann 144 151
18. J.L. Gastwirth Statistical reasoning in the legal setting The American Statistician 46 1 1992 55 69
19. H. Goldstein Multilevel statistical models 4th ed. 2011 Wiley
20. Hajian, S., & Domingo-Ferrer, J. (in press). A methodology for direct and indirect discrimination prevention in data mining. IEEE Transactions on Knowledge and Data Engineering, http://dx.doi.org/10.1109/TKDE.2012.72.
21. G. Heinze A comparative investigation of methods for logistic regression with separated or nearly separated data Statistics in Medicine 25 24 2006 4216 4226 (Pubitemid 46023766)
22. U.W. Jayasinghe, H.W. Marsh, and N.W. Bond A multilevel cross-classified modeling approach to peer-review of grant proposals Journal of the Royal Statistical Society 166 3 2003 279 300
23. F. Kamiran, and T. Calders Data preprocessing techniques for classification without discrimination Knowledge and Information Systems 33 2012 1 33
24. M.R. Killingsworth Analyzing employment discrimination: From the seminar room to the courtroom American Economic Review 83 2 1993 67 72
25. V. Larivière, E. Vignola-Gagné, C. Villeneuve, P. Gélinas, and Y. Gingras Sex differences in research funding, productivity and impact: An analysis of Québec university professors Scientometrics 87 3 2011 483 498
26. T.J. Ley, and B.H. Hamilton The gender gap in NIH grant applications Science 322 5907 2008 1472 1474
27. B.T. Luong, S. Ruggieri, and F. Turini k-NN as an implementation of situation testing for discrimination discovery and prevention C. Apté, J. Ghosh, P. Smyth, Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD 2011) 2011 ACM 502 510
28. H.W. Marsh, U.W. Jayasinghe, and N.W. Bond Improving the peer-review process for grant applications: Reliability, validity, bias, and generalizability American Psychologist 63 3 2008 160 168
29. R. Mutz, L. Bornmann, and H.-D. Daniel Does gender matter in grant peer review? An empirical investigation using the example of the Austrian Science Fund Journal of Psychology 220 2012 121 129
30. D. Pager The use of field experiments for studies of employment discrimination: Contributions, critiques, and directions for the future The ANNALS of the American Academy of Political and Social Science 609 1 2007 104 133 (Pubitemid 44954350)
31. D. Pedreschi, S. Ruggieri, and F. Turini Discrimination-aware data mining Y. Li, B. Liu, S. Sarawagi, Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD 2008) 2008 ACM 560 568
32. L. Quillian New approaches to understanding racial prejudice and discrimination Annual Review of Sociology 32 1 2006 299 328 (Pubitemid 44474123)
33. J.R. Quinlan C4.5: Programs for machine learning 1993 Morgan Kaufmann San Mateo, CA
34. RAND (2005). Is there gender bias in federal grant programs? RAND infrastructure, safety, and environment brief RB-9147-NSF < http://www.rand.org >.
35. A. Romei, and S. Ruggieri Discrimination data analysis: A multi-disciplinary bibliography B.H.M. Custers, T. Calders, B.W. Schermer, T.Z. Zarsky, Discrimination and privacy in the information society Studies in applied philosophy, epistemology and rational ethics Vol. 3 2013 Springer 109 135
36. A. Romei, S. Ruggieri, and F. Turini Discovering gender discrimination in project funding Proceedings of the IEEE ICDM 2012 International Workshop on Discrimination and Privacy-Aware Data Mining (DPADM) 2012 IEEE Computer Society 394 401
37. A. Romei, and F. Turini XML data mining Software: Practice and Experience 40 2 2010 101 130
38. Rorive, I. (2009). Proving discrimination cases - The role of situation testing. Centre For Equal Rights & Migration Policy Group < http://www.migpolgroup.com >.
39. S. Ruggieri, D. Pedreschi, and F. Turini Data mining for discrimination discovery ACM Transactions on Knowledge Discovery from Data 4 2 2010 Article 9
40. S. Ruggieri, D. Pedreschi, and F. Turini DCUBE: Discrimination discovery in databases A.K. Elmagarmid, D. Agrawal, Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD 2010) 2010 ACM 1127 1130
41. U. Sandström, and M. Hällsten Persistent nepotism in peer-review Scientometrics 74 2 2008 175 189
42. UNESCO (2007). Science, technology and gender: An international report (4th ed.). UNESCO Publishing.
43. C. Wennerås, and A. Wold Nepotism and sexism in peer-review Nature 387 5 1997 341 343 (Pubitemid 27227180)
44. R. Wilson Where the elite teach, it's still a man's world The Chronicle of Higher Education 51 15 2004
45. I.H. Witten, and E. Frank Data mining: Practical machine learning tools and techniques with java implementations 3rd ed. 2011 Morgan Kaufmann San Francisco