A comprehensive survey of the reviewer assignment problem

International Journal of Information Technology and Decision Making

Volumn 9, Issue 4, 2010, Pages 645-668

  Wang, Fan ^a   Shi, Ning ^a   Chen, Ben ^a  

^a SUN YAT SEN UNIVERSITY   (China)

Author keywords

information retrieval; optimization; Reviewer assignment

Indexed keywords

EID: 77954820992     PISSN: 02196220     EISSN: None     Source Type: Journal    
DOI: 10.1142/S0219622010003993     Document Type: Article

References (81)

1. P. Evans, The peer-review process, Literati Newsline: Special Issue for Authors and Editors 2 (1995).
2. H. El-Munchid, Evaluation of peer review in biomedical publications, Annals of Saudi Medicine 21 (2001) 5-6.
3. V. Bence and C. Oppenheim, The influence of peer review on the research assessment exercise, Journal of Information Science 30 (2004) 347-368.
4. Santini, S, We are Sorry to Inform You. . . , IEEE Computer 38 (2005) 128-1127
5. F. Casati, Giunchiglia and F. M. Marchese, Publish and perish: Why the current publication and review model is killing research and wasting your money, Ubiquity 8 (2007) 1.
6. JAIR, Journal of Artificial Intelligence Research e-journal, 2008. Available at: www.jair.org (accessed 6 November 2008).
7. R. Smith, Opening up BMJ peer review: A beginning that should lead to complete transparency, British Medical Journal 318 (1999) 4-5.
8. R. Weber, The journal review process: A Manifesto for change, Communications of the Association for Information Systems 2 (1999).
9. S. Harnad, Free at last: The future of peer reviewed journals, D-Lib Magazine 5 (1999).
10. J. C. Wei, D. Hartvigsen and R. Czuchlewski, The conference paper-reviewer assignment problem, Decision Science 30 (1999) 865-876.
11. M. A. Rodriguez and J. Bollen, An Algorithm to Determine Peer-Reviewers, arxiv preprint cs.DL/0605112, 2006.
12. S. Dumais and J. Nielsen, Automating the assignment of submitted manuscripts to reviewers, Proceedings of the 15th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (Copenhagen, Denmark, 1992), pp. 233-244.
13. A. Pesenhofer, R.Mayer and A. Rauber, Improving scientific conferences by enhancing conference management systems with information mining capabilities, Proceedings of IEEE International Conference on Digital Information Management (ICDIM 2006), pp. 359-366.
14. R. T. Snodgrass and J. Li, Summary of Conference Management Software. Available at: http://www.acm.org/sigs/sgb/summary.html (accessed, February 2009).
15. J. Goldsmith and R. H. Solan, The AI conference paper assignment problem, Proc. AAAI 2007 Workshop on Preference Handling for Artificial Intelligence (British Columbia, Canada, 2007), pp. 53-57.
16. S. Hettich and M. J. Pazzani, Mining for proposal reviewers: Lessons learned at the national science foundation, Proceedings of the 12th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD'06) (Philadelphia Pennsylvania, USA, 2006).
17. P. Willett, Recent trends in hierarchic document clustering: A critical review, Information Processing and Management 24 (1998) 577-597.
18. B. Larsen and A. Chinatsu, Fast and effective text mining using linear-time document clustering, Proceedings of the fifth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (1999), pp. 16-22.
19. H. K. Biswas and M. M. Hasan, Using publications and domain knowledge to build research profiles: An application in automatic reviewer assignment, Proceedings of the 2007 International Conference on Information and Communication Technology (Dhaka, Bangladesh, 2007).
20. C. Giles, K. Bollacker and S. Lawrence, CiteSeer: An automatic citation indexing system, The Third ACM Conference on Digital Libraries (1998), pp. 89-98.
21. G. Fox, A. F. Mustacoglu, A. E. Topcu and A. Cami, SRG: A digital documentenhanced service oriented research grid, Information Reuse and Integration (IEEE IRI-2007) (Las Vegas, USA, 2007).
22. Y. H. Sun, J. Ma, Z. P. Fan and J. Wang, A hybrid knowledge and model approach for reviewer assignment, in Proceedings of the 40th Annual Hawaii International Conference on System Sciences (HICSS'07) (2007).
23. A. D. Henriksen and A. J. Traynor, A practical R&D project-selection scoring tool, IEEE Trans. Eng. Manage. 46 (1999) 158-170.
24. Q. Tian, J. Ma and O. Liu, A hybrid knowledge and model system for R&D project selection, Expert Syst. Appl. 23 (2002) 265-271.
25. Q. Tian, J. Ma, J. Liang, R. C. W. Kwok and O. Liu, An organizational decision support system for effective R&D project selection, Decis. Support Syst. 39 (2005) 403-413.
26. B. Aleman-Meza, M. Nagarajan, C. Ramakrishnan, L. Ding, P. Kolari, A. P. Sheth, I. B. Arpinar, A. Joshi and T. Finin, Semantic analytics on social networks: Experiences in addressing the problem of conflict of interest detection, Proceedings of the 15th International World Wide Web Conference (Edinburgh, Scotland, 2006), pp. 407-416.
27. M. Papagelis, D. Plexousakis and P. N. Nikolaou, CONFIOUS: Managing the electronic submission and reviewing process of scientific conferences, Proc. of the 6th International Conference on Web Information Systems Engineering (New York, USA, 2005).
28. J. Li, H. Boley, V. C. Bhavsar and J. Mei, Expert finding for eCollaboration using FOAF with RuleML rules, Conference on eTechnologies (Montreal, Canada, 2006).
29. U. Bojars, Extending FOAF with resume information, First Workshop on FOAF, Social Networks and the Semantic Web (Galway, Ireland, 2004).
30. S. R. Kruk and S. Decker, Semantic social collaborative filtering with FOAFRealm, First Semantic Desktop Workshop (Galway, Ireland, 2005).
31. A. Schirrer, K. F. Doerner and R. F. Hartl, Reviewer assignment for scientific articles using memetic algorithms, Operations Research/Computer Science Interfaces Series 39 (2007) 113-134.
32. D. Hartvigsen, J. C. Wei and R. Czuchlewski, The conference paper-reviewer assignment problem, Decision Sciences 30 (1999) 865-876.
33. R. K. Ahuja, T. L. Magnanti and J. B. Orlin, Network Flows: Theory, Algorithms, and Applications (Prentice Hall, 2003).
34. G. Salton and M. McGill, An Introduction to Modern Information Retrieval (New York, McGraw-Hill, 1983).
35. P. R. Cohen and R. Kjeldsen, Information retrieval by constrained spreading activation in semantic network, Information Processing & Management 23 (1987) 255-268.
36. S. Deerwester, S. Dumais, T. Landauer, G. Furnas and R. Harsham, Indexing by latent semantic analysis, Journal of the American Society for Information Science 41 (1990) 391-407.
37. D. Yarowsky and R. Florian, Taking the load off the conference chairs: Towards a digital paper-routing assistant, Proceedings of the 1999 Joint SIGDAT Conference on Empirical Methods in NLP and Very-Large Corpora (1999).
38. K. Antonina, B. Barbro, V. Hannu and V. Ari, Prototype-matching system for allocating conference papers, Proceedings of the 36th Annual Hawaii International Conference on System Sciences (Hawaii, USA, 2003), pp. 70-80.
39. J. Konstan, B. Miller, D. Maltz, L. Herlocker, L. Gordon and J. Riedl, Grouplens: Applying collaborative filtering to usenet News, Communications of the ACM 40 (1997) 77-87.
40. W. Hill, L. Stead, M. Rosenstein and G. Furnas, Recommending and evaluating choices in a virtual community of use, Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Denver, Colorado, United States, 2005), pp. 194-201.
41. C. Basu, H. Hirsh and W. Cohen, Recommendation as classification: Using social and content-based information in recommendation, Proceedings of the Fifteenth National Conference on Artificial Intelligence (California, USA, 1998).
42. U. Shardanand and P. Maes, Social information filtering: Algorithms for automating "Word of Mouth", Proceedings of CHI-95 (1995).
43. W. Cohen and W. Fan, Web-collaborative filtering: Recommending music by crawling the web. Proceedings of the 9th International World Wide Web Conference on Computer Networks: The International Journal of Computer and Telecommunications Networking Amsterdam (The Netherlands, 2000), pp. 685-698.
44. D. Gupta, M. Digiovanni, H. Narita and K. Goldberg, Jester 2.0: A new linear time collaborative filtering algorithm applied to jokes, Workshop on Recommender Systems Algorithms and Evaluation, 22nd International Conference on Research and Development in Information Retrieval (California, USA, 1999).
45. L. Yu, L. Liu and X. Li, A hybrid collaborative filtering method for multiple-interests and multiple-content recommendation in ecommerce, Expert Systems with Applications 28 (2005) 67-77.
46. S. Watanabe, T. Ito, T. Ozono and T. Shintani, A paper recommendation mechanism for the research support system papits, Proceeding of International Workshop on Data Engineering Issues in E-Commerce (2005), pp. 71-80.
47. M. A. Rodriguez and J. Bollen, Simulating Network Influence Algorithms Using Particle-Swarms: Pagerank and Pagerank-priors, CoRR abs/cs/0602002 (2006).
48. X. Liu, J. Bollen, M. L. Nelson and H. V. de Sompel, Co-authorship networks in the digital library research community, Information Processing and Management 41 (2005) 1462-1480.
49. E. Atlam, A new Approach for Text similarity using articles, International Journal of Information Technology & Decision Making 7(1) (2008) 23-24.
50. A. Popescul, L. H. Ungar, D. M. Pennock and S. Lawrence, Probabilistic models for unified collaborative and content-base recommendation in sparse-data environments, Proceeding of the 17th Conference on Uncertainty in Artificial Intelligence (UAI-2001) (Morgan Kaufmann, San Francisco, 2001).
51. T. Hofmann, Probabilistic latent semantic analysis, Proceeding of the 15th Conference on Uncertainty in Artificial Intelligence (1999), pp. 289-296.
52. C. Basu, H. Hirsh, W. Cohen and C. Nevill-Manning, Technical paper recommendation: A study in combining multiple information sources, Journal of Artificial Intelligence Research 14 (2001) 231-252.
53. T. J. Siddiqui and U. S. Tiwary, Utilizing local context for effective information retrieval, International Journal of Information Technology & Decision Making 7 (2008).
54. Y. Peng, G. Kou, Y. Shi and Z. X. Chen, A descriptive framework for the field of data mining and knowledge discovery, International Journal of Information Technology & Decision Making 7(4) (2008) 639-682.
55. K. Tatsumi and T. Tanino, Improved projection hopfield network for the quadratic assignment problem, International Journal of Information Technology & Decision Making 7(1) (2008) 53-70.
56. S. L. Janak, M. S. Taylor, C. A. Floudas, M. Burka and T. J. Mountzizris, Novel and effective integer optimization approach for the NSF panel-assignment problem: A multiresource and preference-constrained generalized assignment problem, Industrial & Engineering Chemistry Research 45 (2006) 258-265.
57. A. Caprara, P. Toth and M. Fischetti, Algorithms for the set covering problem, Annals of Operations Research 98 (2000) 353-371.
58. M. Dell'Amico and S. Martello, The k-cardinality assignment problem, Discrete Applied Mathematics 76 (1997) 103-121.
59. L. J. LeBlanc, D. Randels and T. K. Swann, Heery international's spreadsheet optimization model for assigning managers to construction projects, Interface 30 (2000) 95-106.
60. M. W. Carter and C. A. Tovey, When is the classroom assignment problem hard? Operations Research 40 (1992) 28-39.
61. P. Hansen and R. E. Wendell, A note on airline commuting, Interfaces 11 (1982) 85-87.
62. G. Caron, P. Hansen and B. Jaumard, The assignment problem with seniority and job priority constraints, Operations Research 47 (1999) 449-454.
63. D. Klingman and N. Phillips, Topological and computational aspects of preemptive multicriteria military personnel assignment problems, Management Sciences 30 (1984) 1362-1375.
64. D. O. Bausch, G. G. Brown, D. R. Hundley, S. H. Rapp and R. E. Rosenthal, Mobilizing marine corps officers, Interfaces 21 (1991) 26-38.
65. A. Veronika, L. S. Riantini and B. Trigunarsyah, Corrective action recommendation for project cost variance in construction material management, Proceedings of the 10th East Asia-Pacific Conference on Structural Engineering and Construcion (Bangkok, Thailand, 2006), pp. 23-28.
66. J. J. Merelo-Guervos, F. J. Garcoa-Castellano, P. A. Castillo and M. G. Arenas, How evolutionary computation and Perl saved my conference, MAEB03, Segundo Congreso Espaool sobre Metaheurosticas, ed. L. Sonchez (Algoritmos Evolutivos y Bioinspirados, 2003), pp. 93-99.
67. S. Benferhat and J. Lang, Conference paper assignment, International Journal of Intelligent Systems 16 (2001) 1183-1192.
68. D. G. Cattrysse and L. N. VanWassenhove, A survey of algorithms for the generalized assignment problem, European Journal of Operational Research 60 (1992) 260-272.
69. M. Savesbergh, A branch-and-price algorithm for the generalized assignment problem, Operational Research 45 (1997) 831-841.
70. J. J. Merelo-Guervos and P. Castillo-Valdivieso, Conference paper assignment using a combined Greedy/ evolutionary algorithm, Lecture Notes in Computer Science (2004), pp. 602-611.
71. P. Moscato and C. Cotta, A gentle introduction to memetic algorithms, Handbook of Metaheuristics, eds. Glover, Fred, Kochenberger, Gary A. (Kluwer Academic Publishers, 2003), pp. 105-144.
72. W. D. Cook, B. Golany, M. Kress, M. Penn and T. Raviv, Optimal allocation of proposals to reviewers to facilitate effective ranking, Management Science 51 (2005) 655-661.
73. M. M. Solomon, Algorithms for the vehicle routing and scheduling problems with time window constraints, Operations Research 35 (1987) 254-265.
74. Netflix, http://www.netflixprize.com/ Last check date: November 4, 2008.
75. R. Jin, L. Si, C. Zhai and J. Callan, Collaborative filtering with decoupled models for preferences and ratings, Proceedings of the 12th International Conference on Information and Knowledge Management (New Orleans, 2003).
76. C. Christakou, S. Veettos and A. Stafylopatis, A hybrid movie recommender system on neural networks, International Journal of Information Technology & Decision Making 7(4) (2008) 639-682.
77. J. Lehmann, J. Schuppel and S. Auer, Discovering unknown connections - The DBpedia relationship finder, Proceedings of the 1st SABRE Conference on Social Semantic Web (CSSW) (2007).
78. G. Adomavicius and Y. Kwon, New recommendation techniques for multi-criteria rating systems. IEEE Intelligent Systems 22 (2007) 48-55.
79. D. W. Fellner and M. Zens, Managing Conference Proceeding TUBSCG TU Braunschweig, 2001, cgv.tugraz.at.
80. J. Geller, How IJCAI 1999 can prove the value of AI by using AI, Proceeding of the 15-th International Joint Conference on Artificial Intelligence (San Mateo, CA, 1997), pp. 55-58.
81. J. Geller and R. Scherl, Challenge: Technology for Automated Reviewer Selection http://njit.edu/~geller/finalchall.ps, 1997.