Combining relevancy and methodological quality into a single ranking for evidence-based medicine

Information Sciences

Volumn 214, Issue , 2012, Pages 76-90

  Choi, Sungbin ^a   Ryu, Borim ^a   Yoo, Sooyoung ^b   Choi, Jinwook ^a  

^a Seoul National University   (South Korea)

^b Seoul National University Bundang Hospital   (South Korea)

Author keywords

Classification; Document quality; Evidence based medicine; Ranking

Indexed keywords

CLINICAL PRACTICES; COCHRANE REVIEW; COMPREHENSIVE EVALUATION; DOCUMENT QUALITY; EVIDENCE-BASED MEDICINE; FUSION METHODS; MEDICAL RESEARCH; RANKING; RANKING ALGORITHM; TEST COLLECTION;

CLASSIFICATION (OF INFORMATION); SEARCH ENGINES;

INFORMATION RETRIEVAL SYSTEMS;

EID: 84863983405     PISSN: 00200255     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ins.2012.05.027     Document Type: Article

References (84)

1. About ACP Journal Club (cited 2011 July 15), < http://www.acpjc.org/ shared/purpose-and-procedure.htm >.
2. ACP Journal Club (cited 2011 July 15), < http://acpjc.acponline.org/ >.
3. The Cochrane Library (cited 2011 July 15), < http://www. thecochranelibrary.com >.
4. Cochrane Reviews (cited 2011 July 15), < http://www.cochrane.org/ cochrane-reviews >.
5. Evidence-Based Medicine (cited 2011 July 15), < http://ebm.bmj.com/ >.
6. Google Scholar (cited 2011 July 14), < http://scholar.google.com >.
7. Leasing Journal Citations (cited 2011 July 15), < http://www.nlm.nih. gov/databases/journal.html >.
8. MeSH (cited 2011 July 15), < http://www.ncbi.nlm.nih.gov/mesh >.
9. PubMed (cited 2011 July 14), < http://www.ncbi.nlm.nih.gov/pubmed/ >.
10. PubMed Clinical Queries (cited 2011 July 15), < http://www.ncbi.nlm. nih.gov/pubmed/clinical >.
11. S. Alonso h-Index: a review focused in its variants, computation and standardization for different scientific fields Journal of Informetrics 3 4 2009 273 289
12. S. Alonso hg-Index: a new index to characterize the scientific output of researchers based on the h-and g-indices Scientometrics 82 2 2010 391 400
13. G. Amati, and C.J. Van Rijsbergen Probabilistic models of information retrieval based on measuring the divergence from randomness ACM Transactions on Information Systems (TOIS) 20 4 2002 357 389
14. Amit Ghosh, D. Stengel, Nancy Spector, Narayana Murali, Franz Porzsolt (Eds.), Evidence-Based Health Care Seen From Four Points of View, Optimizing Health: Improving the Value of Healthcare Delivery, 2006, pp. 205-216.
15. P.B. Andrew The use of the area under the ROC curve in the evaluation of machine learning algorithms Pattern Recognition 30 7 1997 1145 1159
16. Y. Aphinyanaphongs Text categorization models for high-quality article retrieval in internal medicine Journal of the American Medical Informatics Association 12 2 2005 207 216 (Pubitemid 40298955)
17. C. Apté, F. Damerau, and S.M. Weiss Automated learning of decision rules for text categorization ACM Transactions on Information Systems (TOIS) 12 3 1994 233 251
18. J.A. Aslam, and M. Montague Models for metasearch Proceedings of the 24th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval 2001 ACM New Orleans, Louisiana, United States 276 284 (Pubitemid 32951081)
19. V. Bewick, L. Cheek, and J. Ball Statistics review 13: receiver operating characteristic curves Crit Care 8 6 2004 508 512 (Pubitemid 40073688)
20. D.M. Bruce Croft, and Trevor Strohman Search Engines: Information Retrieval in Practice 2009 Addison-Wesley Publishing Company 235 236
21. A.L. Cochrane Effectiveness and Efficiency: Random Reflections on Health Services 1972 Nuffield Provincial Hospitals Trust London 1 60
22. G.V. Cormack, and T.R. Lynam Validity and power of t-test for comparing MAP and GMAP Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval 2007 ACM Amsterdam, The Netherlands 753 754 (Pubitemid 350165053)
23. D. Demner-Fushman, and J. Lin Answering clinical questions with knowledge-based and statistical techniques Computational Linguistics 33 1 2007 63 103
24. H. Drucker, D. Wu, and V.N. Vapnik Support vector machines for spam categorization IEEE Transactions on Neural Networks 10 5 1999 1048 1054
25. A. Edward, J.A.S. Fox, Combination of multiple searches, in: Proceedings of the 2nd Text REtrieval Conference (TREC-2), NIST Special Publication Gaithersburg, Maryland, USA, 1994.
26. S. Eyheramendy, D.D. Lewis, D. Madigan, On the naive bayes model for text categorization, in: 9th International Workshop on Artificial Intelligence and Statistics, Key West, Florida, 2003, pp. 332-339.
27. H. Fang, T. Tao, and C. Zhai A formal study of information retrieval heuristics Proceedings of the 27th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval 2004 ACM Sheffield, United Kingdom 49 56
28. H. Fang, and C.X. Zhai Semantic term matching in axiomatic approaches to information retrieval Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval 2006 ACM 115 122
29. S. Gerani, M. Carman, and F. Crestani Investigating learning approaches for blog post opinion retrieval M. Boughanem, Advances in Information Retrieval 2009 Springer Berlin/ Heidelberg 313 324
30. C.H. Goulden Methods of Statistical Analysis second ed. 1952 Wiley New York
31. Y. Guo, Z. Shao, and N. Hua Automatic text categorization based on content analysis with cognitive situation models Information Sciences 180 5 2010 613 630
32. H. Zaragoza, N. Craswell, M. Taylor, S. Saria, S. Robertson, Microsoft cambridge at TREC 13: Web and hard tracks, in: Text Retrieval Conference, Gaithersburg, Maryland, 2004.
33. M. Hall The WEKA data mining software: an update SIGKDD Exploration Newsletter 11 1 2009 10 18
34. R.B. Haynes Optimal search strategies for retrieving scientifically strong studies of treatment from Medline: analytical survey BMJ 330 7501 2005 1179
35. R.B. Haynes Developing optimal search strategies for detecting clinically sound studies in MEDLINE Journal of the American Medical Informatics Association 1 6 1994 447 458
36. R.B. Haynes, and N.L. Wilczynski Optimal search strategies for retrieving scientifically strong studies of diagnosis from Medline: analytical survey BMJ 328 7447 2004 1040
37. A. Herdagdelen Generalized syntactic and semantic models of query reformulation Proceedings of the 33rd International ACM SIGIR Conference on Research and Development in Information Retrieval 2010 ACM Geneva, Switzerland
38. E. Herrera-Viedma Evaluating the information quality of web sites: a methodology based on fuzzy computing with words Journal of the American Society for Information Science and Technology 57 4 2006 538 549
39. E. Herrera-Viedma, and E. Peis Evaluating the informative quality of documents in SGML format from judgements by means of fuzzy linguistic techniques based on computing with words Information Processing & Management 39 2 2003 233 249
40. W. Hersh OHSUMED: an interactive retrieval evaluation and new large test collection for research Proceedings of the 17th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval 1994 Springer-Verlag New York, Inc. Dublin, Ireland 192 201
41. T. Hughes, An interview with Anurag Acharya, Google Scholar lead engineer (cited 2011 July 14), < http://www.aardvarknet.info/access/number59/ monthnews.cfm?monthnews=04 >.
42. Iadh Ounis, Craig Macdonald, Ian Soboroff. On the TREC blog track, in: AAAI International Conference on Weblogs and Social Media, 2008.
43. Iadh Ounis, G. Amati, Vassilis Plachouras, Ben He, Craig Macdonald, Christina Lioma, Terrier: a high performance and scalable information retrieval platform, in: ACM SIGIR Workshop on Open Source Information Retrieval, Seattle, WA, USA, 2006, pp. 18-25.
44. N.C. Ide, R.F. Loane, and D. Demner-Fushman Essie: a concept-based search engine for structured biomedical text Journal of the American Medical Informatics Association 14 3 2007 253 263 (Pubitemid 46636341)
45. T. Joachims Making large-Scale SVM learning practical Advances in Kernel Methods - Support Vector Learning 1999 MIT Press 169 184
46. T. Joachims, SVM-perf, 2009 (cited 2011 July 15), < http://www.cs.cornell.edu/People/tj/svm-light/svm-perf.html >.
47. T. Joachims, Text categorization with support vector machines: Learning with many relevant features, in: European Conference on Machine Learning, Chemnitz, Germany, 1998, pp. 137-142. (Pubitemid 128067178)
48. T. Joachims Training linear SVMs in linear time Proceedings of the 12th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining 2006 ACM Philadelphia, PA, USA 217 226 (Pubitemid 44535518)
49. S. Karimi The challenge of high recall in biomedical systematic search Proceeding of the Third International Workshop on Data and Text Mining in Bioinformatics 2009 ACM Hong Kong, China 89 92
50. H. Kilicoglu Towards automatic recognition of scientifically rigorous clinical research evidence Journal of the American Medical Informatics Association 16 1 2009 25
51. O. Kolomiyets, and M.F. Moens A survey on question answering technology from an information retrieval perspective Information Sciences 181 24 2011 5412 5434
52. D.R. Liu, P.Y. Tsai, and P.H. Chiu Personalized recommendation of popular blog articles for mobile applications Information Sciences 181 9 2011 1552 1572
53. T.-Y. Liu Learning to rank for information retrieval Foundations and Trends in Information Retrieval 3 3 2011 225 331
54. Y. Lou, Z. Li, and Q. Chen Semantic relevance ranking for XML keyword search Information Sciences 190 0 2011 127 143
55. C. Macdonald, I. Ounis, I. Soboroff. Overview of the TREC 2007 blog track, in: Proc. of the Text Retrieval Conference, Gaithersburg, Maryland, USA, 2007.
56. C.D. Manning, P. Raghavan, and H. Schutze Introduction to Information Retrieval vol. 1 2008 Cambridge University Press Cambridge 140 144
57. C.D. Manning, P. Raghavan, and H. Schutze Introduction to Information Retrieval vol. 1 2008 Cambridge University Press Cambridge 307 310
58. M. Montague, and J.A. Aslam Condorcet fusion for improved retrieval Proceedings of the Eleventh International Conference on Information and Knowledge Management 2002 ACM McLean, Virginia, USA 538 548
59. T. Mullen, N. Collier, Sentiment analysis using support vector machines with diverse information sources, in: Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), Barcelona, Spain, 2004, pp. 412-418.
60. E. Nuesch Doxycycline for osteoarthritis of the knee or hip Cochrane Database of Systematic Reviews 4 2009
61. E. Nuesch Oral or transdermal opioids for osteoarthritis of the knee or hip Cochrane Database of Systematic Reviews 4 2009 CD003115
62. J.H. Park, W.B. Croft, and D.A. Smith A quasi-synchronous dependence model for information retrieval Proceedings of the 20th ACM International Conference on Information and Knowledge Management 2011 ACM Glasgow, Scotland, UK 17 26
63. C. Porcel A hybrid recommender system for the selective dissemination of research resources in a technology transfer office Information Sciences 184 1 2012 1 19
64. T.C. Rindflesch, and M. Fiszman The interaction of domain knowledge and linguistic structure in natural language processing: interpreting hypernymic propositions in biomedical text Journal of Biomedical Informatics 36 6 2003 462 477 (Pubitemid 38169374)
65. S.E. Robertson, W.S. Okapi, Keenbow at TREC-8, in: Eighth Text REtrieval Conference (TREC-8), Gaithersburg, Maryland, 1999.
66. M.J.T. Ruihua Song, Ji-Rong Wen, Hsiao-Wuen Hon, and Yong Yu Viewing term proximity from a different perspective C. Macdonald, Advances in Information Retrieval 2008 Springer Berlin/ Heidelberg 346 357 (Pubitemid 351499081)
67. J. Savoy Data fusion for effective European monolingual information retrieval C. Peters, Multilingual Information Access for Text Speech and Images 2005 Springer Berlin/Heidelberg 921-921
68. C. Schardt Utilization of the PICO framework to improve searching PubMed for clinical questions BMC Medical Informatics and Decision Making 7 1 2007 16
69. F. Sebastiani Machine learning in automated text categorization ACM Computing Surveys (CSUR) 34 1 2002 1 47
70. J. Serrano-Guerrero A google wave-based fuzzy recommender system to disseminate information in University Digital Libraries 2.0 Information Sciences 181 9 2011 1503 1516
71. A. Singhal Modern information retrieval: a brief overview IEEE Data Engineering Bulletin 24 4 2001 35 43
72. A. Singhal, C. Buckley, and M. Mitra Pivoted document length normalization Proceedings of the 19th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval 1996 ACM Zurich, Switzerland 21 29
73. R. Snowball Using the clinical question to teach search strategy: fostering transferable conceptual skills in user education by active learning Health Libraries Review 14 3 1997 167 172
74. K.M. Svore, P.H. Kanani, and N. Khan How good is a span of terms? Exploiting proximity to improve Web retrieval SIGIR 2010 ACM Geneva, Switzerland
75. I. Tsochantaridis Support vector machine learning for interdependent and structured output spaces Proceedings of the Twenty-first International Conference on Machine Learning 2004 ACM Banff, Alberta, Canada 104
76. R. Vine Google Scholar Journal of the Medical Library Association 94 1 2006 97 99
77. K. Yang, N. Yu, H. Zhang, WIDIT in TREC 2007 blog track: combining lexicon-based methods to detect opinionated blogs, in: Proceedings of the Text REtrieval Conference, Gaithersburg, Maryland, USA, 2007.
78. Y. Yang An evaluation of statistical approaches to text categorization Information Retrieval vol. 1(1) 1999 Springer Netherlands 69 90
79. Y. Yang, and J.O. Pedersen A comparative study on feature selection in text categorization Proceedings of the Fourteenth International Conference on Machine Learning 1997 Morgan Kaufmann Publishers Inc. 412 420
80. Y. Yue A support vector method for optimizing average precision Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval 2007 ACM Amsterdam, The Netherlands 271 278 (Pubitemid 350164971)
81. C. Zhai, A brief review of information retrieval models, Technical report, Department of Computer Science, University of Illinois at Urbana-Champaign, 2007.
82. C. Zhai, and J. Lafferty A study of smoothing methods for language models applied to ad hoc information retrieval Proceedings of the 24th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval 2001 ACM New Orleans, Louisiana, United States 334 342 (Pubitemid 32957519)
83. Q. Zhang et al., Fdu at trec 2007: opinion retrieval of blog track, in: Proceedings of the Text REtrieval Conference, Gaithersburg, Maryland, USA, 2007.
84. W. Zhang, C. Yu, and W. Meng Opinion retrieval from blogs Proceedings of the Sixteenth ACM Conference on Information and Knowledge Management 2007 ACM 831 840