A test collection for evaluating retrieval of studies for inclusion in systematic reviews

SIGIR 2017 - Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval

Volumn , Issue , 2017, Pages 1237-1240

  Scells, Harrisen ^a   Zuccon, Guido ^a   Koopman, Bevan ^b   Deacon, Anthony ^a   Azzopardi, Leif ^c   Geva, Shlomo ^a  

^a QUEENSLAND UNIVERSITY OF TECHNOLOGY   (Australia)

^b CSIRO   (Australia)

^c UNIVERSITY OF STRATHCLYDE   (United Kingdom)

Author keywords

[No Author keywords available]

Indexed keywords

DATA MINING; QUERY PROCESSING;

BIOMEDICAL SCIENCE; BOOLEAN QUERIES; MEDLINE DATABASE; RELEVANCE ASSESSMENTS; RESEARCH STUDIES; RETRIEVAL EFFECTIVENESS; SYSTEMATIC REVIEW; TEST COLLECTION;

SEARCH ENGINES;

EID: 85029374452     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/3077136.3080707     Document Type: Conference Paper

References (16)

1. Tanja Bekhuis, Eugene Tseytlin, Kevin J Mitchell, and Dina Demner-Fushman. 2014. Feature engineering and a proposed decision-support system for systematic reviewers of medical evidence. PloS one 9, 1 (2014), e86277.
2. Florian Boudin, Jian-Yun Nie, and Martin Dawes. 2010. Clinical information retrieval using document and PICO structure. In Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics. Association for Computational Linguistics, 822-830.
3. AM Cohen, WR Hersh, K Peterson, and PY Yen. 2005. Reducing workload in systematic review preparation using automated citation classification. Journal of the American Medical Informatics Association: JAMIA 13, 2 (2005), 206-219.
4. Aaron M Cohen. 2011. Performance of support-vector-machine-based classifi-cation on 15 systematic review topics evaluated with the WSS@ 95 measure. Journal of the American Medical Informatics Association 18, 1 (2011), 104-104.
5. Aaron M Cohen, William R Hersh, K Peterson, and Po-Yin Yen. 2006. Reducing workload in systematic review preparation using automated citation classifi-cation. Journal of the American Medical Informatics Association 13, 2 (2006), 206-219.
6. Sarvnaz Karimi, Stefan Pohl, Falk Scholer, Lawrence Cavedon, and Justin Zobel. 2010. Boolean versus ranked querying for biomedical systematic reviews. BMC medical informatics and decision making 10, 1 (2010), 58.
7. Sarvnaz Karimi, Stefan Pohl, Falk Scholer, Lawrence Cavedon, and Justin Zobel. 2010. Boolean versus ranked querying for biomedical systematic reviews. BMC Medical Informatics and Decision Making 10, 1 (2010), 1.
8. Madian Khabsa, Ahmed Elmagarmid, Ihab Ilyas, Hossam Hammady, and Mourad Ouzzani. 2016. Learning to identify relevant studies for systematic reviews using random forest and external information. Machine Learning 102, 3 (2016), 465-482.
9. David Martinez, Sarvnaz Karimi, Lawrence Cavedon, and Timothy Baldwin. 2008. Facilitating biomedical systematic reviews using ranked text retrieval and classification. In Australasian Document Computing Symposium (ADCS). 53-60.
10. David Maxwell, Leif Azzopardi, Kalervo Järvelin, and Heikki Keskustalo. 2015. Searching and stopping: An analysis of stopping rules and strategies. In Proceedings of the 24th ACM International on Conference on Information and Knowledge Management. ACM, 313-322.
11. Alison OMara-Eves, James Thomas, John McNaught, Makoto Miwa, and Sophia Ananiadou. 2015. Using text mining for study identification in systematic reviews: A systematic review of current approaches. Systematic reviews 4, 1 (2015), 5.
12. Connie Schardt, Martha B Adams, Thomas Owens, Sheri Keitz, and Paul Fontelo. 2007. Utilization of the PICO framework to improve searching PubMed for clinical questions. BMC medical informatics and decision making 7, 1 (2007), 16.
13. Ian Shemilt, Antonia Simon, Gareth J Hollands, eresa M Marteau, David Ogilvie, Alison OMara-Eves, Michael P Kelly, and James Thomas. 2014. Pinpointing needles in giant haystacks: use of text mining to reduce impractical screening workload in extremely large scoping reviews. Research Synthesis Methods 5, 1 (2014), 31-49.
14. Claire Stansfield, Alison OMara-Eves, and James Thomas. 2015. Reducing systematic review workload using text mining: opportunities and pitfalls. Journal of EAHIL 11, 3 (2015), 8-10.
15. Guy Tsafnat, Paul Glasziou, Miew Keen Choong, Adam Dunn, Filippo Galgani, and Enrico Coiera. 2014. Systematic review automation technologies. Systematic reviews 3, 1 (2014), 74.
16. Byron C Wallace, Jöel Kuiper, Aakash Sharma, Mingxi Brian Zhu, and Iain J Marshall. 2016. Extracting PICO sentences from clinical trial reports using supervised distant supervision. Journal of Machine Learning Research 17, 132 (2016), 1-25.