“Enslaved to the trapped data”: A cognitive work analysis of medical systematic reviews

CHIIR 2019 - Proceedings of the 2019 Conference on Human Information Interaction and Retrieval

Volumn , Issue , 2019, Pages 203-212

  Knight, Ian A ^a   Brailsford, David F ^a   Wilson, Max L ^a   Milic Frayling, Natasa ^a  

^a UNIVERSITY OF NOTTINGHAM   (United Kingdom)

Author keywords

Cognitive work analysis; Systematic review; Work task

Indexed keywords

ARTIFICIAL INTELLIGENCE; LEARNING SYSTEMS; NATURAL LANGUAGE PROCESSING SYSTEMS;

CLASSIFIED RESOURCES; COGNITIVE WORK ANALYSIS; ETHNOGRAPHIC STUDY; EXTRACTION METHOD; LITERATURE REVIEWS; MACHINE LEARNING TECHNIQUES; SYSTEMATIC REVIEW; WORK TASK;

DATA MINING;

EID: 85063144775     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/3295750.3298937     Document Type: Conference Paper

References (40)

1. Maryam Ashoori and Catherine Burns. 2013. Team Cognitive Work Analysis: Structure and Control Tasks. Journal of Cognitive Engineering and Decision Making 7, 2 (2013), 123-140. https://doi.org/10.1177/1555343412445577
2. Maryam Ashoori, Catherine M. Burns, Barbara d'Entremont, and Kathryn Mo-mtahan. 2014. Using team cognitive work analysis to reveal healthcare team interactions in a birthing unit. Ergonomics 57, 7 (2014), 973-986.
3. Kumaripaba Athukorala, Eve Hoggan, Anu Lehtiö, Tuukka Ruotsalo, and Giulio Jacucci. 2013. Information-seeking Behaviors of Computer Scientists: Challenges for Electronic Literature Search Tools. In Proceedings of the 76th ASIS&T Annual Meeting: Beyond the Cloud: Rethinking Information Boundaries (ASIST'13). American Society for Information Science, Silver Springs, MD, USA, Article 20, 11 pages. http://dl.acm.org/citation.cfm?id=2655780.2655800
4. Elaine Beller, Justin Clark, Guy Tsafnat, Clive Adams, Heinz Diehl, Hans Lund, Mourad Ouzzani, Kristina Thayer, James Thomas, Tari Turner, Jun Xia, Karen Robinson, Paul Glasziou, and founding members of the ICASR group. 2018. Making progress with the automation of systematic reviews: Principles of the International Collaboration for the Automation of Systematic Reviews (ICASR). Systematic Reviews 7, 1 (2018), 77-84. https://doi.org/10.1186/s13643-018-0740-7
5. C.A. Beverley, A. Booth, and P.A. Bath. 2003. The role of the information specialist in the systematic review process: a health information case study. Health Information & Libraries Journal 20, 2 (2003), 65-74. https://doi.org/10.1046/j.1471-1842.2003.00411.x
6. Andrew Booth. 2016. Searching for qualitative research for inclusion in systematic reviews: a structured methodological review. Systematic Reviews 5, 1 (04 May 2016), 74. https://doi.org/10.1186/s13643-016-0249-x
7. Pearl Brereton, Barbara A. Kitchenham, David Budgen, Mark Turner, and Mohamed Khalil. 2007. Lessons from applying the systematic literature review process within the software engineering domain. Journal of Systems and Software 80, 4 (2007), 571 - 583. https://doi.org/10.1016/j.jss.2006.07.009 Software Performance.
8. Andy Crabtree. 2003. Designing Collaborative Systems: A Practical Guide to Ethnography. Springer-Verlag, London.
9. Andrew Crabtree, Mark Rouncefield, and Peter Tolmie. 2012. Doing Design Ethnography. Springer-Verlag, London.
10. Julian H. Elliott, Tari Turner, Ornella Clavisi, James Thomas, Julian P.T. Higgins, Chris Mavergames, and Russell L Gruen. 2014. Living Systematic Reviews: An Emerging Opportunity to Narrow the Evidence-Practice Gap. PLoS Medicine 11, 2 (2014), 1-6. https://doi.org/10.1371/journal.pmed.1001603
11. Brynn M. Evans and Ed H. Chi. 2010. An elaborated model of social search. Information Processing & Management 46, 6 (2010), 656-678.
12. Sandra Fabbri, Elis Hernandes, Andre Di Thommazo, Anderson Belgamo, Au-gusto Zamboni, and Cleiton Silva. 2013. Using Information Visualization and Text Mining to Facilitate the Conduction of Systematic Literature Reviews. In Enterprise Information Systems, José Cordeiro, Leszek A. Maciaszek, and Joaquim Filipe (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 243-256.
13. James Fogarty, Desney Tan, Ashish Kapoor, and Simon Winder. 2008. CueFlik: interactive concept learning in image search. In Proceedings of the sigchi conference on human factors in computing systems. ACM, 29-38.
14. Allison Gates, Cydney Johnson, and Lisa Hartling. 2018. Technology-assisted title and abstract screening for systematic reviews: A retrospective evaluation of the Abstrackr machine learning tool. Systematic Reviews 7 (2018), 45. https://doi.org/10.1186/s13643-018-0707-8
15. Gene Golovchinsky, Abdigani Diriye, and Tony Dunnigan. 2012. The future is in the past: designing for exploratory search. In Proceedings of the 4th Information Interaction in Context Symposium. ACM, 52-61.
16. Gene Golovchinsky, Pernilla Qvarfordt, and Jeremy Pickens. 2008. Collaborative information seeking. Information Seeking Support Systems (2008), 47-48.
17. David Gough, Sandy Oliver, and James Thomas. 2017. Introducing Systematic Reviews. In An Introduction to Systematic Reviews (2nd ed.), David Gough, Sandy Oliver, and James Thomas (Eds.). Sage, London, 1-18.
18. Jeremy M. Grimshaw, Martin P. Eccles, John N. Lavis, Sophie J. Hill, and Janet E. Squires. 2012. Knowledge translation of research findings. Implementation Science 7, 1 (2012), 50-67. https://doi.org/10.1186/1748-5908-7-50
19. Maura R Grossman, Gordon V Cormack, and Adam Roegiest. 2016. TREC 2016 Total Recall Track Overview.. In TREC.
20. Martha R. Harris. 2005. The librarian's roles in the systematic review process: a case study. Journal of the Medical Library Association 93, 1 (2005), 81.
21. Julian P.T. Higgins and Sally Green (Eds.). 2011. Cochrane Handbook for Systematic Reviews of Interventions, Version 5.1.0. http://handbook-5-1.cochrane.org
22. Hugo C Huurdeman and Jaap Kamps. 2014. From multistage information-seeking models to multistage search systems. In Proceedings of the 5th Information Interaction in Context Symposium. ACM, 145-154.
23. Hugo C Huurdeman, Max L Wilson, and Jaap Kamps. 2016. Active and passive utility of search interface features in different information seeking task stages. In Proceedings of the 2016 ACM on Conference on Human Information Interaction and Retrieval. ACM, 3-12.
24. Kalervo Järvelin and Peter Ingwersen. 2004. Information Seeking Research Needs Extension towards Tasks and Technology. Information Research: An International Electronic Journal 10, 1 (2004), n1.
25. Siddhartha R. Jonnalagadda, Pawan Goyal, and Mark D. Huffman. 2015. Automating data extraction in systematic reviews: a systematic review. Systematic Reviews 4, 1 (2015), 78. https://doi.org/10.1186/s13643-015-0066-7
26. Diane Kelly and Cassidy R. Sugimoto. 2013. A systematic review of interactive information retrieval evaluation studies, 1967-2006. Journal of the American Society for Information Science and Technology 64, 4 (2013), 745-770. https://doi.org/10.1002/asi.22799
27. Svetlana Kiritchenko, Berry De Bruijn, Simona Carini, Joel Martin, and Ida Sim. 2010. ExaCT: Automatic extraction of clinical trial characteristics from journal publications. BMC Medical Informatics and Decision Making 10 (2010), 56. https://doi.org/10.1186/1472-6947-10-56
28. Hubert Knoblauch. 2005. Focused Ethnography. Forum Qualitative Sozi-alforschung / Forum: Qualitative Social Research 6, 3 (2005). https://doi.org/10.17169/fqs-6.3.20
29. Douglas W. Oard, Jason R. Baron, Bruce Hedin, David D. Lewis, and Stephen Tomlinson. 2010. Evaluation of information retrieval for E-discovery. Artificial Intelligence and Law 18, 4 (01 Dec 2010), 347-386. https://doi.org/10.1007/ s10506-010-9093-9
30. Alison O'Mara-Eves, James Thomas, John McNaught, Makoto Miwa, and Sophia Ananiadou. 2015. Using text mining for study identification in systematic reviews: a systematic review of current approaches. Systematic Reviews 4, 1 (2015), 5-27. https://doi.org/10.1186/2046-4053-4-5
31. Diana Papaioannou, Anthea Sutton, Christopher Carroll, Andrew Booth, and Ruth Wong. 2010. Literature searching for social science systematic reviews: consideration of a range of search techniques. Health Information & Libraries Journal 27, 2 (2010), 114-122. https://doi.org/10.1111/j.1471-1842.2009.00863.x
32. David L. Sackett. 1997. Evidence-based medicine. Seminars in Perinatology 21, 1 (1997), 3-5. https://doi.org/10.1016/S0146-0005(97)80013-4
33. Chirag Shah. 2009. Toward collaborative information seeking (CIS). (2009). arXiv:0908.0709
34. Farhad Shokraneh and Clive Elliott Adams. 2017. Study-based registers of randomized controlled trials: Starting a systematic review with data extraction or meta-analysis. BioImpacts 7, 4 (2017), 209-217. https://doi.org/10.15171/bi.2017.25
35. Jaime Teevan, Kevyn Collins-Thompson, Ryen W White, Susan T Dumais, and Yubin Kim. 2013. Slow search: Information retrieval without time constraints. In Proceedings of the Symposium on Human-Computer Interaction and Information Retrieval. ACM, 1.
36. James Thomas, Anna Noel-Storr, Ian Marshall, Byron Wallace, Steven McDonald, Chris Mavergames, Paul Glasziou, Ian Shemilt, Annelise Synnot, Tari Turner, and Julian Elliott. 2017. Living systematic reviews: 2. Combining human and machine effort. Journal of Clinical Epidemiology 91 (2017), 31-37. https://doi.org/10.1016/j.jclinepi.2017.08.011
37. Guy Tsafnat, Paul Glasziou, Miew Keen Choong, Adam Dunn, Filippo Galgani, and Enrico Coiera. 2014. Systematic review automation technologies. Systematic Reviews 3, 1 (2014), 74-89. https://doi.org/10.1186/2046-4053-3-74
38. Alexander Tsertsvadze, Yen Fu Chen, David Moher, Paul Sutcliffe, and Noel McCarthy. 2015. How to conduct systematic reviews more expeditiously? Systematic Reviews 4, 1 (2015), 160-166. https://doi.org/10.1186/s13643-015-0147-7
39. Kim J. Vicente. 1999. Cognitive Work Analysis: Towards safe, productive, and healthy computer-based work. Lawrence Erlbaum Associates, Mahwah, NJ.
40. Ryen W White and Resa A Roth. 2009. Exploratory search: Beyond the query-response paradigm. Synthesis lectures on information concepts, retrieval, and services 1, 1 (2009), 1-98.