Citation analysis as a literature search method for systematic reviews

Journal of the Association for Information Science and Technology

Volumn 67, Issue 11, 2016, Pages 2766-2777

  Belter, Christopher W ^a  

^a NATIONAL INSTITUTES OF HEALTH   (United States)

Author keywords

bibliometrics; information retrieval

Indexed keywords

BIBLIOMETRICS; BIOMEDICAL LITERATURE; BIOMEDICAL TREATMENT; CITATION ANALYSIS; LITERATURE SEARCH; PRECISION AND RECALL; SYSTEMATIC REVIEW; TEXT-BASED METHODS;

INFORMATION RETRIEVAL;

EID: 84991275948     PISSN: 23301635     EISSN: 23301643     Source Type: Journal    
DOI: 10.1002/asi.23605     Document Type: Review

References (87)

1. Abbasi, M., & Frommholz, I. (2015). Cluster-based polyrepresentation as science modelling approach for information retrieval. Scientometrics, 102(3), 2301–2322. doi: 10.1007/s11192-014-1478-1
2. Adeva, J.J.G., Atxa, J.M.P., Carrillo, M.U., & Zengotitabengoa, E.A. (2014). Automatic text classification to support systematic reviews in medicine. Expert Systems with Applications, 41(4), 1498–1508. doi: 10.1016/j.eswa.2013.08.047
3. Anderson, L., & Taylor, R.S. (2014). Cardiac rehabilitation for people with heart disease: An overview of Cochrane systematic reviews. Cochrane Database of Systematic Reviews, (12), Cd011273, doi: 10.1002/14651858.CD011273.pub2
4. Aphinyanaphongs, Y., Tsamardinos, I., Statnikov, A., Hardin, D., & Aliferis, C.F. (2005). Text categorization models for high-quality article retrieval in internal medicine. Journal of the American Medical Informatics Association, 12(2), 207–216. doi: 10.1197/jamia.M1641
5. Bekhuis, T., & Demner-Fushman, D. (2012). Screening nonrandomized studies for medical systematic reviews: A comparative study of classifiers. Artificial Intelligence in Medicine, 55(3), 197–207. doi: 10.1016/j.artmed.2012.05.002
6. Bernstam, E.V., Herskovic, J.R., Aphinyanaphongs, Y., Aliferis, C.F., Sriram, M.G., & Hersh, W.R. (2006). Using citation data to improve retrieval from MEDLINE. Journal of the American Medical Informatics Association, 13(1), 96–105. doi: 10.1197/jamia.M1909
7. Bichteler, J., & Eaton, E.A. (1980). The combined use of bibliographic coupling and cocitation for document-retrieval. Journal of the American Society for Information Science, 31(4), 278–282. doi: 10.1002/asi.4630310408
8. Börner, K. (2010). Atlas of science: Visualizing what we know. Cambridge, MA: MIT Press.
9. Börner, K., Chen, C.M., & Boyack, K.W. (2003). Visualizing knowledge domains. Annual Review of Information Science and Technology, 37, 179–255. doi: 10.1002/aris.1440370106
10. Boyack, K.W., & Klavans, R. (2010). Co-citation analysis, bibliographic coupling, and direct citation: Which citation approach represents the research front most accurately? Journal of the American Society for Information Science and Technology: JASIST, 61(12), 2389–2404. doi: 10.1002/asi.21419
11. Bunn, F., Trivedi, D., Alderson, P., Hamilton, L., Martin, A., & Iliffe, S. (2014). The impact of Cochrane Systematic Reviews: A mixed method evaluation of outputs from Cochrane Review Groups supported by the UK National Institute for Health Research. Systematic Reviews, 3, 125. doi: 10.1186/2046-4053-3-125
12. Carevic, Z., & Schaer, P. (2014). On the Connection Between Citation-based and Topical Relevance Ranking: Results of a Pretest using iSearch. Article presented at the Proceedings of the First Workshop on Bibliometric-enhanced Information Retrieval, Amsterdam. Retrieved from http://ceur-ws.org/Vol-1143/paper5.pdf
13. Chapman, E., Reveiz, L., Illanes, E., & Bonfill Cosp, X. (2014). Antibiotic regimens for management of intra-amniotic infection. Cochrane Database of Systematic Reviews, (12), Cd010976, doi: 10.1002/14651858.CD010976.pub2
14. Couto, T., Cristo, M., Goncalves, M.A., Calado, P., Ziviani, N., Moura, E., … Ieee. (2006). A comparative study of citations and links in document classification. Paper presented at the 6th ACM/IEEE Joint Conference on Digital Libraries (JCDL), Chapel Hill, NC.
15. Cribbin, T. (2014). Augmenting Citation Chain Aggregation with Article Maps. Paper presented at the Proceedings of the First Workshop on Knowledge Maps and Information Retrieval, London.
16. Day, J., Zienius, K., Gehring, K., Grosshans, D., Taphoorn, M., Grant, R., … Brown, P.D. (2014). Interventions for preventing and ameliorating cognitive deficits in adults treated with cranial irradiation. Cochrane Database of Systematic Reviews, (12), Cd011335, doi: 10.1002/14651858.CD011335.pub2
17. DiCenso, A., Bayley, L., & Haynes, R.B. (2009). Accessing preappraised evidence: Fine-tuning the 5S model into a 6S model. Annals of Internal Medicine, 151(6), Article number JC3-3.
18. Dunne, C., Shneiderman, B., Gove, R., Klavans, J., & Dorr, B. (2012). Rapid understanding of scientific paper collections: Integrating statistics, text analytics, and visualization. Journal of the American Society for Information Science and Technology: JASIST, 63(12), 2351–2369. doi: 10.1002/asi.22652
19. Eto, M. (2013). Evaluations of context-based co-citation searching. Scientometrics, 94(2), 651–673. doi: 10.1007/s11192-012-0756-z
20. Flowers, N., Hartley, L., Todkill, D., Stranges, S., & Rees, K. (2014). Co-enzyme Q10 supplementation for the primary prevention of cardiovascular disease. Cochrane Database of Systematic Reviews, (12), Cd010405, doi: 10.1002/14651858.CD010405.pub2
21. Frunza, O., Inkpen, D., Matwin, S., Klement, W., & O'Blenis, P. (2011). Exploiting the systematic review protocol for classification of medical abstracts. Artificial Intelligence in Medicine, 51(1), 17–25. doi: 10.1016/j.artmed.2010.10.005
22. Garfield, E. (1955). Citation indexes for science: A new dimension in documentation through association of ideas. Science, 122(3159), 108–111. doi: 10.1126/science.122.3159.108
23. Garfield, E. (1964). “Science Citation Index”—a new dimension in indexing. Science, 144(3619), 649–654. doi: 10.1126/science.144.3619.649
24. Gilstrap, L.C., 3rd, Leveno, K.J., Cox, S.M., Burris, J.S., Mashburn, M., & Rosenfeld, C.R. (1988). Intrapartum treatment of acute chorioamnionitis: Impact on neonatal sepsis. American Journal of Obstetrics and Gynecology, 159(3), 579–583.
25. Glänzel, W. (2015). Bibliometrics-aided retrieval: Where information retrieval meets scientometrics. Scientometrics, 102(3), 2215–2222. doi: 10.1007/s11192-014-1480-7
26. Greenhalgh, T. (1997). How to read a paper: Getting your bearings (deciding what the paper is about). British Medical Journal, 315(7102), 243–246.
27. Guyatt, G.H., Sackett, D.L., Sinclair, J.C., Hayward, R., Cook, D.J., & Cook, R.J. (1995). Users guides to the medical literature.9. A method for grading health-care recommendations. Journal of the American Medical Association, 274(22), 1800–1804. doi: 10.1001/jama.274.22.1800
28. Hausner, E., Waffenschmidt, S., Kaiser, T., & Simon, M. (2012). Routine development of objectively derived search strategies. Systematic Reviews, 1, 19. doi: 10.1186/2046-4053-1-19
29. Higgins, J.P.T., & Green, S. (Eds.). (2011). Cochrane handbook for systematic reviews of interventions version 5.1.0 [updated March 2011]: The Cochrane collaboration. Retrieved from www.cochrane-handbook.org
30. Hinde, S., & Spackman, E. (2015). Bidirectional citation searching to completion: An exploration of literature searching methods. Pharmacoeconomics, 33(1), 5–11. doi: 10.1007/s40273-014-0205-3
31. Ingwersen, P. (1996). Cognitive perspectives of information retrieval interaction: Elements of a cognitive IR theory. Journal of Documentation, 52(1), 3–50. doi: 10.1108/eb026960
32. Jackson, M.J., Veeratterapillay, R., Harding, C.K., & Dorkin, T.J. (2014). Intermittent self-dilatation for urethral stricture disease in males. Cochrane Database of Systematic Reviews, (12), Cd010258, doi: 10.1002/14651858.CD010258.pub2
33. Kessler, M.M. (1963). Bibliographic coupling between scientific papers. American Documentation, 14(1), 10–25. doi: 10.1002/asi.5090140103
34. Kho, M.E., & Brouwers, M.C. (2012a). Application of the systematic review and bibliometric network analysis (SeBriNA) methodology contextualizes evidence. Part 2: Rituximab for non-Hodgkin's lymphoma. Journal of Clinical Epidemiology, 65(9), 996–1009. doi: 10.1016/j.jclinepi.2012.03.008
35. Kho, M.E., & Brouwers, M.C. (2012b). The systematic review and bibliometric network analysis (SeBriNA) is a new method to contextualize evidence. Part 1: Description. Journal of Clinical Epidemiology, 65(9), 1010–1015. doi: 10.1016/j.jclinepi.2012.03.009
36. Klavans, R., & Boyack, K.W. (2009). Toward a consensus map of science. Journal of the American Society for Information Science and Technology: JASIST, 60(3), 455–476. doi: 10.1002/asi.20991
37. Larsen, B. (2002). Exploiting citation overlaps for Information Retrieval: Generating a boomerang effect from the network of scientific papers. Scientometrics, 54(2), 155–178. doi: 10.1023/A:1016011326300
38. Lefebvre, C., Glanville, J., Wieland, L., Coles, B., & Weightman, A. (2013). Methodological developments in searching for studies for systematic reviews: Past, present and future? Systematic Reviews, 2, 78. doi: 10.1186/2046-4053-2-78
39. Liberati, A., Altman, D.G., Tetzlaff, J., Mulrow, C., Gøtzsche, P.C., Ioannidis, J.P.A., … Moher, D. (2009). The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: Explanation and elaboration. PLoS Medicine, 6(7), e1000100. doi: 10.1371/journal.pmed.1000100
40. Littlejohn, I.H., Tarling, M.M., Flynn, P.J., Ordman, A.J., & Aiken, A. (1996). Post-operative pain relief in children following extraction of carious deciduous teeth under general anaesthesia: A comparison of nalbuphine and diclofenac. European Journal of Anaesthesiology, 13(4), 359–363.
41. Liu, H., Lawrie, T.A., Lu, D., Song, H., Wang, L., & Shi, G. (2014). Robot-assisted surgery in gynaecology. Cochrane Database of Systematic Reviews, (12), Cd011422, doi: 10.1002/14651858.cd011422
42. Mackeen, A.D., Packard, R.E., Ota, E., Berghella, V., & Baxter, J.K. (2014). Timing of intravenous prophylactic antibiotics for preventing postpartum infectious morbidity in women undergoing cesarean delivery. Cochrane Database of Systematic Reviews, (12), Cd009516, doi: 10.1002/14651858.CD009516.pub2
43. Maguire, M.J., Weston, J., Singh, J., & Marson, A.G. (2014). Antidepressants for people with epilepsy and depression. Cochrane Database of Systematic Reviews, (12), Cd010682, doi: 10.1002/14651858.CD010682.pub2
44. Manriquez, J., Andino-Navarrete, R., Cataldo-Cerda, K., & Harz-Fresno, I. (2015). Bibliometric characteristics of systematic reviews in dermatology: A cross-sectional study through Web of Science and Scopus. Dermatologica Sinica, 33(3), 154–156. doi: 10.1016/j.dsi.2014.12.007.
45. Marshakova, I.V. (1973). A system of document connections based on references. Nauchno-Tekhnicheskaya Informatsiya Seriya 2-Informatsionnye Protsessy I Sistemy, (6), 3–8.
46. Marshall, K., Gowing, L., Ali, R., & Le Foll, B. (2014). Pharmacotherapies for cannabis dependence. Cochrane Database of Systematic Reviews, (12), Cd008940, doi: 10.1002/14651858.CD008940.pub2
47. Mayr, P. (2014). Are topic-specific search term, journal name and author name recommendations relevant for researchers? Paper presented at the EuroHCIR Workshop, London. Retrieved from http://arxiv-web3.library.cornell.edu/abs/1408.4440
48. Mayr, P., & Mutschke, P. (2013). Bibliometric-enhanced retrieval models for big scholarly information systems. Paper presented at the 2013 IEEE International Conference on Big Data.
49. Mayr, P., & Scharnhorst, A. (2015). Scientometrics and information retrieval: Weak-links revitalized. Scientometrics, 102(3), 2193–2199. doi: 10.1007/s11192-014-1484-3
50. McCain, K.W. (1989). Descriptor and citation retrieval in the medical behavioral sciences literature: Retrieval overlaps and novelty distribution. Journal of the American Society for Information Science, 40(2), 110–114. doi: 10.1002/(sici)1097-4571(198903)40:2<110::aid-asi5>3.0.co;2-t
51. McNab, S., Ware, R.S., Neville, K.A., Choong, K., Coulthard, M.G., Duke, T., … Dorofaeff, T. (2014). Isotonic versus hypotonic solutions for maintenance intravenous fluid administration in children. Cochrane Database of Systematic Reviews, (12), Cd009457, doi: 10.1002/14651858.CD009457.pub2
52. McRobbie, H., Bullen, C., Hartmann-Boyce, J., & Hajek, P. (2014). Electronic cigarettes for smoking cessation and reduction. Cochrane Database of Systematic Reviews, (12), Cd010216, doi: 10.1002/14651858.CD010216.pub2
53. Medina, C.M.C., & van Leeuwen, T.N. (2012). Seed journal citation network maps: A method based on network theory. Journal of the American Society for Information Science and Technology: JASIST, 63(6), 1226–1234. doi: 10.1002/asi.22631
54. Moher, D., Liberati, A., Tetzlaff, J., Altman, D.G., & The Prisma Group. (2009). Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. PLoS Medicine, 6(7), e1000097. doi: 10.1371/journal.pmed.1000097
55. Moher, D., Shamseer, L., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., … Stewart, L.A. (2015). Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Systematic Reviews, 4(1). doi: 10.1186/2046-4053-4-1
56. Morris, S.A., & Van der Veer Martens, B. (2008). Mapping research specialties. Annual Review of Information Science and Technology, 42, 213–295. doi: 10.1002/aris.2008.1440420113
57. Mutschke, P., & Mayr, P. (2015). Science models for search: A study on combining scholarly information retrieval and scientometrics. Scientometrics, 102(3), 2323–2345. doi: 10.1007/s11192-014-1485-2
58. Mutschke, P., Mayr, P., Schaer, P., & Sure, Y. (2011). Science models as value-added services for scholarly information systems. Scientometrics, 89(1), 349–364. doi: 10.1007/s11192-011-0430-x
59. National Research Council. (2011). Finding what works in health care: Standards for systematic reviews. Washington, DC: The National Academies Press.
60. Nicholson, S. (2006). The basis for bibliomining: Frameworks for bringing together usage-based data mining and bibliometrics through data warehousing in digital library services. Information Processing & Management, 42(3), 785–804. doi: 10.1016/j.ipm.2005.05.008
61. O'Mara-Eves, A., Brunton, G., McDaid, D., Kavanagh, J., Oliver, S., & Thomas, J. (2014). Techniques for identifying cross-disciplinary and “hard-to-detect” evidence for systematic review. Research Synthesis Methods, 5(1), 50–59. doi: 10.1002/jrsm.1094
62. O'Mara-Eves, A., Thomas, J., McNaught, J., Miwa, M., & Ananiadou, S. (2015). Using text mining for study identification in systematic reviews: A systematic review of current approaches. Systematic Reviews, 4(5). doi: 10.1186/2046-4053-4-5
63. Ortuno, F., Rojas, I., Andrade-Navarro, M., & Fontaine, J.-F. (2013). Using cited references to improve the retrieval of related biomedical documents. BMC Bioinformatics, 14(1), 113. doi: 10.1186/1471-2105-14-113
64. Pao, M.L., & Worthen, D.B. (1989). Retrieval effectiveness by semantic and citation searching. Journal of the American Society for Information Science, 40(4), 226–235. doi: 10.1002/(sici)1097-4571(198907)40:4<226::aid-asi2>3.0.co;2-6
65. Parekh, S., Gardener, C., Ashley, P.F., & Walsh, T. (2014). Intraoperative local anaesthesia for reduction of postoperative pain following general anaesthesia for dental treatment in children and adolescents. Cochrane Database of Systematic Reviews, (12), Cd009742, doi: 10.1002/14651858.CD009742.pub2
66. Reijnhoudt, L., Costas, R., Noyons, E., Börner, K., & Scharnhorst, A. (2014). “Seed plus expand”: A general methodology for detecting publication oeuvres of individual researchers. Scientometrics, 101(2), 1403–1417. doi: 10.1007/s11192-014-1256-0
67. Rimmer, J., Fokkens, W., Chong, L.Y., & Hopkins, C. (2014). Surgical versus medical interventions for chronic rhinosinusitis with nasal polyps. Cochrane Database of Systematic Reviews, (12), Cd006991, doi: 10.1002/14651858.CD006991.pub2
68. Ritchie, A., Teufel, S., & Robertson, S. (2006a). Creating a Test Collection for Citation-based IR Experiments. Paper presented at the Proceedings of the Human Language Technology Conference of the North American Chapter of the Association of Computational Linguistics, New York, NY. Retrieved from http://acl.ldc.upenn.edu/N/N06/N06-1050.pdf
69. Ritchie, A., Teufel, S., & Robertson, S. (2006b). How to find better index terms through citations. Paper presented at the Proceedings of the Workshop on How Can Computational Linguistics Improve Information Retrieval?, Sydney, Australia.
70. Ritchie, A., Teufel, S., & Robertson, S. (2008). Using terms from citations for IR: Some first results. In C. Macdonald, I. Ounis, V. Plachouras, I. Ruthven, & R. White (Eds.), Advances in information retrieval (Vol. 4956, pp. 211–221). New York: Springer Berlin Heidelberg.
71. Robinson, K.A., Dunn, A.G., Tsafnat, G., & Glasziou, P. (2014). Citation networks of related trials are often disconnected: Implications for bidirectional citation searches. Journal of Clinical Epidemiology, 67(7), 793–799. doi: 10.1016/j.jclinepi.2013.11.015
72. Roten, A.T., Baker, N.L., & Gray, K.M. (2013). Marijuana craving trajectories in an adolescent marijuana cessation pharmacotherapy trial. Addictive Behaviors, 38(3), 1788–1791. doi: 10.1016/j.addbeh.2012.11.003
73. Royle, P., Kandala, N.B., Barnard, K., & Waugh, N. (2013). Bibliometrics of systematic reviews: Analysis of citation rates and journal impact factors. Systematic Reviews, 2, 74. doi: 10.1186/2046-4053-2-74
74. Schaer, P. (2013). Applied informetrics for digital libraries: An overview of foundations, problems and current approaches. Historical Social Research, 38(3), 282–354.
75. Sci2 Team. (2009). Science of Science (Sci2) Tool: Indiana University and SciTech Strategies. Retrieved from http://sci2.cns.iu.edu
76. Shamseer, L., Moher, D., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., … Stewart, L.A. (2015). Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015: Elaboration and explanation. British Medical Journal, 349, g7647. doi: 10.1136/bmj.g7647
77. Shemilt, I., Simon, A., Hollands, G.J., Marteau, T.M., Ogilvie, D., O'Mara-Eves, A., … Thomas, J. (2014). Pinpointing needles in giant haystacks: Use of text mining to reduce impractical screening workload in extremely large scoping reviews. Research Synthesis Methods, 5(1), 31–49. doi: 10.1002/jrsm.1093
78. Small, H. (1973). Co-citation in the scientific literature: A new measure of the relationship between two documents. Journal of the American Society for Information Science, 24(4), 265–269. doi: 10.1002/asi.4630240406
79. Song, H., Zhu, J., & Lu, D. (2014). Long-term proton pump inhibitor (PPI) use and the development of gastric pre-malignant lesions. Cochrane Database of Systematic Reviews, (12), Cd010623, doi: 10.1002/14651858.CD010623.pub2
80. Sperling, R.S., Ramamurthy, R.S., & Gibbs, R.S. (1987). A comparison of intrapartum versus immediate postpartum treatment of intra-amniotic infection. Obstetrics and Gynecology, 70(6), 861–865.
81. Tan, H.B., Danilla, S., Murray, A., Serra, R., El Dib, R., Henderson, T.O., & Wasiak, J. (2014). Immunonutrition as an adjuvant therapy for burns. Cochrane Database of Systematic Reviews, (12), Cd007174, doi: 10.1002/14651858.CD007174.pub2
82. Thomas, J., McNaught, J., & Ananiadou, S. (2011). Applications of text mining within systematic reviews. Research Synthesis Methods, 2(1), 1–14. doi: 10.1002/jrsm.27
83. Van Eck, N.J., & Waltman, L. (2014). Systematic retrieval of scientific literature based on citation relations: Introducing the CitNetExplorer tool. Paper presented at the Proceedings of the First Workshop on Bibliometric-Enhanced Information Retrieval, Amsterdam. Retrieved from http://ceur-ws.org/Vol-1143/paper2.pdf
84. Wallace, B.C., Trikalinos, T.A., Lau, J., Brodley, C., & Schmid, C.H. (2010). Semi-automated screening of biomedical citations for systematic reviews. BMC Bioinformatics, 11, 55. doi: 10.1186/1471-2105-11-55
85. Zhang, H.W., Lin, Z.X., Tung, Y.S., Kwan, T.H., Mok, C.K., Leung, C., & Chan, L.S. (2014). Cordyceps sinensis (a traditional Chinese medicine) for treating chronic kidney disease. Cochrane Database of Systematic Reviews, (12), Cd008353, doi: 10.1002/14651858.CD008353.pub2
86. Zitt, M. (2015). Meso-level retrieval: IR-bibliometrics interplay and hybrid citation-words methods in scientific fields delineation. Scientometrics, 102(3), 2223–2245. doi: 10.1007/s11192-014-1482-5
87. Zitt, M., & Bassecoulard, E. (2006). Delineating complex scientific fields by an hybrid lexical-citation method: An application to nanosciences. Information Processing & Management, 42(6), 1513–1531. doi: 10.1016/j.ipm.2006.03.016