Citations, research topics and active countries in software engineering: A bibliometrics study

Computer Science Review

Volumn 19, Issue , 2016, Pages 56-77

  Garousi, Vahid ^a   Mäntylä, Mika V ^b  

^a HACETTEPE UNIVERSITY   (Turkey)

^b UNIVERSITY OF OULU   (Finland)

Author keywords

Bibliometrics; Citation analysis; Research literature; Software engineering; Thematic and topic analysis

Indexed keywords

DATA MINING; INFORMATION SCIENCE; SOFTWARE ENGINEERING; SOFTWARE TESTING; WEB SERVICES;

AUTOMATED ANALYSIS; BIBLIOMETRICS; CITATION ANALYSIS; EUROPEAN COUNTRIES; HOT RESEARCH TOPICS; RESEARCH QUESTIONS; TOPIC ANALYSIS; TOPIC DISTRIBUTIONS;

INDUSTRIAL RESEARCH;

EID: 84959387510     PISSN: 15740137     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.cosrev.2015.12.002     Document Type: Review

References (68)

1. Glass R.L. An assessment of systems and software engineering scholars and institutions. J. Syst. Softw. 1994, 27:63-67.
2. Glass R.L., Chen T.Y. An assessment of systems and software engineering scholars and institutions (1999-2003). J. Syst. Softw. 2005, 76:91-97.
3. Tse T.H., Chen T.Y., Glass R.L. An assessment of systems and software engineering scholars and institutions (2000-2004). J. Syst. Softw. 2006, 79:816-819.
4. Wong W.E., Tse T.H., Glass R.L., Basili V.R., Chen T.Y. An assessment of systems and software engineering scholars and institutions (2001-2005). J. Syst. Softw. 2008, 81:1059-1062.
5. Wong W.E., Tse T.H., Glass R.L., Basili V.R., Chen T.Y. An assessment of systems and software engineering scholars and institutions (2002-2006). J. Syst. Softw. 2009, 82:1370-1373.
6. Wong W.E., Tse T.H., Glass R.L., Basili V.R., Chen T.Y. An assessment of systems and software engineering scholars and institutions (2003-2007 and 2004-2008). J. Syst. Softw. 2011, 84:162-168.
7. Glass R.L., Chen T.Y. An assessment of systems and software engineering scholars and institutions (1997-2001). J. Syst. Softw. 2002, 64:79-86.
8. Glass R.L., Chen T.Y. An assessment of systems and software engineering scholars and institutions (1996-2000). J. Syst. Softw. 2001, 59:107-113.
9. Glass R.L., Chen T.Y. An assessment of systems and software engineering scholars and institutions (1998-2002). J. Syst. Softw. 2003, 68:77-84.
10. Wohlin C. An analysis of the most cited articles in software engineering journals-1999. Inf. Softw. Technol. 2005, 47:957-964.
11. Wohlin C. An analysis of the most cited articles in software engineering journals-2000. Inf. Softw. Technol. 2007, 49:2-11.
12. Wohlin C. An analysis of the most cited articles in software engineering journals-2001. Inf. Softw. Technol. 2008, 50:3-9.
13. Wohlin C. An analysis of the most cited articles in software engineering journals-2002. Inf. Softw. Technol. 2009, 51:2-6.
14. Glass R.L., Vessey I., Ramesh V. Research in software engineering: an analysis of the literature. Inf. Softw. Technol. 2002, 44:491-506.
15. Cai K.-Y., Card D. An analysis of research topics in software engineering-2006. J. Syst. Softw. 2008, 81:1051-1058.
16. Coulter N., Monarch I., Konda S. Software engineering as seen through its research literature: A study in co-word analysis. J. Am. Soc. Inf. Sci. 1998, 49:1206-1223.
17. Garousi V., Ruhe G. A bibliometric/geographic assessment of 40 years of software engineering research (1969-2009). Int. J. Softw. Eng. Knowl. Eng. 2013, 23:1343-1366.
18. Griffiths T.L., Steyvers M. Finding scientific topics. Proc. Natl. Acad. Sci. 2004, 101:5228-5235.
19. V. Garousi, M.V. Mäntylä, All source data for bibliometrics study of the software engineering community, in , 2015 (accessed: December 2015). https://goo.gl/G8f0M0.
20. Eric W.E., Tse T.H., Glass Robert L., Basilid Victor R., Chene T.Y. An assessment of systems and software engineering scholars and institutions (2003-2007 and 2004-2008). J. Syst. Softw. 2011, 84:162-168.
21. Garousi V., Varma T. A bibliometric assessment of canadian software engineering scholars and institutions (1996-2006). Canad. J. Comput. Inform. Sci. 2010, 3:19-29.
22. de Freitas F., de Souza J. Ten years of search based software engineering: A bibliometric analysis. Search Based Software Engineering 2011, 6956:18-32. Springer, Berlin, Heidelberg. M. Cohen, M. Ó Cinnéide (Eds.).
23. Farhoodi R., Garousi V., Pfahl D., Sillito J.P. Development of scientific software: A systematic mapping, bibliometrics study and a paper repository. Int. J. Softw. Eng. Knowl. Eng. 2013, 23:463-506.
24. Ren J., Taylor R.N. Automatic and versatile publications ranking for research institutions and scholars. Commun. ACM 2007, 50:81-85.
25. Hoonlor A., Szymanski B.K., Zaki M.J. Trends in computer science research. Commun. ACM 2013, 56:74-83.
26. Fernandes J. Authorship trends in software engineering. Scientometrics 2014, 101:257-271.
27. Garousi V. A bibliometric analysis of the Turkish software engineering research community. Springer J. Scientometrics 2015, 105:23-49.
28. Garousi V., Fernandes J.M. Highly-cited papers in software engineering: The top-100. Inf. Softw. Technol. 2016, 71:108-128.
29. Bornmann L. How are excellent (highly cited) papers defined in bibliometrics? A quantitative analysis of the literature. Res. Eval. 2014, 23:166-173.
30. Noorden R.V., Maher B., Nuzzo R. The top 100 papers. Nature 2014, 514:550-553.
31. Ioannidis J.P.A., Boyack K.W., Small H., Sorensen A.A., Klavan R. Is your most cited work your best?. Nature 2014, 514:561-562.
32. Ponce F.A., Lozano A.M. Highly cited works in neurosurgery. Part I: the 100 top-cited papers in neurosurgical journals. J. Neurosurg. 2010, 112:223-232.
33. Easterbrook S., Singer J., Storey M.-A., Damian D. Selecting empirical methods for software engineering research. Guide to Advanced Empirical Software Engineering 2008, 285-311. Springer, London. F. Shull, J. Singer, D.K. Sjøberg (Eds.).
34. Archambault É., Campbell D., Gingras Y., Larivière V. Comparing bibliometric statistics obtained from the web of science and scopus. J. Am. Soc. Inf. Sci. 2009, 60:1320-1326.
35. Falagas M.E., Pitsouni E.I., Malietzis G.A., Pappas G. Comparison of PubMed, Scopus, Web of Science, and Google Scholar: strengths and weaknesses. FASEB J. 2008, 22:338-342.
36. Abrizah A., Zainab A.N., Kiran K., Raj R.G. LIS journals scientific impact and subject categorization: a comparison between Web of Science and Scopus. Scientometrics 2013, 94:721-740.
37. Chadegani A.A., Salehi H., Yunus M.M., Farhadi H., Fooladi M., Farhadi M., et al. A comparison between two main academic literature collections: Web of science and scopus databases. Asian Soc. Sci. 2013, 9:18-26.
38. Buhr R.J.A. Use case maps as architectural entities for complex systems. IEEE Trans. Softw. Eng. 1998, 24:1131-1155.
39. Holzmann G.J. The model checker SPIN. IEEE Trans. Softw. Eng. 1997, 23:279-295.
40. Tijssen R., Visser M., van Leeuwen T. Benchmarking international scientific excellence: Are highly cited research papers an appropriate frame of reference?. Scientometrics 2002, 54:381-397.
41. Aksnes D.W. Characteristics of highly cited papers. Res. Eval. 2003, 12:159-170.
42. Pyšek P., Richardson D.M., V J. Who cites who in the invasion zoo: insights from an analysis of the most highly cited papers in invasion ecology. Preslia 2006, 78:437-468.
43. Bornmann L., de Moya Anegón F., Leydesdorff L. Do scientific advancements lean on the shoulders of giants? A bibliometric investigation of the ortega hypothesis. PLoS One 2010, 5.
44. Corby Z. To be the best, cite the best. Nature News 2010, 10.1038/news.2010.539.
45. Hamrick T.A., Fricker R.D., Brown G.G. Assessing what distinguishes highly cited from less-cited papers published in interfaces. Interfaces 2010, 40:454-464.
46. Persson O. Are highly cited papers more international?. Scientometrics 2010, 83:397-401.
47. Wang M., Yu G., Yu D. Mining typical features for highly cited papers. Scientometrics 2011, 87:695-706.
48. Miyairi N., Chang H.-W. Bibliometric characteristics of highly cited papers from Taiwan, 2000-2009. Scientometrics 2012, 92:197-205.
49. Abramo G., Cicero T., D'Angelo C.A. Are the authors of highly cited articles also the most productive ones?. J. Informetr. 2014, 8:89-97.
50. Antonakis J., Bastardoz N., Liu Y.H., Schriesheim C.A. What makes articles highly cited?. Leadersh. Quart. 2014, 25:152-179.
51. Newman M.E.J. Prediction of highly cited papers. Europhys. Lett. (EPL) 2014, 105:6.
52. Eaton D.J. Highly cited papers in Medical Physics. Med. Phys. 2014, 41:43-44.
53. Aversa E. Citation patterns of highly cited papers and their relationship to literature ageing: A study of the working literature. Scientometrics 1985, 7:383-389.
54. Price D. Little Science, Big Science 1963, Columbia University Press.
55. Allison P.D., Stewart J.A. Productivity differences among scientists: Evidence for accumulative advantage. Amer. Sociol. Rev. 1974, 39:596-606.
56. Okrasa W. Differences in scientific productivity of research units: Measurement and analysis of output inequality. Scientometrics 1987, 12:221-239.
57. Allison P.D. Inequality and scientific productivity. Soc. Stud. Sci. 1980, 10:163-179.
58. Ghosh A., Chattopadhyay N., Chakrabarti B.K. Inequality in societies, academic institutions and science journals: Gini and -indices. Physica A 2014, 410:30-34.
59. Ponweiser M. Latent Dirichlet allocation in R 2012, (Master's thesis), University of Economics and Business, Vienna.
60. Ding W., Chen C. Dynamic topic detection and tracking: A comparison of HDP, C-word, and cocitation methods. J. Assoc. Informat. Sci. Technol. 2014, 65:2084-2097.
61. Lu K., Wolfram D. Measuring author research relatedness: A comparison of word-based, topic-based, and author cocitation approaches. J. Am. Soc. Inf. Sci. Technol. 2012, 63:1973-1986.
62. D. Binkley, D. Heinz, D. Lawrie, J. Overfelt, Understanding LDA in source code analysis, in: Presented at the Proceedings of the 22nd International Conference on Program Comprehension, Hyderabad, India, 2014.
63. Werner R. The focus on bibliometrics makes papers less useful. Nature 2015, 517:245.
64. Wohlin C., Runeson P., Höst M., Ohlsson M.C., Regnell B., Wesslén A. Experimentation in Software Engineering: An Introduction 2000, Kluwer Academic Publishers.
65. K. Petersen, R. Feldt, S. Mujtaba, M. Mattsson, Systematic mapping studies in software engineering, in: Presented at the 12th International Conference on Evaluation and Assessment in Software Engineering, EASE, 2008.
66. Lam K.-w., Lam K.-y., Hung S.-l. Optimistic concurrency control protocol for real-time databases. J. Syst. Softw. 1997, 38:119-131. 8/.
67. P. Raulamo-Jurvanen, M.V. Mäntylä, V. Garousi, Citation and topic analysis of the ESEM papers, in: International Symposium on Empirical Software Engineering and Measurement, 2015.
68. Parnas D.L. Stop the numbers game. Commun. ACM 2007, 50:19-21.