To publish or not to publish? On the aggregation and drivers of research performance

Scientometrics

Volumn 85, Issue 3, 2010, Pages 657-680

  de Witte, Kristof ^a,b   Rogge, Nicky ^b,c  

^a MAASTRICHT UNIVERSITY   (Netherlands)

^b UNIVERSITY OF LEUVEN   (Belgium)

^c HOGESCHOOL UNIVERSITEIT BRUSSEL   (Belgium)

Author keywords

Composite indicator; Conditional efficiency; Data envelopment analysis; Higher education; Research performance

Indexed keywords

EID: 77958516011     PISSN: 01389130     EISSN: None     Source Type: Journal    
DOI: 10.1007/s11192-010-0286-5     Document Type: Article

References (105)

1. Allen, M. (1996). Research productivity and positive teaching evaluations: Examining the relationship through meta-analysis. Journal of the Association for Communication, 2, 77-96.
2. Archibugi, D., & Coco, A. (2004). A new indicator of technological capabilities for developed and developing countries (ArCo). World Development, 32(4), 629-654.
3. Astin, A. W. (1994). What matters in college? Four critical years revisited. San Francisco: Jossey-Bass Inc.
4. Avital, M., & Collopy, F. (2001). Assessing research performance: Implications for selection and motivation. Sprouts: Working Papers on Information Environments, 1(3), 40-61.
5. Babu, A. R., & Singh, Y. P. (1998). Determinants of research productivity. Scientometrics, 43(3), 309-329.
6. Badin, L., Daraio, C., & Simar, L. (2010). Optimal bandwidth selection for conditional efficiency measures: A data-driven approach. European Journal of Operational Research, 201(2), 633-640.
7. Beasly, J. E. (1995). Determining teaching and research efficiencies. The Journal of the Operational Research Society, 46(4), 441-452.
8. Becker, W. E., & Kennedy, P. E. (2005). Does teaching enhance research in economics. Perspectives on Research and Teaching in Economics, 95(2), 172-176.
9. Bellas, M. L., & Toutkoushian, R. K. (1999). Faculty time allocations and research productivity: Gender, race and family effects. The Review of Higher Education, 22, 367-390.
10. Bland, C. J. (1992). Characteristics of a productive research environment: Literature review. Academic Medicine, 67(6), 385-397.
11. Bland, C. J., & Berquist, W. H. (1997). The vitality of senior faculty members. Snow on the roof-fire in the furnace. ERIC Document Reproduction, service no. ED415733.
12. Bonaccorsi, A., Daraio, C., & Simar, L. (2006). Advanced indicators of productivity of universities: An application of robust nonparametric methods to Italian data. Scientometrics, 66(2), 389-410.
13. Bowen, H., Moesen, W., & Sleuwaegen, L. (2008). A composite index of the creative economy with application to regional best practices. Review of Business and Economics, 53(4), 375-397.
14. Braxton, J. M. (1996). Contrasting perspectives on the relationship between teaching and research. In New directions for institutional research (vol. 2, pp. 5-14). San Francisco: Jossey-Bass.
15. Brew, A. (2001). The nature of research: Inquiry in academic contexts. London: Routlegde/Falmer.
16. Broder, I. E. (1993). Professional achievements and gender differences among academic economists. Economic Inquiry, 31, 116-127.
17. Cazals, C., Florens, J. P., & Simar, L. (2002). Nonparametric frontier estimation: A robust approach. Journal of Econometrics, 106(1), 1-25.
18. Charnes, A., Cooper, W. W., & Rhodes, E. (1978). Measuring the efficiency of decision making units. European Journal of Operational Research, 2, 429-444.
19. Chen, Y., Gupta, A., & Hoshower, L. (2006). Factors that motivate business faculty to conduct research: An expectancy theory analysis. Journal of Education for Business, 81, 179-189.
20. Cherchye, L., & Kuosmanen, T. (2006). Benchmarking sustainable development: A synthetic meta-index approach, Chapter 7. In M. McGillivray & M. Clarke (Eds.), Perspectives on human development. Tokyo: United Nations University Press.
21. Cherchye, L., Lovell, C. A. K., Moesen, W., & van Puyenbroeck, T. (2007a). One market, one number? A composite indicator assessment of EU internal market dynamics. European Economic Review, 51(3), 749-779.
22. Cherchye, L., Moesen, W., Rogge, N., & van Puyenbroeck, T. (2007b). An introduction to 'benefit of the doubt' composite indicators. Social Indicators Research, 82, 111-145.
23. Cherchye, L., Moesen, W., Rogge, N., van Puyenbroeck, T., Saisana, M., Saltelli, A., et al. (2008). Creating composite indicators with DEA and robustness analysis: The case of the technology achievement index. Journal of the Operational Research Society, 59, 239-251.
24. Cherchye, L., & Vanden Abeele, P. (2005). On research efficiency: A micro-analysis of Dutch university research in economics and business management. Research Policy, 34, 495-516.
25. Claro, J., & Costa, C. A. V. (2010). A made-to-measure indicator for cross-disciplinary bibliometric ranking of researchers performance. Scientometrics. doi: 10. 1007/s11192-010-0241-5.
26. Cook, W. D. (2004). Qualitive data in DEA. In W. W. Cooper, L. Seiford, & J. Zhu (Eds.), Handbook on data envelopment analysis (pp. 75-97). Dordrecht: Kluwer Academic Publishers.
27. Daniel, H.-D., & Fisch, R. (1990). Research performance evaluation in the German university sector. Scientometrics, 19(5-6), 349-361.
28. Daouia, A., & Simar, L. (2007). Nonparametric efficiency analysis: A multivariate conditional quantile approach. Journal of Econometrics, 140(2), 375-400.
29. Daraio, C., & Simar, L. (2005). Introducing environmental variables in nonparametric frontier models: A probabilistic approach. Journal of Productivity Analysis, 24(1), 93-121.
30. Daraio, C., & Simar, L. (2007a). Advanced robust and nonparametric methods in efficiency analysis: Methodology and applications. Series: Studies in Productivity and Efficiency. Dordrecht: Springer.
31. Daraio, C., & Simar, L. (2007b). Conditional nonparametric frontier models for convex and nonconvex technologies: A unifying approach. Journal of Productivity Analysis, 28, 13-32.
32. Dasgupta, P., & David, P. A. (1994). Toward a new economics of science. Research Policy, 23(5), 487-521.
33. Davis, J. C., Huston, J. H., & Patterson, D. M. (2001). The scholarly output of economists: A description of publishing patterns. Atlantic Economic Journal, 29(3), 341-349.
34. Davis, J. C., & Patterson, D. M. (2001). Determinants of variations in journal publication rates of economists. American Economist, 45, 86-91.
35. De Witte, K., & Kortelainen, M. (2008). Blaming the exogenous environment? Conditional efficiency estimation with continuous and discrete environmental variables, CES Discussion Paper Series DPS 08. 33, MPRA Paper 14034.
36. De Witte, K., & Rogge, N. (2009). Accounting for exogenous influences in a benevolent performance evaluation of teachers, Brussel. HUB Research Papers 2009/15.
37. Despotis, D. K. (2005). A reassessment of the human development index via data envelopment analysis. Journal of the Operational Research Society, 56(8), 969-980.
38. Emery, C. R., Kramer, T. R., & Tian, R. G. (2003). Return to academic standards: A critique of student evaluations of teaching effectiveness. Quality Assurance in Education, 11(1), 37-46.
39. European Commission. (2004). The EU Economy Review 2004, European Economy, Nr. 6. Luxembourg: Office for Official Publications of the EC.
40. Fabel, O. (2008). Research productivity in business economics: An investigation of Austrian, German and Swiss universities. German Economic Review, 9(4), 506-531.
41. Fairweather, J. S. (1993). Faculty rewards reconsidered: The nature of tradeoffs. Change, 25, 44-47.
42. Fairweather, J. S. (2002). The mythologies of faculty productivity: Implication for institutional policy and decision making. The Journal of Higher Education, 73(1), 26-48.
43. Farrell, M. J. (1957). The measurement of productive efficiency. Journal of the Royal Statistical Society, Series A, CXX, Part 3, 253-290.
44. Feldman, K. A. (1983). Seniority and experience of college teachers as related to evaluations they receive from students. Research in Higher Education, 18, 3-124.
45. Feldman, K. A. (1987). Research productivity and scholarly accomplishment of college teachers as related to their instructional effectiveness: A review and exploration. Research in Higher Education, 26, 227-298.
46. Foster, J., & Sen, A. (1997). On economic inequality, 2nd expanded edn. Oxford: Clarendon Press.
47. Fox, M. F. (1992). Research, teaching, and publication productivity: Mutuality versus competition in academia. Sociology of Education, 65, 293-305.
48. Fox, M. F., & Faver, C. A. (1985). Men, women, and publication productivity: Patterns among social work academics. The Sociological Quarterly, 26(4), 537-549.
49. Fox, M. F., & Milbourne, R. (1999). What determines research output of academic economists? Economic Record, 75, 256-267.
50. Godin, B., & Gingras, Y. (2000). Impact of collaborative research on academic science. Science and Public Policy, 27(1), 65-73.
51. Gupta, B. M., Kumar, S., & Aggarwal, B. S. (1999). A comparison of productivity of male and female scientists of CSIR. Scientometrics, 45(2), 269-289.
52. Harris, G., & Kaine, G. (1994). The determinants of research performance: A study of Australian university economists. Higher Education, 27, 191-201.
53. Hattie, J., & Marsh, H. W. (1996). The relationship between research and teaching: A meta-analysis. Review of Educational Research, 66, 507-542.
54. Hattie, J., & Marsh, H. W. (2002). The relation between research productivity and teaching effectiveness. Journal of Higher Education, 73(5), 603-641.
55. Jacobsen, R. L. (1992). Colleges face new pressure to increase faculty productivity. Chronicle of Higher Education, 38(32), 16-18.
56. Jenkins, A., Blackman, T., Lindsay, R., & Patton-Saltzberg, R. (1998). Teaching and research: Student perspectives and policy implications. Studies in Higher Education, 23, 127-141.
57. Jeong, S., Park, B., & Simar, L. (2010). Nonparametric conditional efficiency measures: Asymptotic properties. Annals of Operations Research, 173(1), 105-122.
58. Johnes, G., & Johnes, J. (1993). Measuring the research performance of UK university departments: An application of data envelopment analysis. Oxford Economic Papers, 45, 332-347.
59. Kremer, J. (1990). Construct validity of multiple measures in teaching, research and services and reliability of peer ratings. Journal of Educational Psychology, 82, 213-218.
60. Kuosmanen, T. (2002). Modeling blank entries in Data Envelopment Analysis. EconWPA Working Paper at WUSTL, No. 0210001.
61. Kyvik, S. (1990). Age and scientific productivity. Differences between fields of learning. Higher Education, 19, 37-55.
62. Landry, R., Traore, N., & Godin, B. (1996). An econometric analysis of the effect of collaboration on academic research productivity. Higher Education, 32(3), 283-301.
63. Lee, S., & Bozeman, B. (2005). The impact of research collaboration on scientific productivity. Social Studies of Science, 35(5), 673-702.
64. Levin, S. G. S., & Stephan, P. (1991). Research productivity over the life cycle: Evidence for academic scientists. American Economic Review, 81(1), 114-132.
65. Li, Q., & Racine, J. S. (2007). Nonparametric econometrics: Theory and practice. Princeton: Princeton University Press.
66. Liddle, B., Westergren, A., & Duke, D. (1997). Time allocation and research productivity among counseling faculty. Psychological Reports, 80, 339-344.
67. Long, J. S. (1987). Problems and prospects for research and sex differences in the scientific career. In L. S. Dix (Ed.), Women: Their underrepresentation and career differentials in science and engineering (pp. 157-169). Washington: National Academy Press.
68. Long, J. S., Allison, P. D., & McGinnis, R. (1993). Rank advancement in academic careers: Sex differences and the effects of productivity. American Sociological Review, 58(5), 703-722.
69. Lotka, A. J. (1926). The frequency distribution of scientific productivity. Journal of the Washington Academy of Sciences, 16(12), 317-324.
70. Lovell, C. A. K., Pastor, J. T., & Turner, J. A. (1995). Measuring macroeconomic performance in the OECD: A comparison of European and Non-European Countries. European Journal of Operational Research, 87, 507-518.
71. Marsh, H. W. (1984). Students' evaluations of teaching: Dimensionality, reliability, validity, potential biases and utility. Journal of Educational Psychology, 76, 707-754.
72. Marsh, H. W. (1987). Students' evaluations of university teaching: Research findings methodological issues, and directions for future research. International Journal of Educational Research, 11, 253-388.
73. Marsh, H. W., & Hattie, J. (2002). The relationship between research productivity and teaching effectiveness: Complementarity, antagonistic, or independent constructs? The Journal of Higher Education, 73(5), 603-641.
74. Martin, B. R. (1996). The use of multiple indicators in the assessment of basic research. Scientometrics, 36(3), 343-362.
75. Maske, K. L., Durden, G. C., & Gaynor, P. (2003). Determinants of scholarly productivity among male and female economists. Economic Inquiry, 41, 555-564.
76. Massy, W. F., & Wilger, A. K. (1995). Improving productivity. Change, 27(4), 10-20.
77. McCain, K., & Turner, K. (1989). Citation context analysis and aging patterns of journal articles in molecular genetics. Scientometrics, 17(1/2), 127-163.
78. Melyn, W., & Moesen, W. (1991). Towards a synthetic indicator of macroeconomic performance: Unequal weighting when limited information is available, Public Economics Research Paper 17. Leuven: CES, KULeuven.
79. Mercer, B. E., & Wanderer, J. J. (1970). The study of society. Belmont: California Wardsworth Publishing Co.
80. Merton, R. K. (1968). Social theory and social structure. New York: The Free Press.
81. Nederhof, A. J., Meijer, R. F., Moed, H. F., & Vanraan, A. F. J. (1993). Research performance indicators for university departments: A study of an agricultural university. Scientometrics, 27(2), 157-178.
82. Neumann, R. (1992). Perceptions of the teaching-research nexus: A framework for analysis. Higher Education, 23, 159-171.
83. OECD, European Commission, Joint Research Centre. (2008). Handbook on constructing composite indicators: Methodology and user guide. In Nardo, M., Saisana, M., Saltelli, A., & Tarantola, S. (EC/JRC), Hoffman, A. & Giovannini, E. (OECD), Paris: OECD publication code: 302008251E1.
84. Olsen, D., & Simmons, A. J. M. (1996). The research versus teaching debate: Untangling the relationships. New Directions for Institutional Research, 90, 31-39.
85. Racine, J. S., Hart, J., & Li, Q. (2006). Testing the significance of categorical predictor variables in nonparametric regression models. Econometric Reviews, 25(4), 523-544.
86. Ramos, R., Royuela, V., & Suriňach, J. (2007). An analysis of the determinants in economics and business publications by Spanish universities between 1994 and 2004. Scientometrics, 71(1), 117-144.
87. Ramsden, P. (1994). Describing and explaining research productivity. Higher Education, 28, 207-226.
88. Ramsden, P., & Moses, I. (1992). Association between research and teaching in Australian higher education. Higher Education, 23, 273-295.
89. Rodgers, J. R., & Neri, F. (2007). Research productivity of Australian academic economists: Human-capital and fixed effects. Australian Economic Papers, 46(1), 67-87.
90. Rogge, N. (2009a). Granting teachers the 'benefit-of-the-doubt' in performance evaluations, Brussels. HUB Research Papers 2009/17.
91. Rogge, N. (2009b). Robust benevolent evaluations of teacher performance. In Conference proceedings: SIS 2009-colloquium 'simulation in industry and services 2009', Brussels. 4 December 2009.
92. Ruiz, C. F., Bonilla, R., Chavarro, D., Orozco, L. A., Zarama, R., & Polanco, X. (2010). Efficiency measurement of research groups using data envelopment analysis and bayesian networks. Scientometrics, 83(3), 711-721.
93. Rushton, J. P., Murray, H. G., & Paunonen, S. V. (1983). Personality, research creativity, and teaching effectiveness in university professors. Scientometrics, 5, 93-116.
94. Sax, L. J., Hagedorn, L. S., Arredondo, M., & Dicrisi, F. A. (2002). Faculty research productivity: Exploring the role of gender and family-related factors. Research in Higher Education, 43(4), 423-446.
95. Seldin, P. (1985). Changing practices in faculty evaluation. San Francisco: Jossey-Bass.
96. Stack, S. (2003). Research productivity and student evaluation of teaching in social science classes: A research note. Research in Higher Education, 44(5), 539-556.
97. van Leeuwen, T. H., Visser, M. S., Moed, H. F., Nederhof, T. J., & van Raan, A. F. J. (2003). The Holy Grail of science policy: Exploring and combining bibliometric tools in search of scientific excellence. Scientometrics, 57(2), 257-280.
98. van Raan, A. F. J. (1996). Advanced bibliometric methods as quantitative core of peer review based evaluation and foresight exercises. Scientometrics, 36(3), 397-420.
99. Vasil, L. (1992). Self-efficacy expectation and causal attributions for achievement among male and female university faculty. Journal of Vocational Behavior, 41(3), 259-269.
100. Vasil, L. (1996). Social process skills and career achievement among male and female academics. Journal of Higher Education, 67(1), 103-114.
101. Vinkler, P. (1998). General performance indexes calculated for research institutes of the Hungarian academy of sciences based on scientometric indicators. Scientometrics, 41(1-2), 185-200.
102. Vinkler, P. (2006). Composite scientometric indicators for evaluating publications of research institutes. Scientometrics, 68(3), 629-642.
103. Volkwein, J. F., & Carbone, D. A. (1994). The impact of departmental research and teaching climates on undergraduate growth and satisfaction. Journal of Higher Education, 65, 147-167.
104. Zamarripa, E. J. (1995). Evaluating research productivity. SRA Journal, 26(3-4), 17-27.
105. Zhou, P., Ang, B. W., & Poh, K. L. (2007). A mathematical programming approach to constructing composite indicators. Ecological Economics, 62, 291-297.