Developing a model to measure the effectiveness of research units

International Journal of Operations and Production Management

Volumn 23, Issue 11-12, 2003, Pages 1514-1531

  Roy, Santanu ^a   Nagpaul, P S ^a   Mohapatra, Pratap K J ^b  

^a INDIAN NATIONAL SCIENCE ACADEMY   (India)

^b INDIAN INSTITUTE OF TECHNOLOGY   (India)

Author keywords

Cost effectiveness; India; Measurement; Reliability management; Research work

Indexed keywords

EID: 0347020971     PISSN: 01443577     EISSN: None     Source Type: Journal    
DOI: 10.1108/01443570310506740     Document Type: Article

References (64)

1. Anderson, J.C. and Gerbing, D.W. (1984), "The effect of sampling error on convergence, improper solutions and goodness of fit indices for maximum likelihood confirmatory factor analysis", Psychometrika, Vol. 49, pp. 155-73.
2. Angur, M.G. and Natarajan, R. (1998), "A causal exploration of 'innovatorship' and 'lead-usership': a research note", Omega: The International Journal of Management Science, Vol. 26 No. 3, pp. 437-42.
3. Bagozzi, R.P. (1983a), "A holistic methodology for modeling consumer response to innovation", Operations Research, Vol. 31, pp. 128-76.
4. Bagozzi, R.P. (1983b), "Issues in the application of covariance structure analysis: a further comment", Journal of Consumer Research, Vol. 9, pp. 449-50.
5. Bagozzi, R.P. and Phillips, L.W. (1980), "Representing and testing organizational theories: a holistic construct", Administrative Science Quarterly, Vol. 27, pp. 459-89.
6. Bagozzi, R. and Yi, Y. (1988), "On the evaluation of structural equation models", Journal of the Academy of Marketing Science, Vol. 16, pp. 74-94.
7. Bentler, P.M. and Bonnet, D.G. (1980), "Significance tests and goodness of fit in the analysis of covariance structures", Psychological Bulletin, Vol. 88, pp. 588-606.
8. Bollen, K.A. (1989), Structural Equation with Latent Variables, Wiley, New York, NY.
9. Bollen, K.A. (1990), "Overall fit in covariance structural models: two types of sample size effects", Psychological Bulletin, Vol. 107, pp. 256-9.
10. Bollen, K.A. (1992), "A new incremental fit index for general structural equation models", Psychometrika, Vol. 51, pp. 335-73.
11. Browne, M.W. (1977), "Generalized least squares estimators in the analysis of covariance structures", in Aigner, DJ. and Goldberger, A.S. (Eds), Latent Variables in Socio-Economic Models, North-Holland, Amsterdam, pp. 205-66.
12. Cameron, K. (1986), "A study of organizational effectiveness and its predictors", Management Science, Vol. 32, pp. 87-112.
13. Campbell, D.T. and Fiske, D.W. (1959), "Convergent and discriminate validation by the multitrait-multimethod matrix", Psychological Bulletin, Vol. 56, pp. 85-105.
14. Carmines, E.G. and Zeller, R.A. (1979), Reliability and Validity Assessment, Sage Publications, Beverly Hills, CA.
15. Connolly, T., Conlon, E.J. and Deutsch, S.J. (1980), "Organizational effectiveness: a multiple constituency approach", Academy of Management Review, Vol. 5, pp. 211-17.
16. Cronbach, L.J. (1951), "Coefficient alpha and internal structure of tests", Psychometrica, Vol. 16 No. 3, pp. 297-334.
17. Cronbach, L.J. (1971), "Test validation", in Thorndike, R.L. (Ed.), Educational Measurement, American Council on Education, Washington, DC, pp. 443-507.
18. Cronbach, L.J. and Meehl, P.E. (1955), "Construct validity in psychological tests", Psychological Bulletin, Vol. 52, pp. 281-302.
19. Daft, R.L. (1986), Organization Theory and Design, West Pub. Co., St Paul, MN.
20. DeCotiis, T.A. and Dyer, L. (1979), "Defining and measuring project performance", Research Management, January, pp. 17-22.
21. Dick, W. and Hagerty, N. (1971), Topics in Measurement: Reliability and Validity, McGraw-Hill, New York, NY.
22. Feller, I. (2002), "Performance measurement redux", American Journal of Evaluation, Vol. 23 No. 4, pp. 435-52.
23. Fornell, C. (1983), "Issues in the application of covariance structure analysis: a comment", Journal of Consumer Research, Vol. 9, pp. 443-7.
24. Fox, J. (1984), Linear Statistical Models and Related Methods with Applications to Social Research, Wiley, New York, NY.
25. Ghosn, A.A., Al-Jazzaf, M.I. and Nazar, A. (1997), "A model for evaluating organization performance with application to a non-profit R&D organization", International Journal of Technology Management, Vol. 13 No. 5/6, pp. 497-510.
26. Hansen, C.P. (1989), "A causal model of the relationship among accidents, biodata, personality, and cognitive factors", Journal of Applied Psychology, Vol. 74 No. 1, pp. 81-90.
27. Hayduk, LA. (1987), Structural Equation Modeling with LISREL: Essentials and Advances, The Johns Hopkins University Press, Baltimore, MD.
28. Hemlin, S. and Gustafsson, M. (1996), "Research productions in the arts and humanities: a questionnaire study of factors influencing research performance", Scimtometrics, Vol. 37 No. 3, pp. 417-32.
29. Howard, J.L. and Frink, D.D. (1996), "The effects of organizational restructure on employee satisfaction", Group and Organization Management, Vol. 21 No. 3, pp. 278-303.
30. James, L.R., Mulaik, S.S. and Bret, J.M. (1982), Causal Analysis: Assumptions, Models and Data, Sage, Beverly Hills, CA.
31. Joreskog, K.G. (1969), "A general approach to confirmatory maximum-likelihood factor analysis", Psychometrica, Vol. 34, pp. 183-202.
32. Joreskog, K.G. (1973), "A general method for estimating a linear structural equation system", in Goldberger, A.S. and Duncan, O.D. (Eds), Structural Equation Models in the Social Sciences, Seminar, New York, NY, pp. 85-112.
33. Joreskog, K.G. (1978), "Structural analysis of covariance and correlation matrices", Psychometrica, Vol. 43 No. 4, pp. 443-77.
34. Joreskog, K.G. and Sorbom, D. (1984), LISREL VI User's Guide, Scientific Software, Mooresville, IN.
35. Joreskog, K. and Sorbom, D. (1989), LISREL 7.16: Analysis of Linear Structured Relationship by Maximum Likelihood and Least Squares Method, International Educational Services, Chicago, IL.
36. Joreskog, K.G. and Sorbom, D. (1993), LISREL 8: Structural Equation Modeling with the SIMPLIS Command Language, Scientific Software International, Chicago, IL.
37. Kim, B. and Oh, H. (2002), "An effective R&D performance measurement system: survey of Korean R&D researchers", Omega: The International Journal of Management Science, Vol. 30, pp. 19-31.
38. Koreisha, S.G. and Fang, Y. (1999), "The impact of measurement errors on ARMA prediction", Journal of Forecasting, Vol. 18, pp. 95-109.
39. La Du, T.J. and Tanaka, J.S. (1989), "Influence of sample size, estimation method, and model specification as goodness-of-fit assessments in structural equation models", Journal of Applied Psychology, Vol. 74, pp. 625-35.
40. Lawley, D.N. and Maxwell, A.E. (1971), Factor Analysis as a Statistical Method, Butterworth, London.
41. Lee, M., Son, B. and Lee, H. (1996), "Measuring R&D effectiveness in Korean companies", Research Technology Management, November-December, pp. 28-31.
42. Long, J.S. (1981), "Estimation and hypothesis testing in linear models containing measurement error: a review of Joreskog's model for the analysis of covariance structures", in Marsden, P.V. (Ed.), Linear Models in Social Research, Sage, Beverly Hills, CA, pp. 209-56.
43. Long, J.S. (1983), Covariance Structure Models: An Introduction to LISREL, Sage, Beverly Hills, CA.
44. Lord, F.M. and Novick, M.R. (1968), Statistical Theories of Mental Test Scores, Addison-Wesley, Reading, MA.
45. Martin, B.R. and Irvine, J. (1983), "Assessing basic research: some partial indicators of scientific progress in radio astronomy", Research Policy, Vol. 12, pp. 61-90.
46. Miller, R.B. (1982), "Measurement issues in R&D productivity", in Fusfeld, H.I. and Langlois, R.N. (Eds), Understanding R&D Productivity, Pergamon Press, New York, NY, pp. 18-31.
47. Moed, H.F., Burger, W.J.M., Frankfort, J.G. and van Raan, A.F.J. (1985), "The use of bibliometric data for the measurement of university research performance", Research Policy, Vol. 14, pp. 131-49.
48. Moser, M.R. (1985), "Measuring performance in R&D settings", Research Management, Vol. 28 No. 5, pp. 31-3.
49. Pappas, R. and Remer, D.S. (1989), "Measuring R&D productivity", in Timpe, D. (Ed.), Productivity: The Art and Science of Business Management, Kend Publishers, New York, NY, pp. 307-21.
50. Parkes, R.K. (1987), "Field dependence and the differentiation of neurotic syndromes", in Cuttanece, P. and Ecob, R. (Eds), Structural Modelling by Example, Cambridge University Press, Cambridge.
51. Rahim, M.A. and Psenicka, C. (1996), "A structural equation model of stress, locus of control, social support, psychiatric symptoms, and propensity to leave a job", The Journal of Social Psychology, Vol. 136 No. 1, pp. 69-84.
52. Reddy, S.K. (1992), "Effects of ignoring correlated measurement errors in structural equation models", Educational and Psychological Measurement, Vol. 52, pp. 549-90.
53. Riley, M.W. (1963), Sociological Research: A Case Approach, Harcourt Brace Jovanovich, New York, NY.
54. Saris, W.E. and Stronkhorst, L. (1984), Causal Modelling in Non-Experimental Research: An Introduction to the LISREL Approach, Scientometric Research Foundation, Amsterdam.
55. Sorbom, D. and Joreskog, K.G. (1978), "The use of LISREL in sociological model building", Proceedings of 9th World Congress of Sociology, 14-19 August, Uppsala.
56. Stainer, A. and Nixon, B. (1997), "Productivity and performance measurement in R&D", International Journal of Technology Management, Vol. 13 No. 5/6, pp. 486-96.
57. Stolte-Heiskanen, V. (1984), "Trends and problems in the evaluation of research", in Kaukonen, E. and Stolte-Heiskanen, V. (Eds), Science Studies and Science Policy: Proceedings of a Finnish-Bulgarian Symposium, Academy of Finland (Co-ordination Research Group for Science Studies) and University of Tampere.
58. Toren, N. and Galai, D. (1978), "The determinants of potential effectiveness of government supported industrial research institutes", Research Policy, Vol. 7, pp. 362-82.
59. Van de Ven, A.H., Delbeg, A.L. and Koenig, K. Jr (1976), "Determinants of coordination modes within organizations", American Sociological Review, Vol. 41, pp. 322-38.
60. Venkatraman, N. (1989), "Strategic orientation of business enterprises: the constructs, dimensionality and measurement", Management Science, Vol. 11, pp. 942-62.
61. Vinkler, P. (1998), "General performance indexes calculated for research institutes of the Hungarian Academy of Sciences based on scientometric indicators", Scientometrics, Vol. 41 No. 1/2, pp. 185-200.
62. Werner, B.M. and Souder, W.E. (1997), "Measuring R&D performance - state-of-the-art", Research Technology Management, March-April, pp. 34-42.
63. Werts, C.E., Linn, R.L. and Joreskog, K.G. (1974), "Interclass reliability estimates: testing structural assumptions", Education and Psychological Measurement, Vol. 34, pp. 25-33.
64. Whitley, R. and Frost, P.A. (1971), "The measurement of performance in research", Human Relations, Vol. 24, pp. 161-78.