From Practice to Theory and back to Practice: Reflexivity in Measurement and Evaluation for Evidence-based Policy Making in the Information Society

Government Information Quarterly

Volumn 30, Issue SUPPL. 1, 2013, Pages

  Misuraca, Gianluca ^a   Codagnone, Cristiano ^b   Rossel, Pierre ^c  

^a JOINT RESEARCH CENTRE   (Italy)

^b UNIVERSITY OF MILAN   (Italy)

^c EPFL   (Switzerland)

Author keywords

ICTs; Information Society; Measurement; Modelling; Policy; Reflexivity

Indexed keywords

EID: 84873060629     PISSN: 0740624X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.giq.2012.07.011     Document Type: Article

References (164)

1. Acemoglu D. Technical change, inequality, and the labor market. Journal of Economic Literature 2002, 40(1):7-72.
2. Accenture Leadership in customer service: Delivering on the promise 2007, (Ottawa).
3. Amariles F., Paz O., Russell N., Johnson N. The Impacts of Community Telecenters in Rural Colombia. Journal of Communty Informatics, Special Issue on Telecentres 2006.
4. Angrist J., Pischke J. Mostly harmless econometrics: An empiricist's companion 2009, Princeton University Press, Princeton, NJ.
5. Atkinson T. Atkinson review: Final report: Measurement of government output and productivity for the national accounts 2005, Palgrave Macmillan, London.
6. Bannister F. Citizen Centricity: A Model of IS Value in Public Administration. Electronic Journal of Information Systems Evaluation 2002, 5(2).
7. Bannister F. The curse of the benchmark: An assessment of the validity and value of e-government comparisons. International Review of Administrative Sciences 2007, 73(2):171-188.
8. Best J. Damned lies and statistics: Untangling numbers from the media, politicians, and activists 2001, University of California Press, Berkeley.
9. Bertot J.C., Jaeger P.T. The E-Government paradox: Better customer service doesn't necessarily cost less. Government Information Quarterly 2008, 25(2):149-154.
10. Bloom N., Sadun R., Van Reenen J.M. Americans Do I.T. Better: US Multinationals and the Productivity Miracle 2007, SSRN eLibrary.
11. Bresnahan T., Trajtenberg M. General purpose technologies "Engines of growth"?. Journal of Econometrics 1995, 65(1):83-108.
12. Bresnahan T., Brynjolfsson E., Hitt L. Information Technology, Workplace Organization, and the Demand for Skilled Labor: Firm-Level Evidence. The Quarterly Journal of Economics 2002, 117(1):339-376.
13. Broster D., Misuraca G., Bacigalupo M. Lifting off towards Open Government: A report from the EU Belgian Presidency Conference. Special Issue on: 'The Openness of Government' 2011, March / April, Vol.12. P. Waller, T.A. Undheim (Eds.).
14. Brynjolfsson E. The productivity paradox of information technology: Review and assessment. Communications of the ACM 1993, 36(12):67-77.
15. Brynjolfsson E., Hitt L. Beyond the productivity paradox. Communications of the ACM 1998, 41(8):49-55.
16. Brynjolfsson Erik, Hitt Lorin Computing Productivity: Firm-level Evidence. Review of Economics and Statistics 2003, November, 84(4).
17. Campbell D., Stanley J. Experimental and quasi-experimental evaluations in social research 1963, Rand McNally, Chicago.
18. CapGemini Ernst, Young eGovernment Benchmark study 2003 2003, Brussels
19. CapGemini Does E-Government Pay Off? 2004, CapGemini, Utrecht.
20. CapGemini Online Availability Of Public Services: How Is Europe Progressing? 2005, CapGemini, Brussels.
21. CapGemini Online Availability Of Public Services: How Is Europe Progressing? 2006, CapGemini, Brussels.
22. Capgemini The user challenge benchmarking the supply of online public services 7th measurement 2007, (Brussels).
23. Capgemini Smarter, faster, better eGovernment, 8th measurement 2009, (Brussels).
24. Capgemini Digitizing public service in Europe: Putting ambition into action, 9th benchmark measurement 2010, (Brussels).
25. Capgemini Method paper 2010, preparing the 9th benchmark measurement 2010, (Brussels).
26. CapGemini Ernst & Young Summary report web-based survey on electronic public services: Results of the first measurement 2001, (Brussels).
27. CapGemini Ernst & Young Summary report web-based survey on electronic public services: Results of the second measurement 2002, (Brussels)
28. Caroli E., Van Reenen J. Skill-Biased Organizational Change? Evidence from A Panel of British and French Establishments. The Quarterly Journal of Economics 2001, 116(4):1449-1492.
29. Carrera L., Dunleavy P. Productivity Change in the Public Sector: Innovation, New Public Management and Cultural Resistance to 'Digital Era Governance' in UK Social Security. Paper presented at the American Political Science Association 2010 Annual Meeting 2010.
30. Carrera L., Dunleavy P., Bastow S. Understanding productivity trends in UK tax collection. London School of Economics Public Policy Group Working Paper, London 2009.
31. Castelli A., Dawson D., Gravelle H., Jacobs R., Kind P., Loveridge P., et al. A new approach to measuring health system output and productivity. National Institute Economic Review 2007, 200(1):105-117.
32. Castelnovo W. Is there an eGovernment Paradox?. 10th European eGovernment Conference on eGovernment 2010, 90-98. Academic Publishing Limited, Limerick, Ireland. D. O'Donnel (Ed.).
33. Castelnovo W., Simonetta M. The Evaluation of e-Government projects for Small Local Government Organisations. The Electronic Journal of e-Government 2007, 5(1):21-28.
34. Castelnovo W., Simonetta M. A Public Value Evaluation of e-Government Policies. The Electronic Journal Information Systems Evaluation 2008, 11(2):61-72.
35. Chaudhry B., Wang J., Wu S., Maglione M., Mojica W., Roth E., et al. Systematic review: Impact of health information technology on quality, efficiency, and costs of medical care. Annals of Internal Medicine 2006, 144(10):742-752.
36. Codagnone C. Compendium to eGEP measurement framework 2006, Delivered for the European Commission, DG Information Society, Brussels.
37. Codagnone C. Compendium to eGEP expenditure study 2006, (Brussels).
38. Codagnone C. Measuring eGovernment: Reflections from eGEP measurement framework experience. European Review of Political Technologies 2007, 4:89-106.
39. Codagnone C. Vienna study on inclusive innovation for growth and cohesion: Modelling and demonstrating the impact of eInclusion 2009, Publication Office of the EU, Luxembourg.
40. Codagnone C., Abadie F. Strategic intelligence monitor on personal health systems (SIMPHS): Structure of available data and new measurement framework with selected indicators 2011, Publication Office of the EU, Luxembourg.
41. Codagnone C., Boccardelli D. eGEP measurement framework 2006, EC, Brussels.
42. Codagnone C., Cilli V. eGEP expenditure study 2006, EC, Brussels.
43. Codagnone C., Lupiañez-Villanueva F. A composite index for the benchmarking of eHealth deployment in European acute hospitals. Distilling reality into a manageable form for evidence-based policy 2011, Publication Office of the EU, Luxembourg.
44. Codagnone C., Maghiros I., Browster D., Lupiañez-Villanueva F., Lluch M. Assessing the impact of integrated personal health and social care services: The need for modelling 2011, Publication Office of the EU, Luxembourg.
45. Codagnone C., Undheim T. Government efficiency and effectiveness: The theory and practice of benchmarking and measurement. European Journal of ePractice 2008, 1(4):4-18.
46. College of Europe Analysis of e-Inclusion impact resulting from advanced R&D based on economic modelling in relation to innovation capacity, capital formation, productivity, and empowerment 2010, EC, Brussels.
47. Corsi M., et al. EGEP economic model 2006, EC, Brussels.
48. Crandall R., Singer H. The Economic Impact of Broadband Investment 2010, National Cable and Telecommunication Association, Washington D.C.
49. Crespi G., Criscuolo C., Haskel J. Information Technology, Organizational Change and Productivity Growth: Evidence from U.K. Firms. CEP Discussion Paper 2007, No. 783.
50. Czernich N., Falck O., Kretschmer T., Woessmann L. Broadband Infrastructure and Economic Growth. Economic Journal 2011, 121(552):505-532.
51. Daveri F. The New Economy in Europe, 1992-2001. Oxford Review of Economic Policy 2002, 18(3):345-362.
52. Daveri F. Why Is There a Productivity Problem in Europe?. Bruxelles: CEPS Working Document 2004, N. 205.
53. De Luca A., Osimo D., Cristiano C. e-Inclusion initiatives from private and non profit European entities 2010, (Brussels).
54. Dehning B., Dow K., Stratopoulos T.C. Information Technology and Organizational Slack. International Journal of Accounting Information Systems 2004, 5(1):51-63.
55. Dewan S., Kraemer K.L. International dimensions of the productivity paradox. Communications of the ACM 1998, 41(8):56-62.
56. Di Maggio P., Powell W. The new institutionalism in organizational analysis 1991, University of Chicago Press, Chicago.
57. Diewert W.E., Fox K.J. Can measurement error explain the productivity paradox?. Canadian Journal of Economics-Revue Canadienne D Economique 1999, 32(2):251-280.
58. DiNardo J., Pischke J. The Returns to Computer Use Revisited: Have Pencils Changed the Wage Structure Too?. The Quarterly Journal of Economics 1997, 112(1):291-303.
59. Dobrev A., Haesner M., Hüsing T., Korte W., Meyer I. Benchmarking ICT use among general practitioners in Europe 2008, Empirica, EC, Brussels, Bonn.
60. Doms M., Jarmin R., Klimek S. Information technology investment and firm performance in US retail trade. Economic Innovation and New Technologies 2004, 13(7):595-613.
61. Dopfer K. The origins of meso economics: Schumpeter's legacy. The papers on economics and evolution 2006, Evolutionary Economics Group, Jena, Germany.
62. Econsult Corporation & US Digital Impact Group The Economic Impact Of Digital Exclusion 2010, US Federal Communication Commission, Washington, D.C.
63. Enterprise L.S.E. The economic impact of ICT, Interim Report. Delivered for the European Commission 2010, DG Information Society, Brussels.
64. Enterprise L.S.E. The economic impact of ICT, Final Report. Delivered for the European Commission 2010, DG Information Society, Brussels.
65. Entorf H., Gollac M., Kramarz F. New technologies, wages, and worker selection. Journal of Labor Economics 1999, 17(3):464-491.
66. Entorf H., Kramarz F. Does unmeasured ability explain the higher wages of new technology workers?. European Economic Review 1997, 41(8):1489-1509.
67. Etzioni A., Lehman E. Some dangers in 'Valid' social measurements: Preliminary notes. The Annals of the American Academy of Political and Social Science 1967, 373(1):1-15.
68. European Commission Commission staff working document, accompanying the communication European i2010 initiative on eInclusion: Impact assessment. Brussels 2007, (COM(2007) 694 final SEC(2007) 1470, Brussels).
69. European Commission, JRC-IPTS Scientific & Technical Report (2011). Using ICT to co-produce better health outcomes: A paradigm shift towards Health 2.0. Piniewski, B., Codagnone, C, and Osimo, D.
70. Faggio G., Salvanes K., Van Reenen J. The Evolution of Inequality in Productivity and Wages: Panel Data Evidence. CEP Discussion Paper 2007, No. 821.
71. Fariselli P., Bojic O., Culver-Hopper J. Demand and Supply of Public Information Online for Business: A Comparison of EU Countries and the US. Paper presented at the EGOV 2004, Retrieved from.
72. Fernández-i-Marín X. The Impact of e-Government Promotion in Europe: Internet Dependence and Critical Mass. Policy & Internet 2011, 3(4).
73. Ford G.S., Koutsky T.M. Broadband And Economic Development: A Municipal Case Study From Florida. Review of Urban & Regional Development Studies 2005, 17(3):216-229.
74. Freeman R.B. The labour market in the new information economy. Oxford Review of Economic Policy 2002, 18(3):288-305.
75. Friedberg L. The impact of technological change on older workers: Evidence from data on computer use. Industrial & Labor Relations Review 2003, 56(3):511-529.
76. Garicano L., Heaton P. Information Technology, Organization, and Productivity in the Public Sector: Evidence from Police Departments. Journal of Labor Economics 2010, 28(1):167-201.
77. Gillett S., Lehr W., Sirbu M. Measuring the Economic Impact of Broadband Deployment 2006, US Department of Commerce, Washington, D.C.
78. Goldkuhl G., Persson A. From e-Ladder to e-Diamond - Re-conceptualising models for public e-Services. Paper presented at the 14th European Conference on Information Systems (ECIS2006) 2006.
79. Gomez R., Reilly K. Comparing Approaches: Telecentre Evaluation Experiences in Asia and Latin America. The International Information & Library Review 2002, 34(1):57-78.
80. Gordon R.J. Why was Europe Left at the Station When America's Productivity Locomotive Departed?. National Bureau of Economic Research Working Paper Series 2004, No. 10661.
81. Organizational linkages: Understanding the productivity paradox 2003, National Academy Press, Washington. D.H. Harris (Ed.).
82. Heeks R. Understanding and Measuring eGovernment: International Benchmarking Studies. Paper presented at the UNDESA Workshop on Participation and E-Government: Understanding the Present and Creating the Future 2006.
83. Heckman J.J. Econometric causality. International Statistical Review 2008, 76(1):1-27.
84. Helsper H. Digital Inclusion: An Analysis of Social Disadvantage and the Information Society 2008, UK Department for Communities and Local Government, London.
85. Hempell T. What's spurious, what's real? Measuring the productivity impacts of ICT at the firm-level. Empirical Economics 2005, 30(2):427-464.
86. Hempell, T., Van Leeuwen, G., & Van Der Wiel, H. (2004). ICT, Innovation and Business Performance in Services: Evidence for Germany and The Netherlands. In OECD (Ed.), The Economic Impact of ICT: Measurement, Evidence and Implications. OECD, Paris.
87. Hillestad R., Bigelow J., Bower A., Girosi F., Meili R., Scoville R., et al. Can electronic medical record systems transform health care? Potential health benefits, savings, and costs. Health Affairs 2005, 24(5):1103-1117.
88. Hinssen P. The New Normal 2010, 202. Belgium.
89. Holt L., Jamison M. Broadband and contributions to economic growth: Lessons from the US experience. Telecommunications Policy 2009, 33(10-11):575-581.
90. Inklaar R., O'Mahony M., Timmer M. ICT and Europe's productivity performance: Industry-level growth account comparisions with the United States. Review of Income and Wealth 2005, 51(4):505-536.
91. Inklaar R., Timmer M.P., van Ark B. Mind the gap! International comparisons of productivity in services and goods production. German Economic Review 2007, 8(2):281-307.
92. Inklaar R., Timmer M.P., van Ark B. Market services productivity across Europe and the US. Economic Policy 2008, 53:140-194.
93. ITU Measuring the Information Society 2011, ITU, Geneva.
94. Jansen J., de Vries S., van Schaik P. The contextual benchmark method: Benchmarking e-Government services. Government Information Quarterly 2010, 27(3):213-219.
95. Jorgenson D.W., Ho M.S., Stiroh K.J. A Retrospective Look at the U.S. Productivity Growth Resurgence. Journal of Economic Perspectives 2008, 22(1):3-24.
96. Joseph R., Esteves J. A comprehensive framework for the assessment of eGovernment projects. Government Information Quarterly 2008, 25(1):118-132.
97. Jourmard I., Hoeller P., André C., Nicq C. Health care systems: Efficiency and policy settings 2010, OECD, Paris.
98. Kathryn S. Insider econometrics: A roadmap with stops along the way. Labour Economics 2009, 16(6):607-617.
99. Katz R., Vaterlaus S., Zenhäusern P., Suter S., Mahler P. The Impact of Broadband on Jobs and the German Economy 2009, Deutsche Telekom AG, Bonn.
100. Kearney A.T. Assessing the economic benefits of digital inclusion 2009, Infoxchange, Canberra.
101. Khander S.R., Koolwal G.B., Samad H.A. Handbook on Impact Evaluation: Quantitative Methods and Practice 2010, Washington D.C, The World Bank.
102. Krueger A.B. How Computers Have Changed the Wage Structure - Evidence from Microdata, 1984-1989. Quarterly Journal of Economics 1993, 108(1):33-60.
103. Kunstelj M., Vintar M. Evaluating the progress of e-government development: A critical analysis. Information Polity 2004, 9(3,4):131-148.
104. Landauer T.K. The Trouble with Computers: Usefulness, Usability and Productivity 1995, MIT Press, Cambridge.
105. Lapointe L., Mignerat M., Vedel I. The IT productivity paradox in health: A stakeholder's perspective. International Journal of Medical Informatics 2011, 80(2):102-115.
106. Machin S., McNally S., Silva O. New technology in schools: Is there a pay-off?. Economic Journal 2006, 552(117):1145-1167.
107. Magoutas B., Halaris C., Mentzas G. An ontology for the multi-perspective evaluation of quality in e-government services. Electronic Government, Proceedings 2007, 4656:318-329.
108. Maliranta, M., Rouvinen, P. (2004). ICT and Business Productivity: Finnish Micro-Level Evidence. In OECD (Ed.), The Economic Impact of ICT: Measurement, Evidence and Implications. OECD, Paris.
109. Martini A. How counterfactuals got lost on the way to Brussels. Paper presented to the Symposium on "Policy and programme evaluation in Europe: cultures and prospects", Strasbourg, July 3-4, 2008 2008.
110. Mehrens W., Lehmann I. Using standardized tests in education 1987, Longman, New York.
111. Mishel L., Bernstein J. Wage inequality and the new economy in the US: Does IT-led growth generate wage inequality. Canadian Public Policy-Analyse De Politiques 2003, 29:S203-S221.
112. Misuraca G. e-Governance in Africa, from Theory to Action: A handbook on ICTs for local governance July 2007, IDRC/Africa World Press, http://www.idrc.ca/EN/Resources/Publications/Pages/IDRCBookDetails.aspx?PublicationID=101 and http://www.africaworldpressbooks.com/servlet/Detail?no=157.
113. Misuraca G. E-government 2015: Exploring m-government scenarios, between ICT-driven experiments and citizen-centric implications. Technology Analysis and Strategic Management 2009, 21(3):18.
114. Misuraca G., Broster D., Centeno C. Digital Europe 2030: Designing scenarios for ICT in future governance and policy making, in Government Information Quarterly, Special Issue 10/2011 2011, Elsevier Publishing.
115. Misuraca G., Rossel P. Triggering the governance perspective of e-Government projects: Beyond mere digitization of administration services. Background paper for the Third Global Knowledge Conference, Kuala Lumpur, 10-13 December 2007.
116. Misuraca G., Rossel P. Measuring and meta-measuring, in search of new pathways for modelling impacts of ICT-enabled services on the Information Society. Proceedings of the IFIP 8.5 eGOV2011 Conference, Delft, Netherlands, 28 August-2 September 2011.
117. Misuraca G., Rossel P. Reflexivity, modelling and weak signals of transformational tracks to support both micro- and macro-measuring of Information Society services. Proceedings of the 5th International Conference on Theory and Practice of Electronic Governance (ICEGOV2011), Tallinn, Estonia, 26-28 September 2011 - ACM international conference proceedings series 2011, ACM Press, (www.icegov.org).
118. Misuraca, G., P. Rossel et M. Finger (2006). Governance with and of ICTs: The need for new institutional design in a changing world. Egov Magazine, vol. 2, no 5, p. 36-39.
119. Miyagawa T., Kim Y. Measuring Organization Capital in Japan: An Empirical Assessment Using Firm-Level Data. CEP Discussion Paper, No. 817 2007.
120. OECD Rethinking eGovernment Services 2009, OECD, Paris.
121. OECD The economic impact of ICT. Measurement, Evidence and Implications 2010, OECD, Paris
122. OECD OECD Information Technology Outlook 2010, OECD, Paris.
123. OECD OECD guide to measuring the Information Society 2011 2011, OECD, Paris.
124. Oliner S.D., Sichel D.E. The resurgence of growth in the late 1990s: Is information technology the story?. Journal of Economic Perspectives 2000, 14(3):3-22.
125. Oliner S.D., Sichel D.E. Information technology and productivity: Where are we now and where are we going?. Federal Reserve Bank of Atlanta Economic Review 2002, 3(1-13).
126. Osimo D. Benchmarking eGovernment in the Web 2.0 Era: What to measure and how. European Journal of ePractice 2008, 1(4):33-43.
127. Pawson R., Tilley N. Realistic evaluation 1997, Sage Publications Ltd., London.
128. Peters R.M., Janssen M., v.Engers T.M. Measuring e-government impact: Existing practices and shortcomings. Proceedings of the 6th International conference on Electronic commerce 2004, ACM Press, New York.
129. Petricek V., Escher T., Cox I., Margetts H. The web structure of e-government - developing a methodology for quantitative evaluation. proceedings of the 15th international conference on World Wide Web, Edinburgh, Scotland U, May 22 - 26, 2006 2006, ACM Press, New York.
130. Picci L. The quantitative evaluation of the economic impact of e-government: A structural modelling approach. Information Economics and Policy 2006, 18(1):107-123.
131. Potnis D.D. Measuring e-Governance as an innovation in the public sector. Government Information Quarterly 2010, 27(1):41-48.
132. Reddick C.G. Citizen interaction with e-government: From the streets to servers?. Government Information Quarterly 2005, 22(1):38-57.
133. Rossel P. Measurement issues and paradoxes of ICT-enabled societal modelling: eGOV implications. Presented in plenary session at ICEGOV 2010, 4th International conference on theory and practice of electronic governance, Beijing, Oct. 25-28, 2010 2010.
134. PriceWaterHouse&Coopers Champion for Digital Inclusion: The Economic Case for Digital Inclusion 2009, UK Digital Inclusion Task Force, London
135. The impact of Social Computing on the EU Information Society and Economy 2009, European Commission, Joint Research Centre, IPTS, Seville. Y. Punie, W. Lusoli, C. Centeno, G. Misuraca, D. Broster (Eds.).
136. Rorissa A., Demissie D., Pardo T. Benchmarking e-Government: A comparison of frameworks for computing e-Government index and ranking. Government Information Quarterly 2011, 28(3):354-362.
137. Salem S. Benchmarking the e-Government Bulldozer: Beyond Measuring the Tread Marks. Measuring Business Excellence 2008, 11(4):9-22.
138. Schleife K. Computer Use and Employment Status of Older Workers - An Analysis Based on Individual Data. Labour 2006, 20(2):325-348.
139. Solow, R. (1987). We'd better watch out. New York Times, July 12, p. 36.
140. Solow R. The productivity paradox. Issues in Science and Technology 1998, 15(1):9-10.
141. Stiroh K.J. Are ICT spillovers driving the new economy?. Review of Income and Wealth 2002, (1):33-57.
142. Stiroh K.J. Information technology and the US productivity revival: What do the industry data say?. American Economic Review 2002, 92(5):1559-1576.
143. Stratopoulos T., Dehning B. Does successful investment in information technology solve the productivity paradox?. Information and Management 2000, 38(2):103-117.
144. Street A. The contribution of ICT to health care system productivity and efficiency: What do we know? 2007, OECD, Paris.
145. Thatcher M.E., Pingry D.E. Modeling the IT value paradox. Communications of the ACM 2007, 50(8):41-45.
146. Timmer L.P., Van Ark B. Does information and communication technology drive EU-US productivity growth differentials?. Oxford Economic Papers 2005, 57(4):693-716.
147. Triplett J.E. The Solow productivity paradox: What do computers do to productivity?. Canadian Journal of Economics-Revue Canadienne D Economique 1999, 32(2):309-334.
148. United Nations - Department of Economic and Social Affairs (UNDESA) Global e-Government survey 2003: E-government at the Crossroads 2003, New York.
149. United Nations - Department of Economic and Social Affairs (UNDESA) Global e-Government Readiness Report 2004: Towards Access for Opportunity 2004, New York.
150. United Nations - Department of Economic and Social Affairs (UNDESA) Global e-Government Readiness Report 2005: From e-Government to e-Inclusion 2005, New York.
151. UN e-Government survey 2008: From e-Government to connected governance 2008, United Nations - Department of Economic and Social Affairs (UNDESA), United Nations, NY, USA.
152. United Nations - Department of Economic and Social Affairs (UNDESA) Global e-Government survey 2010: Leveraging E-government at a time of financial and economic crisis 2010, New York.
153. United Nations - Department of Economic and Social Affairs (UNDESA) Global e-Government survey 2012: E-Government for the People 2012, New York.
154. van Ark B. Measuring the new economy: An international comparative perspective. Review of Income and Wealth 2002, (1):1-14.
155. van Ark B., O'Mahony M., Timmer M.P. The productivity gap between Europe and the United States: Trends and causes. Journal of Economic Perspectives 2008, 22(1):25-44.
156. van Ark B., Inklaar R., McGuckin R.H. 'Changing gear': Productivity, ICT and service industries in Europe and the United States. Industrial Dynamics of the New Digital Economy 2003, 56-99.
157. Van Dooren W. A politico-administrative agenda for progress in social measurement: Reforming the calculation of Government's contribution to GDP. Journal of Comparative Policy Analysis: Research and Practice 2009, 11(3):309-326.
158. Visser R. Trends in program evaluation literature: The emergence of pragmatism. Texas Center for Adult Literacy, occasional research paper no. 5 2003.
159. Walker J., Pan E., Johnston D., Adler-Milstein J., Bates D.W., Middleton B. The value of health care information exchange and interoperability. [Research Support, Non-U.S. Gov't]. Health Affairs, Suppl Web Exclusives 2005, (W5-10-W15-18).
160. Webster F. Theories of the Information Society 2002, Routledge, London.
161. Whitmore A. A statistical analysis of the construction of the United Nations e-Government development index. Government Information Quarterly 2012, 29(1):68-75.
162. Whitten P.S., Mair F.S., Haycox A., May C.R., Williams T.L., Hellmich S. Systematic review of cost effectiveness studies of telemedicine interventions. British Medical Journal 2002, 324(7351):1434-1437.
163. WITSA Digital planet 2010 2010, World Information Technology and Services Alliance, Taipei.
164. Worthen B., Borg W., White K. Measurement and evaluation in the school 1993, Longman, New York.