Community Operational Research and Citizen Science: Two icons in need of each other?

European Journal of Operational Research

Volumn 268, Issue 3, 2018, Pages 1111-1124

  Gregory, Amanda J ^a   Atkins, Jonathan P ^a  

^a UNIVERSITY OF HULL   (United Kingdom)

Author keywords

Citizen Science; Community Operational Research; OR in environment and climate change; Problem structuring methods; Systems thinking

Indexed keywords

MATHEMATICAL MODELS; OPERATIONS RESEARCH;

CITIZEN SCIENCE; OPERATIONAL RESEARCH; POLICY MAKERS; PROBLEM STRUCTURING METHODS; SYSTEMS THINKING;

CLIMATE CHANGE;

EID: 85028322319     PISSN: 03772217     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.ejor.2017.07.037     Document Type: Article

References (199)

1. Ackermann, F., Problem structuring methods in the dock: Arguing the case for soft OR. European Journal of Operational Research 219:3 (2012), 653–658, 10.1016/j.ejor.2011.11.014.
2. Ackermann, F., Eden, C., Brown, I., The practice of making strategy: A step-by-step guide. 2005, Sage Publications Ltd, London.
3. Ackoff, R.L., A black ghetto's research on a university. Operational Research 18 (1970), 761–771, 10.1287/opre.18.5.761.
4. Arnstein, S., A ladder of citizen participation. Journal of the American Planning Association 35 (1969), 216–224, 10.1080/01944366908977225.
5. Asimov, I. A cult of ignorance, Newsweek, January 21, p.19, http://aphelis.net/wp-content/uploads/2012/04/ASIMOV_1980_Cult_of_Ignorance.pdf accessed 06/12/16.
6. Atkins, J.P., Burdon, D., Elliott, M., Gregory, A.J., Management of the Marine environment: integrating ecosystem services and societal benefits with the dpsir framework in a systems approach. Marine Pollution Bulletin 62 (2011), 215–226, 10.1016/j.marpolbul.2010.12.012.
7. Atkins, J.P., Gregory, A.J., Burdon, D., Elliott, M., Managing the marine environment: Is the DPSIR framework holistic enough. Systems Research and Behavioral Science 28:5 (2011), 497–508, 10.1002/sres.111.
8. Atkins, J.P. & Gregory, A. (2015). Key barriers of achieving good environmental status (GES) Part 2: development of a systemic modelling approach to understanding and achieving GES, http://www.devotes-project.eu/wp-content/uploads/2015/05/DEVOTES-Deliverable-2_2.pdf accessed 06/12/16.
9. Bäckstrand, K., Civic science for sustainability: Reframing the role of experts, policy-makers and citizens in environmental governance;. Global Environmental Politics 3 (2003), 24–41, 10.1162/152638003322757916.
10. Barros, R., Midgley, G., Pinzón, L., A systemic intervention approach to research on computer-supported collaborative learning for mathematical problem-solving: A Colombian case. Systems Research and Behavioral Science 32 (2015), 86–105.
11. Baraniuk, C. (2016). Google responds on skewed Holocaust search results, BBC, http://www.bbc.co.uk/news/technology-38379453 accessed 20/12/16.
12. Beck, U., Risk society: Towards a new modernity. Ritter, M., (eds.), 1992, Sage Publications, London trans.
13. Beer, S., Brain of the firm. 2nd ed., 1981, Wiley, Chichester.
14. Berger, P., Luckmann, T., The Social Construction of Reality. 1971, Penguin, Harmondsworth.
15. Bonney, R., Citizen science: A lab tradition. Living Bird 15 (1996), 7–15.
16. Bonney, R., Ballard, H., Jordan, R., McCallie, E., Phillips, T., Shirk, J., et al. Public participation in scientific research: Defining the field and assessing its potential for informal science education. A CAISE inquiry group report. 2009, Center for Advancement of Informal Science Education (CAISE), Washington, D.C.
17. Bonney, R., Cooper, C.B., Dickinson, J., Kelling, S., Phillips, T., Rosenberg, K.V., et al. Citizen science: A developing tool for expanding science knowledge and scientific literacy. BioScience 59 (2009), 977–984, 10.1525/bio.2009.59.11.9.
18. Bowen, K., In at the deep end: MSc Student Projects in Community Operational Research. 1995, Community Operational Research Unit Publications.
19. Boyd, A., Brown, M., Midgley, G., Systemic intervention for community OR: Developing services for young people (under 16) living on the streets. Midgley, G., Ochoa Arias, A.E., (eds.) Community operational research: OR and systems thinking for community development, 2004, Kluwer Academic/Plenum Publishers, New York, 203–252.
20. Boyd, A., Geerling, T., Gregory, W.J., Midgley, G., Murray, P., Walsh, M., Systemic evaluation: A participative, multi-method approach. Journal of the Operational Research Society 58 (2007), 1306–1320, 10.1057/palgrave.jors.2602281.
21. Bradshaw, B., Questioning the credibility and capacity of community-based resource management. The Canadian Geographer 47 (2003), 137–150, 10.1111/1541-0064.t01-1-00001.
22. Bryson, J.M., Ackermann, F., Eden, C., Finn, C.B., Visible Thinking, Unlocking causal mapping for practical business results. 2004, John Wiley and Sons Ltd, Chichester.
23. Carpini, M.X.D., Cook, F.L., Jacobs, L.R., Public deliberation, discursive participation, and citizen engagement: A review of the empirical literature. Annual Review of Political Science 7 (2004), 315–344, 10.1146/annurev.polisci.7.121003.091630.
24. Carr, A.J.L., Why do we all need community science. Society & Natural Resources: An International Journal 17 (2004), 841–849, 10.1080/08941920490493846.
25. Cash, D.W., Clark, W.C., Alcock, F., Dickson, N.M., Eckley, N., Jäger, J., Salience, credibility, legitimacy and boundaries: Linking research, assessment and decision making. Faculty Research Working Paper Series, 2002, John F. Kennedy School of Government, Harvard University.
26. Cash, D.W., Clark, W.C., Alcock, F., Dickson, N.M., Eckley, N., Guston, D.H., et al. Knowledge systems for sustainable development. Proceedings of the National Academy of Science 100 (2003), 8086–8091, 10.1073/pnas.1231332100.
27. Caulkins, J.P., The role of operations research in public policy. Operations Research Proceedings 2002 (2002), 1–13.
28. Caulkins, J.P., Eelman, E., Ratnatunga, M., Schaarsmith, D., Operations Research and public policy for Africa: Harnessing the revolution in management science instruction. International Transactions in Operational Research 15 (2008), 151–171, 10.1007/978-3-642-55537-4_1.
29. Chambers, R., Whose reality counts? Putting the first last. 1997, Intermediate Technology Publications, London.
30. Checkland, P.B., Systems thinking, systems practice. 1981, Wiley, Chichester.
31. Checkland, P., Poulter, J., Learning for action: A short definitive account of soft systems methodology and its use, for practitioners, teachers and students. 2006, John Wiley and Sons, Chichester.
32. Churchman, C.W., The systems approach. 1968, Delta Books, New York Reprinted 1979.
33. Churchman, C.W., Operations research as a profession. Management Science 17 (1970), B37–B53.
34. Churchman, C.W., The design of inquiring systems. 1971, Basic Books, New York.
35. Conrad, C.C., Hilchey, K.G., A review of citizen science and community-based environmental monitoring: Issues and opportunities. Environmental Monitoring and Assessment 176 (2011), 273–291, 10.1007/s10661-010-1582-5.
36. Cook, S.L., Operational research, social well-being and the zero growth concept. Omega 1 (1973), 647–667, 10.1016/0305-0483(73)90084-4.
37. Cook, S., The writings of steve cook alternative futures, managerial functions, education in O.R. and systems science. Bowen, K., Cook, A., Luck, M., (eds.), 1984, Operational Research Society, UK.
38. Córdoba, J.R., Midgley, G., Beyond organisational agendas: Using boundary critique to facilitate the inclusion of societal concerns in information systems planning. European Journal of Information Systems 17 (2008), 125–142, 10.1057/ejis.2008.4.
39. Cornwall, A., Jewkes, R., What is participatory research. Social Science and Medicine 41 (1995), 1667–1676, 10.1016/0277-9536(95)00127-S.
40. Dewey, J., The school and society the child and the curriculum. 1990, University of Chicago, Chicago.
41. Eden, C., Modelling cognition in complex decision problems. Journal of Interdisciplinarity Modelling and Simulation 3 (1980), 19–44, 10.1016/0377-2217(88)90002-1.
42. Eden, C., Cognitive mapping: A review. European Journal of Operational Research 36 (1988), 1–13.
43. Eden, C., On the nature of cognitive maps. Journal of Management Studies 29 (1992), 261–265, 10.1111/j.1467-6486.1992.tb00664.x.
44. Eden, C., Ackermann, F., Making strategy: The journey of strategic management. 1998, Sage, London.
45. Eden, C., Ackermann, F., SODA - the principles. Rosenhead, J., Mingers, J., (eds.) Rational analysis for a problematic world revisited, 2001, Wiley, Chichester, 21–42.
46. Elden, M., Levin, M., Cogenerative learning. Whyte, W.F., (eds.) Participative action research, 1991, Sage, Newbury Park.
47. Ely, E., Volunteer monitoring and the democratization of science. The Volunteer Monitor 19 (2008), 1–5.
48. ETHZurich (2016). Citizen Science: New Ways for Research, Policy advice paper, https://www.ethz.ch/…/citizenscience…/citizen_science_policy_advice_paper.docx accessed 23/06/16.
49. European Commission. Directive 2008/56/EC of the European Parliament and of the Council establishing a framework for community action in the field of marine environmental policy (Marine Strategy Framework Directive),. Official Journal of the European Union L164 (2008), 19–40.
50. ExCiteS (2016). What is ‘extreme’ citizen science?, https://www.ucl.ac.uk/excites/home-columns/full-what-is-extreme-citizen-science/ accessed 23/06/16.
51. Fals-Borda, O., Rahman, M.A., Action and knowledge: Breaking the monopoly with participatory action research. 1991, Apex Press, New York.
52. Feeney, M.K., Welch, E.W., Academic outcomes among principal investigators, co-principal investigators, and non-PI researchers. Journal of Technology Transfer 39 (2014), 111–133, 10.1007/s10961-012-9272-9.
53. Fernandez-Gimenez, M.E., Ballard, H.L., Sturtevant, V.E., Adaptive management and social learning in collaborative and community-based monitoring: A study of five community-based forestry organizations in the western USA. Ecology and Society 13 (2008), 4–26 http://www.jstor.org/stable/26267955.
54. Flood, R.L., Jackson, M.C., Creative problem solving: Total systems intervention. 1991, Wiley, Chichester.
55. Foote, J., Baker, V., Gregor, J., Hepi, M., Houston, D., Midgley, G., Systems thinking for community involvement in water conservation. Journal of the Operational Research Society 58 (2007), 645–654, 10.1057/palgrave.jors.2602248.
56. Franco, L.A., Rethinking soft OR interventions: Models as boundary objects. European Journal of Operational Research 231 (2013), 720–733, 10.1016/j.ejor.2013.06.033.
57. Freeman, R.E., Strategic management: A stakeholder approach. 1984, Pitman, Boston.
58. Freeman, R.E., The politics of stakeholder theory: Some future directions. Business Ethics Quarterly 4 (1994), 409–421, 10.2307/3857340.
59. Freeman, R.E., Divergent Stakeholder Theory. Academy of Management Review 24 (1999), 233–236, 10.2307/259078.
60. Freire, P., Pedagogy of the oppressed. Bergman Ramos, M., (eds.), 1970, reprinted in 1996 by Penguin Books, London trans.
61. Frickel, S., Gibbon, S., Howard, J., Kempner, J., Ottinger, G., Hess, D.J., Undone science: Charting social movement and civil society challenges to research agenda setting. Science, Technology and Human Values 35 (2010), 444–473, 10.1177/0162243909345836.
62. Friend, J., The strategic choice approach. Rosenhead, J., Mingers, J., (eds.) Rational analysis for a problematic world revisited. Problem structuring methods for complexity, uncertainty and conflict, 2001, Wiley, Chichester, 115–149.
63. Friend, J., Hickling, A., Planning under pressure: The strategic choice approach. 1987, Pergamon Press, Oxford.
64. Funtowicz, S., Ravetz, J., Uncertainty and quality in science for policy. 1990, Kluwer Academic Publishers, Dordrecht.
65. Funtowicz, S.O., Ravetz, J.R., Science for the post-normal age. Futures 25 (1993), 739–755, 10.1016/0016-3287(93)90022-L.
66. Futures (2017). Post-normal science in practice, Futures https://doi.org/10.1016/j.futures.2017.05.009 accessed 16/06/17.
67. Gauchat, G., The political context of science in the united states: Public acceptance of evidence-based policy and science funding. Social Forces 94:2 (2015), 723–746, 10.1093/sf/sov040.
68. Gauchat, G., The politics of science funding: We need to think about science and knowledge production in a more practical light’ interviewed by A.L. Kalleberg. 2016, LSE Blog http://blogs.lse.ac.uk/impactofsocialsciences/2016/01/13/the-politics-of-science-funding/ accessed 05/12/16.
69. Geurts, J.L.A., Joldersma, C., Methodology for participatory policy analysis. European Journal of Operational Research 128:2 (2001), 300–310, 10.1016/S0377-2217(00)00073-4.
70. Gluckman, P., Policy: The art of science advice to government. Nature 507 (2014), 163–165 12 March http://www.nature.com/news/policy-the-art-of-science-advice-to-government-1.14838 accessed 23/06/16.
71. Gouviea, C., Fonseca, A., Camara, A., Ferrira, F., Promoting the use of environmental data collected by concerned citizens through information and communication technologies. Journal of Environmental Management 71 (2004), 135–154, 10.1016/j.jenvman.2004.01.009.
72. Gramsci, A., Selections from the prison notebooks. Hoare, Q., Nowell Smith, G., (eds.), 1971, Lawrence and Wishart, London trans.
73. Gregory, A.J., Jackson, M.C., Evaluation methodologies: A system for use. Journal of the Operational Research Society 43 (1992), 19–28, 10.1057/jors.1992.3.
74. Gregory, A.J., Jackson, M.C., Evaluating organisations: A systems and contingency approach. Systems Practice 5 (1992), 37–60, 10.1007/BF01060046.
75. Gregory, A.J., Atkins, J.P., Burdon, D., Elliott, M., A problem structuring method for ecosystem-based management: The DPSIR modelling process. European Journal of Operational Research 227 (2013), 409–584, 10.1016/j.ejor.2012.11.020.
76. Gregory, A.J., Ronan, M., Insights on developing strategy from a complexity perspective. Journal of the Operational Research Society 66 (2015), 627–636, 10.1057/jors.2014.27.
77. Gregory, W.J., Romm, R.A., Critical facilitation: Learning through intervention in group processes. Management Learning 32 (2001), 453–467, 10.1177/1350507601324003.
78. Gregory, W.J., Romm, R.A., Facilitation as fair intervention. Midgley, G., Ochoa Arias, A.E., (eds.) Community operational research: OR and systems thinking for community development, 2004, Kluwer Academic/Plenum Publishers, New York, 157–174.
79. Grinnell, F., Rethink our approach to assessing risk. Nature, 522, 2015, 257 http://www.nature.com/news/policy-the-art-of-science-advice-to-government-1.14838 accessed 23/06/16.
80. Guardian (2007). The appliance of science, 14 March, https://www.theguardian.com/society/2007/mar/14/scienceofclimatechange.climatechange accessed 23/06/16.
81. Habermas, J. Knowledge and human interests, Shapiro J.J. (trans.), (1972). Heinemann, London.
82. Habermas, J., Theory and practice. Viertel, J., (eds.), 1974 trans.
83. Habermas, J., Theory of communicative action. McCarthy, T.A., (eds.) Reason and the rationalization of society, 1, 1984, Beacon Press, Boston trans.
84. Habermas, J., Theory of communicative action. McCarthy, T.A., (eds.) Liveworld and system: A critique of functionalist reason, Two, 1987, Beacon Press, Boston trans.
85. Heink, U., Marquard, E., Heubach, K., Jax, K., Kugel, C., Neßhöver, C., et al. Conceptualizing credibility, relevance and legitimacy for evaluating the effectiveness of science–policy interfaces: Challenges and opportunities. Science and Public Policy, 2015, 1–14, 10.1093/scipol/scu082.
86. Hindle, G., Vidgen, R, Developing a business analytics methodology: A case study in the foodbank sector. European Journal of Operational Research, 2018 http://dx.doi.org/10.1016/j.ejor.2017.06.031.
87. HM Treasury (2016). Autumn statement, https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/571559/autumn_statement_2016_web.pdf accessed 05/12/16.
88. INFORMS (2017). Pro bono analytics® https://www.informs.org/Pro-Bono-Analytics accessed 16/06/17.
89. Irwin, A., Citizen science: A study of people, expertise and sustainable development. 1995, Routledge, London.
90. ISSNET (2017) ISSNET – Improving science shop networking, http://www.livingknowledge.org/projects/overview/eu-funded-projects/issnet/ accessed 16/06/17.
91. Jackson, M.C., Community operational research: Purposes, theory and practice. Dragon 2 (1987), 47–73.
92. Jackson, M.C., New directions in management science. Jackson, M.C., Keys, P., (eds.) New directions in management science, 1987, Gower, Aldershot, 133–164.
93. Jackson, M.C., Systems approaches to management. 2000, Kluwer/Plenum, London.
94. Jackson, M.C., Community operational research: Purposes, theory and practice. Midgley, G., Ochoa Arias, A.E., (eds.) Community operational research: OR and systems thinking for community development, 2004, Kluwer Academic/Plenum Publishers, New York, 57–74.
95. Jackson, M.C., Beyond problem structuring methods: Reinventing the future of OR/MS. Journal of the Operational Research Society 57 (2006), 868–878, 10.1057/palgrave.jors.2602093.
96. Jackson, M.C., Keys, P., Towards a system of systems methodologies. Journal of the Operational Research Society 35 (1984), 473–486, 10.1057/jors.1984.101.
97. Jasanoff, S., The idiom of co-production. Jasanoff, S., (eds.) States of knowledge: The co-production of science and the social order, 2004, Routledge, London.
98. Johnson, M.P., Community-based operations research: Introduction, theory, and applications. Johnson, M.P., (eds.) Community-based operations research: Decision modeling for local impact and diverse populations, 2012, Springer-Verlag, New York, 3–36.
99. Johnson, M.P., Smilowitz, K., What is community-based OR?. Johnson, M.P., (eds.) Community-based operations research: Decision modeling for local impact and diverse populations, 2012, Springer-Verlag, New York, 37–65.
100. Jones, S., Eden, C., OR in the community. Journal of the Operational Research Society 32 (1981), 335–345, 10.1057/jors.1981.71.
101. Kingdon, J., Agendas, alternatives and public policies. 1984, Little Brown and Co, Boston.
102. Kirby, M.W., ‘A festering sore’: The issue of professionalism in the history of the operational research society. Journal of the Operational Research Society 57 (2006), 1161–1172, 10.1057/palgrave.jors.2602078.
103. Klein, J.H., Connell, N.A.D., Meyer, E., Operational research practice as storytelling. Journal of the Operational Research Society 58 (2007), 1535–1542, 10.1057/palgrave.jors.2602277.
104. Kuhn, T., The Structure of Scientific Revolutions. 1962, University of Chicago Press, Chicago.
105. Lawrence, A., No personal motive? Volunteers, bio-diversity, and the false dichotomies of participation. Ethics, Place and Environment 9 (2006), 279–298, 10.1080/13668790600893319.
106. Levin, M., Action research and critical systems thinking: Two icons carved out of the same log?. Systems Practice 7 (1994), 25–41, 10.1007/BF02169163.
107. Luck, M., Working with inner city community organizations. Bowen, K., Cook, A., M., Luck, (eds.) The Writings of Steve Cook, 1984, Operational Research Society, Birmingham.
108. Maani, K.E., Cavana, R.Y., Systems thinking and modelling: Understanding change and complexity. 2007, Prentice Hall, New Zealand.
109. Marine Management Organisation (2014) Developing the East Inshore and East Offshore marine plan areas, https://www.gov.uk/east-inshore-and-east-offshore-marine-plan-areas accessed 16/06/17.
110. Mason, R.O., Mitroff, I.I., Challenging strategic planning assumptions. 1981, John Wiley and Sons, Chichester.
111. Midgley, G., What is this Thing called Critical Systems Thinking?. Flood, R.L., Romm, N.R.A., (eds.) Critical systems thinking: Current research and practice, 1996, Plenum, New York, 11–24.
112. Midgley, G., Systemic intervention: Philosophy, methodology, and practice. 2000, Kluwer Academic/Plenum Publishers, London.
113. Midgley, G., Systems thinking, complexity and the philosophy of science. Emergence: Complexity and Organization 10 (2008), 55–73.
114. Midgley, G., Ahuriri-Driscoll, A., Baker, V., Foote, J., Hepi, M., Taimona, H., et al. Practitioner identity in systemic intervention: Reflections on the promotion of environmental health through Maori community development. Systems Research and Behavioural Science 24 (2007), 233–247, 10.1002/sres.827.
115. Midgley, G., Cavana, R.Y., Brocklesby, J., Foote, J.L., Wood, D.R.R., Ahuriri-Driscoll, A., Towards a new framework for evaluating systemic problem structuring methods. European Journal of Operational Research 229 (2013), 143–154, 10.1016/j.ejor.2013.01.047.
116. Midgley, G., Johnson, M.P., Chichirau, G., What is community operational research. European Journal of Operational Research, 2018, 10.1016/j.ejor.2017.08.014.
117. Midgley, G., Munlo, I., Brown, M., The theory and practice of boundary critique: Developing housing services for older people. Journal of the Operational Research Society 49 (1998), 467–478, 10.1057/palgrave.jors.2600531.
118. Midgley, G., Ochoa Arias, A.E., Visions of Community for Community OR. Omega 27 (1999), 259–274, 10.1016/S0305-0483(98)00044-9.
119. Midgley, G., Ochoa Arias, A.E., An introduction to community operational research. Midgley, G., Ochoa Arias, A.E., (eds.) Community operational research: OR and systems thinking for community development, 2004, Kluwer Academic/Plenum Publishers, New York.
120. Midgley, G., Ochoa Arias, A.E., Visions of community for community OR. Midgley, G., Ochoa Arias, A.E., (eds.) Community operational research: OR and systems thinking for community development, 2004, Kluwer Academic/Plenum Publishers, New York.
121. Midgley, G., Pinzón, L., Systemic mediation: Moral reasoning and boundaries of concern. Systems Research and Behavioral Science 30 (2013), 607–632, 10.1002/sres.2228.
122. Midgley, G., Reynolds, M., Operational research and environmental management: A new agenda. 2001, Operational Research Society, Birmingham.
123. Midgley, G.R., Reynolds, M., Systems/operational research and sustainable development: Towards a new agenda. Sustainable Development 12 (2004), 56–64, 10.1002/sd.218.
124. Miller, A.N., Taylor, S.G., Bedeian, A.G., Publish or perish: Academic life as management faculty live it. Career Development International 16:5 (2011), 422–445, 10.1108/13620431111167751.
125. Mims, F.M.I.I.I., Amateur science-strong tradition bright future. Science 284:5411 (1999), 55–56 http://science.sciencemag.org/content/284/5411/55.full accessed 23/06/16.
126. Mingers, J., Rosenhead, J., Problem structuring methods in action. European Journal of Operational Research 152 (2004), 530–554, 10.1016/S0377-2217(03)00056-0.
127. Mingers, J., Gill, A., Multimethodology: Theory and Practice of Combining Management Science Methodologies. 1997, Wiley, Chichester.
128. Mitchell, R.K., Agle, B.R., Wood, D.J., Toward a theory of stakeholder identification and salience: Defining the principle of who and what really counts. Academy of Management Review 22 (1997), 853–886, 10.5465/AMR.1997.9711022105.
129. Munck, R., Community-Based Research: Genealogy and Prospects. Munck, R., McIlrath, L., Hall, B., Tandon, R., (eds.) Higher education and community-based research: Creating a global vision, 2014, Palgrave Macmillan, New York.
130. Nauroth, P., Gollwitzer, M., Kozuchowski, H., Bender, J., Rothmund, T., The effects of social identity threat and social identity affirmation on laypersons’ perception of scientists. Public Understanding of Science, 2016, 1–17.
131. Nature (2016). Editorial: Future present, Nature 531:7–8, http://www.nature.com/news/future-present-1.19474 accessed 23/06/16.
132. NUSAP (2017). Robust knowledge for sustainability, NUSAP http://www.nusap.net/ accessed 16/06/2017.
133. OECD. Technology on trial: Public participation in decision making related to science and technology. 1979, OECD, Paris.
134. Official Journal of the European Union (2008). L 164/19, Chapter I, Article 1.1, 25 June.
135. OR Society (2017). Pro bono O.R. in the third sector, http://www.theorsociety.com/Pages/Probono/Probono.aspx accessed 26/06/17.
136. Ormerod, R.J., Beyond internal OR groups. Journal of the Operational Research Society 49 (1998), 420–429, 10.1057/palgrave.jors.2600550.
137. Ossorio, P., The role of patents in limiting scientific research, 2015 http://www.nytimes.com/roomfordebate/2015/05/28/scientists-curbing-the-ethical-use-of-science/the-role-of-patents-in-limiting-scientific-research accessed 23/06/16.
138. Parry, R., Mingers, J., Community operational research: Its context and its future. Omega 19 (1991), 577–586, 10.1016/0305-0483(91)90008-H.
139. Pellizzoni, L., Uncertainty and participatory democracy. Environmental Values 12 (2003), 195–224, 10.3197/096327103129341298.
140. Piketty, T. (2010). On the long-run evolution of inheritance: France 1820-2050, PSE Working Papers n2010-12. PSE. .
141. Piketty, T., Capital in the twenty-first century [eBook]. Goldhammer, A., (eds.), 2013, The Belknap Press of Harvard University Press, Cambridge Massachusetts trans.
142. Popper, K.R., The logic of scientific discovery. 1959, Abingdon 2002.
143. Popper, K.R., Objective knowledge: An evolutionary approach. 1972, Clarendon Press, Oxford.
144. Renn, O., Risk governance. 2008, Earthscan, London.
145. Riesch, H., Potter, C., Citizen science as seen by scientists: Methodological, epistemological and ethical dimensions. Public Understanding of Science 23 (2014), 107–120, 10.1177/0963662513497324.
146. Ritchie, C., Taket, A., Bryant, J., Community works: 26 Case studies showing community operational research in action. 1994, PAVIC Publications, Sheffield.
147. Rosenhead, J., Custom and practice. Journal of the Operational Research Society 37 (1986), 335–343, 10.1057/jors.1986.61.
148. Rosenhead, J., From management science to workers’ science. Jackson, M.C., Keys, P., (eds.) New directions in management science, 1987, Gower, Aldershot.
149. Rosenhead, J., Past, present and future of problem structuring methods. Journal of the Operational Research Society 57 (2006), 759–765, 10.1057/palgrave.jors.2602206.
150. Rosenhead, J., Reflections on fifty years of operational research. Journal of the Operational Research Society 60 (2009), S5–S15, 10.1057/jors.2009.13.
151. Rosenhead, J., Book Review of Johnson. Michael, P., (eds.) Community-based operations research: Decision modeling for local impact and diverse populations, 43, 2013, 609–610.
152. Rosenhead, J., Mingers, J., Rational analysis for a problematic world revisited. 2001, Wiley, Chichester.
153. Rosenhead, J., Thunhurst, C., A materialist analysis of operational research. Journal of the Operational Research Society 33 (1982), 111–122, 10.1057/jors.1982.23.
154. Rosenhead, J., White, L., Nuclear fusion: Some linked case studies in community operational research. Journal of the Operational Research Society 47 (1996), 479–489, 10.1057/jors.1996.55.
155. Rouwette, E.A.J.A., Facilitated modelling in strategy development: Measuring the impact on communication, consensus and commitment. Journal of the Operational Research Society 62 (2011), 879–887, 10.1057/jors.2010.78.
156. Royal Society, The Public Understanding of Science. 1985, Report of a Royal Society ad hoc Group endorsed by the Council of the Royal Society, London.
157. Schecter, D., Critical systems thinking in the 1980s: A connective summary. Flood, R.L., Jackson, M.C., (eds.) Critical systems thinking: Directed readings, 1991, John Wiley & Sons, Chichester, 213–226.
158. Science, Technology and Human Values (2011). Special issue on post-normal science, S cience, Technology and Human Values 36, 3.
159. Shaw, D., Ackermann, F., Eden, C., Approaches to sharing knowledge in group problem structuring. Journal of the Operational Research Society 54 (2003), 936–948, 10.1057/palgrave.jors.2601581.
160. Shaw, D., Edwards, J.S., Collier, P.M., Quid pro quo: Reflections on the value of problem structuring group workshops. Journal of the Operational Research Society 57 (2006), 939–949, 10.1057/palgrave.jors.2602049.
161. Silvertown, J., A new dawn for citizen science. Trends in Ecology and Evolution 24 (2009), 467–471, 10.1016/j.tree.2009.03.017.
162. Sims, D., Smithin, T., Voluntary OR. Journal of the Operational Research Society 33 (1982), 21–28, 10.1057/jors.1982.3.
163. Skjervheim, H., Objektivismen og Studiet av Mennesket (Objectivism and the study of the human being). 1974, Gyldendal, Oslo.
164. Smith, L.T., Decolonising methodologies. 1999, Zed Books, Ltd, London.
165. SOCIENTIZE (2014). White paper on citizen science for Europe, http://www.socientize.eu/sites/default/files/white-paper_0.pdf accessed 06/12/16.
166. Sullivan, D. (2016). Google's results are no longer in denial over “Did the Holocaust happen?” http://searchengineland.com/googles-results-no-longer-in-denial-over-holocaust-265832 accessed 20/12/16.
167. Suomela, T.E., Citizen science: Framing the public, information exchange, and communication in crowdsourced science. 2014, University of Tennessee, Knoxville Doctoral Dissertation http://trace.tennessee.edu/cgi/viewcontent.cgi?article=4166&context=utk_graddiss accessed 15/06/16.
168. Sulston, J., Ferry, G., The common thread: A Story of science, ethics and the human genome. 2002, Bantam, London.
169. Stilgoe, J., Citizen scientists: Reconnecting science with civil society. 2009, Demos, London http://www.demos.co.uk/files/Citizen_Scientists_-_web.pdf accessed 23/06/16.
170. Stone, D., Maxwell, S. and Keating, M. (2001). Bridging Research and Policy: An International Workshop Funded by the UK Department for International Development Radcliffe House, Warwick University, 16-17 July www2.warwick.ac.uk/fac/soc/pais/research/researchcentres/…/research/…/bridging.pdf accessed 05/12/16.
171. Taket, A., White, L., Wanted: Dead OR alive – ways of using problem-structuring methods in community OR. International Transaction Operational Research 4 (1997), 99–108, 10.1111/j.1475-3995.1997.tb00067.x.
172. Taket, A., White, L., Partnership and participation. 2000, John Wiley and Sons, Chichester.
173. The Economist (2016). The post-truth world: Yes, I'd lie to you, http://www.economist.com/news/briefing/21706498-dishonesty-politics-nothing-new-manner-which-some-politicians-now-lie-and accessed 05/12/16.
174. Living Knowledge (2017) Living knowledge: The international science shop network, http://www.livingknowledge.org/ accessed 16/06/17.
175. Thunhurst, C., Operational research: A role in strengthening community participation?. Journal of Management in Medicine 6 (1992), 56–71, 10.1108/02689239210021979.
176. Toerpe, K., The rise of citizen science, 2013, 25–30 July-August.
177. TRAMS (2017). Final Report Summary - TRAMS (Training and mentoring of science shops), http://cordis.europa.eu/result/rcn/46612_en.html accessed 16/06/17.
178. Turnpenny, J., Lorenzoni, I., Jones, M., Noisy and definitely not normal: Responding to wicked issues in the environment, energy and health. Environmental Science & Policy 12 (2009), 347–358, 10.1016/j.envsci.2009.01.004.
179. Ulrich, W., Critical heuristics of social planning. 1983, John Wiley and Sons, Chichester.
180. Ulrich, W., Systems thinking, systems practice and practical philosophy: A program of research. Systems Practice 1 (1988), 137–163, 10.1007/BF01059855.
181. Ulrich, W., Churchman's “process of unfolding” - its significance for policy analysis and evaluation. Systems Practice 1 (1988), 415–428, 10.1007/BF01066583.
182. Ulrich, W., Some difficulties of ecological thinking, considered from a critical systems perspective: A plea for critical holism. Systems Practice 6 (1993), 583–611, 10.1007/BF01059480.
183. Ulrich, W., Critical systems thinking for citizens: A research proposal. 1996, Centre for Systems Studies, Hull.
184. Ulrich, W., A primer to critical system heuristics for action researchers. 1996, Centre for Systems Studies, Hull.
185. Velez-Castiblanco, J., Brocklesby, J., Midgley, G., Boundary games: How teams of OR practitioners explore the boundaries of intervention. European Journal of Operational Research 249 (2016), 968–982, 10.1016/j.ejor.2015.08.006.
186. Videira, N., Antunes, P., Santos, R., Lopes, R., A participatory modelling approach to support integrated assessment processes. Systems Research and Behavioral Science 27 (2010), 446–460, 10.1002/sres.1041.
187. Videira, N., Lopes, R., Antunes, P., Santos, R., Casanova, J.L., Mapping maritime sustainability issues with stakeholder groups. Systems Research and Behavioral Science 29 (2012), 569–619, 10.1002/sres.2141.
188. Wesselink, A., Hoppe, R., If post-normal science is the solution, what is the problem? The politics of activist environmental science. Science, Technology and Human Values 36 (2011), 389–412, 10.1177/0162243910385786.
189. White, L., Evaluating problem–structuring methods: Developing an approach to show the value and effectiveness of PSMs. Journal of the Operational Research Society 57 (2006), 842–855, 10.1057/palgrave.jors.2602149.
190. White, L., Burger, K., Yearworth, M., Understanding behaviour in problem structuring methods interventions with activity theory. European Journal of Operational Research 249 (2016), 983–1004, 10.1016/j.ejor.2015.07.044.
191. Whitelaw, G., Vaughan, H., Craig, B., Atkinson, D., Establishing the Canadian community monitoring network. Environmental Monitoring and Assessment 88 (2003), 409–418, 10.1023/A:1025545813057.
192. Wilderman, C.C., Barron, A., and Imgrund, L. (2004). Top down or bottom up? ALLARM's experience with two operational models for community science, https://acwi.gov/monitoring/conference/2004/proceedings_contents/13_titlepages/posters/poster_235.pdf accessed 23/06/16.
193. Wilsdon, J., Wynne, B., Stilgoe, J., The public value of science or how to ensure that science really matters. 2005, Demos, London, UK http://www.demos.co.uk/files/publicvalueofscience.pdf accessed 23/06/16.
194. Wolpert, L., The unnatural nature of science. 1992, Harvard University Press, Cambridge, Mass.
195. Wong, N., Mingers, J., The nature of community OR. Journal of the Operational Research Society 45 (1994), 245–254, 10.1057/jors.1994.37.
196. Yearworth, M., White, L.A., The non-codified use of problem structuring methods and the need for a generic constitutive definition. European Journal of Operational Research 237 (2014), 932–945, 10.1016/j.ejor.2014.02.015.
197. Ziman, J., Reliable knowledge: An exploration of the grounds for belief in science. 1978, Canto, Cambridge University Press, Cambridge Canto edition, 1991.
198. Ziman, J., Public Understanding of science. Science, Technology, & Human Values 16 (1991), 99–105, 10.1177/016224399101600106.
199. Ziman, J., Science in civil society. 2007, Imprint Academic, Exeter.