Design of a web-based application of the coupled multi-agent system model and environmental model for watershed management analysis using Hadoop

Environmental Modelling and Software

Volumn 70, Issue , 2015, Pages 149-162

  Hu, Yao ^a   Cai, Ximing ^a   DuPont, Benjamin ^b  

^a University of Illinois at Urbana Champaign   (United States)

^b Nebland Software LLC   (United States)

Author keywords

Apache Hadoop; Coupled human and natural system; Multi agent system; Parallel computing; Web application

Indexed keywords

COMPUTATIONAL EFFICIENCY; COMPUTER SOFTWARE; PARALLEL PROCESSING SYSTEMS; SOCIAL NETWORKING (ONLINE); SOIL CONSERVATION; TRANSPORTATION; WATER CONSERVATION; WATER MANAGEMENT; WATERSHEDS; WEB SERVICES; WEBSITES; WORLD WIDE WEB;

APACHE HADOOP; CLOUD COMPUTING ENVIRONMENTS; COMPUTATIONAL INTENSITY; COUPLED HUMAN AND NATURAL SYSTEMS; MULTI AGENT SYSTEM MODELS; MULTITHREADED PROGRAMMING; WEB APPLICATION; WEB-BASED APPLICATIONS;

MULTI AGENT SYSTEMS;

ENVIRONMENTAL MODELING; INTERNET; NUMERICAL MODEL; SOFTWARE; WATERSHED;

EID: 84929336516     PISSN: 13648152     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.envsoft.2015.04.011     Document Type: Article

References (59)

1. Amdahl G. Validity of the single processor approach to achieving large-scale computing capabilities. AFIPS Conference Proceedings 1967, vol. 30:483-485.
2. An L. Modeling human decisions in coupled human and natural systems: review of agent-based models. Ecol. Model. 2012, 229:25-36. 10.1016/j.ecolmodel.2011.07.010.
3. An L., Linderman M., Qi J., Shortridge A., Liu J. Exploring complexity in a human-environment system: an agent-based spatial model for multidisciplinary and multiscale integration. Ann. Assoc. Am. Geogr. 2005, 95(1):54-79. 10.1111/j.1467-8306.2005.00450.x.
4. Apache Hadoop, 2009.. http://hadoop.apache.org.
5. Barrow C.J. River basin development planning and management: a critical review. World Dev. 1998, 26(1):171-186. 10.1016/S0305-750X(97)10017-1.
6. Becu N., Perez P., Walker A., Barreteau O., Le Page C. Agent based simulation of a small catchment water management in northern Thailand description of the CATCHSCAPE model RID F-1968-2010 RID E-6856-2010. Ecol. Model. 2003, 170(2-3):319-331. 10.1016/S0304-3800(03)00236-9.
7. Bennett D.A., Tang W. Modelling adaptive, spatially aware, and mobile agents: Elk migration in yellowstone. Int. J. Geogr. Inf. Sci. 2006, 20(9):1039-1066. 10.1080/13658810600830806.
8. Bonabeau E. Agent-based modeling: methods and techniques for simulating human systems. Proc. Natl. Acad. Sci. U. S. A. 2002, 99:7280-7287. 10.1073/pnas.082080899.
9. Borthakur D. The hadoop distributed file system: architecture and design. Hadoop Proj. Website 2007, 11(2007):21.
10. Castronova A.M., Goodall J.L., Elag M.M. Models as web services using the open geospatial consortium (OGC) web processing service (WPS) standard. Environ. Model. Softw. 2013, 41:72-83. 10.1016/j.envsoft.2012.11.010.
11. Curbera F., Duftler M., Khalaf R., Nagy W., Mukhi N., Weerawarana S. Unraveling the web services web: an introduction to SOAP, WSDL, and UDDI. IEEE Internet Comput. 2002, 6(2):86-93.
12. Da-Jun T., Tang F., Lee T., Sarda D., Krishnan A., Goryachev A. Parallel Computing Platform for the Agent-Based Modeling of Multicellular Biological Systems. Parallel and Distributed Computing: Applications and Technologies 2005, 5-8. Springer.
13. Dean J., Ghemawat S. Mapreduce: simplified data processing on large clusters. Commun. ACM 2008, 51(1):107-113. 10.1145/1327452.1327492.
14. Deissenberg C., van der Hoog S., Dawid H. EURACE: a massively parallel agent-based model of the european economy. Appl. Math. Comput. 2008, 204(2):541-552. 10.1016/j.amc.2008.05.116.
15. Epstein J.M. Agent-based computational models and generative social science. Complexity 1999, 4:41-60.
16. Feuillette S., Bousquet F., Le Goulven P. SINUSE: a multi-agent model to negotiate water demand management on a free access water table. Environ. Model. Softw. 2003, 18(5):413-427. 10.1016/S1364-8152(03)00006-9.
17. Gilbert G.N., Troitzsch K.G. Simulation for the Social Scientist, Milton Keynes 1999, Open University Press, UK.
18. Goetz B., Peierls T., Bloch J., Bowbeer J., Holmes D., Lea D. Java Concurrency in Practice 2006, Addison-Wesley.
19. Gong Z., Tang W., Bennett D.A., Thill J. Parallel agent-based simulation of individual-level spatial interactions within a multicore computing environment. Int. J. Geogr. Inf. Sci. 2013, 27(6):1152-1170. 10.1080/13658816.2012.741240.
20. Goodall J.L., Robinson B.F., Castronova A.M. Modeling water resource systems using a service-oriented computing paradigm. Environ. Model. Softw. 2011, 26(5):573-582. 10.1016/j.envsoft.2010.11.013.
21. Granell C., Diaz L., Gould M. Service-oriented applications for environmental models: reusable geospatial services. Environ. Model. Softw. 2010, 25(2):182-198. 10.1016/j.envsoft.2009.08.005.
22. Hadoop Map/Reduce Tutorial, 2013. https://hadoop.apache.org/docs/r1.2.1/mapred_tutorial.html.
23. Haefner J.W. Parallel computers and individual-based models: an overview. Individual-Based Models and Approaches in Ecology 1992, 126-164. Springer, US.
24. Hargreaves G.H., Samani Z.A. Reference crop evapotranspiration from ambient air temperature. Am. Soc. Agric. Eng. 1985, 1(2):96-99.
25. Hipel K.W., Jamshidi M.M., Tien J.M., White Chelsea C. The future of systems, man, and cybernetics: application domains and research methods. IEEE Trans. Syst. Man Cybern. Part C Appl. Rev. 2007, 37(5):726-743. 10.1109/TSMCC.2007.900671.
26. Huhns M., Singh M. Service-oriented computing: key concepts and principles. IEEE Internet Comput. 2005, 9(1):75-81.
27. Hunt R.J., Luchette J., Schreuder W.A., Rumbaugh J.O., Doherty J., Tonkin M.J., Rumbaugh D.B. Using a cloud to replenish parched groundwater modeling efforts. Ground water 2010, 48(3):360-365.
28. Kahneman D. Thinking, Fast and Slow 2011, Macmillan.
29. Keutzer K., Mattson T. Our Pattern Language (OPL): a design pattern language for engineering (parallel) software. ParaPLoP Workshop on Parallel Programming Patterns 2009, vol. 14.
30. Lansing J.S. Anti-chaos, common property and the emergence of cooperation. Dynamics in Human and Primate Societies: Agent-Based Modelling of Social and Spatial Processes 1999, 207-224. Santa Fe Institute and Oxford University Press. T. Kohler, G. Gumerman (Eds.).
31. Lee P.M. Bayesian Statistics: an Introduction 2004, Arnold Publishing. third ed.
32. Liu J., Dietz T., Carpenter S.R., Alberti M., Folke C., Moran E., Taylor W.W. Complexity of coupled human and natural systems. Science 2007, 317(5844):1513-1516. 10.1126/science.1144004.
33. Liu Y., Sun A.Y., Nelson K., Hipke W.E. Cloud computing for integrated stochastic groundwater uncertainty analysis. Int. J. Digital Earth 2013, 6(4):313-337.
34. Massingill B.L., Mattson T.G., Sanders B.A. Reengineering for Parallelism: an entry point into PLPP for legacy applications. Concurr. Comput. Pract. Exp. 2007, 19(4):503-529.
35. Mattson T.G., Sanders B.A., Massingill B.L. APattern Language for Parallel Programming 2004, Addison Wesley Software Patterns Series.
36. McKusick V. Final report for the special master with certificate of adoption of RRCA groundwater model. State of Kansas v. State Neb. State Colo. Supreme Court U. S. 2003, 3605.
37. Monticino M., Acevedo M., Callicott B., Cogdill T., Lindquist C. Coupled human and natural systems: a multi-agent-based approach. Environ. Model. Softw. 2007, 22(5):656-663. 10.1016/j.envsoft.2005.12.017.
38. Muller P.A. Modélisation objet avec UML 1997, Eyrolles Paris.
39. Mulvey J.M., Vanderbei R.J., Zenios S.A. Robust optimization of large-scale systems. Oper. Res. 1995, 43(2):264-281. 10.1287/opre.43.2.264.
40. Murphy K.P. Conjugate Bayesian Analysis of the Gaussian Distribution 2007, Technical Report, University of British Columbia.
41. Ng Tze Ling, Eheart J.W., Cai X., Braden J.B. An agent-based model of farmer decision-making and water quality impacts at the watershed scale under markets for carbon allowances and a second-generation biofuel crop. Water Resour. Res. 2011, 47:W09519. 10.1029/2011WR010399.
42. Nielsen M. Write Your First MapReduce Program in 20 Minutes 2009, Michael's main blog. http://michaelnielsen.org/blog/write-your-first-mapreduce-program-in-20-minutes/.
43. North M.J., Macal C.M. Managing Business Complexity: Discovering Strategic Solutions with Agent-Based Modeling and Simulation 2007, Oxford University Press.
44. Pahl-Wostl C. Information, public empowerment, and the management of urban watersheds. Environ. Model. Softw. 2005, 20(4):457-467. 10.1016/j.envsoft.2004.02.005.
45. Palazzo A.M. Farm-Level Impacts of Alternative Spatial Water Management Policies for the Protection of Instream Flows 2009, (Master thesis), University of Illinois at Urbana-Champaign.
46. Papajorgji P., Beck H.W., Braga J.L. An architecture for developing service-oriented and component-based environmental models. Ecol. Model. 2004, 179(1):61-76. 10.1016/j.ecolmodel.2004.05.013.
47. Parker J., Epstein J.M. Adistributed platform for global-scale agent-based models of disease transmission. ACM Trans. Model. Comput. Simul. (TOMACS) 2011, 22(1):2.
48. Parker D.C., Manson S.M., Janssen M.A., Hoffmann M.J., Deadman P. Multi-agent systems for the simulation of land-use and land-cover change: a review. Ann. Assoc. Am. Geogr. 2003, 93(2):314-337. 10.1111/1467-8306.9302004.
49. Poo D., Kiong D., Ashok S. Java database connectivity. Object-Oriented Program. Java 2007, 297-314.
50. Reeves H.W., Zellner M.L. Linking MODFLOW with an agent-based land-use model to support decision making. Ground Water 2010, 48(5):649-660. 10.1111/j.1745-6584.2010.00677.x.
51. Reynolds R.G., Kobti Z., Kohler T.A., Yap L.Y.L. Unraveling ancient mysteries: reimagining the past using evolutionary computation in a complex gaming environment. IEEE Trans. Evol. Comput. 2005, 9(6):707-720. 10.1109/TECV.2005.856206.
52. Robinson D.T., Brown D.G. Evaluating the effects of land-use development policies on ex-urban forest cover: an integrated agent-based GIS approach. Int. J. Geogr. Inf. Sci. 2009, 23(9):1211-1232. 10.1080/13658810802344101.
53. Snir M., Otto S., Huss-Lederman S., Walker D., Dongarra J. MPI-The Complete Reference. The MPI Core 1998, vol. 1. The MIT Press. second ed.
54. Tang W., Bennett D.A. Reprint of: parallel agent-based modeling of spatial opinion diffusion accelerated using graphics processing units. Ecol. Model. 2012, 229:108-118.
55. Tang W., Wang S., Bennett D.A., Liu Y. Agent-based modeling within a cyberinfrastructure environment: a service-oriented computing approach. Int. J. Geogr. Inf. Sci. 2011, 25(9):1323-1346.
56. USDA Irrigation Water Requirements 1967, Tech. Release No. 21, United States Dept. of Agr., Soil Conservation Service, Washington, D.C.
57. Wächter A., Biegler L. On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming. Math. Program. 2006, 106(1):25-57. 10.1007/s10107-004-0559-y.
58. Zhang K., Kimball J.S., Mu Q., Jones L.A., Goetz S.J., Running S.W. Satellite based analysis of northern ET trends and associated changes in the regional water balance from 1983 to 2005. J.Hydrol. 2009, 379(1):92-110.
59. Zhang K., Kimball J.S., Nemani R.R., Running S.W. Acontinuous satellite-derived global record of land surface evapotranspiration from 1983 to 2006. Water Resour. Res. 2010, 46(9).