A novel approach for distributed application scheduling based on prediction of communication events

Future Generation Computer Systems

Volumn 26, Issue 5, 2010, Pages 740-752

  Dodonov, Evgueni ^a   de Mello, Rodrigo Fernandes ^a  

^a UNIVERSITY OF SÃO PAULO   (Brazil)

Author keywords

Chaotic systems; Distributed applications; Knowledge acquisition; Neural nets; Scheduling

Indexed keywords

APPLICATION EXECUTION; AUTOMATIC DETECTION; BEHAVIOR PREDICTION; CHAOTIC PROPERTIES; CLUSTER AND GRID COMPUTING; COMMUNICATION COST; COMPUTATIONAL COSTS; DISTRIBUTED APPLICATIONS; DISTRIBUTED COMPUTING; DISTRIBUTED ENVIRONMENTS; EFFICIENT SCHEDULING; HETEROGENEOUS ENVIRONMENTS; NETWORK LATENCIES; NEURAL NET; NEURAL NETS; ONLINE PREDICTION; PROCESS ALLOCATION; PROCESS BEHAVIOR; PROCESS SCHEDULING; SCHEDULING POLICIES; SCHEDULING STRATEGIES;

CHAOTIC SYSTEMS; CLUSTER COMPUTING; FORECASTING; GRID COMPUTING; KNOWLEDGE ACQUISITION; METAL RECOVERY; NEURAL NETWORKS; SUPERCOMPUTERS;

SCHEDULING;

EID: 77950022236     PISSN: 0167739X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.future.2009.05.004     Document Type: Article

References (93)

1. Spinellis D. A tale of four kernels. In: Schäfer W., Dwyer M.B., and Gruhn V. (Eds). ICSE '08: Proceedings of the 30th International Conference on Software Engineering (2008), Association for Computing Machinery, New York 381-390
2. Roberson J. Ule: A modern scheduler for freebsd. BSDC'03: Proceedings of the BSD Conference 2003 on BSD Conference (2003), USENIX Association, Berkeley, CA, USA 17-28
3. Shivaratri N.G., Krueger P., and Singhal M. Load distributing for locally distributed systems. Computer 25 12 (1992) 33-44
4. S. Zhou, D. Ferrari, An experimental study of load balancing performance, Tech. Rep., University of California at Berkeley, Berkeley, CA, USA, 1987
5. Tannenbaum T., Wright D., Miller K., and Livny M. Condor - A distributed job scheduler. In: Sterling T. (Ed). Beowulf Cluster Computing with Linux (2001), MIT Press
6. B. Barrett, J. Squyres, A. Lumsdaine, Integration of the LAM/MPI environment and the PBS scheduling system, in: Proceedings, 17th Annual International Symposium on High Performance Computing Systems and Applications, Quebec, Canada, 2003
7. A. Sudarsanam, M. Srinivasan, S. Panchanathan, Resource estimation and task scheduling for multithreaded reconfigurable architectures, in: ICPADS 00, 2004, p. 323
8. P. Krueger, D. Babbar, Stealth: A liberal approach to distributed scheduling for networks of workstations, 1993
9. Barak A., and La'adan O. The MOSIX multicomputer operating system for high performance cluster computing. Future Generation Computer Systems 13 4-5 (1998) 361-372
10. Foster I., and Kesselman C. Globus: A metacomputing infrastructure toolkit. The International Journal of Supercomputer Applications and High Performance Computing 11 2 (1997) 115-128
11. de Mello R.F., Senger L.J., and Yang L.T. Performance evaluation of route: A load balancing algorithm for grid computing. RITA 13 1 (2006) 87-108
12. J.A. Andrade, R.F. Mello, E. Dodonov, L.J. Senger, L.T. Yang, K.C. Li, Toward an efficient middleware for multithreaded applications in computational grid, in: Proceedings the 11th IEEE International Conference on Computational Science and Engineering, CSE-08, São Paulo, Brazil, 2008
13. Ishii R.P., de Mello R.F., and Yang L.T. A complex network-based approach for job scheduling in grid environments. In: Perrott R.H., Chapman B.M., Subhlok J., de Mello R.F., and Yang L.T. (Eds). HPCC. Lecture Notes in Computer Science vol. 4782 (2007), Springer 204-215
14. de Mello R.F., Filho J.A.A., Senger L.J., and Yang L.T. Routega: A grid load balancing algorithm with genetic support. AINA (2007), IEEE Computer Society 885-892
15. Devarakonda M.V., and Iyer R.K. Predictability of process resource usage: A measurement-based study on UNIX. IEEE Transactions on Software Engineering 15 12 (1989) 1579-1586
16. Feitelson D.G., Rudolph L., Schwiegelshohn U., Sevcik K.C., and Wong P. Theory and practice in parallel job scheduling. Job Scheduling Strategies for Parallel Processing. Lect. Notes Comput. Sci. vol. 1291 (1997), Springer Verlag 1-34
17. Gibbons R. A historical application profiler for use by parallel schedulers. Job Scheduling Strategies for Parallel Processing (1997), Springer Verlag 58-77
18. W. Smith, I.T. Foster, V.E. Taylor, Predicting application run times using historical information, in: JSSPP, 1998, pp. 122-142
19. Silva F.A.B.D., and Scherson I.D. Improving parallel job scheduling using runtime measurements. In: Feitelson D.G., and Rudolph L. (Eds). Job Scheduling Strategies for Parallel Processing. Lect. Notes Comput. Sci. vol. 1911 (2000), Springer Verlag 18-38
20. J. Corbalan, X. Martorell, J. Labarta, Improving gang scheduling through job performance analysis and malleability, in: International Conference on Supercomputing, Sorrento, Italy, 2001, pp. 303-311
21. Senger L.J., Mello R.F., Santana M.J., and Santana R.C. An on-line approach for classifying and extracting application behavior on linux. In: Yang L.T., and Guo M. (Eds). High Performance Computing: Paradigm and Infrastructure (2005), John Wiley and Sons (Chapter 20)
22. E. Dodonov, R. Mello, L.T. Yang, Adaptive technique for automatic communication access pattern discovery applied to data prefetching in distributed applications using neural networks and stochastic models, in: Proceedings of the ISPA-06, 2006
23. E. Dodonov, R. Mello, A model for automatic on-line process behavior extraction, classification and prediction in heterogeneous distributed systems, in: Proceedings the First TCSC Doctoral Symposium in conjunction with 7th IEEE International Symposium and the Grid, CCGRID 2007, Rio de Janeiro, Brazil, 2007
24. Scordino C., and Lipari G. A resource reservation algorithm for power-aware scheduling of periodic and aperiodic real-time tasks. IEEE Transactions on Computers 55 12 (2006) 1509-1522
25. Dodonov E., Mello R.F., and Yang L.T. A network evaluation for lan, man and wan grid environments. In: Yang L.T., Amamiya M., Liu Z., Guo M., and Rammig F.J. (Eds). EUC. Lecture Notes in Computer Science vol. 3824 (2005), Springer 1133-1146
26. N. Andrade, W. Cirne, F. Brasileiro, P. Roisenberg, Ourgrid: An approach to easily assemble grids with equitable resource sharing, in: 9th Workshop on Job Scheduling Strategies for Parallel Processing, 2003
27. P. Costa, H.C. Guardia, S.D. Zorzo, Progrid: A proxy-based architecture for grid operation and management, in: Proceedings of SBAC-PAD 2003, 2003
28. Nagel W.E., Arnold A., Weber M., Hoppe H.C., and Solchenbach K. VAMPIR: Visualization and analysis of MPI resources. Supercomputer 12 1 (1996) 69-80
29. Fang W., Wang C.L., Zhu W., and Lau F.C.M. Pat: A postmortem object access pattern analysis and visualization tool. CCGRID 2004, 4th IEEE/ACM International Symposium on Cluster Computing and the Grid. CCGrid 2004, April 19-22, 2004, Chicago, IL, USA (2004), IEEE Computer Society 379-386
30. A.C. Arpaci-Dusseau, D.E. Culler, M. Mainwaring, Scheduling with implicit information in distributed systems, in: Proceedings of ACM SIGMETRICS'98, 1998, pp. 233-248
31. L.J. Senger, M.J. Santana, R.H.C. Santana, A new approach for acquiring knowledge of resource usage in parallel applications, in: Proceedings of International Symposium on Performance Evaluation of Computer and Telecommunication Systems, SPECTS'2003, 2003, pp. 607-614
32. Chang R.-S., Chang J.-S., and Lin P.-S. An ant algorithm for balanced job scheduling in grids. Future Generation Computer Systems 25 1 (2009) 20-27
33. Byun E., Choi S., Baik M., Gil J., Park C., and Hwang C. Mjsa: Markov job scheduler based on availability in desktop grid computing environment. Future Generation Computer Systems 23 4 (2007) 616-622
34. Zhang Y., Sun W., and Inoguchi Y. Predict task running time in grid environments based on cpu load predictions. Future Generation Computer Systems 24 6 (2008) 489-497
35. Korkhov V.V., Moscicki J.T., and Krzhizhanovskaya V.V. Dynamic workload balancing of parallel applications with user-level scheduling on the grid. Future Generation Computer Systems 25 1 (2009) 28-34
36. Jain R. The Art of Computer Systems Performance Analysis: Techniques for Experimental Design, Measurement, Simulation, and Modeling (1991), John Wiley and Sons
37. Dodonov E., Sousa J.Q., and Guardia H.C. Gridbox: Securing hosts from malicious and greedy applications. Proceedings of the 2nd Workshop on Middleware for Grid Computing (2004), ACM Press, New York, NY, USA 17-22
38. Kotz D., and Ellis C.S. Practical prefetching techniques for multiprocessor file systems. Journal of Distributed and Parallel Databases 1 1 (1993) 33-51
39. Bradley P.S., Fayyad U.M., and Reina C. Scaling clustering algorithms to large databases. Knowledge Discovery and Data Mining (1998) 9-15
40. Pham D., and Prince J. An adaptive fuzzy c-means algorithm for image segmentation in the presence of intensity inhomogeneities. SPIE Medical Imaging 1998: Image Processing vol. 3338 (1998) 555-563
41. Zien A., Brefeld U., and Scheffer T. Transductive support vector machines for structured variables. In: Ghahramani Z. (Ed). Proceedings of the 24th International Conference on Machine Learning (2007), ACM Press, Corvallis, Oregon, USA 1183-1190
42. Hirose S., Shimizu K., Kanai S., Kuroda Y., and Noguchi T. Poodle-l: A two-level svm prediction system for reliably predicting long disordered regions. Bioinformatics 23 16 (2007) 2046-2053
43. Bolch G., Greiner S., de Meer H., and Trivedi K.S. Queueing Networks and Markov Chains: Modeling and Performance Evaluation with Computer Science Applications (1998), Wiley-Interscience, New York, NY, USA
44. Raphael C. Automatic segmentation of acoustic musical signals using hidden markov models. IEEE Transactions on Pattern Analysis and Machine Intelligence 21 4 (1999) 360-370
45. Fine S., Singer Y., and Tishby N. The hierarchical hidden markov model: Analysis and applications. Machine Learning 32 1 (1998) 41-62
46. Adibi J., and Shen W.M. Self-similar layered hidden markov models. PKDD '01: Proceedings of the 5th European Conference on Principles of Data Mining and Knowledge Discovery (2001), Springer-Verlag, London, UK 1-15
47. Kalman R.E. A new approach to linear filtering and prediction problems. Transactions of the ASME-Journal of Basic Engineering 82 Series D (1960) 35-45
48. Cohn S., Sivakumaran N., and Todling R. A fixed-lag Kalman smoother for retrospective data assimilation. Monthly Weather Review 122 (1994) 2838-2867
49. J. Sum, C. Leung, L. Chan, Extended Kalman filter in recurrent neural network training and pruning, Technical Report CS-TR-96-05, Department of Computer Science and Engineering, The Chinese University of Hong Kong, 1996
50. Hu X., Prokhorov D.V., and Wunsch II D.C. Time series prediction with a weighted bidirectional multi-stream extended Kalman filter. Neurocomputing 70 13-15 (2007) 2392-2399
51. Kohonen T., Kaski S., Lagus K., Salojrvi J., Honkela J., Paatero V., and Saarela A. Self organization of a massive document collection. IEEE Transactions on Neural Networks (2000)
52. Chappell G.J., and Taylor J.G. The temporal kohonen map. Neural Networks Journal 6 3 (1993) 441-445
53. T. Koskela, M. Varsta, J. Heikkonen, K. Kaski, Time series prediction using RSOM with local linear modesl, Tech. Rep. B15, Helsinki University of Technology, Espoo, Finland, 1997
54. Lampinen J., and Oja E. Self-organizing maps for spatial and temporal AR models. In: Pietikäinen M., and Röning J. (Eds). Proc. 6 SCIA, Scand. Conf. on Image Analysis (1989), Suomen Hahmontunnistustutkimuksen seura r. y, Helsinki, Finland 120-127
55. Barreto G.A., and Araujo A.F.R. Identification and control of dynamical systems using the self-organizing map. IEEE TNN on Temporal Coding (2004) 1244-1259 (special issue)
56. Fahlman S.E., and Lebiere C. In: Touretzky D.S. (Ed). The Cascade-correlation Learning Architecture. Advances in Neural Information Processing Systems vol. 2 (1990), Morgan Kaufmann, San Mateo, Denver 1989 524-532
57. Kunze M., and Steffens J. Growing cell structure and neural gas. Incremental Neural Networks (1995)
58. Fritzke B. A growing neural gas network learns topologies. In: Tesauro G., Touretzky D.S., and Leen T.K. (Eds). Advances in Neural Information Processing Systems vol. 7 (1995), MIT Press, Cambridge, MA 625-632
59. Alahakoon D., Halgamuge S.K., and Srinivasan B. Self growing cluster development approach to data mining. IEEE International Conference on Systems, Man, and Cybernetics 3 (1998) 2901-2906
60. Dokur Z., and Ölmez T. Segmentation of ultrasound images by using a hybrid neural network. Pattern Recognition Letters 23 14 (2002) 1825-1836
61. Thacker N.A., Abraham I., and Courtney P. Supervised learning extensions to the clam network. Neural Networks 10 2 (1997) 315-326
62. Marsland S., Shapiro J., and Nehmzow U. A self-organising network that grows when required. Neural Networks 15 8-9 (2002) 1041-1058
63. Albertini M.K., and Mello R.F. A self-organizing neural network for detecting novelties. SAC '07: Proceedings of the 2007 ACM Symposium on Applied Computing (2007), ACM Press, New York, NY, USA 462-466
64. Carpenter G.A., and Grossberg S. Art 2: Selforganisation of stable category recognition codes for analog input patterns. Applied Optics 26 (1987) 4919-4930
65. He J., Tan A.-H., and Tan C.-L. Modified art 2a growing network capable of generating a fixed number of nodes. IEEE Transactions on Neural Networks 15 3 (2004) 728-737
66. Powell M. Radial basis functions for multivariable interpolation: A review. Clarendon Press Institute of Mathematics and its Applications Conference Series (1987) 143-167
67. Yee P., and Haykin S. A dynamic regularized radial basis function network for nonlinear, nonstationary time series prediction. IEEE Transaction on Signal Processing 47 (1998) 2503-2521
68. Berthold M. A time delay radial basis function network for phoneme recognition. IEEE World Congress on Computational Intelligence, 1994 IEEE International Conference on 7. Neural Networks (1994)
69. Zemouri R., Racoceanu D., and Zerhouni N. Recurrent radial basis function network for time-series prediction. Engineering Applications of Artificial Intelligence 16 5-6 (2003) 453-463
70. Waibel A., Hanazawa T., Hinton G., Shikano K., and Lang K. Phoneme recognition using time delay neural networks. IEEE Transactions on Accoustics, Speech and Signal Processing 37 (1989) 328-339
71. Day S.P., and Davenport M.R. Continuous-time temporal back-propagation with adaptable time delays. IEEE Transactions on Neural Networks 4 2 (1993) 348-354
72. M. Steijvers, P. Grunwald, A recurrent network that performs a contextsensitive prediction task, in: Proceedings of the 18th Annual Conference of the Cognitive Science Society, 1996
73. Kremer S.C. On the computational power of elman-style recurrent networks. IEEE Transactions on Neural Networks 6 4 (1995) 1000-1004
74. Hopfield J.J. Neural networks and physical systems with emergent collective computational abilities. Neurocomputing: Foundations of Research (1988) 457-464
75. A.F. Gers, J. Schmidhuber, Long short-term memory learns context free and context sensitive languages, in: IDSIA-03-00, 2000
76. Gers F., Schraudolph N., and Schmidhuber J. Learning precise timing with lstm recurrent networks. Journal of Machine Learning Research 3 (2002) 115-143
77. Jaeger H. Echo state network. Scholarpedia 2 9 (2007) 2330. http://www.scholarpedia.org/article/Echo_state_network URL: http://www.scholarpedia.org/article/Echo_state_network
78. H. Gao, R. Sollacher, H.P. Kriegel, Spiral recurrent neural network for online learning, in: Proceedings of 15th European Symposium on Artificial Neural Networks, 2007, pp. 483-488
79. Särkkä S., Vehtari A., and Lampinen J. Cats benchmark time series prediction by Kalman smoother with cross-validated noise density. Neurocomputing 70 13-15 (2007) 2331-2341
80. Weigend A.S., and Gershenfeld N.A. Time series prediction: Forecasting the future and understanding the past. In: Weigend A.S., and Gershenfeld N.A. (Eds). Santa Fe Institute Studies in the Sciences of Complexity. In: Weigend A.S., and Gershenfeld N.A. (Eds). Proceedings of the NATO Advanced Research Workshop on Comparative Time Series Analysis, held in Santa Fe, New Mexico, 14-17 May, 1992 (1994), Addison-Wesley, Reading, MA
81. J.A.K. Suykens, J. Vandewalle, The k.u.leuven competition data: A challenge for advanced neural network techniques, in: ESANN, 2000, pp. 299-304
82. Chen B.-J., Chang M.-W., and Lin C.-J. Load forecasting using support vector machines: A study on eunite competition 2001. IEEE Transactions on Power Systems 19 4 (2004) 1821-1830
83. Mello R.F., and Yang L.T. Prediction of dynamical, non-linear and unstable process behavior. Journal of Supercomputing 45 (2008) 1-10
84. B.S.C. Gruber, M. Coduro, Signature verification with dynamic rbf networks and time series motifs, in: Proceedings of Tenth International Workshop on Frontiers in Handwriting Recognition, 2006
85. A probabilistic rbf network for classification. IJCNN '00: Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks vol. 4 (2000), IEEE Computer Society, Washington, DC, USA 4238
86. Mello R.F., Senger L.J., and Yang L.T. Automatic text classification using an artificial neural network. High Performance Computational Science and Engineering 1 (2005) 1-21
87. dos Santos M.L., de Mello R.F., and Yang L.T. Extraction and classification of user behavior. In: Kuo T.-W., Sha E.H.-M., Guo M., Yang L.T., and Shao Z. (Eds). EUC. Lecture Notes in Computer Science vol. 4808 (2007), Springer 493-506
88. Paninski L. Estimation of entropy and mutual information. Neural Computing 15 6 (2003) 1191-1253
89. Kennel M.B., Brown R., and Abarbanel H.D.I. Determining embedding dimension for phase-space reconstruction using a geometrical construction. Physical Review A 45 6 (1992) 3403-3411
90. Rosenstein M.T., Collins J.J., and De Luca C.J. A practical method for calculating largest lyapunov exponents from small data sets. Physica D 65 (1993) 117-134. http://citeseer.ist.psu.edu/328190.html URL: http://citeseer.ist.psu.edu/328190.html
91. Mielniczuk J., and Wojdyllo P. Estimation of hurst exponent revisited. Computational Statistics & Data Analysis 51 9 (2007) 4510-4525
92. de Mello R.F., Senger L.J., and Yang L.T. A routing load balancing policy for grid computing environments. AINA vol. 1 (2006), IEEE Computer Society 153-158
93. Ho T.-Y., Lam P.-M., and Leung C.-S. Parallelization of cellular neural networks on gpu. Pattern Recognition 41 8 (2008) 2684-2692