Iteration aware prefetching for large multidimensional scientific datasets

Proceedings of the International Conference on Scientific and Statistical Database Management, SSDBM

Volumn , Issue , 2005, Pages 45-54

  Rhodes, Philip J ^a   Tang, Xuan ^b   Bergeron, R Daniel ^c   Sparr, Ted M ^c  

^a UNIVERSITY OF MISSISSIPPI   (United States)

^b Root cause Analysis Network Management Design and Development   (United States)

^c UNIVERSITY OF NEW HAMPSHIRE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ACCESS PATTERNS; CACHING AND PREFETCHING; FILE SYSTEMS; MULTIDIMENSIONAL ARRAYS; PREFETCHING; PRIOR KNOWLEDGE; READ LATENCIES; SCIENTIFIC DATA;

DIGITAL STORAGE; MANAGEMENT INFORMATION SYSTEMS;

ITERATIVE METHODS;

EID: 84883214332     PISSN: 10993371     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (52)

1. [Albers98] S. Albers, N. Garg and S. Leonardi, Minimizing Stall Time in SIngle and Parallel Disk Systems, Proceedings of the 30th Annual ACM Symposium on Theory of Computing, pp. 454-462, 1998.
2. [Amer02] A. Amer, D. Long, and R. Burns. Group-Based Management of Distributed File Caches. In Proc. of the 17th International Conference on Distributed Computing Systems, 2002.
3. [Brown01] A.D. Brown, T.C. Mowry, Compiler-Based I/O Prefetching for Out-of-Core Applications, ACM Trans. on Computer Systems, Vol. 19, No. 2, May 2001.
4. [Cao96] P. Cao and E. Felten, Implementation and Performance of Integrated Application-Controlled File Caching, Prefetching, and Disk Scheduling, ACM Transactions on Computer Systems, vol. 14, No. 4, 1996.
5. [Chang01] F. Chang, Using Speculative Execution to Automatically Hide I/O Latency, Ph. D. Dissertation, Carnegie Mellon University, 2001.
6. [CChang00] C. Chang, T. Kurc, A. Sussman, J. Saltz, Optimizing Retrieval and Processing of Multi-dimensional Scientific Datasets, In Proc. of the Third Merged IPPS/SPDP Symposiums. IEEE Computer Society Press, May 2000.
7. [CChangADR] C. Chang, T. Kurc, A. Sussman, J. Saltz, Active Data Repository Software User Manual, http://www.cs.umd.edu/projects/hpsl/ ResearchAreas/ADR-dist/ADR.htm.
8. [Cigno97] P. Cignoni, C. Montani, E. Puppo, Roberto Scopigno, Multiresolution Representation and Visualization of Volume Data, IEEE Transactions on Visualization and Computer Graphics, Volume 3, No. 4, IEEE, Los Alamitos, CA, 1997.
9. [Coughlin] T. Coughlin, High Density Hard Disk Drive Trends in the USA, tech report at http://www.tomcoughlin.com/techpapers.htm.
10. [Doshi03] P.R. Doshi, G.E. Rosario, E.A. Rundensteiner, and M.O. Ward, A Strategy Selection Framework for Adaptive Prefetching in Data Visualization, Proc. of SSDBM, 2003.
11. [Forney02] B. C. Forney, A. C. Arpaci-Dusseau, R. H. Arpaci- Dusseau, Storage-Aware Caching: Revisiting Caching for Heterogeneous Storage Systems, In The First USENIX Conference on File and Storage Technologies (FAST '02), 2002.
12. [Griffioen94] J. Griffioen and R. Appleton, Reducing File System Latency Using A Predictive Approach, University of Kentucky Technical Report #CS247-94.
13. [Hibbard95] W. L. Hibbard, D. T. Kao, and A. Wierse, Database Issues for Data Visualization: Scientific Data Modeling, Database Issues for Data Visualization, Proceedings of the IEEE Visualization '95 Workshop, LNCS 1183, Springer, Berlin, 1995.
14. [Highley03] T. Highley and P. Reynolds, Marginal Cost-Benefit Analysis for Predictive File Prefetching, Proc. of the 41st Anuual ACM Southeast Conference (ACMSE 2003).
15. [Kotz97] D. Kotz, Disk-Directed I/O for MIMD Multiprocessors, ACM Trans. on Computer Systems, Vol. 15, No. 1, 1997.
16. [Madhyastha96] T. M. Madhyastha, C. L. Elford, and D. A, Reed, Optimizing Input/Output Using Adaptive File System Policies, In Fifth NASA Goddard Conference on Mass Storage Systems and Technologies, September 1996.
17. [Madhyastha97] T. M. Madhyastha, and D. A. Reed, Input/Output Access Pattern Classification Using Hidden Markov Models, In Workshop on Input/Output in Parallel and Distr. Systems, Nov. 1997.
18. [More00] S. More, A. Choudhary, Tertiary Storage Organization for Large Multidimensional Datasets, 8th NASA Goddard Conference on Mass Storage Systems and Technologies, 2000.
19. [Mowry94] T. C. Mowry, Tolerating Latency Through Software- Controlled Data Prefetching, Ph.D. Dissertation, Stanford University, 1994.
20. [Nadeau] D. R. Nadeau, An Architecture for Large Multi- Dimensional Data Management, Scalable Visualization Tools White Paper, http://vistools.npaci.edu/ .
21. [Patterson95] R.H. Patterson, G. A. Gibson, E. Ginting, D. Stodolsky, and J. Zelenka, Informed Prefetching and Caching. In Proceedings of the 15th ACM Symposium on Operating Systems Principles, December 1995, PP. 79-95.
22. [Rhodes01] P.J. Rhodes, R.D. Bergeron, and T.M. Sparr, A Data Model for Distributed Multisource Scientific Data, Hierarchical and Geometrical Methods in Scientific Visualization, Springer-Verlag, Heidelberg, 2001.
23. [Rhodes05] P.J. Rhodes, X. Tang, R.D. Bergeron, and T.M. Sparr, "Out of core visualization using Iterator Aware Multidimensional Prefetching", Conference on Visualization and Data Analysis 2005.
24. [Sarawagi94] S. Sarawagi, M. Stonebraker, Efficient Organizations of Large Multidimensional Arrays, Proc. of the Tenth International Conference on Data Engineering, Feb. 1994.
25. [Vellanki99] V. Vellanki and A. Chervenak, A Cost-Benefit Scheme for High Performance Predictive Prefetching, Proc. of Supercomputing '99, Nov. 1999.
26. [Wu03] K. Wu, W. Koegler, J. Chen, A. Shoshani, Using Bitmap Index for Interactive Exploration of Large Datasets, Proc. of SSDBM, 2003.
27. [Albers98] S. Albers, N. Garg and S. Leonardi, Minimizing Stall Time in SIngle and Parallel Disk Systems, Proceedings of the 30th Annual ACM Symposium on Theory of Computing, pp. 454-462, 1998.
28. [Amer02] A. Amer, D. Long, and R. Burns. Group-Based Management of Distributed File Caches. In Proc. of the 17th International Conference on Distributed Computing Systems, 2002.
29. [Brown01] A.D. Brown, T.C. Mowry, Compiler-Based I/O Prefetching for Out-of-Core Applications, ACM Trans. on Computer Systems, Vol. 19, No. 2, May 2001.
30. [Cao96] P. Cao and E. Felten, Implementation and Performance of Integrated Application-Controlled File Caching, Prefetching, and Disk Scheduling, ACM Transactions on Computer Systems, vol. 14, No. 4, 1996.
31. [Chang01] F. Chang, Using Speculative Execution to Automatically Hide I/O Latency, Ph. D. Dissertation, Carnegie Mellon University, 2001.
32. [CChang00] C. Chang, T. Kurc, A. Sussman, J. Saltz, Optimizing Retrieval and Processing of Multi-dimensional Scientific Datasets, In Proc. of the Third Merged IPPS/SPDP Symposiums. IEEE Computer Society Press, May 2000.
33. [CChangADR] C. Chang, T. Kurc, A. Sussman, J. Saltz, Active Data Repository Software User Manual, http://www.cs.umd.edu/projects/hpsl/ ResearchAreas/ADR-dist/ADR.htm.
34. [Cigno97] P. Cignoni, C. Montani, E. Puppo, Roberto Scopigno, Multiresolution Representation and Visualization of Volume Data, IEEE Transactions on Visualization and Computer Graphics, Volume 3, No. 4, IEEE, Los Alamitos, CA, 1997.
35. [Coughlin] T. Coughlin, High Density Hard Disk Drive Trends in the USA, tech report at http://www.tomcoughlin.com/techpapers.htm.
36. [Doshi03] P.R. Doshi, G.E. Rosario, E.A. Rundensteiner, and M.O. Ward, A Strategy Selection Framework for Adaptive Prefetching in Data Visualization, Proc. of SSDBM, 2003.
37. [Forney02] B. C. Forney, A. C. Arpaci-Dusseau, R. H. Arpaci- Dusseau, Storage-Aware Caching: Revisiting Caching for Heterogeneous Storage Systems, In The First USENIX Conference on File and Storage Technologies (FAST '02), 2002.
38. [Griffioen94] J. Griffioen and R. Appleton, Reducing File System Latency Using A Predictive Approach, University of Kentucky Technical Report #CS247-94.
39. [Hibbard95] W. L. Hibbard, D. T. Kao, and A. Wierse, Database Issues for Data Visualization: Scientific Data Modeling, Database Issues for Data Visualization, Proceedings of the IEEE Visualization '95 Workshop, LNCS 1183, Springer, Berlin, 1995.
40. [Highley03] T. Highley and P. Reynolds, Marginal Cost-Benefit Analysis for Predictive File Prefetching, Proc. of the 41st Anuual ACM Southeast Conference (ACMSE 2003).
41. [Kotz97] D. Kotz, Disk-Directed I/O for MIMD Multiprocessors, ACM Trans. on Computer Systems, Vol. 15, No. 1, 1997.
42. [Madhyastha96] T. M. Madhyastha, C. L. Elford, and D. A, Reed, Optimizing Input/Output Using Adaptive File System Policies, In Fifth NASA Goddard Conference on Mass Storage Systems and Technologies, September 1996.
43. [Madhyastha97] T. M. Madhyastha, and D. A. Reed, Input/Output Access Pattern Classification Using Hidden Markov Models, In Workshop on Input/Output in Parallel and Distr. Systems, Nov. 1997.
44. [More00] S. More, A. Choudhary, Tertiary Storage Organization for Large Multidimensional Datasets, 8th NASA Goddard Conference on Mass Storage Systems and Technologies, 2000.
45. [Mowry94] T. C. Mowry, Tolerating Latency Through Software- Controlled Data Prefetching, Ph.D. Dissertation, Stanford University, 1994.
46. [Nadeau] D. R. Nadeau, An Architecture for Large Multi- Dimensional Data Management, Scalable Visualization Tools White Paper, http://vistools.npaci.edu/ .
47. [Patterson95] R.H. Patterson, G. A. Gibson, E. Ginting, D. Stodolsky, and J. Zelenka, Informed Prefetching and Caching. In Proceedings of the 15th ACM Symposium on Operating Systems Principles, December 1995, PP. 79-95.
48. [Rhodes01] P.J. Rhodes, R.D. Bergeron, and T.M. Sparr, A Data Model for Distributed Multisource Scientific Data, Hierarchical and Geometrical Methods in Scientific Visualization, Springer-Verlag, Heidelberg, 2001.
49. [Rhodes05] P.J. Rhodes, X. Tang, R.D. Bergeron, and T.M. Sparr, "Out of core visualization using Iterator Aware Multidimensional Prefetching", Conference on Visualization and Data Analysis 2005.
50. [Sarawagi94] S. Sarawagi, M. Stonebraker, Efficient Organizations of Large Multidimensional Arrays, Proc. of the Tenth International Conference on Data Engineering, Feb. 1994.
51. [Vellanki99] V. Vellanki and A. Chervenak, A Cost-Benefit Scheme for High Performance Predictive Prefetching, Proc. of Supercomputing '99, Nov. 1999.
52. [Wu03] K. Wu, W. Koegler, J. Chen, A. Shoshani, Using Bitmap Index for Interactive Exploration of Large Datasets, Proc. of SSDBM, 2003.