Intelligent storage: Cross-layer optimization for soft real-time workload

ACM Transactions on Storage

Volumn 2, Issue 3, 2006, Pages 255-282

  Won, Youjip ^a   Chang, Hyungkyu ^a   Ryu, Jaemin ^a   Kim, Yongdai ^b   Shim, Junseok ^c  

^a Hanyang University   (South Korea)

^b Seoul National University   (South Korea)

^c SAMSUNG Electronics   (South Korea)

Author keywords

Autonomic computing; Boosting; Cross layer optimization; File system; Intelligence; Machine learning; Multimedia; Storage

Indexed keywords

AUTONOMIC COMPUTING; BOOSTING; CROSS LAYER OPTIMIZATION; FILE SYSTEMS;

ELECTRONIC DOCUMENT EXCHANGE; INFORMATION MANAGEMENT; INTERFACES (COMPUTER); LEARNING SYSTEMS; MULTIMEDIA SYSTEMS; OPTIMIZATION; REAL TIME SYSTEMS; SECURITY OF DATA;

DATA STORAGE EQUIPMENT;

EID: 33750436568     PISSN: 15533077     EISSN: 15533093     Source Type: Journal    
DOI: 10.1145/1168910.1168912     Document Type: Article

References (44)

1. ABOUTABL, M., AGRAWALA, A., AND DECOTIGNIE, J.-D. 1998. Temporally determinate disk access: An experimental approach. In Proceedings of the ACM SIGMETRICS Joint International Conference on Measurement and Modeling of Computer Systems. ACM, New York, 280-281.
2. ACHARYA, A., UYSAL, M., AND SALTZ, J. 1998. Active disks: Programming model, algorithms and evaluation. In ASPLOS-VIII: Proceedings of the 8th International Conference on Architectural Support for Programming Languages and Operating Systems, ACM, New York, 81-91.
3. ANSI. 2002. At attachment with packet interface entension-(ata/atapi-6). American National Standard for Information Technology, T13-1410D.
4. BOVET, D. P. AND CESATI, M. 2005. Understanding the LINUX Kernel. O'REILLY.
5. BREIMAN, L., FRIEDMAN, J., OLSHEN, R., AND STONE., C. 1984. Classification and Regression Trees. Wadsworth, Belmont, CA.
6. BURNETT, N. C., BENT, J., ARPACI-DUSSEAU, A. C., AND ARPACI-DUSSEAU, R. H. 2000. Exploiting graybox knowledge of buffer-cache management. In Proceedings of 2002 USENIX Annual Technical Conference. USENIX Association, Berkeley, CA, 29-44.
7. CHOI, J. AND WON, Y. 2002. Power constraints: Another dimension of complexity in continuous media playback. In Proceedings of the Joint International Workshops on Interactive Distributed Multimedia Systems and Protocols for Multimedia Systems. Coimbra, Portugal, 288-299.
8. COHEN, I., GOLDSZMIDT, M., KELLY, T., SYMONS, J., AND CHASE, J. S. 2004. Correlating instrumentation data to system states: A building block for automated diagnosis and control. Tech. Rep. HPL-2004-183, HP Laboratories, Palo Alto, CA, Oct.
9. DAVID, R. R. 2004. Diskbench: User-Level disk feature extraction tool. Tech. rep. UCSB TR-2004-18. Nov.
10. DIMITHIJEVIC, Z., RANGASWAMI, R., AND CHANG, E. 2003. Design and implementation of semi-preemptible IO. In FAST '03: Proceedings of the Conference on File and Storage Technologies. San Jose, CA. 145-158.
11. FREUD, Y. AND SCHAPIRE, R. E. 1995. A decision-theoretic generalization of on-line learning and an application to boosting. In EuroCOLT '95: Proceedings of the 2nd European Conference on Computational Learning Theory. Springer Verlag, London, 23-37.
12. FRIEDMAN, J. 2001. Greedy function approximation: A gradient boosting machine. Ann. Statist. 29, 1189-1232.
13. GANGER, G. 2001. Blurring the line between OSES and storage devices. Tech. rep. Technical Report CMU-CS-01-166, Carnegie Mellon University. Dec.
14. GANGER, G. R., WORTHINGTON, B. L., AND PATT, Y. 1998. The Disksim simulation environment. Tech. rep. CSE-TR-358-98, Dept. of Electrical Engineering and Computer Science, Univ. of Michigan. Feb.
15. HUGHES, G. 2002. Wise drives. IEEE Spectrum 39, 8 (Aug.), 37-41.
16. HUSTON, L., SUKTHANKAR, R., WICKREMESINGHE, R., SATYANARAYANAN, M., GANGER, G., RIEDEL, E., AND AILAMAKI, A. 2004. Diamond: A storage architecture for early discard in interactive search. In FAST '04: Proceedings of the 3rd USENIX Conference on File and Technologies. San Jose, CA.
17. IYER, S. AND DRUSCHEL, P. 2001. Anticipatory scheduling: A disk scheduling framework to overcome deceptive idleness in synchronous I/O. In SOSP '01: Proceedings of the 18th ACM Symposium on Operating Systems Principles. ACM, New York, 117-130.
18. KARLSSON, M. AND COVELL, M. 2005. Dynamic black-box performance model estimation for selftuning regulators. In Proceedings of Internation Conference on Autonomic Computing. Seattle, WA, 172-182.
19. KIM, T., WON, Y., AND KOH, K. 2005. Apollon: File system support for qos augmented I/O. In Proceedings of the Pacific Rim Conference on Multimedia, Jeju, Korea.
20. LI, Z., CHEN, Z., SRINIVASAN, S. M., AND ZHOU, Y. 2004. C-Miner: Mining block correlations in storage. In FAST '04: Proceedings of the 3rd USENIX Conference on File and Storage Technologies. San Francisco, CA, 173-186.
21. LU, Y. Du, D. H., AND RUWART, T. 2005. Qos provisioning framework for an OSD-Based storage system. In Proceedings of the 22nd IEEE/13th NASA Goddard Conferene on Mass Storage Systems and Technologies (MSST). 28-35.
22. LUMB, C. R., SCHINDLER, J., AND GANGER, G. R. 2002. Freeblock scheduling outside of disk firmware. In FAST '02: Proceedings of the Conference on File and Storage Technologies. USENIX Association, Berkeley, CA, 275-288.
23. MESNIER, M., THERESKA, E., GREGORY GANGER, D. E., AND SELTZER, M. 2004. File classification in self-stroage systems. In Proceedings of the 1st International Conference on Autonomic Computing,
24. MITECHELLE, T. M. 1997. Machine Learning. Donnelly and Sons.
25. mpeg2dec. http://libmpeg2.sourceforge.net.
26. mplayer. http://www.mplayerhq.hu.
27. NIRANJAN, T., CHIUEH, T., AND SCHLOSS, G. A. 1997. Implementation and evaluation of a multimedia file system. In ICMCS '97: Proceedings of the International Conference on Multimedia Computing and Systems (ICMCS '97). IEEE Computer Society, Ottawa, Ontario, Canada, 269-276.
28. PERFORMANCE EVALUATION LABORATORY, B. Y. U. 2006. Dtb: Linux disk trace buffer. http://traces.byu.edu/new/Tools/.
29. QUINLAN, J. R. 1993. C4.5: Programs for Machine Learning, Morgan Kaufmann, San Francisco, CA.
30. RIEDEL, E., FALOUTSOS, C., GANGER, G. R., AND NAGLE, D. F. 2000. Data mining on an oltp system (nearly) for free. In SIGMOD '00: Proceedings of the ACM SIGMOD International Conference on Management of Data. ACM, New York, 13-21.
31. RIEDEL, E., GIBSON, G. A., AND FALOUTSOS, C. 1998. Active storage for large-scale data mining and multimedia. In VLDB '98: Proceedings of the 24th International Conference on Very Large Data Bases. Morgan Kaufmann, San Francisco, CA, 62-73.
32. SCHAPIRE, R. E. AND SINGER, Y. 1999. Improved boosting algorithms using confidence-rated predictions. Mach. Learn. 37, 3 (Dec.), 297-336.
33. SCHINDLER, J., GRIFFIN, J. L., LUMB, C. R., AND GANGER, G. R. 2002. Track-Aligned extents: Matching access patterns to disk drive characteristics. In FAST '02: Proceedings of the Conference on File and Storage Technologies. USENIX Association, Berkeley, CA, 259-274.
34. SIVATHANU, M., PRABHAKARAN, V., POPOVICI, F. I., DENEHY, T. E., ARPACI-DUSSEAU, A. C., AND ARPACI-DUSSEAU, R. H. 2003. Semantically-Smart disk systems. In FAST '03: Proceedings of 2nd USENIX Conference on File and Storage Technologies (FAST). USENIX Association.
35. WANG, C., GOEBEL, V., AND PLAGEMANN, T. 1999. Techniques to increase disk access locality in the minorca multimedia file system. In Proceedings of the 7th ACM Multimedia Conference, 147-150.
36. WANG, R. Y., ANDERSON, T. E., AND PATTERSON, D. A. 1999. Virtual log based file systems for a programmable disk. In OSDI '99: Proceedings of the 3rd Symposium on Operating Systems Design and Implementation. USENIX Association, Berkeley, CA, 29-43.
37. WEISSEL, A., BEUTEL, B., AND BELLOSA, F. 2002. Cooperative I/O: A novel I/O semantics for energy-aware applications. SIGOPS Oper. Syst. Rev. 36, SI (Dec.), 117-129.
38. WILDSTROM, J., STONE, P., WITCHEL, E., MOONEY, R., AND DAHLIN, M. 2005. Towards self-configuring hardware for distributed computer systems. In Proceedings of the International Conference on Autonomic Computing. Seattle, WA, 241-249.
39. WON, Y., PARK, J., KIM, D., AND LEE, S. 2005. Hermes: Embedded file system for a/v workload. Multimedia Tools and Applications, Springer.
40. WORTHINGTON, B. L., GANGER, G. R., PATT, Y. N., AND WILKES, J. 1995. On-line extraction of SCSI disk drive parameters. In SIGMETRICS '95/PERFORMANCE '95: Proceedings of the ACM SIGMETRICS Joint International Conference on Measurement and Modeling of Computer Systems. ACM, New York, 146-156.
41. xine. http://xinehq.de.
42. XU, W., BODIK, P., AND PATTERSON, D. 2004. A flexible architecture for statistical learning and data mining from system log streams. In. Proceedings of the Workshop on Temporal Data Mining: Algorithms, Theory and Applications Conjunction with the International Conference on Data Mining. Brighton, UK.
43. ZHANG, Z., LIAN, Q., LIN, S., CHEN, W., CHEN, Y., AND JIN, C. 2005. Bitvault: A highly reliable distributed retension platform. Tech. rep. MSR-TR-2005-179, Microsoft Research, China. Dec.
44. ZHANG, Z., LIN, S., LIAN, Q., AND JIN, C. 2004. Repstore: A self-managing and self-tuning storage backend with smart bricks. In Proceedings of the International Conference on Autonomic Computing. 122-129.