BibSonomy :: publication :: Server-side I/O coordination for parallel file systems

Server-side I/O coordination for parallel file systems

Huaiming Song, Yanlong Yin, Xian-He Sun, Rajeev Thakur, and Samuel Lang. Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis, page 17:1--17:11. New York, NY, USA, ACM, (2011)

Abstract

Parallel file systems have become a common component of modern high-end computers to mask the ever-increasing gap between disk data access speed and CPU computing power. However, while working well for certain applications, current parallel file systems lack the ability to effectively handle concurrent I/O requests with data synchronization needs, whereas concurrent I/O is the norm in data-intensive applications. Recognizing that an I/O request will not complete until all involved file servers in the parallel file system have completed their parts, in this paper we propose a serverside I/O coordination scheme for parallel file systems. The basic idea is to coordinate file servers to serve one application at a time in order to reduce the completion time, and in the meantime maintain the server utilization and fairness. A window-wide coordination concept is introduced to serve our purpose. We present the proposed I/O coordination algorithm and its corresponding analysis of average completion time in this study. We also implement a prototype of the proposed scheme under the PVFS2 file system and MPI-IO environment. Experimental results demonstrate that the proposed scheme can reduce average completion time by 8% to 46%, and provide higher I/O bandwidth than that of default data access strategies adopted by PVFS2 for heavy I/O workloads. Experimental results also show that the server-side I/O coordination scheme has good scalability.

Links and resources

DOI:10.1145/2063384.2063407
URL:http://doi.acm.org/10.1145/2063384.2063407
BibTeX key:Song:2011:SIC:2063384.2063407
internal link:
?
You can use this internal link to create references to this post in your discussions. Just copy this internal link and paste it in your discussion text.
search on:

Comments or reviews  
(0)

There is no review or comment yet. You can write one!

Tags

  • Last update 2 years ago.
  • Created 2 years ago.

Cite this publication

Server-side I/O coordination for parallel file systems

Huaiming Song, Yanlong Yin, Xian-He Sun, Rajeev Thakur, and Samuel Lang. Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis, page 17:1--17:11. New York, NY, USA, ACM, (2011)