Inproceedings,

A hypergraph partitioning based approach for scheduling of tasks with batch-shared I/O

, , , , , , and .
Cluster Computing and the Grid, 2005. CCGrid 2005. IEEE International Symposium on, 2, page 792--799. IEEE, (2005)
DOI: 10.1109/CCGRID.2005.1558643

Abstract

This paper proposes a novel, hypergraph partitioning based strategy to schedule multiple data analysis tasks with batch-shared I/O behavior. This strategy formulates the sharing of files among tasks as a hypergraph to minimize the I/O overheads due to transferring of the same set of files multiple times and employs a dynamic scheme for file transfers to reduce contention on the storage system. We experimentally evaluate the proposed approach using application emulators from two application domains; analysis of remotely-sensed data and biomedical imaging.

Tags

Users

  • @ytyoun

Comments and Reviews