Managing large-scale workflow execution from resource provisioning to provenance tracking: The CyberShake example

Deelman, E.; Callaghan, S.; Field, E.; Francoeur, H.; Graves, R.; Gupta, N.; Gupta, V.; Jordan, T. H.; Kesselman, C.; Maechling, P.; Mehringer, J.; Mehta, G.; Okaya, D.; Vahi, K.; Zhao, L.

Abstract:

This paper discusses the process of building an environment where large-scale, complex, scientific analysis can be scheduled onto a heterogeneous collection of computational and storage resources. The example application is the Southern California Earthquake Center (SCEC) CyberShake project, an analysis designed to compute probabilistic seismic hazard curves for sites in the Los Angeles area. We explain which software tools were used to build to the system, describe their functionality and interactions. We show the results of running the CyberShake analysis that included over 250,000 jobs using resources available through SCEC and the TeraGrid. ?? 2006 IEEE.

Genre:

Conference Paper

ProdID:

70028627

Citation Author:

Deelman, E.; Callaghan, S.; Field, E.; Francoeur, H.; Graves, R.; Gupta, N.; Gupta, V.; Jordan, T. H.; Kesselman, C.; Maechling, P.; Mehringer, J.; Mehta, G.; Okaya, D.; Vahi, K.; Zhao, L.

Citation Contributing Office:

Citation Datum:

Citation Day:

Citation Edition:

Citation Editor:

Citation End Page:

Citation Issue:

Citation Keywords:

Citation Language:

English

Citation Larger Work Title:

e-Science 2006 - Second IEEE International Conference on e-Science and Grid Computing

Citation LatN:

Citation LatS:

Citation LonE:

Citation LonW:

Citation Month:

Citation No Pagination:

Citation Number Of Pages:

Citation Online Only Flag:

Citation Phsyical Description:

Citation Projection:

Citation Public Comments:

Citation Publisher:

Citation Series:

Citation Series Code:

Citation Series Number:

Citation Search Results Text:

Managing large-scale workflow execution from resource provisioning to provenance tracking: The CyberShake example; 2006; Conference Paper; e-Science 2006 - Second IEEE International Conference on e-Science and Grid Computing; Deelman, E.; Callaghan, S.; Field, E.; Francoeur, H.; Graves, R.; Gupta, N.; Gupta, V.; Jordan, T. H.; Kesselman, C.; Maechling, P.; Mehringer, J.; Mehta, G.; Okaya, D.; Vahi, K.; Zhao, L.