Workflow-Based User Environment for High Performance Computing
-
Graphical Abstract
-
Abstract
In high performance computing environment in many fields, to finish a task requires not only computing service, but also data service and all kinds of device services, which results in different relation dependences and is very complex. However, job management systems such as PBS, LSF, and Condor and so on, only support time dependence among jobs, and are short of fault-tolerance and complete flow control. Workflow-based user environment for high performance computing is successfully applied in petroleum geophysics, which not only benefits construction and control of task flow, but also enhances all kinds of relation dependences and flow semantics, especially for the workflow engine based on event model with checkpoint function. It provides good reliability. Thus, workflow-based user environment for high performance computing can be flexibly suitable for other different user environments.
-
-