由于海量天文数据处理的迫切需求,科学工作流技术已成为一种有效的分布式数据处理解决方案被迅速应用到天文领域。然而,现有的科学工作流系统存在诸多不足,如系统的部署复杂,应用太过繁琐等,这严重制约了天文学家的应用。针对天文领域数据处理的要求,设计实现了一套轻量级的科学工作流系统(C—SWF)。系统具有任务定制、数据传输、数据起源和任务重做机制等基本功能,与现有的科学工作流系统相比,C-SWF具有简单、高可用性和易于部署等优势,可以较好地满足天文学家的需要。
Due to the urgent requirements of massive data processing in astronomy, scientific workflow technique is being quickly adopted for distributed astronomical data processing. However, existing scientific workflow systems are over-complex and over-enormous in deployment and application so that few people can master them. In this paper we present a lightweight scientific workflow system, C-SWF, which is specially designed for astronomy. All required fundamental functions, such as task customization, data transfer, data provenance, and task re-run mechanisms, are fully implemented. In comparison to the existing scientific workflow systems, the C-SWF exhibits many unique features such as simplicity, high performance, and easy deployment, which make it meet the requirements of astronomers.