位置:成果数据库 > 期刊 > 期刊详情页
An Online Visualization System for Streaming Log Data of Computing Clusters
  • ISSN号:1007-0214
  • 期刊名称:Tsinghua Science and Technology
  • 时间:2013.8.8
  • 页码:196-205
  • 分类:TP391.41[自动化与计算机技术—计算机应用技术;自动化与计算机技术—计算机科学与技术] TP301.6[自动化与计算机技术—计算机系统结构;自动化与计算机技术—计算机科学与技术]
  • 作者机构:[1]Zhejiang Univ, State Key Lab CAD & CG, Hangzhou 310058, Zhejiang, Peoples R China, [2]Hangzhou Dianzi Univ, Coll Comp Sci & Technol, Hangzhou 310018, Zhejiang, Peoples R China
  • 相关基金:supported by the National Natural Science Foundation of China (Nos. 61232012 and 61202279);the National High-Tech Research and Development (863) Program of China (No. 2012AA120903);the Doctoral Fund of Ministry of Education of China (No. 20120101110134)
  • 相关项目:大规模复杂动态图可视化关键技术研究
中文摘要:

Monitoring a computing cluster requires collecting and understanding log data generated at the core, computer, and cluster levels at run time. Visualizing the log data of a computing cluster is a challenging problem due to the complexity of the underlying dataset: it is streaming, hierarchical, heterogeneous, and multi-sourced. This paper presents an integrated visualization system that employs a two-stage streaming process mode. Prior to the visual display of the multi-sourced information, the data generated from the clusters is gathered, cleaned, and modeled within a data processor. The visualization supported by a visual computing processor consists of a set of multivariate and time variant visualization techniques, including time sequence chart, treemap, and parallel coordinates. Novel techniques to illustrate the time tendency and abnormal status are also introduced. We demonstrate the effectiveness and scalability of the proposed system framework on a commodity cloud-computing platform.

英文摘要:

Monitoring a computing cluster requires collecting and understanding log data generated at the core, computer, and cluster levels at run time. Visualizing the log data of a computing cluster is a challenging problem due to the complexity of the underlying dataset: it is streaming, hierarchical, heterogeneous, and multi-sourced. This paper presents an integrated visualization system that employs a two-stage streaming process mode. Prior to the visual display of the multi-sourced information, the data generated from the clusters is gathered, cleaned, and modeled within a data processor. The visualization supported by a visual computing processor consists of a set of multivariate and time variant visualization techniques, including time sequence chart, treemap, and parallel coordinates. Novel techniques to illustrate the time tendency and abnormal status are also introduced. We demonstrate the effectiveness and scalability of the proposed system framework on a commodity cloud-computing platform.

同期刊论文项目
同项目期刊论文
期刊信息
  • 《清华大学学报:自然科学英文版》
  • 主管单位:教育部
  • 主办单位:清华大学
  • 主编:孙家广
  • 地址:北京市海淀区清华园
  • 邮编:100084
  • 邮箱:journal@tsinghua.edu.cn
  • 电话:010-62788108 62792994
  • 国际标准刊号:ISSN:1007-0214
  • 国内统一刊号:ISSN:11-3745/N
  • 邮发代号:82-627
  • 获奖情况:
  • 国内外数据库收录:
  • 美国化学文摘(网络版),美国数学评论(网络版),德国数学文摘,荷兰文摘与引文数据库,美国工程索引,美国剑桥科学文摘
  • 被引量:323