位置:成果数据库 > 期刊 > 期刊详情页
SwiftArray: Accelerating Queries on Multidimensional Arrays
  • ISSN号:0254-4164
  • 期刊名称:《计算机学报》
  • 时间:0
  • 分类:TP312[自动化与计算机技术—计算机软件与理论;自动化与计算机技术—计算机科学与技术] TP311.13[自动化与计算机技术—计算机软件与理论;自动化与计算机技术—计算机科学与技术]
  • 作者机构:[1]the Department of Computer Science and Technology, Tsinghua University, Beijing 100084, China, [2]1the Ministry of Education Key Laboratory for Earth System Modeling, Tsinghua University, Beijing 100084, China
  • 相关基金:Acknowledgements This work was supported in part by the Natural Science Foundation of China (No. 41375102), the National Key Basic Research and Development (973) Program of China (No. 2014CB347800) and the National High- Tech Research and Development Program (863) of China (No. 2011AA01A203).
中文摘要:

Scientific instruments and simulation programs are generating large amounts of multidimensional array data.Queries with value and dimension subsetting conditions are commonly used by scientists to find useful information from big array data,and data storage and indexing methods play an important role in supporting queries on multidimensional array data efficiently.In this paper,we propose SwiftArray,a new storage layout with indexing techniques to accelerate queries with value and dimension subsetting conditions.In SwiftArray,the multidimensional array is divided into blocks and each block stores sorted values.Blocks are placed in the order of a Hilbert space-filling curve to improve data locality for dimension subsetting queries.We propose a 2-D-Bin method to build an index for the blocks’value ranges,which is an efficient way to avoid accessing unnecessary blocks for value subsetting queries.Our evaluations show that SwiftArray surpasses the NetCDF-4 format and FastBit indexing technique for queries on multidimensional arrays.

英文摘要:

Scientific instruments and simulation programs are generating large amounts of multidimensional array data. Queries with value and dimension subsetting conditions are commonly used by scientists to find useful information from big array data, and data storage and indexing methods play an important role in supporting queries on multidimensional array data efficiently. In this paper, we propose SwiftArray, a new storage layout with indexing techniques to accelerate queries with value and dimension subsetting conditions. In SwiftArray, the multidimensional array is divided into blocks and each block stores sorted values. Blocks are placed in the order of a Hilbert space-filling curve to improve data locality for dimension subsetting queries. We propose a 2-D-Bin method to build an index for the blocks' value ranges, which is an efficient way to avoid accessing unnecessary blocks for value subsetting queries. Our evaluations show that SwiftArray surpasses the NetCDF-4 format and FastBit indexing technique for queries on multidimensional arrays.

同期刊论文项目
同项目期刊论文
期刊信息
  • 《计算机学报》
  • 北大核心期刊(2011版)
  • 主管单位:中国科学院
  • 主办单位:中国计算机学会 中国科学院计算技术研究所
  • 主编:孙凝晖
  • 地址:北京中关村科学院南路6号
  • 邮编:100190
  • 邮箱:cjc@ict.ac.cn
  • 电话:010-62620695
  • 国际标准刊号:ISSN:0254-4164
  • 国内统一刊号:ISSN:11-1826/TP
  • 邮发代号:2-833
  • 获奖情况:
  • 中国期刊方阵“双效”期刊
  • 国内外数据库收录:
  • 美国数学评论(网络版),荷兰文摘与引文数据库,美国工程索引,美国剑桥科学文摘,日本日本科学技术振兴机构数据库,中国中国科技核心期刊,中国北大核心期刊(2004版),中国北大核心期刊(2008版),中国北大核心期刊(2011版),中国北大核心期刊(2014版),中国北大核心期刊(2000版)
  • 被引量:48433