位置:成果数据库 > 期刊 > 期刊详情页
FARMER:A novel approach to file access correlation mining and evaluation reference model
  • ISSN号:1000-1239
  • 期刊名称:《计算机研究与发展》
  • 时间:0
  • 分类:TP316.81[自动化与计算机技术—计算机软件与理论;自动化与计算机技术—计算机科学与技术] TP273.2[自动化与计算机技术—控制科学与工程;自动化与计算机技术—检测技术与自动化装置]
  • 作者机构:[1]Computer College, Huazhong University of Science and Technology, Wuhan 430074, P. R. China, [2]Wuhan National Laboratory for Optoelectronic, Wuhan 430074, P. R. China
  • 相关基金:Project supported by the National Basic Research Program of China (Grant Nos. 2004CB318201,2011CB302300); the US National Science Foundation (Grant No. CCF-0621526); the National Natural Science Foundation of China (Grant No. 60703046); HUST-SRF (Grant No.2007Q021B)Acknowledgments We are especially grateful to JUAN Wang and YU Hua for valuable feedback, support and discussions. We appre- ciate CHEN Chen for his help. We are grateful to M1 the members of our Laboratory, for their continuous support.
中文摘要:

文件语义在优化大规模证明了有效分布式的文件系统。作为在上面的层应用程序和文件系统之间的精致、富有的 I/O 接口的后果,文件系统能提供有用、深刻的信息关于语义。因此,文件语义采矿在工程和研究社区成为了一个日益重要的惯例。不幸地,利用文件是挑战语义知识因为许多因素能影响这信息探索,处理。甚至更坏,挑战由于在这些因素之间的复杂互相依赖被加重,并且使充分在各种各样的语义知识之中利用潜在地重要的关联困难。在文件在向量以内被当作一个 multivariate 向量空格,和每个项目的地方,这篇文章建议文件存取关联 miming 和评估引用(农民) 模型通信给定的文件的一个分开的因素。因素的选择取决于申请,因素的例子是文件路径,创造者和执行节目。如果一个特别因素发生在两个文件,它的值是非零。内部文件的关系的程度能在语义向量基于他们的因素价值的相似被测量,是清楚的。从这个模型,的利益农民代表组织了标识符,和基本向量操作的向量的文件能被利用确定在二文件向量之间的文件关联。农民模型利用线性回归模型估计在文件关联和一套影响因素之间的关系的力量以便坏知识能被滤出。为了表明新农民模型,的能力,农民作为案例研究被合并到一个真实大规模基于目标的存储系统动态地推断文件关联。另外使农民能优化服务因为预取算法和对象数据布局算法的元数据被实现。当时,是使农民能的预取算法的试验性的结果表演被显示由近似 30%40% 减少元数据操作潜伏与预取算法和一条通常使用的代替政策的一个最先进的元数据相比。

英文摘要:

File semantic has proven effective in optimizing large scale distributed file system.As a consequence of the elaborate and rich I/O interfaces between upper layer applications and file systems,file system can provide useful and insightful information about semantic.Hence,file semantic mining has become an increasingly important practice in both engineering and research community.Unfortunately,it is a challenge to exploit file semantic knowledge because a variety of factors coulda ffect this information exploration process.Even worse,the challenges are exacerbated due to the intricate interdependency between these factors,and make it difficult to fully exploit the potentially important correlation among various semantic knowledges.This article proposes a file access correlation miming and evaluation reference(FARMER) model,where file is treated as a multivariate vector space,and each item within the vector corresponds a separate factor of the given file.The selection of factor depends on the application,examples of factors are file path,creator and executing program.If one particular factor occurs in both files,its value is non-zero.It is clear that the extent of inter-file relationships can be measured based on the likeness of their factor values in the semantic vectors.Benefit from this model,FARMER represents files as structured vectors of identifiers,and basic vector operations can be leveraged to quantify file correlation between two file vectors.FARMER model leverages linear regression model to estimate the strength of the relationship between file correlation and a set of influencing factors so that the "bad knowledge" can be filtered out.To demonstrate the ability of new FARMER model,FARMER is incorporated into a real large-scale object-based storage system as a case study to dynamically infer file correlations.In addition FARMER-enabled optimize service for metadata prefetching algorithm and object data layout algorithm is implemented.Experimental results show that is FARMER-enabled prefetching al

同期刊论文项目
同项目期刊论文
期刊信息
  • 《计算机研究与发展》
  • 中国科技核心期刊
  • 主管单位:中国科学院
  • 主办单位:中国科学院计算技术研究所
  • 主编:徐志伟
  • 地址:北京市科学院南路6号中科院计算所
  • 邮编:100190
  • 邮箱:crad@ict.ac.cn
  • 电话:010-62620696 62600350
  • 国际标准刊号:ISSN:1000-1239
  • 国内统一刊号:ISSN:11-1777/TP
  • 邮发代号:2-654
  • 获奖情况:
  • 2001-2007百种中国杰出学术期刊,2008中国精品科...,中国期刊方阵“双效”期刊
  • 国内外数据库收录:
  • 俄罗斯文摘杂志,荷兰文摘与引文数据库,美国工程索引,日本日本科学技术振兴机构数据库,中国中国科技核心期刊,中国北大核心期刊(2004版),中国北大核心期刊(2008版),中国北大核心期刊(2011版),中国北大核心期刊(2014版),中国北大核心期刊(2000版)
  • 被引量:40349