中文摘要：

本文重点围绕HDFS机架感知和副本存放策略方面对HDFS分布式存储进行剖析。副本存放策略和机架感知主要通过Datanode节点形成的树状网络拓扑图来让Namenode节点获取,从而确定副本存放的位置,这种方式保证了对于数据的极高的容错性的同时也兼顾了数据本地化,即提高了数据在集群网络中的传输效率。基于此,提出一个设想,希望通过对副本存放策略的深入挖掘,根据Datanode数据节点的实时状态信息,实现对于数据块副本的定向存储,再由数据驱动任务分配,来为每一个Datanode数据节点分配更适合的任务,从而达到负载均衡提高资源利用率的作用。

英文摘要：

This article focuses on the strategy of Replication Target Chooser and Rack-Awareness to analyze HDFS distributed storage. To realize the strategy of Replication Target Chooser and Rack-Awareness,the HDFS forms a network topology tree of Datanode primarily to let Namenode nodes determine the location of replication,in such a way to ensure that for extremely high data fault tolerance while taking into account the data locally,and to improve the efficiency of data transmission in the cluster network. Based on this,the paper proposes an idea,hope to learn more of the strategy of Replication Target Chooser,based on real-time status information Datanode nodes to achieve the orientation for the data block,data-driven task redistribution to Datanode data for each node assign tasks better suited to achieve the effect of load balancing and improve resource utilization.