针对Delay算法的不合理等待问题,提出一种基于资源预测的Delay调度算法(RFD),该算法基于对资源可用性的预测方法合理地调度作业.实验结果表明,在Hadoop机群一般应用场景下,该调度算法与已有算法相比,在保证作业本地化计算Map任务比例相近的同时,将作业平均运行效率提高28.8%,明显提高了Mapreduee作业的执行效率.
In order to solve the unreasonable wait existed in delay algorithm, this paper presents a method based on resource forecast delay scheduling algorithm, by which one reasonably dispatches operation on the basis of resource availability prediction method. The experimental results show that in the Hadoop cluster general application scenario, the scheduling algorithm, compared with related work, makes the average operating efficiency increased by a factor of 28.8% in the assurance of localization computing map task to be similar. This work will greatly improve the working efficiencY of Mapreduce.