HPMR(high performance MapReduce)系统是一个采用MapReduce模型的高性能计算软件支撑平台.在进行高性能计算时,HPMR往往需要很多轮Map-Reduce过程,中间的通信过程由KV路由和KV传输组成.KV传输依照KV路由阶段产生的KV路由表进行.HPMR程序的典型通信特征是每一轮的KV传输以高概率使用上一轮的KV路由表.根据这一特点,提出在HPMR的通信模型中引入推测执行技术,由此减少了KV路由的次数,使得HPMR的通信性能得到大大地提升.
HPMR (high performance MapReduce)system is a high performance computing software supporting platform.It is common for HPMR to do many rounds of the Map-Reduce process in high performance computing.The middle communication process consists of KV routing and KV transfer.KV transfer is carried out with the help of the KV table generated by KV routing.The notable feature of communication in HPMR program is that each round of KV transfer adopts the KV table of the last round with high probability.In view of to this characteristic,speculation execution technology is introduced into the communication model of HPMR,which reduces the number of KV routings and greatly enhances communication performance of HPMR.