为应对用电信息大数据存储和处理的挑战,构建了关系数据库与Mongo DB数据库混合存储的云存储架构。首先,根据用电数据存储容量和速率的需求,提出基于Mongo DB的前置通信平台大数据存储机制,并从数据存储、可用性、均衡策略和读写分离4个方面分析了其中的关键技术和优化机制。然后,针对目前Mongo DB数据均衡策略的不足,结合数据节点负载的差异,对均衡策略进行优化,实现了数据量和负载的动态均衡。前置通信平台的实践应用分析验证了基于Mongo DB的大数据存储机制具有高并发读写性能和良好的可行性。
To deal with challenges of large electricity information data storage and processing, a cloud storage architecture mixing relational database with Mongo DB database is built. According to demands of electricity data storage capacity and rate, large data storage mechanism for front communication platform based on Mongo DB is presented, and key technology and optimization mechanism are analyzed in four aspects, i.e. data storage, availability, balancing distribution and read/write splitting. For shortcomingsin Mongo DB data equilibrium strategy and load difference between data nodes, equilibriumis optimized to realize dynamic equilibrium of data volume and load. Practical application confirms that big data storage mechanism based on Mongo DB applied in front communication platform has good feasibility and high concurrent read and write performance.