在对大数据分析平台研究的基础上,根据国内外大数据测试的研究现状和在交通信息大数据分析平台测试中遇见的问题,对大数据测试技术进行了深入研究.首先分析了大数据测试的特点和难点,分析了在Hadoop处理过程各个阶段测试的主要特点与挑战;然后从功能测试和非功能测试两个方面,分析了大数据分析系统的测试方法.针对于大数据的“4V”特性,分析了测试的难点和解决方案,分析了对于具体业务背景的大数据分析系统在测试前期需要的准备工作和测试环境的搭建要注意的问题;讨论了现有的大数据测试基准及大数据测试中常用的测试工具;分析了大数据自动化测试的技术框架,并研究了在此框架内需解决的关键技术.最后分析讨论了大数据测试技术值得进一步研究的主题.
This paper intensively studied the big data testing technique according to the test problems in big data analysis platform for traffic information.Firstly it analyzed the characteristics and difficulties of big data testing,as well as the main characteristics and challenges of testing in each Hadoop processing stage.Secondly,it analyzed the testing method for big data analytics system from two aspects of functional testing and non-functional testing.Thirdly,according to the "4V" characteristics of big data,this paper analyzed the difficulties and solutions for testing,the preparations needed for big data analytics system testing under specific business background and issues of setup of testing environment.Fourthly,it gave out the existing benchmarking and common test tools for big data.Then,it analyzed the automatic testing framework for big data and studied the key techniques demanded to solve on the framework.Finally,it discussed the big data testing technology should be worth further research.