文章以sina微博为研究对象,分析研究了微博舆情分析中提取微博信息转发路径的方法,并获得在微博信息转发过程中起关键作用的微博用户。系统主要使用网络爬虫框架进行数据采集,采用多账户多线程分布式技术,可以绕过sina微博反爬虫机制的功能,具有较高的稳定性和高效性。在研究转发路径提取方法整个过程中,需要经历爬取微博转发网页信息、提取转发信息、转发信息预处理、构造转发路径树等步骤。通过对微博转发路径信息的提取和组织成树形结构信息,就可以实现在网页中显示微博的转发图。最后通过对Page Rank算法的改进,实现了计算用户传播影响力的算法设计,能够快速评估在微博整个转发传播过程中用户的转发影响力。
In this paper, taking the sina microblog as the study, the method of extracting forwarding path of microblog information is analyzed, and microblogging users who play a key role in the process of micro-blogging message forwarding can be obtained. By utilizing multiple accounts and distributed multi-thread technology, the new network crawler frame used in this system can bypass the sina microblog anti crawler mechanism function and has high stability and high effi ciency. There are several steps when researching the extracting method of forwading path, including crawling forwarding webpage information of microblog, extracting the message forwarding information, preprocessing the forward information, constructing the forwarding path tree, etc. The system can show the spread graph of a microblog message forwarding by extracting and organizing the path forwarding information to tree state structure information. Finally, the system implements the algorithm of calculating the user,s spreading infl uence, and can quickly estimate the user's infl uence in the whole process of the forwarding and propagation of the microblog by improving the Page Rank algorithm.