根据统计结果,从阅读角度对网页页面空间的构成进行了噪声与信息实体的划分与判断,改进了传统的DOM模型,增加了层次与样式等属性作为噪声判断的依据,逐级降噪,并利用新闻的标题、时间等外显特性,提出并实现了一种结合正向直接抽取与反向过滤降噪抽取新闻网页得到结构化数据的方法,并使用这种方法进行了大范围的效果验证。验证结果表明:这种方法信息抽取准确率高,对中英文新闻网页都有良好的适用性。
According to the statistical result of the website of news, estimate and partition of the webpage's noise and information entity based on space structure are provided from the visual point of reading. It improved the traditional DOM model, increased hierarchies and form attributes as the basis to noise judgment, and gradually reduced the noise. Using the extrinsic characteristics of the news, such as titles and report time, a method is proposed and achieved, which could combine positive extract web pages and gain structured data. The positive extract method through the prescient information borderline grab the useful information. The inverse yawp filter uses the filter rules to reduce the range of the matching. A large scale validation to the effect of extraction is ac- complished by using this combining method. The results showed a high rate of accuracy. The information collected on the applicability of English and Chinese news website is good.