本文首先提出一种改进的X^2统计量,以此衡量词条对文本分类的贡献。然后根据模式聚合理论,将对各文本类分类贡献比例相近似的词条聚合为一个特征,建立出文本集的特征向量空间模型。此方法有效地降低了文本特征向量空间的维数。最后使用决策树进行分类,从而既保证了分类精度又获得了决策树易于抽取可理解的分类规则的优势。
In this paper, an improved X^2 statistic is given, which is used to measure contribution for categorization. The new method establishes the text vector space model in terms of the improved X^2 statistic and the theory of pattern aggregation, which merges some words as a new feature that has the approximate proportion of contribution for categorization, and so largely reduces the dimension of the vector space. And then, the decision tree is applied to text categorization. Both the understandable categorization rules and better accuracy of categorization can be acquired.