特征降维与分类算法的性能是文本自动分类的两个主要问题。KNN算法以其简单、有效、非参数特点常用于文本分类,但是训练文本分布的不均匀对KNN的分类效果产生负面影响,而在实际应用中训练文本分布不均是常见现象。本文针对这种分类环境,首先提出了一种改进的tf-idf赋权方法用于特征降维,在此基础上进一步提出了一种基于密度的改进KNN方法用于文本分类,使处于样本点分布较密集区域的样本点之间的距离增大。随后的文本分类试验表明,本文提出的方法基于密度的KNN方法具有较好的文本分类效果。
Feature reduction and performance of classification algorithm are the two main problems in automatic text categorization. The KNN is a simple, valid and non-parameter method often applied to text categorization, but the uneven distribution in training set will affect the KNN classified result negatively. However, the uneven distribution environment is more familiar in training set in reality. Under the condition we first put forward an improved tf- idfweighting way in feature reduction; then we improve the KNN based on density in automatic text categorization by adding the distance of training swatches which in the dense area. In the last, we have a test about text categorization. The result shows that these methods have a better precision than the common KNN