基于信任机制设计了一种无须特征选择的高效的线性文本分类方法。面向特征与文档类的信任关系,使用bata概率密度函数评估特征的可靠度,提出特征对文档类的忠诚度的计算模型,基于忠诚度实现简单的线性文本分类器。采用20Newsgroup、复旦中文分类语料、SEWM2007评测语料等3个具有典型特征的单标签语料集,以朴素贝叶斯、KNN为比照算法进行了比较实验。实验结果表明,相对于传统算法,该算法分类性能显著提高,对不均匀语料和高维特征处理表现出很强的稳定性,同时算法执行速度快,适于大规模文本分类。
A text categorization approach based on trust mechanism design is discussed,which is linear as well as no need of feature se-lection.The trust relation between feature and document class is analyzed.By using beta probability density function feature reliability,calculation model of loyalty degree is presented.Furthermore,linear text classifier is realized based on loyalty degree.In the experiments,Naive Bayes and KNN are selected as two comparison classifiers,and 20Newsgroup,Fudan Chinese evaluation data collection and SEWM2007 research corpus data are used to evaluate the effectiveness of the techniques proposed.The experimental results show the method could improve significantly the performance for text categorization,is suitable for large-scale text categorization and contributes a good solution for the difficulties of text categorization,such as high dimension characteristic of feature,in homogeneity of corpus and execution efficiency.