文本聚类是信息检索的重要内容。为了避免使用计算过程复杂的聚类算法,并能从语言学角度对聚类特征和聚类结果进行分析和解释,该文提出了采用句法分布信息进行文本聚类的方法。在汉语依存树库中,得出10种具有显著差异的词类依存关系,以其中5种依存关系作为聚类特征,访谈会话类和新闻播报类文本的相似度分别为71.98%和83.13%。实验结果验证了该方法利用依存关系对文本聚类的可行性和有效性。
Text clustering is of substantial importance to information retrieval.The method of applying the information of syntactic distribution to text clustering is presented,in order to avoid the complex clustering algorithm whileenabling the linguistic interpretation of clustering features and the results of clustering.According to the dependency Treebank,ten dependency relations are suggested with distinctive distribution between oral and written Chinese By using five of them as clustering feature,the similarity of spoken and written classes achieves 71.98% and 83.13%,respectively.The experiment result shows that the proposed method of applying dependency relations to text clustering is feasible and effective.