为了克服训练样本不足、获取大量标注样本费时费力的问题,在基于不确定选择策略的基础上,提出了一种新的基于分层选择策略的主动学习方法。使用新提出的选择策略从大量无标注的样本中选择最有价值的样例,进行标注后加入到训练集中来训练分词器。最后在PKU、MSR和山西大学数据集上进行测试,并与不确定选择策略进行比较。结果表明提出的分层选择策略在相同大小的训练语料下可以获得更高的分词准确率,同时还降低了人工标注的代价。
To solve the problems of lacking of training samples and accessing a large number of labeled samples laborious,this paper proposed one fresh active learning segmentation method based on stratified sampling strategy. The method used the stratified sampling strategy to select the most useful instances to annotate from unlabeled samples. Next,it put the annotated instances into the labeled set and then trained the segmenter using the set. Finally the method tested in PKU,MSR and Shanxi university corpora and compared with the uncertainty sampling strategy. The experimental result shows that the stratified selection strategy can improve the accuracy of segmentation in the same size training corpus,at the same time reduce the cost of manual annotation effectively.