语料库是自然语言处理NLP(natural language processing)的基础,其标注质量影响着基于有指导机器学习方法的NLP系统的性能。针对汉语句法树库,提出了一种基于不一致查找树库潜在标注错误的方法,该方法主要从两方面进行不一致检测:一是从类似短语内部构成并结合可疑度来检测不一致;二是从标注大纲入手,检测词性、短语等各类标记符号与大纲定义不符合的情况。实验结果表明,在查找到的不一致现象中,存在一定数量的语料库标注错误。
Corpora are fundamental to natural language processing( NLP) and corpus annotation quality influences the performance of the systems based on supervised machine learning approaches. Aiming at Chinese treebank,an approach was proposed to find potential errors based on inconsistencies. Inconsistencies were detected with two strategies: one uses similar internal structure and suspicious degree,the other uses the annotation guideline to check those annotations,which don't meet the definitions of the guideline. Experimental results showthat there are some annotation errors in the inconsistencies.