汉语四字格的能产性和派生性极强,利用四字格模式创造出的新词数量在现代汉语词汇中一直呈上升趋势。该文将研究的目光投向分词语料库中的四字格,对语料库中的四字格进行了系统的分类和归纳,并对语料库内部和语料库之间的四字格切分不一致现象进行了详细的调查统计。最后,针对四字格的切分不一致数据引入条件随机场(CRF)模型,对多语料库中的汉语四字格进行识别实验,封闭测试和开放测试的识别精度均达到93%以上。
The productive and derivative of four-character idioms are extremely high,the use of four-character pattern to create new words in the vocabulary of modern Chinese is still on the rise.This article looks into the eyes of the large number of four-character idioms in word-segmented corpora,and works on the four-character idioms in corpora for analysis and induction.Then this article works on the segmented comparison of four-character idioms both in single segmented corpora and between different segmented corpora.Finally,through the introduction of CRF statistical model,and take the results of segmented comparison of four-character idioms as training corpora,this article develops the research of the recognition of four-character idioms in corpora.Recognition results show the accuracy of four-character idioms can reach more than 93%in both closed test and open test.