随着短信息应用的普及,用户、运营商及政府管理部门均迫切需要智能短信处理工具。语料库是研究算法,开发系统,测试性能等必不可少的基础资源。但受到技术、版权保护、隐私权利等种种原因,目前还没有公开的标准短信息语料库。SMS-2008标注短信息库是本项目组在国内外率先建立的多用途中文短信息语料库,它包括原始语料库、预处理语料库、隐私标注语料库、内容标注语料库、错误标注语料库等。该语料库可用于短信语言现象研究、短信分类过滤算法研究、隐私保护算法研究、自动纠错算法研究等。
With the popularity of short messages, smart SMS tools are urgently demanded by users, operators and government departments. However, there is no open standard SMS corpus, which is an indispensable resource for the algorithm research, system development and performance test etc, due to the technology, the copyright protection, the privacy right and other various reasons. SMS-2008, as an annotated Chinese SMS Corpus, takes the lead in establishing a multi-purpose Chinese text message corpus, which includes the original corpus, privacy tagged corpus, content tagged corpus, errors tagged corpus. This Corpus can be applied in the research of SMS language, SMS classification, privacy protection algorithm or automatically correcting system.