详细信息

基于构成模式和条件随机场的企业简称预测    

Enterprise abbreviation prediction based on constitution pattern and conditional random field

文献类型:期刊文献

中文题名:基于构成模式和条件随机场的企业简称预测

英文题名:Enterprise abbreviation prediction based on constitution pattern and conditional random field

作者:孙丽萍[1];过弋[1,2];唐文武[1];徐永斌[1]

机构:[1]华东理工大学信息科学与工程学院,上海200237;[2]石河子大学信息科学与技术学院,新疆石河子832007

年份:2016

卷号:36

期号:2

起止页码:449

中文期刊名:计算机应用

外文期刊名:journal of Computer Applications

收录:CSTPCD;;北大核心:【北大核心2014】;CSCD:【CSCD_E2015_2016】;

基金:国家自然科学基金资助项目(61462073;61272198)~~

语种:中文

中文关键词:企业简称;构成模式;简称预测;核心词识别;条件随机场

外文关键词:enterprise abbreviation; constitution pattern; abbreviation prediction; core word recognition; Conditional Random Field(CRF)

摘要:针对目前企业营销的不断深入,企业简称被各大新闻广泛使用,而作为新词又难以被有效识别的问题,提出一种基于构成模式和条件随机场(CRF)的企业简称预测方法。首先,从语言学的角度对企业全称和简称的构成规律进行了总结,并采用词库以及规则相结合的方式对Bi-gram算法进行改进,提出CBi-gram算法,实现了对企业全称的结构化切分,并提高了企业全称中核心词识别的准确性。然后,依据上述切分结果对企业类型进行再次细分,并通过人工总结和规则自学习的方法形成不同企业类型下的简称规则集。最后再基于规则生成企业的候选简称集,降低了不适用的规则对于不同类型的企业在生成简称过程中产生的噪声。另外,为了弥补单纯基于规则在解决全称缩写和简写缩写混合的局限性,引入CRF,从统计的角度对简称进行预测,并选取词、音调以及词在全称组成成分中的位置作为模型特征,进行模型训练,以实现两种方法的相互补充。实验结果显示,该方法具有较高的准确率,输出的企业简称集基本覆盖了企业的常用简称范围。
With the continuous development of enterprise marketing, the enterprise abbreviation has been widely used.Nevertheless, as one of the main sources of unknown words, the enterprise abbreviation can not be effectively identified. A methodology on predicting enterprise abbreviation based on constitution pattern and Conditional Random Field( CRF) was proposed. First, the constitution patterns of enterprise name and abbreviation were summarized from the perspective of linguistics, and the Bi-gram algorithm was improved by a combination of lexicon and rules, namely CBi-gram. CBi-gram algorithm was used to realize the automatic segmentation of the enterprise name and improve the recognition accuracy of the company's core word. Then the enterprise type was subdivided by CBi-gram, and the abbreviation rule sets were collected by artificial summary and self-learning method to reduce noise caused by unsuitable rules. Besides, in order to make up the limitations of artificial building rules on abbreviations and mixed abbreviation, the CRF was introduced to generate enterprise abbreviation statistically, and word, tone and word position were used as characteristics to train model as supplementary. The experimental results show that the method exhibites a good performance and the output can fundamentally cover the usual range of enterprise abbreviations.

参考文献:

正在载入数据...

版权所有©华东理工大学 重庆维普资讯有限公司 渝B2-20050021-7 
渝公网安备 50019002500408号 违法和不良信息举报中心