| 基于组合度的汉语分词决策算法研究 |
| |
| 引用本文： | 刘利东.基于组合度的汉语分词决策算法研究[J].德州学院学报,2003,19(2):65-70. |
| |
| 作者姓名： | 刘利东 |
| |
| 作者单位： | 德州学院计算机系,山东,德州,253023 |
| |
| 摘 要： | 提出了汉字组合的组合度概念，讨论了组合度与组合的成词能力之间的关系，利用决策树的方法挖掘了组合度与分词模板的关系．在此基础上得出了一种新的分词算法．实验表明组合度对组合成词能力的影响远远大于组合频率的影响．这种分词方法对汉语分词的歧义问题、人名、地名识别问题；新词识别问题等都有一定的作用．
|
| 关 键 词： | 汉语信息处理 汉语自动分词 组合度 汉语分词决策算法 分词模板 决策树 |
| 文章编号： | 1004-9444(2003)02-0065-03 |
| 修稿时间： | 2002年9月13日 |
Chinese word segmentation arithmetic based on the degree of combination |
| |
| LIU Li-dong.Chinese word segmentation arithmetic based on the degree of combination[J].Journal of Dezhou University,2003,19(2):65-70. |
| |
| Authors: | LIU Li-dong |
| |
| Abstract: | In this paper, we put forward the conception of combination degree about Chinese word; discussed the relationship between combination degree and the to_binded word capacities; proposed the method of Chinese word segmentation by means of combination degree and word segmentation template. Experiments show that this method can better solve the problem of different meaning in Chinese word segmentation, recognition of person and place name as well as new words. |
| |
| Keywords: | Chinese word segmentation combination degree to_binded word capacities word segment template |
| 本文献已被 CNKI 维普 万方数据 等数据库收录！ |
