基于SVM的维吾尔文文本分类研究
阿力木江·艾沙;吐尔根·依布拉音;库尔班·吾布力;艾山·吾买尔
【期刊名称】《计算机工程与科学》 【年(卷),期】2012(034)012
【摘要】The automatic text categorization technique has important practical significance and broad application prospect in improving the validity and accuracy of the use of text information. With the rapid increase of Uyghur language text information on the Internet, Uyghur language text categorization has become a key technique of processing and organizing these text data. As to the high dimensionality of Uyghur language text under vector space model representation, the stemming technique is used along with x2 to reduce the dimensionality. Uyghur language text categorizer is constructed based on SVM. The experimental results based on Uyghur language text corpus show that the MacroFl value of SVM categorizer can reach 84. 6% and outperform the kNN approach.%文本自动分类技术在提高文本信息利用的有效性和准确性上具有重要的现实意义和广阔的应用前景.随着Internet上维吾尔文信息的迅速发展,维吾尔文文本分类成为处理和组织这些大量文本数据的关键技术.研究维吾尔文文本分类相关技术和方法,针对维吾尔文文本在向量空间模型表示下的高维性,本文采用词干提取和x2统计量相结合的方法对表示空间进行降维.采用SVM算法构造了维吾尔文文本分类器.针对维吾尔文文本分类语料进行的实验结果表明,SVM分类器的MacroF1值达到了84.6％,明显好于kNN方法.
基于SVM的维吾尔文文本分类研究
