###
计算机系统应用英文版:2022,31(10):295-302
←前一篇   |   后一篇→
本文二维码信息
码上扫一扫!
基于孪生网络和字词向量结合的文本相似度匹配
(青岛科技大学 信息科学技术学院, 青岛 266061)
Similar Text Matching Based on Siamese Network and Char-word Vector Combination
(College of Information Science and Technology, Qingdao University of Science & Technology, Qingdao 266061, China)
摘要
图/表
参考文献
相似文献
本文已被:浏览 1319次   下载 6032
Received:January 21, 2022    Revised:February 22, 2022
中文摘要: 文本相似度匹配是许多自然语言处理任务的基础, 本文提出一种基于孪生网络和字词向量结合的文本相似度匹配方法, 采用孪生网络的思想对文本整体建模, 实现两个文本的相似性判断. 首先, 在提取文本特征向量时, 使用BERT和WoBERT模型分别提取字和词级别的句向量, 将二者结合使句向量具有更丰富的文本语义信息; 其次, 针对特征信息融合过程中出现的维度过大问题, 加入PCA算法对高维向量进行降维, 去除冗余信息和噪声干扰; 最后, 通过Softmax分类器得到相似度匹配结果. 通过在LCQMC数据集上的实验表明, 本文模型的准确率和F1值分别达到了89.92%和88.52%, 可以更好地提取文本语义信息, 更适合文本相似度匹配任务.
Abstract:Text similarity matching is the basis of many natural language processing tasks. This study proposes a text similarity matching method based on a Siamese network and char-word vector combination. The method adopts the idea of the Siamese network to model the overall text so that the text similarity can be determined. First, when text feature vectors are extracted, BERT and WoBERT models are used to extract character-level and word-level sentence vectors which are then combined to have richer text semantic information. If the dimension is too large during feature information fusion, the principal component analysis (PCA) algorithm is employed for the dimension reduction of high-dimensional vectors to remove the interference of redundant information and noise. Finally, the similarity matching result is obtained through the Softmax classifier. The experimental results on the LCQMC dataset show that the accuracy and F1 score of the model in this study reach 89.92% and 88.52%, respectively, which can better extract text semantic information and is more suitable for text similarity matching tasks.
文章编号:     中图分类号:    文献标志码:
基金项目:
引用文本:
李奕霖,周艳平.基于孪生网络和字词向量结合的文本相似度匹配.计算机系统应用,2022,31(10):295-302
LI Yi-Lin,ZHOU Yan-Ping.Similar Text Matching Based on Siamese Network and Char-word Vector Combination.COMPUTER SYSTEMS APPLICATIONS,2022,31(10):295-302