基于CNN和B-LSTM的文本处理模型研究
Research on text processing model based on CNN and B-LSTM
-
摘要: 针对文本情感分类准确率不高的问题，在卷积神经网络CNN和栈式双向长短时记忆网络B-LSTM的基础上，提出了一种新的情感分析训练模型CNN-B-LSTM.该模型利用CNN的卷积操作对词向量进行处理，提取词向量的强度特征，再输入到B-LSTM中进行上层建模，对句子进行处理.结果表明：CNN-B-LSTM模型的情感分类准确率比CNN和B-LSTM模型更高，差错率大约分别降低了4%和1%，具有一定的效果优势.
-
关键词:
- 文本情感分类 /
- 卷积神经网络 /
- 长短时记忆网络 /
- PaddlePaddle
Abstract: Aiming at the problem of low accuracy of text sentiment classification, CNN-B-LSTM, a new sentiment analysis training model based on CNN and B-LSTM was presented. The convolution operation processed the word vector to extract the intensity characteristics of the word vector, and then inputed it into the B-LSTM to perform the upper level modeling and used it to process the sentences.The results showed that the proposed CNN-B-LSTM model had higher sentiment classification accuracy,the error rates decreased by 4% and 1%,respectively.It was superior to B-LSTM and CNN models in sentiment classification.-
Key words:
- text sentiment classification /
- CNN /
- LSTM /
- PaddlePaddle
-
-
[1]
王雪娇.基于深度学习的文本情感分析[D].长春:吉林大学,2016.
-
[2]
YU H,HATZIVASSILOGLOU V.Towards answering opinion questions:separating facts from opinions and identifying the polarity of opinion sentences[C]//Proceedings of Conference on Empirical Methods in Natural Language Processing,Sapporo:ACL,2003:129.
-
[3]
BUDANITSKY A,HIRST G.Evaluating wordnet-based measures of lexical semantic relatedness[J].Computational Linguistics,2006,32(1):13.
-
[4]
VELIKOVICH L,BLAIR-GOLDENSOHN S,HANNAN K,et al.The viability of web-derived polarity lexicons[C]//Proceedings of Annual Conference of the North American Chapter of the Association for Computational Linguistics,Los Angeles:NAACL,2010:777.
-
[5]
PANG B,LEE L,VAITHYANATHAN S.Thumbs up sentiment classification using machine learning techniques[C]//Proceedings of Conference on Empirical Methods in Natural Language Processing,Philadelphia:ACL,2002:79.
-
[6]
KIM S M,HOVY E H.Automatic identification of pro and con reasons in online reviews[C]//Proceedings of the Meeting of the Association for Computational Linguistics,Sydney:ACL 2006:483.
-
[7]
READ J,CARROLL J.Weakly supervised techniques for domain-independent sentiment classification[C]//Proceedings of Conference on Information and Knowledge Management,Hongkong:ACL,2009:45.
-
[8]
BENGIO Y,DUCHARME R,VINCENT P,et al.A neural probabilistic language model[J].The Journal of Machine Learning Research,2003(3):1137.
-
[9]
HOCHREITER S,SCHMIDHUBER J.Long short-term memory[J].Neural Computarion,1997,9(8):1735.
-
[10]
COLLOBERT R,WESTON J.A unified architecture for natural language processing:deep neural networks with multitask learning[C]//Proceedings of International Conference on Machine learning,Helsinki:ICML,2008:160.
-
[11]
KIM Y.Convolutional neural networks for sentence classification[C]//Proceedings of Empirical Methods in Natural Language Processing,Doha:ACL,2014:1746.
-
[1]
-
点击查看大图
计量
- PDF下载量: 8
- 文章访问数: 1352
- 引证文献数: 0
下载:
