[논문]CNN 보조 손실을 이용한 차원 기반 감성 분석

전민진; 황지원; 김종우

doi:10.13088/jiis.2021.27.4.001

CNN 보조 손실을 이용한 차원 기반 감성 분석
Target-Aspect-Sentiment Joint Detection with CNN Auxiliary Loss for Aspect-Based Sentiment Analysis 원문보기

지능정보연구 = Journal of intelligence and information systems, v.27 no.4, 2021년, pp.1 - 22

전민진 (한양대학교 파이낸스경영학과) , 황지원 (한양대학교 경영학부) , 김종우 (한양대학교 경영대학 경영학부)

초록
AI-Helper

텍스트를 바탕으로 한 차원 기반 감성 분석(Aspect-Based Sentiment Analysis)은 다양한 산업에서 유용성을 주목을 받고 있다. 기존의 차원 기반 감성 분석에서는 타깃(Target) 혹은 차원(Aspect)만을 고려하여 감성을 분석하는 연구가 대다수였다. 그러나 동일한 타깃 혹은 차원이더라도 감성이 나뉘는 경우, 또는 타깃이 없지만 감성은 존재하는 경우 분석 결과가 정확하지 않다는 한계가 존재한다. 이러한 문제를 해결하기 위한 방법으로 차원과 타깃을 모두 고려한 감성 분석(Target-Aspect-Sentiment Detection, 이하 TASD) 모델이 제안되었다. 그럼에도 불구하고, TASD 기존 모델의 경우 구(Phrase) 간의 관계인 지역적인 문맥을 잘 포착하지 못하고 초기 학습 속도가 느리다는 문제가 있었다. 본 연구는 TASD 분야 내 기존 모델의 한계를 보완하여 분석 성능을 높이고자 하였다. 이러한 연구 목적을 달성하기 위해 기존 모델에 합성곱(Convolution Neural Network) 계층을 더하여 차원-감성 분류 시 보조 손실(Auxiliary loss)을 추가로 사용하였다. 즉, 학습 시에는 합성곱 계층을 통해 지역적인 문맥을 좀 더 잘 포착하도록 하였으며, 학습 후에는 기존 방식대로 차원-감성 분석을 하도록 모델을 설계하였다. 본 모델의 성능을 평가하기 위해 공개 데이터 집합인 SemEval-2015, SemEval-2016을 사용하였으며, 기존 모델 대비 F1 점수가 최대 55% 증가했다. 특히 기존 모델보다 배치(Batch), 에폭(Epoch)이 적을 때 효과적으로 학습한다는 것을 확인할 수 있었다. 본 연구에서 제시된 모델로 더욱 더 세밀한 차원 기반 감성 분석이 가능하다는 점에서, 기업에서 상품 개발 및 마케팅 전략 수립 등에 다양하게 활용할 수 있으며 소비자의 효율적인 구매 의사결정을 도와줄 수 있을 것으로 보인다.

Abstract ▼ AI-Helper

Aspect Based Sentiment Analysis (ABSA), which analyzes sentiment based on aspects that appear in the text, is drawing attention because it can be used in various business industries. ABSA is a study that analyzes sentiment by aspects for multiple aspects that a text has. It is being studied in various forms depending on the purpose, such as analyzing all targets or just aspects and sentiments. Here, the aspect refers to the property of a target, and the target refers to the text that causes the sentiment. For example, for restaurant reviews, you could set the aspect into food taste, food price, quality of service, mood of the restaurant, etc. Also, if there is a review that says, "The pasta was delicious, but the salad was not," the words "steak" and "salad," which are directly mentioned in the sentence, become the "target." So far, in ABSA, most studies have analyzed sentiment only based on aspects or targets. However, even with the same aspects or targets, sentiment analysis may be inaccurate. Instances would be when aspects or sentiment are divided or when sentiment exists without a target. For example, sentences like, "Pizza and the salad were good, but the steak was disappointing." Although the aspect of this sentence is limited to "food," conflicting sentiments coexist. In addition, in the case of sentences such as "Shrimp was delicious, but the price was extravagant," although the target here is "shrimp," there are opposite sentiments coexisting that are dependent on the aspect. Finally, in sentences like "The food arrived too late and is cold now." there is no target (NULL), but it transmits a negative sentiment toward the aspect "service." Like this, failure to consider both aspects and targets - when sentiment or aspect is divided or when sentiment exists without a target - creates a dual dependency problem. To address this problem, this research analyzes sentiment by considering both aspects and targets (Target-Aspect-Sentiment Detection, hereby TASD). This study detected the limitations of existing research in the field of TASD: local contexts are not fully captured, and the number of epochs and batch size dramatically lowers the F1-score. The current model excels in spotting overall context and relations between each word. However, it struggles with phrases in the local context and is relatively slow when learning. Therefore, this study tries to improve the model's performance. To achieve the objective of this research, we additionally used auxiliary loss in aspect-sentiment classification by constructing CNN(Convolutional Neural Network) layers parallel to existing models. If existing models have analyzed aspect-sentiment through BERT encoding, Pooler, and Linear layers, this research added CNN layer-adaptive average pooling to existing models, and learning was progressed by adding additional loss values for aspect-sentiment to existing loss. In other words, when learning, the auxiliary loss, computed through CNN layers, allowed the local context to be captured more fitted. After learning, the model is designed to do aspect-sentiment analysis through the existing method. To evaluate the performance of this model, two datasets, SemEval-2015 task 12 and SemEval-2016 task 5, were used and the f1-score increased compared to the existing models. When the batch was 8 and epoch was 5, the difference was largest between the F1-score of existing models and this study with 29 and 45, respectively. Even when batch and epoch were adjusted, the F1-scores were higher than the existing models. It can be said that even when the batch and epoch numbers were small, they can be learned effectively compared to the existing models. Therefore, it can be useful in situations where resources are limited. Through this study, aspect-based sentiments can be more accurately analyzed. Through various uses in business, such as development or establishing marketing strategies, both consumers and sellers will be able to make efficient decision

주제어

표/그림 (10)

그림 BERT architecture for Text Classification(Devlin et al. 2018)
그림 The architecture and a running example for the TAS-BERT model(Hai Wan et al. 2020)
그림 Example of Sentences that TAS-BERT failed to predict
그림 The overall process of the proposed model
그림 The architecture and a running example for the proposed model 'BERT with CNN Auxiliary Loss'
표 SemEval Dataset
표 Statistic about the number of aspect, sentiment labels per sentence of dataset
표 Data pre-processing based on aspect-sentiment pairs
표 Model performance (F1-score) comparison based on batch size
표 Model performance(F1-score) comparison based on epoch

참고문헌 (32)

Ahn, C. a
Azhar, A. N., M. L. Khodra, "Fine-tuning Pretrained Multilingual BERT Model for Indonesian Aspect-based Sentiment Analysis", ArXiv, Vol.1, (2021).
Banerjee, P., K. K. Pal, F. Wang, C. Baral, "Variable Name Recovery in Decompiled Binary Code using Constrained Masked Language Modeling", ArXiv, Vol.1, (2021).
Brun, C., and V. Nikoulina, "Aspect based sentimentanalysis into the wild", WASSA@EMNLP, Vol.1, (2018), 116~122.
Chaybouti, S., A. Saghe, A. Shabou, "MIX : a Multi-task Learning Approach to Solve Open-Domain Question Answering Edit social preview", Arxiv, Vol.2, (2021).
Devlin, J., M. W. Chang, K. Lee, and K. Toutanova, "BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding", arXiv, Vol.2, 1810.04805(2018).
He, R.; W. S. Lee, H. T. Ng, and D. Dahlmeier, "An unsupervised neural attention model for aspect extraction", ACL, Vol.1, (2017), 388~397.
Khezrian, N., J. Habibi, I. Annamoradnejad, "Tag Recommendation for Online Q&A Communities based on BERT Pre-Training Technique", ArXiv, Vol.1, (2020).
Kim, Y., "Convolutional Neural Networks for Sentence Classification", EMNLP, Vol.1, (2014), 1746~1751.
Kiritchenko, S., X. Zhu, C. Cherry, and S. Mohammad, "Detecting aspects and sentiment in customer reviews", SemEval@COLING, Vol.1, (2014), 437~442.
LeCun, Y., B. Boser, J. S. Denker, D. Henderson, R. E. Howard, W. Hubbard, L. D. Jackel, "Backpropagation Applied to Handwritten Zip Code Recognition", MIT Press, Vol.1, (1989), 541~551.
Lee, J., "Sentiment Analysis based on Korean using Recurrent Neural Network: focused on Online Movie Review", Graduate School of Kookmin University, (2018).
Lee, J., "Sentimental Analysis Research Trends", KIPS, No.25, (2018), 358~361.
Li, X.; L. Bing, P. Li, and W. Lam, "A unified model for opinion target extraction and target sentiment prediction.", AAAI, Vol.1, (2019), 6714~6721.
Ma, Y.; H. Peng, and E. Cambria, "Targeted aspect-based sentiment analysis via embedding commonsense knowledge into an attentive LSTM", AAAI, (2018), 5876~5883.
Moon, H.C, A. Yang, and J.G. Kim, "CNN-Based Hand Gesture Recognition for Wearable Applications", Journal of Broadcast Engineering, (2018), 246~252.
Movahedi, S., E, Ghadery, H. Faili, and A. Shakery, "Aspect Category Detection via Topic-Attention Network", ArXiv, (2019).
Pontiki, M., D. Galanis, H. Papageorgiou, S. Manandhar and I. Androutsopoulos, "Semeval-2015 task 12: Aspect based sentiment analysis", SemEval, Vol.1, (2015), 486~495.
Pontiki, M., D. Galanis, H. Papageorgiou, S. Manandhar and I. Androutsopoulos, S. Manandhar, M. Al-Smadi, M. Al-Ayyoub, Y. Zhao, B. Qin, O. D. Clercq, V. Hoste, M. Apidianaki, N. V. Tannier, X.; Loukachevitch, E. V. Kotelnikov, N. Bel, S. M. J. Zafra and G. Eryigit, "Semeval-2016 task 5: Aspect based sentiment analysis", SemEval, Vol.1, (2016), 19~30.
Raj, D., S.K. Sahu, and A. Anand. "Learning Local and Global Contexts Using a Convolutional Recurrent Network Model for Relation Classification in Biomedical Text", CoNLL, (2017), Vol. 1, 311~321.
Schmitt, M., S. Steinheber, K. Schreiber and B. Roth, "Joint aspect and polarity classification for aspect-based sentiment analysis with end-to-end neural networks", EMNLP, Vol.1(2018), 1109~1114.
Seo, S. and J. Kim, "Sentimental Analysis Research Trends based on Deep Learning", KMMS, Vol.3, No.25 (2016), 8~22.
She, X., D. Zhang, "Text Classification Based on Hybrid CNN-LSTM Hybrid Model", ISCID, (2018), 185~189.
Sun, C., L. Huang, and X. Qiu, "Utilizing BERT for Aspect-Based Sentiment Analysis via Constructing Auxiliary Sentence", NAACL-HLT, Vol.1, (2019), 380~385.
Vaswani A., N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, L. Kaiser and I. Polosukhin, "Attention Is All You Need", arXiv, Vol.5, (2017).
Wan, H., Y. Yang, J. Du, Y. Liu, K. Qi, and J. Z. Pan, "Target-Aspect-Sentiment Joint Detection for Aspect-Based Sentiment Analysis", AAAI, Vol.34, No.5(2020), 9122~9129.
Wang, Y., M. Huang, X. Zhu and L. Zhao, "Attention-based LSTM for aspect-level sentiment classification", EMNLP, Vol.1, (2016), 606~615.
Wyk, G. J. v., and A. S. Bosman, "Evolutionary Neural Architecture Search for Image Restoration", IJCNN, Vol.2, (2019).
Xenos, D., P. Theodorakakos, J. Pavlopoulos, P. Malakasiotis, and I. Androutsopoulos, "Ensembles of Classifiers and Embeddings for Aspect Based Sentiment Analysis", SemEval@NAACL-HLT, Vol.1, (2016), 312~317.
Xue, W. and T. Li, "Aspect based sentiment analysis with gated convolutional networks", ACL, Vol.1, (2018), 2514~2523.
Xue, W., W. Zhou, T. Li and Q. Wang, "A Neural Multi-task Model for Aspect Category Classification And Aspect Term Extraction on RestaurantReviews", IJCNLP, Vol.2, (2017), 151~156.
Yan, H., J. Dai, T. Ji, X. Qiu and Z. Zhang, "A Unified Generative Framework for Aspect-Based Sentiment Analysis", arXiv preprint arXiv:2106.04300, (2021).

저자의 다른 논문 :

표제어: PCR

동의어: Packet Collision Rate

용어 설명 출처 목록 (6)

용어 설명: PCR은 세균 특이성이 있는 primer를 이용하여 적은 수의 세균이 있을지라도 쉽게 검출할 수 있는 유용한 방법이며, 이를 이용하여 구강 내 치면세균막이나 타액에서 직접 세균을 검출할 수 있게 되었다[8].

내보내기 구분	파일저장 인쇄 메일전송
구성항목	기본정보 상세정보 관리번호, 논문명, 저널/프로시딩명, 저자 , 발행년, 권, 호, 시작페이지, 끝페이지, 발행기관 관리번호, 논문명, 대등논문명, 저자 , 저널/프로시딩명, 발행기관, 발행년, 발행언어, 권, 호, 시작페이지, 끝페이지, ISBN, ISSN, 주제분야, 키워드, 초록(한글), 초록(영문), 저자(소속기관)
저장형식	Text(ASCII format) Excel format RefWorks Direct Export RIS format (for Reference Manager, ProCite, EndNote), Scholar's Aids, Mendeley
메일정보	받는사람 (필수) @ 보내는사람 (선택) @ 제목 내용 KISTI 검색결과 이메일 서비스
안내	총 건의 자료가 검색되었습니다. 다운받으실 자료의 인덱스를 입력하세요. (1-10,000) 검색결과의 순서대로 최대 10,000건 까지 다운로드가 가능합니다. 데이타가 많을 경우 속도가 느려질 수 있습니다.(최대 2~3분 소요) 다운로드 파일은 UTF-8 형태로 저장됩니다. 파일의 내용이 제대로 보이지 않을실 때는 웹브라우저 상단의 보기 -> 인코딩 -> 자동선택 여부를 확인하십시오. ~ Text(ASCII format) Excel format

연합인증