[논문]Syntax Vector Learning Using Correspondence for Natural Language Understanding

Seo, Hyein; Jung, Sangkeun; Hwang, Taewook; Kim, Hyunji; Roh, Yoon-Hyung

doi:10.1109/access.2021.3087271

[해외논문] Syntax Vector Learning Using Correspondence for Natural Language Understanding 원문보기

IEEE access : practical research, open solutions, v.9, 2021년, pp.84067 - 84078

Seo, Hyein (Chungnam National University, Daejeon, South Korea) , Jung, Sangkeun (Chungnam National University, Daejeon, South Korea) , Hwang, Taewook (Chungnam National University, Daejeon, South Korea) , Kim, Hyunji (Chungnam National University, Daejeon, South Korea) , Roh, Yoon-Hyung (Electronics and Telecommunications Research Institute, Daejeon, South Korea)

Abstract ▼ AI-Helper

Natural language understanding (NLU) is a core technique for implementing natural user interfaces. In this study, we propose a neural network architecture to learn syntax vector representation by employing the correspondence between texts and syntactic structures. For representing the syntactic structures of sentences, we used three methods: dependency trees, phrase structure trees, and part of speech tagging. A pretrained transformer is used to propose text-to-vector and syntax-to-vector projection approaches. The texts and syntactic structures are projected onto a common vector space, and the distances between the two vectors are minimized according to the correspondence property to learn the syntax representation. We conducted massive experiments to verify the effectiveness of the proposed methodology using Korean corpora, i.e., Weather, Navi, and Rest, and English corpora, i.e., the ATIS, SNIPS, Simulated Dialogue-Movie, Simulated Dialogue-Restaurant, and NLU-Evaluation datasets. Through the experiments, we concluded that our model is quite effective in capturing a syntactic representation and the learned syntax vector representations are useful.

참고문헌 (26)

10.18653/v1/P16-1139
Proc Korea Comput Congr Measuring the syntactic similarity between Korean sentences using lee 2016 792
Maillard, Jean, Clark, Stephen, Yogatama, Dani. Jointly learning sentence embeddings and syntax with unsupervised Tree-LSTMs. Natural language engineering, vol.25, no.4, 433-449.

상세보기
Proc Korea Softw Congr Semantic vector learning using pretrained bert kim 2019 1427
10.3115/116580.116612
arXiv 1805 10190 Snips voice platform: An embedded spoken language understanding system for private-by-design voice interfaces coucke 2018
arXiv 1801 04871 Building a conversational agent overnight with dialogue self-play shah 2018
Proc 10th Int Workshop Spoken Dialogue Syst Technol (IWSDS) Benchmarking natural language understanding services for building conversational agents liu 2019
Advances in neural information processing systems Pytorch: An imperative style, high-performance deep learning library paszke 2019 8024
arXiv 1910 03771 HuggingFace’s transformers: State-of-the-art natural language processing wolf 2019
Jung, Sangkeun. Semantic vector learning for natural language understanding. Computer speech & language, vol.56, 130-145.

상세보기
arXiv 1909 11942 ALBERT: A lite BERT for self-supervised learning of language representations lan 2019
10.3115/v1/P15-1150
10.18653/v1/K18-1013
10.18653/v1/P16-1231
Hochreiter, Sepp, Schmidhuber, Jürgen. Long Short-Term Memory. Neural computation, vol.9, no.8, 1735-1780.

상세보기
arXiv 1907 11692 RoBERTa: A robustly optimized BERT pretraining approach liu 2019
arXiv 1803 11175 Universal sentence encoder cer 2018
arXiv 1810 04805 BERT: Pre-training of deep bidirectional transformers for language understanding devlin 2018
10.3115/1073083.1073135
Proc LREC Universal Stanford dependencies: A cross-linguistic typology marneffe 2014 14 4585
Proc Workshop ACL Text Summarization Branches Out ROUGE: A package for automatic evaluation of summaries lin 2004 74
10.18653/v1/2020.emnlp-main.18
Straightforward Statistics for the Behavioral Sciences evans 1996
10.1145/3292500.3330701
Advances in neural information processing systems XLNet: Generalized autoregressive pretraining for language understanding yang 2019 32

LOADING...

활용도 분석정보

상세보기

다운로드

내보내기

활용도 Top5 논문

해당 논문의 주제분야에서 활용도가 높은 상위 5개 콘텐츠를 보여줍니다.
더보기 버튼을 클릭하시면 더 많은 관련자료를 살펴볼 수 있습니다.

원문 보기

AccessON 원문보기

원문 URL 링크

DOI : 10.1109/ACCESS.2021.3087271 [무료]
IEEE : 저널 > 논문 [무료]
AccessON : 저널

*원문 PDF 파일 및 링크정보가 존재하지 않을 경우 KISTI DDS 시스템에서 제공하는 원문복사서비스를 사용할 수 있습니다.

오픈액세스(OA) 유형

GOLD

오픈액세스 학술지에 출판된 논문

저작권 관리 안내

내보내기 메뉴

내보내기 구분

파일저장
인쇄
메일전송

구성항목

기본정보
상세정보

관리번호, 논문명, 저널/프로시딩명, 저자 , 발행년, 권, 호, 시작페이지, 끝페이지, 발행기관

저장형식

Text(ASCII format)
Excel format
RefWorks Direct Export
RIS format (for Reference Manager, ProCite, EndNote), Scholar's Aids, Mendeley

메일정보

받는사람 (필수): @
보내는사람 (선택): @
제목
내용: KISTI 검색결과 이메일 서비스

안내

총 건의 자료가 검색되었습니다.

다운받으실 자료의 인덱스를 입력하세요. (1-10,000)

검색결과의 순서대로 최대 10,000건 까지 다운로드가 가능합니다.

데이타가 많을 경우 속도가 느려질 수 있습니다.(최대 2~3분 소요)

다운로드 파일은 UTF-8 형태로 저장됩니다.
파일의 내용이 제대로 보이지 않을실 때는 웹브라우저 상단의 보기 -> 인코딩 -> 자동선택 여부를 확인하십시오.

Text(ASCII format)
Excel format

표제어: PCR

동의어: Packet Collision Rate

용어 설명 출처 목록 (6)

용어 설명: PCR은 세균 특이성이 있는 primer를 이용하여 적은 수의 세균이 있을지라도 쉽게 검출할 수 있는 유용한 방법이며, 이를 이용하여 구강 내 치면세균막이나 타액에서 직접 세균을 검출할 수 있게 되었다[8].

AI-Helper ※ AI-Helper는 을 사용합니다.

AI-Helper

안녕하세요, AI-Helper입니다. 좌측 "선택된 텍스트"에서 텍스트를 선택하여 요약, 번역, 용어설명을 실행하세요.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.

연합인증