[논문]A Robust Channel Access Using Cooperative Reinforcement Learning for Congested Vehicular Networks

Choe, Chungjae; Ahn, Jangyong; Choi, Junsung; Park, Dongryul; Kim, Minjun; Ahn, Seungyoung

doi:10.1109/access.2020.3011568

[해외논문] A Robust Channel Access Using Cooperative Reinforcement Learning for Congested Vehicular Networks 원문보기

IEEE access : practical research, open solutions, v.8, 2020년, pp.135540 - 135557

Choe, Chungjae (The CCS Graduate School of Green Transporation, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, South Korea) , Ahn, Jangyong (The CCS Graduate School of Green Transporation, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, South Korea) , Choi, Junsung (The CCS Graduate School of Green Transporation, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, South Korea) , Park, Dongryul (The CCS Graduate School of Green Transporation, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, South Korea) , Kim, Minjun (Korea Aerospace Research Institute (KARI), Daejeon, South Korea) , Ahn, Seungyoung (The CCS Graduate School of Green Transporation, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, South Korea)

Abstract ▼ AI-Helper

Vehicular Ad-hoc Network (VANET) is an emerging technique dedicated to wireless vehicular communication to improve transportation safety by exchanging driving information between vehicles. For safety purposes, vehicles periodically broadcast a safety packet via Vehicle-to-Vehicle (V2V) communication. Accordingly, VANET safety applications demand a reliable exchange of the safety packet with high Packet Delivery Ratio (PDR), acceptable latency, and communication fairness. However, the communication performance significantly degrades due to numerous packet collisions when a large number of vehicles simultaneously access limited channel resources for the safety broadcast. In particular, the problem grows more severe in congested VANETs absent infrastructures since vehicles must control channel access using a self-adaptive scheme without external assistance. Thus, a robust and decentralized channel access protocol for VANETs is required to achieve road safety. In this paper, we propose an intelligent channel access algorithm empowered by cooperative Reinforcement Learning (RL), in which vehicles coordinate the channel access in a fully-decentralized manner. We also consider a proper interaction scheme between vehicles for enhancing the V2V safety broadcast in infrastructure-less congested VANETs. We provide evaluation results with extensive simulations according to various levels of traffic congestion. Simulations confirm the superior performance of the algorithm: the algorithm has a 20% increase in PDR compared to the latest RL-based channel access scheme. Furthermore, the algorithm satisfies the low latency requirement of VANET safety applications as well as both short-term and long-term communication fairness.

참고문헌 (49)

Monahan, George E.. State of the Art-A Survey of Partially Observable Markov Decision Processes: Theory, Models, and Algorithms. Management science, vol.28, no.1, 1-16.

상세보기
Goodman, Jonathan, Greenberg, Albert G., Madras, Neal, March, Peter. Stability of binary exponential backoff. Journal of the Association for Computing Machinery, vol.35, no.3, 579-602.

상세보기
10.1109/VTCFall.2018.8690643
10.1145/1161064.1161066
10.1109/VNC.2009.5416394
Zhang, Xinming, Jiang, Xinghe, Zhang, Mengdi. A Black-Burst Based Time Slot Acquisition Scheme for the Hybrid TDMA/CSMA Multichannel MAC in VANETs. IEEE wireless communications letters, vol.8, no.1, 137-140.

상세보기
Xu, Zhigang, Li, Xiaochi, Zhao, Xiangmo, Zhang, Michael H., Wang, Zhongren. DSRC versus 4G-LTE for Connected Vehicle Applications: A Study on Field Experiments of Vehicular Communication Performance. Journal of advanced transportation, vol.2017, 1-10.

상세보기
10.1109/WD.2017.7918118
Sybis, Michał, Vukadinovic, Vladimir, Rodziewicz, Marcin, Sroka, Paweł, Langowski, Adrian, Lenarska, Karolina, Wesołowski, Krzysztof. Communication Aspects of a Modified Cooperative Adaptive Cruise Control Algorithm. IEEE transactions on intelligent transportation systems : a publication of the IEEE Intelligent Transportation Systems Council, vol.20, no.12, 4513-4523.

상세보기
Li, Ming, Zeng, Kai, Lou, Wenjing. Opportunistic broadcast of event-driven warning messages in Vehicular Ad Hoc Networks with lossy links. Computer networks, vol.55, no.10, 2443-2464.

상세보기
10.1109/VTCSpring.2018.8417803
Nguyen, Vandung, Khanh, Tran Trong, Oo, Thant Zin, Tran, Nguyen H., Huh, Eui-Nam, Hong, Choong Seon. A Cooperative and Reliable RSU-Assisted IEEE 802.11P-Based Multi-Channel MAC Protocol for VANETs. IEEE access : practical research, open solutions, vol.7, 107576-107590.

상세보기
10.1109/VTCFall.2018.8690786
Ma, Xiaomin, Chen, Xianbo, Refai, Hazem H. Performance and Reliability of DSRC Vehicular Safety Communication: A Formal Analysis. EURASIP journal on wireless communications and networking, vol.2009, 969164-.

상세보기
Kenney, John B.. Dedicated Short-Range Communications (DSRC) Standards in the United States. Proceedings of the IEEE, vol.99, no.7, 1162-1182.

상세보기
Pressas, Andreas, Sheng, Zhengguo, Ali, Falah, Tian, Daxin. A Q-Learning Approach With Collective Contention Estimation for Bandwidth-Efficient and Fair Access Control in IEEE 802.11p Vehicular Networks. IEEE transactions on vehicular technology, vol.68, no.9, 9136-9150.

상세보기
Tseng, Y.-C., Ni, S.-Y., Chen, Y.-S., Sheu, J.-P.. The Broadcast Storm Problem in a Mobile Ad Hoc Network. Wireless networks, vol.8, no.2, 153-168.

상세보기
Seuken, Sven, Zilberstein, Shlomo. Formal models and algorithms for decentralized decision making under uncertainty. Autonomous agents and multi-agent systems, vol.17, no.2, 190-250.

상세보기
10.1109/CDC.2018.8619581
arXiv 1802 08757 Fully decentralized multi-agent reinforcement learning with networked agents zhang 2018
Nature Human-level control through deep reinforcement learning mnih 2015 10.1038/nature14236 518 529

상세보기
Proc 34th Int Conf Mach Learn A distributional perspective on reinforcement learning bellemare 2017 449
Wu, Di, Ling, Yan, Zhu, Hongsong, Liang, Jie. The RSU Access Problem Based on Evolutionary Game Theory for VANET. International journal of distributed sensor networks, vol.9, no.7, 143024-.

상세보기
Kim, Jae Hyun; Lee, Jong Kyu etc. "Performance of Carrier Sense Multiple Access with Collision Avoidance Protocols in Wireless LANs." Wireless personal communications, v.11 no.2 (1999), pp. 161-183, doi:10.1023/A:1018350821500.
10.1109/VETECF.2007.461
10.1109/ICC.2016.7511574
VanDung Nguyen, Thant Zin Oo, Tran, Nguyen H., Choong Seon Hong. An Efficient and Fast Broadcast Frame Adjustment Algorithm in VANET. IEEE communications letters : a publication of the IEEE Communications Society, vol.21, no.7, 1589-1592.

상세보기
10.1109/ISCC.2017.8024608
10.1109/ICCChina.2018.8641195
Liu, Xiaofeng, Jaekel, Arunita. Congestion Control in V2V Safety Communication: Problem, Analysis, Approaches. Electronics, vol.8, no.5, 540-.

상세보기
Reinforcement Learning An Introduction sutton 2018
Proc IEEE Consum Commun Netw Conf (CCNC) A MAC protocol for delay-sensitive VANET applications with self-learning contention scheme wu 2014 438
10.1109/VNC.2017.8275614
10.1145/1330107.1330140
Hafeez, Khalid Abdel, Lian Zhao, Ma, Bobby, Mark, Jon W.. Performance Analysis and Enhancement of the DSRC for VANET's Safety Applications. IEEE transactions on vehicular technology, vol.62, no.7, 3069-3083.

상세보기
Nguyen, Vandung, Kim, Oanh Tran Thi, Pham, Chuan, Oo, Thant Zin, Tran, Nguyen H., Hong, Choong Seon, Huh, Eui-Nam. A Survey on Adaptive Multi-Channel MAC Protocols in VANETs Using Markov Models. IEEE access : practical research, open solutions, vol.6, 16493-16514.

상세보기
Nguyen, VanDung, Pham, Chuan, Oo, Thant Zin, Tran, Nguyen H., Huh, Eui-Nam, Hong, Choong Seon. MAC protocols with dynamic interval schemes for VANETs. Vehicular communications, vol.15, 40-62.

상세보기
Hadded, Mohamed, Muhlethaler, Paul, Laouiti, Anis, Zagrouba, Rachid, Saidane, Leila Azouz. TDMA-Based MAC Protocols for Vehicular Ad Hoc Networks: A Survey, Qualitative Analysis, and Open Research Issues. IEEE Communications surveys and tutorials, vol.17, no.4, 2461-2492.

상세보기
10.1109/WiSPNET.2017.8300131
A quantitative measure of fairness and discrimination for resource allocation in shared computer systems jain 1984
Gao, Zhenguo, Chen, Danjie, Yao, Nianmin, Lu, Zhimao, Chen, Bingcai. A Novel Problem Model and Solution Scheme for Roadside Unit Deployment Problem in VANETs. Wireless personal communications, vol.98, no.1, 651-663.

상세보기
Xiaomin Ma, Jinsong Zhang, Tong Wu. Reliability Analysis of One-Hop Safety-Critical Broadcast Services in VANETs. IEEE transactions on vehicular technology, vol.60, no.8, 3933-3946.

상세보기
Phys Rev E Stat Phys Plasmas Fluids Relat Interdiscip Top Metastable states in a microscopic model of traffic flow krauß 1997 55 5597
Abbas, Taimoor, Sjöberg, Katrin, Karedal, Johan, Tufvesson, Fredrik. A Measurement Based Shadow Fading Model for Vehicle-to-Vehicle Network Simulations. International journal of antennas and propagation, vol.2015, 1-12.

상세보기
Song, Yoo-Seung, Choi, Hyun-Kyun. Analysis of V2V Broadcast Performance Limit for WAVE Communication Systems Using Two-Ray Path Loss Model. ETRI journal, vol.39, no.2, 213-221.

원문보기 상세보기
10.1109/PIMRC.2011.6140062
10.1109/NOMS.2018.8406219
10.1109/WD.2012.6402853
Proc ACM Int Conf Modeling Anal and Sim of Wireless and Mobile Syst ns-3 meets openai gym: The playground for machine learning in networking research gaw?owicz 2019 113

LOADING...

활용도 분석정보

상세보기

다운로드

내보내기

활용도 Top5 논문

해당 논문의 주제분야에서 활용도가 높은 상위 5개 콘텐츠를 보여줍니다.
더보기 버튼을 클릭하시면 더 많은 관련자료를 살펴볼 수 있습니다.

원문 보기

AccessON 원문보기

원문 URL 링크

DOI : 10.1109/ACCESS.2020.3011568 [무료]
IEEE : 저널 > 논문 [무료]
AccessON : 저널

*원문 PDF 파일 및 링크정보가 존재하지 않을 경우 KISTI DDS 시스템에서 제공하는 원문복사서비스를 사용할 수 있습니다.

오픈액세스(OA) 유형

GOLD

오픈액세스 학술지에 출판된 논문

저작권 관리 안내

내보내기 메뉴

내보내기 구분

파일저장
인쇄
메일전송

구성항목

기본정보
상세정보

관리번호, 논문명, 저널/프로시딩명, 저자 , 발행년, 권, 호, 시작페이지, 끝페이지, 발행기관

저장형식

Text(ASCII format)
Excel format
RefWorks Direct Export
RIS format (for Reference Manager, ProCite, EndNote), Scholar's Aids, Mendeley

메일정보

받는사람 (필수): @
보내는사람 (선택): @
제목
내용: KISTI 검색결과 이메일 서비스

안내

총 건의 자료가 검색되었습니다.

다운받으실 자료의 인덱스를 입력하세요. (1-10,000)

검색결과의 순서대로 최대 10,000건 까지 다운로드가 가능합니다.

데이타가 많을 경우 속도가 느려질 수 있습니다.(최대 2~3분 소요)

다운로드 파일은 UTF-8 형태로 저장됩니다.
파일의 내용이 제대로 보이지 않을실 때는 웹브라우저 상단의 보기 -> 인코딩 -> 자동선택 여부를 확인하십시오.

Text(ASCII format)
Excel format

표제어: PCR

동의어: Packet Collision Rate

용어 설명 출처 목록 (6)

용어 설명: PCR은 세균 특이성이 있는 primer를 이용하여 적은 수의 세균이 있을지라도 쉽게 검출할 수 있는 유용한 방법이며, 이를 이용하여 구강 내 치면세균막이나 타액에서 직접 세균을 검출할 수 있게 되었다[8].

AI-Helper ※ AI-Helper는 을 사용합니다.

AI-Helper

안녕하세요, AI-Helper입니다. 좌측 "선택된 텍스트"에서 텍스트를 선택하여 요약, 번역, 용어설명을 실행하세요.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.

연합인증