[논문]Deep Q-network-based traffic signal control models

Park, Sangmin; Han, Eum; Park, Sungho; Jeong, Harim; Yun, Ilsoo

doi:10.1371/journal.pone.0256405

[해외논문] Deep Q-network-based traffic signal control models 원문보기

PLoS ONE, v.16 no.9, 2021년, pp.e0256405 -

Park, Sangmin (Department of Transportation System Engineering, Ajou University, Suwon, Republic of Korea) , Han, Eum (Department of Transportation Engineering Research, Korea Road Traffic Authority, Wonju-si, Republic of Korea) , Park, Sungho (Department of Transportation System Engineering, Ajou University, Suwon, Republic of Korea) , Jeong, Harim (Department of Transportation System Engineering, Ajou University, Suwon, Republic of Korea) , Yun, Ilsoo (Department of Transportation System Engineering, Ajou University, Suwon, Republic of Korea)

Abstract ▼ AI-Helper

Traffic congestion has become common in urban areas worldwide. To solve this problem, the method of searching a solution using artificial intelligence has recently attracted widespread attention because it can solve complex problems such as traffic signal control. This study developed two traffic signal control models using reinforcement learning and a microscopic simulation-based evaluation for an isolated intersection and two coordinated intersections. To develop these models, a deep Q-network (DQN) was used, which is a promising reinforcement learning algorithm. The performance was evaluated by comparing the developed traffic signal control models in this research with the fixed-time signal optimized by Synchro model, which is a traffic signal optimization model. The evaluation showed that the developed traffic signal control model of the isolated intersection was validated, and the coordination of intersections was superior to that of the fixed-time signal control method.

참고문헌 (19)

1 Han E , Lee H , Park S , So J , Yun I . Optimal Signal Control Algorithm for Signalized Intersections under a V2I Communication Environment . J Adv Transp . 2019 ; 2019 : 1 – 9 . Available from: https://www.hindawi.com/journals/jat/2019/6039741/

상세보기
2 Stevanovic A , Martin PT . Split-Cycle Offset Optimization Technique and Coordinated Actuated Traffic Control Evaluated through Microsimulation . Transportation Research Record . 2008 ; 2080 ( 1 ): 48 – 56 . doi: 10.3141/2080-06

상세보기
3 Park B , Yun I , Ahb K . Stochastic Optimization for Sustainable Traffic Signal Control , International Journal of Sustainable Transportation . 2019 ; 3 : 4 , 263 – 284 , doi: 10.1080/15568310802091053

상세보기
4 Yun I , Park B . Stochastic Optimization for Coordinated Actuated Traffic Signal Systems , 2012 ; Vol. 138 , Issue 7 : 819 – 829 , 10.1061/(ASCE)TE.1943-5436.0000384

상세보기
5 Sutton R , Barto A . Reinforcement Learning an Introduction . 1st ed. Cambridge : The MIT Press ; 1998
6 Sutton R , Barto A . Reinforcement Learning an Introduction . 2nd ed. Cambridge : The MIT Press ; 2017
7 Lapan M . Deep Reinforcement Learning Hands-On . Packt ; 2018 .
8 Minih V , Kavukcuoglu K , Silver D , Rusu A , Veness J , Bellemare M , et al . Human-level control through deep reinforcement learning . Nature . 2015 ; 518 : 529 – 533 . Available from: https://www.nature.com/articles/nature14236 doi: 10.1038/nature14236 25719670

상세보기
9 Li L . Traffic Signal Timing via Deep Reinforcement Learning . IEEE/CAA J Automatica Sin . 2016 ; 3 : 247 – 254 . doi: 10.1109/JAS.2016.7508798 Available from: https://ieeexplore.ieee.org/document/7508798

상세보기
10 Van der Pol E. Deep Reinforcement Learning for Coordination in Traffic Light Control. M.Sc. Thesis, University of Amsterdam. 2006. Available from: https://esc.fnwi.uva.nl/thesis/centraal/files/ f632158773.pdf
11 Genders W , Razavi S . Using a Deep Reinforcement Learning Agent for Traffic Signal Control . arXiv:1611.01142v1 . 2016 . Available from: https://arxiv.org/abs/1611.01142
12 Jin J , Ma X . A Group-based Traffic Signal Control with Adaptive Learning Ability . Eng Appl Artif Intell . 2017 ; 65 : 282 – 293 . doi: 10.1016/j.engappai.2017.07.022 Available from: https://www.sciencedirect.com/science/article/pii/S0952197617301707

상세보기
13 Gao J , Shen Y , Liu J , Ito M , Shiratori N . Adaptive Traffic Signal Control: Deep Reinforcement Learning Algorithm with Experience Replay and Target Network . arXiv:1705.02755v1 . Available from: https://arxiv.org/abs/1705.02755
14 Wang X , Yang X , Liu Y , Liang H . Evaluation and Application of Urban Traffic Signal Optimizing Control Strategy Based on Reinforcement Learning . J Adv Transp . 2018 ; 2018 : 1 – 9 . Available from: https://www.hindawi.com/journals/jat/2018/3631489/

상세보기
15 Zheng G , Xiong Y , Xang X , Feng J , Wei H . Learning Phase Competition for Traffic Signal Control . arXiv:1905.04722v1 , 2019 . Available from: https://arxiv.org/abs/1905.04722
16 Zhao Y , Ma J , Shen L , Qian Y . Optimizing the Junction-Tree-Based Reinforcement Learning Algorithm for Network-Wide Signal Coordination . J Adv Transp . 2020 ; 2020 : 1 – 11 . Available from: https://www.hindawi.com/journals/jat/2020/6489027/

상세보기
17 Zhao J. , Knoop V. L. , & Wang M. ( 2020 ). Two-dimensional vehicular movement modelling at intersections based on optimal control . Transportation Research Part B: Methodological , 138 , 1 – 22 . Available from: 10.1016/j.trb.2020.04.001

상세보기
18 Abdulhai Baher ., Pringle R. , Karakoulas G. J. , Reinforcement Learning for True Adaptive Traffic Signal Control , Journal of Transportation Engineering , Vol. 129 , Iss. 3 , pp. 278 – 285 , 2003 . Available from: 10.1061/(ASCE)0733-947X(2003)129:3(278)

상세보기
19 El-Tantawy S. , Abdulhai B. , and Abdelgawad H. , " Design of Reinforcement Learning Parameters for Seamless Application of Adaptive Traffic Signal Control ," Journal of Intelligent Transportation Systems , vol. 18 , no. 3 , pp. 227 – 245 , 2014 . Available from: 10.1080/15472450.2013.810991

상세보기

LOADING...

활용도 분석정보

상세보기

다운로드

내보내기

활용도 Top5 논문

해당 논문의 주제분야에서 활용도가 높은 상위 5개 콘텐츠를 보여줍니다.
더보기 버튼을 클릭하시면 더 많은 관련자료를 살펴볼 수 있습니다.

원문 보기

AccessON 원문보기

원문 URL 링크

DOI : 10.1371/journal.pone.0256405 [무료]
Public Library of Science (PLoS) : 저널
EBSCOhost-Academic Search Premier : 저널
AccessON : 저널

*원문 PDF 파일 및 링크정보가 존재하지 않을 경우 KISTI DDS 시스템에서 제공하는 원문복사서비스를 사용할 수 있습니다.

오픈액세스(OA) 유형

GOLD

오픈액세스 학술지에 출판된 논문

이 논문과 함께 이용한 콘텐츠

[논문] Transferable traffic signal control: Reinforcement learning with graph centric state representation

저작권 관리 안내

내보내기 메뉴

내보내기 구분

파일저장
인쇄
메일전송

구성항목

기본정보
상세정보

관리번호, 논문명, 저널/프로시딩명, 저자 , 발행년, 권, 호, 시작페이지, 끝페이지, 발행기관

저장형식

Text(ASCII format)
Excel format
RefWorks Direct Export
RIS format (for Reference Manager, ProCite, EndNote), Scholar's Aids, Mendeley

메일정보

받는사람 (필수): @
보내는사람 (선택): @
제목
내용: KISTI 검색결과 이메일 서비스

안내

총 건의 자료가 검색되었습니다.

다운받으실 자료의 인덱스를 입력하세요. (1-10,000)

검색결과의 순서대로 최대 10,000건 까지 다운로드가 가능합니다.

데이타가 많을 경우 속도가 느려질 수 있습니다.(최대 2~3분 소요)

다운로드 파일은 UTF-8 형태로 저장됩니다.
파일의 내용이 제대로 보이지 않을실 때는 웹브라우저 상단의 보기 -> 인코딩 -> 자동선택 여부를 확인하십시오.

Text(ASCII format)
Excel format

표제어: PCR

동의어: Packet Collision Rate

용어 설명 출처 목록 (6)

용어 설명: PCR은 세균 특이성이 있는 primer를 이용하여 적은 수의 세균이 있을지라도 쉽게 검출할 수 있는 유용한 방법이며, 이를 이용하여 구강 내 치면세균막이나 타액에서 직접 세균을 검출할 수 있게 되었다[8].

AI-Helper ※ AI-Helper는 을 사용합니다.

AI-Helper

안녕하세요, AI-Helper입니다. 좌측 "선택된 텍스트"에서 텍스트를 선택하여 요약, 번역, 용어설명을 실행하세요.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.

연합인증