[논문]A Collision Avoidance Method Based on Deep Reinforcement Learning

Feng, Shumin; Sebastian, Bijo; Ben-Tzvi, Pinhas

doi:10.3390/robotics10020073

A Collision Avoidance Method Based on Deep Reinforcement Learning 원문보기

Robotics, v.10 no.2, 2021년, pp.73 -

Feng, Shumin , Sebastian, Bijo , Ben-Tzvi, Pinhas

Abstract ▼ AI-Helper

This paper set out to investigate the usefulness of solving collision avoidance problems with the help of deep reinforcement learning in an unknown environment, especially in compact spaces, such as a narrow corridor. This research aims to determine whether a deep reinforcement learning-based collision avoidance method is superior to the traditional methods, such as potential field-based methods and dynamic window approach. Besides, the proposed obstacle avoidance method was developed as one of the capabilities to enable each robot in a novel robotic system, namely the Self-reconfigurable and Transformable Omni-Directional Robotic Modules (STORM), to navigate intelligently and safely in an unknown environment. A well-conceived hardware and software architecture with features that enable further expansion and parallel development designed for the ongoing STORM projects is also presented in this work. A virtual STORM module with skid-steer kinematics was simulated in Gazebo to reduce the gap between the simulations and the real-world implementations. Moreover, comparisons among multiple training runs of the neural networks with different parameters related to balance the exploitation and exploration during the training process, as well as tests and experiments conducted in both simulation and real-world, are presented in detail. Directions for future research are also provided in the paper.

참고문헌 (38)

Silver Mastering chess and shogi by self-play with a general reinforcement learning algorithm arXiv 2017
François-Lavet, Vincent, Henderson, Peter, Islam, Riashat, Bellemare, Marc G., Pineau, Joelle. An Introduction to Deep Reinforcement Learning. Foundations and trends in machine learning, vol.11, no.3, 219-354.

상세보기
Moreira, Ithan, Rivas, Javier, Cruz, Francisco, Dazeley, Richard, Ayala, Angel, Fernandes, Bruno. Deep Reinforcement Learning with Interactive Feedback in a Human-Robot Environment. Applied sciences, vol.10, no.16, 5574-.

상세보기
10.1109/ICRA.2017.7989385
Pirník Integration of inertial sensor data into control of the mobile platform Adv. Intell. Syst. Comput. 2017 10.1007/978-3-319-46535-7_21 511 271
Kilin, A, Bozek, P, Karavaev, Yury, Klekovkin, A, Shestakov, V. Experimental investigations of a highly maneuverable mobile omniwheel robot. International journal of advanced robotic systems, vol.14, no.6, 172988141774457-.

상세보기
Gazebo http://gazebosim.org/
10.1115/DETC2017-67436
Ben-Tzvi, Pinhas, Saab, Wael. A Hybrid Tracked-Wheeled Multi-Directional Mobile Robot. Journal of mechanisms and robotics, vol.11, no.4, 041008-.

상세보기
10.1109/CoASE.2013.6653891
Sebastian, Bijo, Ben-Tzvi, Pinhas. Physics Based Path Planning for Autonomous Tracked Vehicle in Challenging Terrain. Journal of intelligent & robotic systems, vol.95, no.2, 511-526.

상세보기
Sebastian, Bijo, Ben-Tzvi, Pinhas. Active Disturbance Rejection Control for Handling Slip in Tracked Vehicle Locomotion. Journal of mechanisms and robotics, vol.11, no.2, 021003-.

상세보기
10.1115/DETC2018-85626
Hart, Peter E., Nilsson, Nils J., Raphael, Bertram. A Formal Basis for the Heuristic Determination of Minimum Cost Paths. IEEE transactions on systems science and cybernetics, vol.4, no.2, 100-107.

상세보기
Lozano-Pérez, Tomás, Wesley, Michael A.. An algorithm for planning collision-free paths among polyhedral obstacles. Communications of the ACM, vol.22, no.10, 560-570.

상세보기
Khatib, Oussama. Real-Time Obstacle Avoidance for Manipulators and Mobile Robots. The International journal of robotics research, vol.5, no.1, 90-98.

상세보기
Borenstein, J., Koren, Y.. The vector field histogram-fast obstacle avoidance for mobile robots. IEEE transactions on robotics and automation : A publication of the IEEE Robotics and Automation Society, vol.7, no.3, 278-288.

상세보기
Faisal, Mohammed, Hedjar, Ramdane, Al Sulaiman, Mansour, Al-Mutib, Khalid. Fuzzy Logic Navigation and Obstacle Avoidance by a Mobile Robot in an Unknown Dynamic Environment. International journal of advanced robotic systems, vol.10, no.1, 37-.

상세보기
Pothal, J.K., Parhi, D.R.. Navigation of multiple mobile robots in a highly clutter terrains using adaptive neuro-fuzzy inference system. Robotics and autonomous systems, vol.72, 48-58.

상세보기
Dijkstra, E. W.. A note on two problems in connexion with graphs. Numerische Mathematik, vol.1, no.1, 269-271.

상세보기
Dechter, Rina, Pearl, Judea. Generalized best-first search strategies and the optimality of A*. Journal of the Association for Computing Machinery, vol.32, no.3, 505-536.

상세보기
Kavraki, L.E., Svestka, P., Latombe, J.-C., Overmars, M.H.. Probabilistic roadmaps for path planning in high-dimensional configuration spaces. IEEE transactions on robotics and automation : A publication of the IEEE Robotics and Automation Society, vol.12, no.4, 566-580.

상세보기
Elbanhawi, Mohamed, Simic, Milan. Sampling-Based Robot Motion Planning: A Review. IEEE access : practical research, open solutions, vol.2, 56-77.

상세보기
Ulrich VFH+: Reliable obstacle avoidance for fast mobile robots Proc. IEEE Int. Conf. Robot. Autom. 1998 10.1109/ROBOT.1998.677362 2 1572
Haarnoja Composable deep reinforcement learning for robotic manipulation arXiv 2018
Wang, Chao, Wang, Jian, Shen, Yuan, Zhang, Xudong. Autonomous Navigation of UAVs in Large-Scale Complex Environments: A Deep Reinforcement Learning Approach. IEEE transactions on vehicular technology, vol.68, no.3, 2124-2136.

상세보기
Feng Mobile robot obstacle avoidance base on deep reinforcement learning Proc. ASME Des. Eng. Tech. Conf. 2019 5A-2019 1
Pelton, Walter J.. 1. Introduction. American journal of public health and the nation's health, vol.50, no.1, 21-21.

상세보기
Mnih Playing Atari with Deep Reinforcement Learning arXiv 2013
Van Hasselt Deep Reinforcement Learning with Double Q-learning Assoc. Adv. Artif. Intell. 2016 30 2094
Saab, Wael, Ben-Tzvi, Pinhas. A Genderless Coupling Mechanism With Six-Degrees-of-Freedom Misalignment Capability for Modular Self-Reconfigurable Robots. Journal of mechanisms and robotics, vol.8, no.6, 061014-.

상세보기
POZYX Positioning System https://www.pozyx.io/
10.1109/IROS.2007.4399139

내보내기 구분	파일저장 인쇄 메일전송
구성항목	기본정보 상세정보 관리번호, 논문명, 저널/프로시딩명, 저자 , 발행년, 권, 호, 시작페이지, 끝페이지, 발행기관 관리번호, 논문명, 대등논문명, 저자 , 저널/프로시딩명, 발행기관, 발행년, 발행언어, 권, 호, 시작페이지, 끝페이지, ISBN, ISSN, 주제분야, 키워드, 초록(한글), 초록(영문), 저자(소속기관)
저장형식	Text(ASCII format) Excel format RefWorks Direct Export RIS format (for Reference Manager, ProCite, EndNote), Scholar's Aids, Mendeley
메일정보	받는사람 (필수) @ 보내는사람 (선택) @ 제목 내용 KISTI 검색결과 이메일 서비스
안내	총 건의 자료가 검색되었습니다. 다운받으실 자료의 인덱스를 입력하세요. (1-10,000) 검색결과의 순서대로 최대 10,000건 까지 다운로드가 가능합니다. 데이타가 많을 경우 속도가 느려질 수 있습니다.(최대 2~3분 소요) 다운로드 파일은 UTF-8 형태로 저장됩니다. 파일의 내용이 제대로 보이지 않을실 때는 웹브라우저 상단의 보기 -> 인코딩 -> 자동선택 여부를 확인하십시오. ~ Text(ASCII format) Excel format

연합인증

A Collision Avoidance Method Based on Deep Reinforcement Learning 원문보기

Abstract ▼ AI-Helper

참고문헌 (38)

이 논문을 인용한 문헌

관련 콘텐츠

원문 보기

원문 URL 링크

오픈액세스(OA) 유형

이 논문과 함께 이용한 콘텐츠

AI-Helper ※ AI-Helper는 오픈소스 모델을 사용합니다.

선택된 텍스트