[논문]네트워크 공격 시뮬레이터를 이용한 강화학습 기반 사이버 공격 예측 연구

김범석; 김정현; 김민석

네트워크 공격 시뮬레이터를 이용한 강화학습 기반 사이버 공격 예측 연구
A Study of Reinforcement Learning-based Cyber Attack Prediction using Network Attack Simulator (NASim) 원문보기

반도체디스플레이기술학회지 = Journal of the semiconductor & display technology, v.22 no.3, 2023년, pp.112 - 118

김범석 (상명대학교 전자정보시스템공학과) , 김정현 (상명대학교 전자정보시스템공학과) , 김민석 (상명대학교 휴먼지능로봇공학과)

Abstract ▼ AI-Helper

As technology advances, the need for enhanced preparedness against cyber-attacks becomes an increasingly critical problem. Therefore, it is imperative to consider various circumstances and to prepare for cyber-attack strategic technology. This paper proposes a method to solve network security problems by applying reinforcement learning to cyber-security. In general, traditional static cyber-security methods have difficulty effectively responding to modern dynamic attack patterns. To address this, we implement cyber-attack scenarios such as 'Tiny Alpha' and 'Small Alpha' and evaluate the performance of various reinforcement learning methods using Network Attack Simulator, which is a cyber-attack simulation environment based on the gymnasium (formerly Open AI gym) interface. In addition, we experimented with different RL algorithms such as value-based methods (Q-Learning, Deep-Q-Network, and Double Deep-Q-Network) and policy-based methods (Actor-Critic). As a result, we observed that value-based methods with discrete action spaces consistently outperformed policy-based methods with continuous action spaces, demonstrating a performance difference ranging from a minimum of 20.9% to a maximum of 53.2%. This result shows that the scheme not only suggests opportunities for enhancing cybersecurity strategies, but also indicates potential applications in cyber-security education and system validation across a large number of domains such as military, government, and corporate sectors.

주제어

참고문헌 (21)

Kim, D. W., Lee, M. S., Jeong, J. Y., Kim, and H. C.,？"COVID19 Related Keyword Analysis: Based on Topic？Modeling and Semantic Network Analysis," Journal of？the Semiconductor & Display Technology, Vol. 21, No.？2, pp.127-132, 2022.
Kang, Y. G., Yoo, J. D., Park, E.J., Kim, D. H., and Kim,？H.K., "Design and Implementation of Cyber Attack？Simulator based on Attack Techniques Modeling,"？Journal of the Korea Society of Computer and？Information, Vol.25, pp.65-72, 2020.
Taherdoost, H., "Understanding cybersecurity frameworks and information security standards-a review？and comprehensive overview," Electronics, Vol. 11, pp.？2181, 2022.
Lee, J. Y., Moon, D. S. and Kim, I. K., "Technological？Trends in Cyber Attack Simulations." Electronics and？Telecommunications Trends, Vol. 35, pp. 34-48, 2020.
Rabie, A. R., Bassam, W. A., Jalawi, S. A., Abdullah, J.？A., Ayman, E.S., and Mohamed, M. D., "Cybersecurity？and Countermeasures at the Time of Pandemic", Journal？of Advanced Transportation, Vol. 2021, pp. 1-19, 2021.

상세보기
Al-Qahtani, A. F., and Cresci, S., "The COVID-19？scamdemic: A survey of phishing attacks and their？countermeasures during COVID-19," IET Information？Security, Vol.16, pp.324-345, 2022.

상세보기
Singh, S., Sharma, P. K., Moon, S. Y., Moon, D. S., and？Park, J. H., "A comprehensive study on APT attacks and？countermeasures for future networks and communications: challenges and solutions", The Journal of Supercomputing, Vol. 75, pp. 4543-4574, 2019.

상세보기
Choi,Y. K., Jang I. S., Whoang, I., Kim, T. G., Hong, S.？J., Park, I. S., Yang, J. S., Kwon, Y. J., and Kang, J. M.,？"Design and Implementation of Cyber Range for Cyber？Defense Exercise Based on Cyber Crisis Alert." Journal？of the Korea Institute of Information Security &？Cryptology, Vol. 30, pp. 805-821, 2020.
Milian, E. Z., Spinola, M. D. M., and Carvalho, M. M.,？"Fintechs: A literature review and research agenda",？Electronic Commerce Research and Applications, Vol.？34, 2019.

상세보기
Jiang, H., Choi, T., and Ko, R. K. L., "Pandora: A cyber？range environment for the safe testing and deployment？of autonomous cyber-attack tools," Security in Computing and Communications, Vol. 1364, pp. 1-20, 2021.
Yamin, M. M., Katt, B., and Gkioulos, V., "Cyber ranges？and security testbeds: Scenarios, functions, tools and？architecture," Computers & Security, Vol. 88, pp.？101636, 2020.

상세보기
Yamin, M. M., and Katt, B., "Use of cyber attack and？defense agents in cyber ranges: A case study," Computers & Security, Vol. 122, pp. 102892, 2022.

상세보기
Katina, P. F., and Keskin, O. F., "Complex system governance as a foundation for enhancing the cybersecurity of cyber-physical systems," International Journal？of Cyber Warfare and Terrorism, Vol. 11, pp. 1-14, 2021.

상세보기
Kim, D. H., Kim, Y. H., Ahn, M. K., and Lee, H. J.,？"Automated cyber threat emulation based on ATT&CK？for cyber security training," Journal of the Korea？Society of Computer and Information, Vol. 25, pp. 71-80, 2020.
Yoo, J. D., Park, E., Lee, G., Ahn, M. K., Kim, D., Seo,？S., and Kim, H. K., "Cyber attack and defense？emulation agents," Applied Sciences, Vol. 10, pp. 2140,？2020.
Mohamed, N., "Study of bypassing Microsoft Windows？Security using the MITRE CALDERA framework"？F1000 Research, Vol. 11, pp. 16-25, 2022.
Sainadh, J., Navya, Y. S., Raja, P., Tagore, G., and Rao,？G. R. K., "Dynamic Malware Analysis Using Cuckoo？Sandbox", 2018 Second International Conference on？Inventive Communication and Computational？Technologies, pp. 1056-1060, 2018.
Jjschwartz, "NetworkAttackSimulator (Version 0.9.1)."？Retrieved August 12, 2021, from https://github.com/Jjschwartz/NetworkAttackSimulator (Publication Date:？N/A).
Microsoft, "CyberBattleSim (Version 2.4.0)." Retrieved？August 26, 2021, from https://github.com/microsoft/CyberBattleSim.
Walter, E., Ferguson-Walter, K., and Ridley, A., "Incorporating Deception into CyberBattleSim for Autonomous Defense." Retrieved May 18, 2023, from？https://arxiv.org/abs/2108.13980, 2021.
Xiang, X., Foo, S., and Zang, H., "Recent Advances in？Deep Reinforcement Learning Applications for Solving？Partially Observable Markov Decision Processes？(POMDP) Problems Part 2 - Applications in Transportation, Industries, Communications and Networking？and More Topics", Machine Learning and Knowledge？Extraction, Vol. 3, pp. 863-878, 2021.

내보내기 구분	파일저장 인쇄 메일전송
구성항목	기본정보 상세정보 관리번호, 논문명, 저널/프로시딩명, 저자 , 발행년, 권, 호, 시작페이지, 끝페이지, 발행기관 관리번호, 논문명, 대등논문명, 저자 , 저널/프로시딩명, 발행기관, 발행년, 발행언어, 권, 호, 시작페이지, 끝페이지, ISBN, ISSN, 주제분야, 키워드, 초록(한글), 초록(영문), 저자(소속기관)
저장형식	Text(ASCII format) Excel format RefWorks Direct Export RIS format (for Reference Manager, ProCite, EndNote), Scholar's Aids, Mendeley
메일정보	받는사람 (필수) @ 보내는사람 (선택) @ 제목 내용 KISTI 검색결과 이메일 서비스
안내	총 건의 자료가 검색되었습니다. 다운받으실 자료의 인덱스를 입력하세요. (1-10,000) 검색결과의 순서대로 최대 10,000건 까지 다운로드가 가능합니다. 데이타가 많을 경우 속도가 느려질 수 있습니다.(최대 2~3분 소요) 다운로드 파일은 UTF-8 형태로 저장됩니다. 파일의 내용이 제대로 보이지 않을실 때는 웹브라우저 상단의 보기 -> 인코딩 -> 자동선택 여부를 확인하십시오. ~ Text(ASCII format) Excel format

연합인증

네트워크 공격 시뮬레이터를 이용한 강화학습 기반 사이버 공격 예측 연구
A Study of Reinforcement Learning-based Cyber Attack Prediction using Network Attack Simulator (NASim) 원문보기

Abstract ▼ AI-Helper

주제어

참고문헌 (21)

이 논문을 인용한 문헌

관련 콘텐츠

원문 보기

연관된 기능

이 논문과 함께 이용한 콘텐츠

AI-Helper ※ AI-Helper는 오픈소스 모델을 사용합니다.

선택된 텍스트

연합인증

네트워크 공격 시뮬레이터를 이용한 강화학습 기반 사이버 공격 예측 연구 A Study of Reinforcement Learning-based Cyber Attack Prediction using Network Attack Simulator (NASim) 원문보기

Abstract ▼ AI-Helper

주제어

참고문헌 (21)

이 논문을 인용한 문헌

관련 콘텐츠

원문 보기

연관된 기능

이 논문과 함께 이용한 콘텐츠

AI-Helper ※ AI-Helper는 오픈소스 모델을 사용합니다.

선택된 텍스트

네트워크 공격 시뮬레이터를 이용한 강화학습 기반 사이버 공격 예측 연구
A Study of Reinforcement Learning-based Cyber Attack Prediction using Network Attack Simulator (NASim) 원문보기