[논문]Length of Pseudorandom Binary Sequence Required to Train Artificial Neural Network Without Overfitting

Kim, Jongwan; Kim, Hoon

doi:10.1109/access.2021.3111092

[해외논문] Length of Pseudorandom Binary Sequence Required to Train Artificial Neural Network Without Overfitting 원문보기

IEEE access : practical research, open solutions, v.9, 2021년, pp.125358 - 125365

Kim, Jongwan (Korea Advanced Institute of Science and Technology (KAIST), School of Electrical Engineering, Daejeon, South Korea) , Kim, Hoon (Korea Advanced Institute of Science and Technology (KAIST), School of Electrical Engineering, Daejeon, South Korea)

Abstract ▼ AI-Helper

The artificial neural network (ANN) has been applied to the various fields due to its capability to process complicated nonlinear functions involving a large amount of data. A pseudorandom binary sequence (PRBS) is commonly used to train the ANN since the PRBS is easily generated by using a linear feedback shift register and has a correlation function which is peaked at zero delay but is almost zero at other delays. However, when the PRBS length is not sufficiently long (compared to the input size of the ANN), the ANN trained by the PRBS could suffer from the overfitting where the ANN describes the behavior of the training sequence very well, but does poorly on new data inputs. In this paper, we provide a minimum length of the PRBS required by the ANN to avoid the overfitting for a given input size of the ANN. For this purpose, we analyze the minimum length of the input sequence required to estimate the PRBS pattern through theoretical study. These analyses are confirmed by numerical simulation. The findings of this paper would be used to select the PRBS length for training the ANN.

참고문헌 (32)

arXiv 1609 04747 An overview of gradient descent optimization algorithms ruder 2016
Neural Networks and Machine Learning Multilayer perceptrons haykin 2009 122
Machine Learning A Probabilistic Perspective Probability murphy 2012 27
Khan, Faisal Nadeem, Zhong, Kangping, Zhou, Xian, Al-Arashi, Waled Hussein, Yu, Changyuan, Lu, Chao, Lau, Alan Pak Tao. Joint OSNR monitoring and modulation format identification in digital coherent receivers using deep neural networks. Optics express, vol.25, no.15, 17767-.

상세보기
Danshi Wang, Min Zhang, Ze Li, Jin Li, Meixia Fu, Yue Cui, Xue Chen. Modulation Format Recognition and OSNR Estimation Using CNN-Based Deep Learning. IEEE photonics technology letters : a publication of the IEEE Laser and Electro-optics Society, vol.29, no.19, 1667-1670.

상세보기
Zhenhua Dong, Khan, Faisal Nadeem, Qi Sui, Kangping Zhong, Chao Lu, Lau, Alan Pak Tao. Optical Performance Monitoring: A Review of Current and Future Technologies. Journal of lightwave technology : a joint IEEE/OSA publication, vol.34, no.2, 525-543.

상세보기
IEEE/OSA Journal of Optical Communications and Networking Convolutional neural network-based optical performance monitoring for optical transport networks tanimura 2019 10.1364/JOCN.11.000A52 11 52a

상세보기
Chen, Xiaoliang, Li, Baojia, Proietti, Roberto, Zhu, Zuqing, Yoo, S. J. Ben. Self-Taught Anomaly Detection With Hybrid Unsupervised/Supervised Machine Learning in Optical Networks. Journal of lightwave technology : a joint IEEE/OSA publication, vol.37, no.7, 1742-1749.

상세보기
Jarajreh, Mutsam A., Giacoumidis, Elias, Aldaya, Ivan, Son Thai Le, Tsokanos, Athanasios, Ghassemlooy, Zabih, Doran, Nick J.. Artificial Neural Network Nonlinear Equalizer for Coherent Optical OFDM. IEEE photonics technology letters : a publication of the IEEE Laser and Electro-optics Society, vol.27, no.4, 387-390.

상세보기
Giacoumidis, Elias, Le, Son T., Ghanbarisabagh, Mohammad, McCarthy, Mary, Aldaya, Ivan, Mhatli, Sofien, Jarajreh, Mutsam A., Haigh, Paul A., Doran, Nick J., Ellis, Andrew D., Eggleton, Benjamin J.. Fiber nonlinearity-induced penalty reduction in CO-OFDM by ANN-based nonlinear equalization. Optics letters, vol.40, no.21, 5113-.

상세보기
10.1364/OFC.2018.M2F.2
10.1364/OFC.2018.M2B.2
Digital test patterns for performance measurements on digital transmission equipment 1992
10.1364/OFC.2020.T4D.3
Hinton, G., Li Deng, Dong Yu, Dahl, G. E., Mohamed, A., Jaitly, N., Senior, Andrew, Vanhoucke, V., Nguyen, P., Sainath, T. N., Kingsbury, B.. Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups. IEEE signal processing magazine, vol.29, no.6, 82-97.

상세보기
Argyris, Apostolos, Bueno, Julián, Fischer, Ingo. Photonic machine learning implementation for signal recovery in optical communications. Scientific reports, vol.8, 8487-.

상세보기
Proc Adv Neural Inf Process Syst ImageNet classification with deep convolutional neural network krizhevsky 2012 1097
Proc Adv Neural Inf Process Syst Sequence to sequence learning with neural networks sutskever 2014 3104
Huang, Wei-Hsiang, Nguyen, Hong-Minh, Wang, Chung-Wen, Chan, Min-Chi, Wei, Chia-Chien, Chen, Jyehong, Taga, Hidenori, Tsuritani, Takehiro. Nonlinear Equalization Based on Artificial Neural Network in DML-Based OFDM Transmission Systems. Journal of lightwave technology : a joint IEEE/OSA publication, vol.39, no.1, 73-82.

상세보기
10.1109/ICMLA.2007.27
Wen, Long, Li, Xinyu, Gao, Liang, Zhang, Yuyan. A New Convolutional Neural Network-Based Data-Driven Fault Diagnosis Method. IEEE transactions on industrial electronics : a publication of the IEEE Industrial Electronics Society, vol.65, no.7, 5990-5998.

상세보기
10.1109/CVPR.2014.220
Nature Deep learning lecun 2015 10.1038/nature14539 521 436

상세보기
Khan, Faisal Nadeem, Zhou, Yudi, Lau, Alan Pak Tao, Lu, Chao. Modulation format identification in heterogeneous fiber-optic networks using artificial neural networks. Optics express, vol.20, no.11, 12422-.

상세보기
Ferrari, S., Stengel, R.F.. Smooth function approximation using neural networks. IEEE transactions on neural networks, vol.16, no.1, 24-38.

상세보기
10.1109/IWADS.2002.1194667
10.1109/ECOC.2018.8535327
Eriksson, Tobias A., Bulow, Henning, Leven, Andreas. Applying Neural Networks in Optical Communication Systems: Possible Pitfalls. IEEE photonics technology letters : a publication of the IEEE Laser and Electro-optics Society, vol.29, no.23, 2091-2094.

상세보기
Liao, Tao, Xue, Lei, Huang, Luyao, Hu, Weisheng, Yi, Lilin. Training data generation and validation for a neural network-based equalizer. Optics letters, vol.45, no.18, 5113-.

상세보기
10.1109/ECOC.2018.8535400
Table of linear feedback shift registers ward 2012
Matsumoto, Makoto, Nishimura, Takuji. Mersenne twister : a 623-dimensionally equidistributed uniform pseudo-random number generator. ACM transactions on modeling and computer simulation : a publication of the Association for Computing Machinery, vol.8, no.1, 3-30.

상세보기

LOADING...

활용도 분석정보

상세보기

다운로드

내보내기

활용도 Top5 논문

해당 논문의 주제분야에서 활용도가 높은 상위 5개 콘텐츠를 보여줍니다.
더보기 버튼을 클릭하시면 더 많은 관련자료를 살펴볼 수 있습니다.

원문 보기

AccessON 원문보기

원문 URL 링크

DOI : 10.1109/ACCESS.2021.3111092 [무료]
IEEE : 저널 > 논문 [무료]
AccessON : 저널

*원문 PDF 파일 및 링크정보가 존재하지 않을 경우 KISTI DDS 시스템에서 제공하는 원문복사서비스를 사용할 수 있습니다.

오픈액세스(OA) 유형

GOLD

오픈액세스 학술지에 출판된 논문

저작권 관리 안내

내보내기 메뉴

내보내기 구분

파일저장
인쇄
메일전송

구성항목

기본정보
상세정보

관리번호, 논문명, 저널/프로시딩명, 저자 , 발행년, 권, 호, 시작페이지, 끝페이지, 발행기관

저장형식

Text(ASCII format)
Excel format
RefWorks Direct Export
RIS format (for Reference Manager, ProCite, EndNote), Scholar's Aids, Mendeley

메일정보

받는사람 (필수): @
보내는사람 (선택): @
제목
내용: KISTI 검색결과 이메일 서비스

안내

총 건의 자료가 검색되었습니다.

다운받으실 자료의 인덱스를 입력하세요. (1-10,000)

검색결과의 순서대로 최대 10,000건 까지 다운로드가 가능합니다.

데이타가 많을 경우 속도가 느려질 수 있습니다.(최대 2~3분 소요)

다운로드 파일은 UTF-8 형태로 저장됩니다.
파일의 내용이 제대로 보이지 않을실 때는 웹브라우저 상단의 보기 -> 인코딩 -> 자동선택 여부를 확인하십시오.

Text(ASCII format)
Excel format

표제어: PCR

동의어: Packet Collision Rate

용어 설명 출처 목록 (6)

용어 설명: PCR은 세균 특이성이 있는 primer를 이용하여 적은 수의 세균이 있을지라도 쉽게 검출할 수 있는 유용한 방법이며, 이를 이용하여 구강 내 치면세균막이나 타액에서 직접 세균을 검출할 수 있게 되었다[8].

AI-Helper ※ AI-Helper는 을 사용합니다.

AI-Helper

안녕하세요, AI-Helper입니다. 좌측 "선택된 텍스트"에서 텍스트를 선택하여 요약, 번역, 용어설명을 실행하세요.
※ AI-Helper는 부적절한 답변을 할 수 있습니다.

연합인증