[논문]Enhancing the decoding accuracy of EEG signals by the introduction of anchored-STFT and adversarial data augmentation method

Ali, Omair; Saif-ur-Rehman, Muhammad; Dyck, Susanne; Glasmachers, Tobias; Iossifidis, Ioannis; Klaes, Christian

doi:10.1038/s41598-022-07992-w

Enhancing the decoding accuracy of EEG signals by the introduction of anchored-STFT and adversarial data augmentation method 원문보기

Scientific reports, v.12, 2022년, pp.4245 -

Ali, Omair (Faculty of Medicine, Department of Neurosurgery, University Hospital Knappschaftskrankenhaus Bochum GmbH, Bochum, Germany) , Saif-ur-Rehman, Muhammad (Department of Computer Science, Ruhr-West University of Applied Science, Mü) , Dyck, Susanne (lheim an der Ruhr, Germany) , Glasmachers, Tobias (Faculty of Medicine, Department of Neurosurgery, University Hospital Knappschaftskrankenhaus Bochum GmbH, Bochum, Germany) , Iossifidis, Ioannis (Institut Fü) , Klaes, Christian (r Neuroinformatik, Ruhr University Bochum, Bochum, Germany)

Abstract ▼ AI-Helper

Brain-computer interfaces (BCIs) enable communication between humans and machines by translating brain activity into control commands. Electroencephalography (EEG) signals are one of the most used brain signals in non-invasive BCI applications but are often contaminated with noise. Therefore, it is possible that meaningful patterns for classifying EEG signals are deeply hidden. State-of-the-art deep-learning algorithms are successful in learning hidden, meaningful patterns. However, the quality and the quantity of the presented inputs are pivotal. Here, we propose a feature extraction method called anchored Short Time Fourier Transform (anchored-STFT), which is an advanced version of STFT, as it minimizes the trade-off between temporal and spectral resolution presented by STFT. In addition, we propose a data augmentation method derived from l2-norm fast gradient sign method (FGSM), called gradient norm adversarial augmentation (GNAA). GNAA is not only an augmentation method but is also used to harness adversarial inputs in EEG data, which not only improves the classification accuracy but also enhances the robustness of the classifier. In addition, we also propose a CNN architecture, namely Skip-Net, for the classification of EEG signals. The proposed pipeline outperforms the current state-of-the-art methods and yields classification accuracies of 90.7% on BCI competition II dataset III and 89.5%, 81.8%, 76.0% and 85.4%, 69.1%, 80.9% on different data distributions of BCI Competition IV dataset 2b and 2a, respectively.

참고문헌 (54)

1. Graimann B Allison B Pfurtscheller G Brain-Computer Interfaces: A Gentle Introduction 2010 Springer
2. Kübler A Furdea A Halder S Hammer EM Nijboer F Kotchoubey B A brain-computer interface controlled auditory event-related potential (p300) spelling system for locked-in patients Ann. N. Y. Acad. Sci. 2009 10.1111/j.1749-6632.2008.04122.x 19351359

상세보기
3. Klaes C Kellis S Afalo T Lee B Kelsie P Shanfield K Hayes-Jackson S Aisen M Heck C Liu C Andersen RA Hand shape representations in the human posterior parietal cortex J. Neurosci. 2015 35 15466 15476 10.1523/JNEUROSCI.2747-15.2015 26586832

상세보기
4. Kellis S Miller K Thomson K Brown R House P Greger B Decoding spoken words using local field potentials recorded from the cortical surface J. Neural Eng. 2010 7 056007 10.1088/1741-2560/7/5/056007 20811093

상세보기
5. Aflalo T Kellis S Klaes C Lee B Shi Y Pejsa K Shanfield K Hayes-Jackson S Aisen M Heck C Liu C Andersen RA Decoding motor imagery from the posterior parietal cortex of a tetraplegic human Science 2015 348 906 910 10.1126/science.aaa5417 25999506

상세보기
6. Ajiboye AB Willett FR Young D Memberg WD Murphy BA Miller JP Walter BL Sweet JA Hoyen HA Keith MW Peckham PH Simeral JD Kirsch RF Restoration of reaching and grasping movements through brain-controlled muscle stimulation in a person with tetraplegia: A proof-of-concept demonstration Lancet 2017 389 10081 1821 1830 10.1016/S0140-6736(17)30601-3 28363483

상세보기
7. Choi J Kim S Ryu R Kim S Sohn J Implantable neural probes for brain-machine interfaces - current developments and future prospects Exp. Neurobiol. 2018 27 6 453 471 10.5607/en.2018.27.6.453 30636899

상세보기
8. Pfurtscheller G Lopes da Silva F Event-related EEG/MEG synchronization and desynchronization: Basic principles Clin. Neurophysiol. 1999 110 1842 1857 10.1016/S1388-2457(99)00141-8 10576479

상세보기
9. Müller-Gerking J Pfurtscheller G Flyvbjerg H Designing optimal spatial filters for single-trial EEG classification in a movement task Clin. Neurophysiol. 1999 110 787 798 10.1016/S1388-2457(98)00038-8 10400191

상세보기
10. Grosse-Wentrup M Buss M Multiclass common spatial patterns and information theoretic feature extraction IEEE Trans. Biomed. Eng. 2008 55 1991 2000 10.1109/TBME.2008.921154 18632362

상세보기
11. Ang K Chin Z Wang C Guan C Zhang H Filter bank common spatial pattern algorithm on BCI competition IV Datasets 2a and 2b Front. Neurosci. 2012 10.3389/fnins.2012.00039 22479236

상세보기
12. Ramoser H Muller-Gerking J Pfurtscheller G Optimal spatial filtering of single trial EEG during imagined hand movement IEEE Trans. Rehabil. Eng. 2000 10.1109/86.895946 11204035

상세보기
13. Mousavi EA Maller JJ Fitzgerald PB Lithgow BJ Wavelet Common Spatial Pattern in asynchronous offline brain computer interfaces Biomed. Signal Process. Control 2011 6 121 128 10.1016/j.bspc.2010.08.003

상세보기
14. Nicolas-Alonso LF Gomez-Gil J Brain computer interfaces, a review Sensors 2012 10.3390/s120201211 22438708

상세보기
15. Tabar YR Halici U A novel deep learning approach for classification of EEG motor imagery signals J. Neural Eng. 2017 10.1088/1741-2560/14/1/016003 27900952

상세보기
16. Li F He F Wang F Zhang D Xia Y Li X A novel simplified convolutional neural network classification algorithm of motor imagery EEG signals based on deep learning Appl. Sci. 2020 10 1605 10.3390/app10051605

상세보기
17. Fukunaga K Introduction to Statistical Pattern Recognition 2013 Elsevier
18. Firat Ince N Arica S Tewfik A Classification of single trial motor imagery EEG recordings with subject adapted non-dyadic arbitrary time-frequency tilings J. Neural Eng. 2006 10.1088/1741-2560/3/3/006

상세보기
19. Schlögl A Lee F Bischof H Pfurtscheller G Characterization of four-class motor imagery EEG data for the BCI-competition 2005 J. Neural Eng. 2005 10.1088/1741-2560/2/4/L02 16317224

상세보기
20. Nielsen TD Jensen FV Bayesian Networks and Decision Graphs 2001 Springer
21. Cortes C Vapnik V Support-vector networks Mach. Learn. 1995 20 273 297

상세보기
22. Shah ZH Müller M Wang T-C Scheidig PM Schneider A Schüttpelz M Huser T Schenck W Deep-learning based denoising and reconstruction of super-resolution structured illumination microscopy images bioRxiv 2020 12 988
23. Ren S He K Girshick R Sun J Faster R-CNN: Towards real-time object detection with region proposal networks IEEE Trans. Pattern Anal. Mach. Intell. 2017 39 6 1137 1149 10.1109/TPAMI.2016.2577031 27295650

상세보기
24. Saif-ur-Rehman M Lienkämper R Parpaley Y Wellmer J Liu C Lee B Kellis S Andersen R Iossifidis I Glasmachers T Klaes C SpikeDeeptector: A deep-learning based method for detection of neural spiking activity J. Neural Eng. 2019 16 5 10.1088/1741-2552/ab1e63

상세보기
25. Saif-ur-Rehman M Ali ODS Lienkämper R Metzler M Parpaley Y Wellmer J Liu C Lee B Kellis S Iossifidis I Glasmachers T Klaes C SpikeDeep-Classifier: A deep-learning based fully automatic offline spike sorting algorithm J. Neural Eng. 2020 10.1088/1741-2552/abc8d4
26. Issar D Williamson RC Khanna SB Smith MA A neural network for online spike classification that improves decoding accuracy J. Neurophysiol. 2020 123 4 1472 1485 10.1152/jn.00641.2019 32101491

상세보기
27. An X Kuang D Guo X Zhao Y He L A deep learning method for classification of EEG data based on motor imagery Intell. Comput. Bioinform. 2014 10.1007/978-3-319-09330-7_25

상세보기
28. Wulsin DF Gupta JR Mani R Blanco JA Litt B Modeling electroencephalography waveforms with semi-supervised deep belief nets: Fast classification and anomaly measurement J. Neural Eng. 2011 10.1088/1741-2560/8/3/036015 21525569

상세보기
29. Ren, Y. & Wu, Y. Convolutional deep belief networks for feature extraction of EEG signal. In International Joint Conference on Neural Networks (IJCNN) , Beijing (2014).
30. Yang, H., Sakhavi, S., Ang, K. K. & Guan, C. On the use of convolutional neural networks and augmented CSP features for multi-class motor imagery of EEG signals classification. In Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) , Milan (2015).
31. Bashivan, P., Rish, I., Yeasin, M. & Codella, N. Learning representations from EEG with deep recurrent-convolutional neural networks. arXiv, https://arxiv.org/abs/1511.06448 (2015)
32. Dai G Zhou J Huang J Wang N HS-CNN: A CNN with hybrid convolution scale for EEG motor imagery classification J. Neural Eng. 2020 17 016025 10.1088/1741-2552/ab405f 31476743

상세보기
33. Zhang C Kim Y-K Eskandarian A EEG-inception: An accurate and robust end-to-end neural network for EEG-based motor imagery classification J. Neural Eng. 2021 18 4 046014 10.1088/1741-2552/abed81

상세보기
34. Tangermann M Müller K-R Aertsen A Birbaumer N Braun C Brunner C Leeb R Mehring C Miller K Mueller-Putz G Benjamin B Review of the BCI competition IV Front. Neurosci. 2012 6 00055 10.3389/fnins.2012.00055

상세보기
35. Schlögl A Outcome of the BCI-competition 2003 on the Graz data set 2003 Graz University of Technology
36. DebnathJean, L. & Antoine, J.-P. Wavelet Transforms and Their Applications, Louvain-la-Neuve: Physics Today (2003).
37. Goodfellow, I. J., Shlens, J. & Szegedy, C. Explaining and Harnessing Adversarial Examples. arXiv, https://arxiv.org/abs/1412.6572 (2014).
38. Pfurtscheller G Lopes Da Silva FH Event-related EEG/MEG synchronization and desynchronization: Basic principles Clin. Neurophysiol. 1999 110 11 1842 1857 10.1016/S1388-2457(99)00141-8 10576479

상세보기
39. He, K., Zhang, X., Ren, S. & Sun, J. Deep Residual Learning for Image Recognition. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2016).
40. Suk, H.-I. & Seong-Whan, L. Data-driven frequency bands selection in EEG-based brain-computer interface. In International Workshop on Pattern Recognition in NeuroImaging . IEEE, 2011, 25–28 (2011).
41. Gandhi, V., Arora, V., Behera, L., Prasad, G., Coyle, D. & McGinnity, T. EEG denoising with a recurrent quantum neural network for a brain-computer interface. In In The 2011 International Joint Conference on Neural Networks. IEEE (2011).
42. Shahid, S., Sinha, R. & Prasad, G. A bispectrum approach to feature extraction for a motor imagery based brain-computer interfacing system. In 18th European Signal Processing Conference . IEEE, 2010 (2010).
43. Raza H Cecotti H Li Y Adaptive learning with covariate shift-detection for motor imagery-based brain–computer interface Soft Comput. 2016 20 3085 10.1007/s00500-015-1937-5

상세보기
44. Gaur P Gupta H Chowdhury A McCreadie K BilasPachori R Wang H A sliding window common spatial pattern for enhancing motor imagery classification in EEG-BCI IEEE Trans. Instrum. Meas. 2021 70 1 9 10.1109/TIM.2021.3051996 33776080

상세보기
45. Barachant A Bonnet S Congedo M Jutten C Classification of covariance matrices using a Riemannian-based kernel for BCI applications Neurocomputing 2013 112 172 178 10.1016/j.neucom.2012.12.039

상세보기
46. Lawhern VJ Solon AJ Waytowich NR Gordon SM Hung CP Lance BJ EEGNet: A compact convolutional neural network for EEG-based brain–computer interfaces J. Neural Eng. 2018 15 0560 10.1088/1741-2552/aace8c

상세보기
47. Ozdenizi O Erdogmus D Information theoretic feature transformation learning for brain interfaces IEEE Trans. Biomed. Eng. 2020 67 1 69 78 10.1109/TBME.2019.2908099 30932828

상세보기
48. Tibor Schirrmeister R Tobias Springenberg J Dominique Josef Fiederer L Glasstetter M Eggensperger K Tangermann M Hutter F Burgard W Ball T Deep learning with convolutional neural networks for EEG decoding and visualization Hum. Brain Mapp. 2017 38 11 5391 5420 10.1002/hbm.23730 28782865

상세보기
49. Zheng, Q., Zhu, F., & Heng, P.-A. Robust support matrix machine for single trial EEG classification. In IEEE Transactions on Neural Systems and Rehabilitation Engineering (2018).
50. Shahid S Prasad G Bispectrum-based feature extraction technique for devising a practical brain–computer interface J. Neural Eng. 2011 8 025014 10.1088/1741-2560/8/2/025014 21436530

상세보기
51. Lemm S Schäfer C Curio G BCI competition 2003-data set III: Probabilistic modeling of sensorimotor μ rhythms for classification of imaginary hand movements IEEE Trans. Biomed. Eng. 2004 51 1077 1080 10.1109/TBME.2004.827076 15188882

상세보기
52. Ren, S., He, K., Girshick, R. & Sun, J. Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks. arXiv, https://arxiv.org/abs/1506.01497 (2015).
53. Jiang, X. & Zhang Xiao, W. D. Active Learning for Black-Box Adversarial Attacks in EEG-Based Brain-Computer Interfaces. In IEEE Symposium Series on Computational Intelligence , Xiamen, China (2019).
54. Feng, B., Wang, Y. & Ding, Y. Saga: Sparse Adversarial Attack on EEG-Based Brain Computer Interface. In ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) , Toronto, ON, Canada (2021).

표제어: PCR

동의어: Packet Collision Rate

용어 설명 출처 목록 (6)

용어 설명: PCR은 세균 특이성이 있는 primer를 이용하여 적은 수의 세균이 있을지라도 쉽게 검출할 수 있는 유용한 방법이며, 이를 이용하여 구강 내 치면세균막이나 타액에서 직접 세균을 검출할 수 있게 되었다[8].

내보내기 구분	파일저장 인쇄 메일전송
구성항목	기본정보 상세정보 관리번호, 논문명, 저널/프로시딩명, 저자 , 발행년, 권, 호, 시작페이지, 끝페이지, 발행기관 관리번호, 논문명, 대등논문명, 저자 , 저널/프로시딩명, 발행기관, 발행년, 발행언어, 권, 호, 시작페이지, 끝페이지, ISBN, ISSN, 주제분야, 키워드, 초록(한글), 초록(영문), 저자(소속기관)
저장형식	Text(ASCII format) Excel format RefWorks Direct Export RIS format (for Reference Manager, ProCite, EndNote), Scholar's Aids, Mendeley
메일정보	받는사람 (필수) @ 보내는사람 (선택) @ 제목 내용 KISTI 검색결과 이메일 서비스
안내	총 건의 자료가 검색되었습니다. 다운받으실 자료의 인덱스를 입력하세요. (1-10,000) 검색결과의 순서대로 최대 10,000건 까지 다운로드가 가능합니다. 데이타가 많을 경우 속도가 느려질 수 있습니다.(최대 2~3분 소요) 다운로드 파일은 UTF-8 형태로 저장됩니다. 파일의 내용이 제대로 보이지 않을실 때는 웹브라우저 상단의 보기 -> 인코딩 -> 자동선택 여부를 확인하십시오. ~ Text(ASCII format) Excel format

연합인증

Enhancing the decoding accuracy of EEG signals by the introduction of anchored-STFT and adversarial data augmentation method 원문보기

Abstract ▼ AI-Helper

참고문헌 (54)

이 논문을 인용한 문헌

관련 콘텐츠

원문 보기

원문 URL 링크

오픈액세스(OA) 유형

이 논문과 함께 이용한 콘텐츠

AI-Helper ※ AI-Helper는 오픈소스 모델을 사용합니다.

선택된 텍스트