[논문]Mental workload during n-back task—quantified in the prefrontal cortex using fNIRS

Herff, Christian; Heger, Dominic; Fortmann, Ole; Hennrich, Johannes; Putze, Felix; Schultz, Tanja

doi:10.3389/fnhum.2013.00935

Mental workload during n-back task—quantified in the prefrontal cortex using fNIRS 원문보기

Frontiers in human neuroscience, v.7, 2013년, pp.935 -

Herff, Christian , Heger, Dominic , Fortmann, Ole , Hennrich, Johannes , Putze, Felix , Schultz, Tanja

Abstract ▼ AI-Helper

When interacting with technical systems, users experience mental workload. Particularly in multitasking scenarios (e.g., interacting with the car navigation system while driving) it is desired to not distract the users from their primary task. For such purposes, human-machine interfaces (HCIs) are desirable which continuously monitor the users' workload and dynamically adapt the behavior of the interface to the measured workload. While memory tasks have been shown to elicit hemodynamic responses in the brain when averaging over multiple trials, a robust single trial classification is a crucial prerequisite for the purpose of dynamically adapting HCIs to the workload of its user. The prefrontal cortex (PFC) plays an important role in the processing of memory and the associated workload. In this study of 10 subjects, we used functional Near-Infrared Spectroscopy (fNIRS), a non-invasive imaging modality, to sample workload activity in the PFC. The results show up to 78% accuracy for single-trial discrimination of three levels of workload from each other. We use an n-back task (n ∈ {1, 2, 3}) to induce different levels of workload, forcing subjects to continuously remember the last one, two, or three of rapidly changing items. Our experimental results show that measuring hemodynamic responses in the PFC with fNIRS, can be used to robustly quantify and classify mental workload. Single trial analysis is still a young field that suffers from a general lack of standards. To increase comparability of fNIRS methods and results, the data corpus for this study is made available online.

주제어

참고문헌 (35)

Ang K. Guan C. Lee K. Lee J. Nioka S. Chance B. ( 2010a ). A brain-computer interface for mental arithmetic task from single-trial near-infrared spectroscopy brain signals , in International Conference on Pattern Recognition , (Istanbul), 3764 – 3767
Ang K. K. Guan C. Lee K. Lee J. Q. Nioka S. Chance B. ( 2010b ). Application of rough set-based neuro-fuzzy system in nirs-based bci for assessing numerical cognition in classroom , in The 2010 International Joint Conference on Neural Networks (IJCNN) , ( Barcelone ), 1 – 7
Ang K. K. Chin Z. Y. Zhang H. Guan C. ( 2008 ). Filter bank common spatial pattern (fbcsp) in brain-computer interface , in IEEE International Joint Conference on Neural Networks, 2008. IJCNN 2008. (IEEE World Congress on Computational Intelligence) , ( Hong Kong ), 2390 – 2397
Ayaz H. Izzetoglu M. Bunce S. Heiman-Patterson T. Onaral B. ( 2007 ). Detecting cognitive activity related hemodynamic signal for brain computer interface using functional near infrared spectroscopy , in 3rd International IEEE/EMBS Conference on Neural Engineering, 2007. CNE '07 , ( Kohala Coast, HI ), 342 – 345
Ayaz H. Shewokis P. A. Bunce S. Izzetoglu K. Willems B. Onaral B. ( 2012 ). Optical brain monitoring for operator training and mental workload assessment . Neuroimage 59 , 36 – 47 10.1016/j.neuroimage.2011.06.023 21722738

상세보기
Ayaz H. Willems B. Bunce B. Shewokis P. A. Izzetoglu K. Hah S. ( 2010 ). Cognitive workload assessment of air traffic controllers using optical brain imaging sensors , in Advances in Understanding Human Performance: Neuroergonomics, Human Factors Design, and Special Populations , eds Marek T. Karwowski W. Rice V. ( CRC Press Taylor & Francis Group ), 21 – 31
Baldwin C. L. Penaranda B. ( 2012 ). Adaptive training using an artificial neural network and eeg metrics for within-and cross-task workload classification . Neuroimage 59 , 48 – 56 10.1016/j.neuroimage.2011.07.047 21835243

상세보기
Berka C. Levendowski D. J. Lumicao M. N. Yau A. Davis G. Zivkovic V. T. ( 2007 ). Eeg correlates of task engagement and mental workload in vigilance, learning, and memory tasks . Aviat. Space Environ. Med . 78 , B231 – B244 Available online at: http://www.ingentaconnect.com/content/asma/asem/2007/00000078/A00105s1/art00032 17547324
Brouwer A.-M. Hogervorst M. A. Van Erp J. B. Heffelaar T. Zimmerman P. H. Oostenveld R. ( 2012 ). Estimating workload using eeg spectral power and erps in the n-back task . J. Neural Eng . 9 : 045008 10.1088/1741-2560/9/4/045008 22832068

상세보기
Cohen J. Perlstein W. Braver T. Nystrom L. Noll D. Jonides J. ( 1997 ). Temporal dynamics of brain activation during a working memory task . Nature 386 , 604 10.1038/386604a0 9121583

상세보기
Cooper R. Selb J. Gagnon L. Phillip D. Schytz H. W. Iversen H. K. ( 2012 ). A systematic comparison of motion artifact correction techniques for functional near-infrared spectroscopy . Front. Neurosci . 6 : 147 10.3389/fnins.2012.00147 23087603

상세보기
Coyle S. M. Ward T. E. Markham C. M. ( 2007 ). Brain–computer interface using a simplified functional near-infrared spectroscopy system . J. Neural Eng . 4 , 219 10.1088/1741-2560/4/3/007 17873424

상세보기
Cui X. Bray S. Reiss A. ( 2010a ). Functional near infrared spectroscopy (NIRS) signal improvement based on negative correlation between oxygenated and deoxygenated hemoglobin dynamics . Neuroimage 49 , 3039 – 3046 10.1016/j.neuroimage.2009.11.050 19945536

상세보기
Cui X. Bray S. Reiss A. L. ( 2010b ). Speeded near infrared spectroscopy (nirs) response detection . PLoS ONE 5 : e15474 10.1371/journal.pone.0015474 21085607

상세보기
Cutrell E. Tan D. ( 2008 ). Bci for passive input in hci , in Proceedings of CHI , Vol. 8 ( Citeseer ), 1 – 3
Duda R. O. Hart P. E. Stork D. G. ( 2012 ). Pattern Classification . New York, NY : John Wiley & Sons
Girouard A. Solovey E. Hirshfield L. Chauncey K. Sassaroli A. Fantini S. ( 2009 ). Distinguishing difficulty levels with non-invasive brain activity measurements , in Human-Computer Interaction INTERACT 2009, Volume 5726 of Lecture Notes in Computer Science , eds Gross T. Gulliksen J. Kotz P. Oestreicher L. Palanque P. Prates R. Winckler M. ( Berlin; Heidelberg : Springer ), 440 – 452
Heger D. Mutter R. Herff C. Putze F. Schultz T. ( 2013 ). Continuous recognition of affective states by functional near infrared spectroscopy signals , in Affective Computing and Intelligent Interaction (ACII), 2013 Humaine Association Conference on , ( Geneva : IEEE ), 832 – 837
Herff C. Heger D. Putze F. Hennrich J. Fortmann O. Schultz T. ( 2013 ). Classification of mental tasks in the prefrontal cortex using fnirs , in Engineering in Medicine and Biology Society (EMBC), 2013 35th Annual International Conference of the IEEE , ( San Diego ), 2160 – 2163
Herff C. Putze F. Heger D. Guan C. Schultz T. ( 2012 ). Speaking mode recognition from functional near infrared spectroscopy , in Engineering in Medicine and Biology Society (EMBC), 2012 Annual International Conference of the IEEE , ( Osaka ), 1715 – 1718
Hirshfield L. M. Gulotta R. Hirshfield S. Hincks S. Russell M. Ward R. ( 2011 ). This is your brain on interfaces: enhancing usability testing with functional near-infrared spectroscopy , in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems ( ACM ), ( Vancouver, BC ), 373 – 382
Hoshi Y. Tsou B. H. Billock V. A. Tanosaki M. Iguchi Y. Shimada M. ( 2003 ). Spatiotemporal characteristics of hemodynamic changes in the human lateral prefrontal cortex during working memory tasks . Neuroimage 20 , 1493 – 1504 10.1016/S1053-8119(03)00412-9 14642462

상세보기
Izzetoglu K. Bunce S. Izzetoglu M. Onaral B. Pourrezaei K. ( 2003 ). fNIR spectroscopy as a measure of cognitive task load , in Engineering in Medicine and Biology Society, 2003. Proceedings of the 25th Annual International Conference of the IEEE , Vol. 4 , ( Cancun ), 3431 – 3434
Jarvis J. Putze F. Heger D. Schultz T. ( 2011 ). Multimodal person independent recognition of workload related biosignal patterns , in Proceedings of the 13th International Conference on Multimodal Interfaces , ICMI '11 ( New York, NY : ACM ), 205 – 208
Kothe C. Makeig S. ( 2011 ). Estimation of task workload from eeg data: New and current tools and perspectives , in Engineering in Medicine and Biology Society, EMBC, 2011 Annual International Conference of the IEEE , ( Boston ), 6547 – 6551
Molavi B. Dumont G. ( 2010 ). Wavelet based motion artifact removal for functional near infrared spectroscopy , in Engineering in Medicine and Biology Society (EMBC), 2010 Annual International Conference of the IEEE , ( Buenos Aires ), 5 – 8
Oldfield R. ( 1971 ). The assessment and analysis of handedness: the Edinburgh inventory . Neuropsychologia 9 , 97 – 113 10.1016/0028-3932(71)90067-4 5146491

상세보기
Owen A. M. McMillan K. M. Laird A. R. Bullmore E. ( 2005 ). N-back working memory paradigm: A meta-analysis of normative functional neuroimaging studies . Hum. Brain Mapp . 25 , 46 – 59 10.1002/hbm.20131 15846822

상세보기
Power S. D. Falk T. H. Chau T. ( 2010 ). Classification of prefrontal activity due to mental arithmetic and music imagery using hidden markov models and frequency domain near-infrared spectroscopy . J. Neural Eng . 7 : 026002 10.1088/1741-2560/7/2/026002 20168001

상세보기
Power S. D. Kushki A. Chau T. ( 2012 ). Intersession consistency of single-trial classification of the prefrontal response to mental arithmetic and the no-control state by nirs . PLoS ONE 7 : e37791 10.1371/journal.pone.0037791 22844390

상세보기
Sassaroli A. Fantini S. ( 2004 ). Comment on the modified beerlambert law for scattering media . Phys. Med. Biol . 49 : N255 10.1088/0031-9155/49/14/N07 15357206

상세보기
Sitaram R. Zhang H. Guan C. Thulasidas M. Hoshi Y. Ishikawa A. ( 2007 ). Temporal classification of multichannel near-infrared spectroscopy signals of motor imagery for developing a braincomputer interface . Neuroimage 34 , 1416 – 1427 10.1016/j.neuroimage.2006.11.005 17196832

상세보기
Smith E. E. Jonides J. ( 1997 ). Working memory: a view from neuroimaging . Cogn. Psychol . 33 , 5 – 42 10.1006/cogp.1997.0658 9212720

상세보기
Wolpaw J. R. Birbaumer N. McFarland D. J. Pfurtscheller G. Vaughan T. M. ( 2002 ). Brain–computer interfaces for communication and control . Clin. Neurophysiol . 113 , 767 – 791 10.1016/S1388-2457(02)00057-3 12048038

상세보기
Zander T. O. Kothe C. ( 2011 ). Towards passive braincomputer interfaces: applying braincomputer interface technology to humanmachine systems in general . J. Neural Eng . 8 : 025005 10.1088/1741-2560/8/2/025005 21436512

상세보기

내보내기 구분	파일저장 인쇄 메일전송
구성항목	기본정보 상세정보 관리번호, 논문명, 저널/프로시딩명, 저자 , 발행년, 권, 호, 시작페이지, 끝페이지, 발행기관 관리번호, 논문명, 대등논문명, 저자 , 저널/프로시딩명, 발행기관, 발행년, 발행언어, 권, 호, 시작페이지, 끝페이지, ISBN, ISSN, 주제분야, 키워드, 초록(한글), 초록(영문), 저자(소속기관)
저장형식	Text(ASCII format) Excel format RefWorks Direct Export RIS format (for Reference Manager, ProCite, EndNote), Scholar's Aids, Mendeley
메일정보	받는사람 (필수) @ 보내는사람 (선택) @ 제목 내용 KISTI 검색결과 이메일 서비스
안내	총 건의 자료가 검색되었습니다. 다운받으실 자료의 인덱스를 입력하세요. (1-10,000) 검색결과의 순서대로 최대 10,000건 까지 다운로드가 가능합니다. 데이타가 많을 경우 속도가 느려질 수 있습니다.(최대 2~3분 소요) 다운로드 파일은 UTF-8 형태로 저장됩니다. 파일의 내용이 제대로 보이지 않을실 때는 웹브라우저 상단의 보기 -> 인코딩 -> 자동선택 여부를 확인하십시오. ~ Text(ASCII format) Excel format

연합인증

Mental workload during n-back task—quantified in the prefrontal cortex using fNIRS 원문보기

Abstract ▼ AI-Helper

주제어

참고문헌 (35)

이 논문을 인용한 문헌

관련 콘텐츠

원문 보기

원문 URL 링크

오픈액세스(OA) 유형

이 논문과 함께 이용한 콘텐츠

AI-Helper ※ AI-Helper는 오픈소스 모델을 사용합니다.

선택된 텍스트