[논문]MC2‐Net: motion correction network for multi‐contrast brain MRI

Lee, Jongyeon; Kim, Byungjai; Park, HyunWook

doi:10.1002/mrm.28719

[해외논문] MC2‐Net: motion correction network for multi‐contrast brain MRI

Magnetic resonance in medicine : official journal of the Society of Magnetic Resonance in Medicine, v.86 no.2, 2021년, pp.1077 - 1092

Lee, Jongyeon (Department of Electrical Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, Republic of Korea) , Kim, Byungjai (Department of Electrical Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, Republic of Korea) , Park, HyunWook (Department of Electrical Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, Republic of Korea)

Abstract ▼ AI-Helper

PurposeA motion‐correction network for multi‐contrast brain MRI is proposed to correct in‐plane rigid motion artifacts in brain MR images using deep learning.MethodThe proposed method consists of 2 parts: image alignment and motion correction. Alignment of multi‐contrast MR images is performed in an unsupervised manner by a CNN work, yielding transformation parameters to align input images in order to minimize the normalized cross‐correlation loss among multi‐contrast images. Then, fine‐tuning for image alignment is performed by maximizing the normalized mutual information. The motion correction network corrects motion artifacts in the aligned multi‐contrast images. The correction network is trained to minimize the structural similarity loss and the VGG loss in a supervised manner. All datasets of motion‐corrupted images are generated using motion simulation based on MR physics.ResultsA motion‐correction network for multi‐contrast brain MRI successfully corrected artifacts of simulated motion for 4 test subjects, showing 0.96%, 7.63%, and 5.03% increases in the average structural simularity and 5.19%, 10.2%, and 7.48% increases in the average normalized mutual information for T1‐weighted, T2‐weighted, and T2‐weighted fluid‐attenuated inversion recovery images, respectively. The experimental setting with image alignment and artifact‐free input images for other contrasts shows better performances in correction of simulated motion artifacts. Furthermore, the proposed method quantitatively outperforms recent deep learning motion correction and synthesis methods. Real motion experiments from 5 healthy subjects demonstrate the potential of the proposed method for use in a clinical environment.ConclusionA deep learning‐based motion correction method for multi‐contrast MRI was successfully developed, and experimental results demonstrate the validity of the proposed method.

Keyword

참고문헌 (55)

Andre JB , Bresnahan BW , Mossa‐Basha M , et al. Toward quantifying the prevalence, severity, and cost associated with patient motion during clinical MR examinations . J Am Coll Radiol . 2015 ; 12 : 689 ‐ 695 .
Zaitsev M , Maclaren J , Herbst M . Motion artifacts in MRI: a complex problem with many partial solutions . J Magn Reson Imaging . 2015 ; 42 : 887 ‐ 901 .

상세보기
Runge VM , Wood ML . Fast imaging and other motion artifact reduction schemes: a pictorial overview . Magn Reson Imaging . 1988 ; 6 : 595 ‐ 608 .
Godenschweger F , Kägebein U , Stucht D , et al. Motion correction in MRI of the brain . Phys Med Biol . 2016 ; 61 : R32 .

상세보기
Bernstein MA , King KF , Zhou XJ . Handbook of MRI Pulse Sequences . Burlington, MA : Elsevier Academic Press ; 2004 .
Ehman RL , Felmlee JP . Adaptive technique for high‐definition MR imaging of moving structures . Radiology . 1989 ; 173 : 255 ‐ 263 .

상세보기
Hu X , Kim SG . Reduction of signal fluctuation in functional MRI using navigator echoes . Magn Reson Med . 1994 ; 31 : 495 ‐ 503 .

상세보기
Firmin D , Keegan J . Navigator echoes in cardiac magnetic resonance . J Cardiovasc Magn Reson . 2001 ; 3 : 183 ‐ 193 .
Zaitsev M , Dold C , Sakas G , Hennig J , Speck O . Magnetic resonance imaging of freely moving objects: prospective real‐time motion correction using an external optical motion tracking system . Neuroimage . 2006 ; 31 : 1038 ‐ 1050 .

상세보기
Herbst M , Maclaren J , Weigel M , Korvink J , Hennig J , Zaitsev M . Prospective motion correction with continuous gradient updates in diffusion weighted imaging . Magn Reson Med . 2012 ; 67 : 326 ‐ 338 .

상세보기
Pipe JG . Motion correction with PROPELLER MRI: application to head motion and free‐breathing cardiac imaging . Magn Reson Med . 1999 ; 42 : 963 ‐ 969 .

상세보기
Vaillant G , Prieto C , Kolbitsch C , Penney G , Schaeffter T . Retrospective rigid motion correction in k‐space for segmented radial MRI . IEEE Trans Med Imaging . 2013 ; 33 : 1 ‐ 10 .
Atkinson D , Hill DL , Stoyle PN , Summers PE , Keevil SF . Automatic correction of motion artifacts in magnetic resonance images using an entropy focus criterion . IEEE Trans Med Imaging . 1997 ; 16 : 903 ‐ 910 .
Cordero‐Grande L , Teixeira RPAG , Hughes EJ , Hutter J , Price AN , Hajnal JV . Sensitivity encoding for aligned multishot magnetic resonance reconstruction . IEEE Trans Comput Imaging . 2016 ; 2 : 266 ‐ 280 .
Akkus Z , Galimzianova A , Hoogi A , Rubin DL , Erickson BJ . Deep learning for brain MRI segmentation: state of the art and future directions . J Digit Imaging . 2017 ; 30 : 449 ‐ 459 .

상세보기
Ronneberger O , Fischer P , Brox T . U‐net: convolutional networks for biomedical image segmentation . In International Conference on Medical Image Computing and Computer‐Assisted Intervention (MICCAI 2015), Munich, Germany , 2015 . p. 234 ‐ 241 .
Schlemper J , Caballero J , Hajnal JV , Price AN , Rueckert D . A deep cascade of convolutional neural networks for dynamic MR image reconstruction . IEEE Trans Med Imaging . 2017 ; 37 : 491 ‐ 503 .
Kwon K , Kim D , Park H . A parallel MR imaging method using multilayer perceptron . Med Phys . 2017 ; 44 : 6209 ‐ 6224 .

상세보기
Kyathanahally SP , Döring A , Kreis R . Deep learning approaches for detection and removal of ghosting artifacts in MR spectroscopy . Magn Reson Med . 2018 ; 80 : 851 ‐ 863 .

상세보기
Hammernik K , Klatzer T , Kobler E , et al. Learning a variational network for reconstruction of accelerated MRI data . Magn Reson Med . 2018 ; 79 : 3055 ‐ 3071 .

상세보기
Jin KH , Um JY , Lee D , Lee J , Park SH , Ye JC . MRI artifact correction using sparse + low‐rank decomposition of annihilating filter‐based Hankel matrix . Magn Reson Med . 2017 ; 78 : 327 ‐ 340 .

상세보기
Krizhevsky A , Sutskever I , Hinton GE . ImageNet classification with deep convolutional neural networks . Adv Neural Inf Process Syst . 2012 ; 1097 ‐ 1105 .
Goodfellow I , Pouget‐Abadie J , Mirza M , et al. Generative adversarial nets . Adv Neural Inf Process Syst . 2014 ; 2672 ‐ 2680 .
Litjens G , Kooi T , Bejnordi BE , et al. A survey on deep learning in medical image analysis . Med Image Anal . 2017 ; 42 : 60 ‐ 88 .
Johnson PM , Drangova M . Motion correction in MRI using deep learning . In Proceedings of the 26th Annual Meeting of ISMRM, Paris, France , 2018 . p. 4098.
Pawar K , Chen Z , Shah NJ , Egan GF . Motion correction in MRI using deep convolutional neural network . In Proceedings of the 26th Annual Meeting of ISMRM, Paris, France , 2018 . p. 1174.
Isola P , Zhu JY , Zhou T , Efros AA . Image‐to‐image translation with conditional adversarial networks . In？Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI , 2017 . p. 1125 ‐ 1134 .
Bian Y , Wang Y , Reeves S . Motion correction of magnitude MR images using generative adversarial networks . In Proceedings of the 27th Annual Meeting of ISMRM, Montréal, Québec, Canada , 2019 . p. 4857 .
Johnson PM , Drangova M . Conditional generative adversarial network for 3D rigid‐body motion correction in MRI . Magn Reson Med . 2019 ; 82 : 901 ‐ 910 .

상세보기
Armanious K , Jiang C , Fischer M , Küstner T , Hepp T , Nikolaou K . MedGAN: medical image translation using GANs . Comput Med Imaging Graph . 2020 ; 79 : 101684 .

상세보기
Küstner T , Armanious K , Yang J , Yang B , Schick F , Gatidis S . Retrospective correction of motion‐affected MR images using deep learning frameworks . Magn Reson Med . 2019 ; 82 : 1527 ‐ 1540 .

상세보기
Haskell MW , Cauley SF , Bilgic B , et al. Network accelerated motion estimation and reduction (NAMER): convolutional neural network guided retrospective motion correction using a separable motion model . Magn Reson Med . 2019 ; 82 : 1452 ‐ 1461 .

상세보기
Huang J , Chen C , Axel L . Fast multi‐contrast MRI reconstruction . Magn Reson Imaging . 2014 ; 32 : 1344 ‐ 1352 .
Bilgic B , Goyal VK , Adalsteinsson E . Multi‐contrast reconstruction with Bayesian compressed sensing . Magn Reson Med . 2011 ; 66 : 1601 ‐ 1615 .

상세보기
Menze BH , Jakab A , Bauer S , et al. The multimodal brain tumor image segmentation benchmark (BRATS) . IEEE Trans Med Imaging . 2014 ; 34 : 1993 ‐ 2024 .
Balkrishnan G , Zhao A , Sabuncu MR , Guttag J , Dalca AV . Voxelmorph: a learning framework for deformable medical image registration . IEEE Trans Med Imaging . 2019 ; 38 : 1788 ‐ 1800 .
de Vos BD , Berendsen FF , Viergever MA , Sokooti H , Staring M , Išgum I . A deep learning framework for unsupervised affine and deformable image registration . Med Image Anal . 2019 ; 52 : 128 ‐ 143 .
Lu H , Nagae‐Poetscher LM , Golay X , Lin D , Pomper M , Van Zijl PC . Routine clinical brain MRI sequences for use at 3.0 Tesla . J Magn Reson Imaging . 2005 ; 22 : 13 ‐ 22 .

상세보기
Jaderberg M , Simonyan K , Zisserman A . Spatial transformer networks . Adv Neural Inf Process Syst . 2015 ; 2017 ‐ 2025 .
Adler DH , Ittyerah R , Pluta J , Pickup S , Liu W , Wolk DA . Probabilistic atlas of the human hippocampus combining ex vivo MRI and histology . In International Conference on Medical Image Computing and Computer‐Assisted Intervention (MICCAI 2016), Athens, Greece , 2016 . p. 63 ‐ 71 .
Wells WM III , Viola P , Atsumi H , Nakajima S , Kikinis R . Multi‐modal volume registration by maximization of mutual information . Med Image Anal . 1996 ; 1 : 35 ‐ 51 .
He K , Zhang X , Ren S , Sun J . Deep residual learning for image recognition . In？Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV , 2016 . p. 770 ‐ 778 .
Zhu JY , Park T , Isola P , Efros AA . Unpaired image‐to‐image translation using cycle‐consistent adversarial networks . In？Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition, Honolulu, HI , 2017 . p. 2223 ‐ 2232 .
Wang Z , Bovik AC , Sheikh HR , Simoncelli EP . Image quality assessment: from error visibility to structural similarity . IEEE Trans Image Process . 2004 ; 13 : 600 ‐ 612 .

상세보기
Simonyan K , Zisserman A . Very deep convolutional networks for large‐scale image recognition . In International Conference on Learning Representations. 2015 . arXiv:1409.1556v6 [cs.CV]
Johnson J , Alahi A , Fei‐Fei L . Perceptual losses for real‐time style transfer and super‐resolution . In？European Conference on Computer Vision (ECCV), Amsterdam, The Netherlands , 2016 . p. 694 ‐ 711 .
Kingma DP , Ba J . Adam: a method for stochastic optimization . In Proceedings the 3rd International Conference for Learning Representations, San Diego , 2015 . arXiv:1412.6980 [cs.LG].
Abadi M , Barham P , Chen J , et al. Tensorflow: a system for large‐scale machine learning . In？12th USENIX Symposium on Operating Systems Design and Implementation, Savannah, GA , 2016 . p. 265 ‐ 283 .
Walsh DO , Gmitro AF , Marcellin MW . Adaptive reconstruction of phased array MR imagery . Magn Reson Med . 2000 ; 43 : 682 ‐ 690 .

상세보기
Al Shalabi L , Shaaban Z . Normalization as a preprocessing engine for data mining and the approach of preference matrix . In Proceedings of the International Conference on Dependability of Computer Systems (DepCoS‐RELCOMEX), Szklarska Poreba, Poland , 2006 . p. 207 ‐ 214 .
Chartsias A , Joyce T , Giuffrida MV , Tsaftaris SA . Multimodal MR synthesis via modality‐invariant latent representation . IEEE Trans Med Imaging . 2018 ; 37 : 803 ‐ 814 .
Sharma A , Hamarneh G . Missing MRI pulse sequence synthesis using multi‐modal generative adversarial network . IEEE Trans Med Imaging . 2020 ; 39 : 1170 ‐ 1183 .
Russakoff DB , Tomasi C , Rohlfing T , Maurer CR . Image similarity using mutual information of regions . In Proceedings of the European Conference on Computer Vision (ECCV), Prague, Czech Republic , 2004 . p. 596 ‐ 607 .
Hu Y , Tang J , Jiang H , Peng S . A fast algorithm to estimate mutual information for image registration . In: The 9th International Conference for Young Computer Scientists (ICYCS), Hunan, China , 2008 . p. 720 ‐ 724 .
Lee J , Kim B , Jeong N , Park H . Motion correction for a multi‐contrast brain MRI using a multi‐input neural network . In Proceedings of the 28th Annual Meeting of ISMRM, Virtual Conference & Exhibition, 2020 . p. 3354 .

LOADING...

활용도 분석정보

상세보기

다운로드

내보내기

활용도 Top5 논문

해당 논문의 주제분야에서 활용도가 높은 상위 5개 콘텐츠를 보여줍니다.
더보기 버튼을 클릭하시면 더 많은 관련자료를 살펴볼 수 있습니다.

표제어: PCR

동의어: Packet Collision Rate

용어 설명 출처 목록 (6)

용어 설명: PCR은 세균 특이성이 있는 primer를 이용하여 적은 수의 세균이 있을지라도 쉽게 검출할 수 있는 유용한 방법이며, 이를 이용하여 구강 내 치면세균막이나 타액에서 직접 세균을 검출할 수 있게 되었다[8].

내보내기 구분	파일저장 인쇄 메일전송
구성항목	기본정보 상세정보 관리번호, 논문명, 저널/프로시딩명, 저자 , 발행년, 권, 호, 시작페이지, 끝페이지, 발행기관 관리번호, 논문명, 대등논문명, 저자 , 저널/프로시딩명, 발행기관, 발행년, 발행언어, 권, 호, 시작페이지, 끝페이지, ISBN, ISSN, 주제분야, 키워드, 초록(한글), 초록(영문), 저자(소속기관)
저장형식	Text(ASCII format) Excel format RefWorks Direct Export RIS format (for Reference Manager, ProCite, EndNote), Scholar's Aids, Mendeley
메일정보	받는사람 (필수) @ 보내는사람 (선택) @ 제목 내용 KISTI 검색결과 이메일 서비스
안내	총 건의 자료가 검색되었습니다. 다운받으실 자료의 인덱스를 입력하세요. (1-10,000) 검색결과의 순서대로 최대 10,000건 까지 다운로드가 가능합니다. 데이타가 많을 경우 속도가 느려질 수 있습니다.(최대 2~3분 소요) 다운로드 파일은 UTF-8 형태로 저장됩니다. 파일의 내용이 제대로 보이지 않을실 때는 웹브라우저 상단의 보기 -> 인코딩 -> 자동선택 여부를 확인하십시오. ~ Text(ASCII format) Excel format

연합인증