[논문]딥러닝 기반 픽셀 단위 콘크리트 벽체 균열 검출 방법

강경수; 류한국

doi:10.5345/jkibc.2023.23.2.197

딥러닝 기반 픽셀 단위 콘크리트 벽체 균열 검출 방법
Deep Learning-based Pixel-level Concrete Wall Crack Detection Method 원문보기

한국건축시공학회지 = Journal of the Korea Institute of Building Construction, v.23 no.2, 2023년, pp.197 - 207

강경수 (Department of Architecture, Sahmyook University) , 류한국 (Department of Architecture, Sahmyook University)

초록
AI-Helper

콘크리트는 압축력에 잘 저항하고 내구성이 우수하여 널리 사용되는 재료이다. 하지만 구조물은 시공 단계에서 주변 환경, 사용되는 재료의 특성에 따라 완공된 후 표면의 균열, 구조물의 침하 등 다양한 하자가 발생하거나 시간이 지남에 따라 콘크리트 구조물 표면에 결함이 발생한다. 그대로 방치하면 구조물에 심각한 손상을 초래하기 때문에 안전 점검을 통해 검사해야 한다. 하지만 전문 검사원들이 직접 조사하기에 비용이 높고 육안으로 판단하는 외관 검사법을 사용한다. 고층 건물일수록 상세한 검사가 힘들다. 본 연구는 노후화로 인해 콘크리트 표면에 발생하는 결함 중 균열을 탐지하는 딥러닝 기반 시맨틱 세그먼테이션 모형과 해당 모형의 특징 추출과 일반화 성능을 높이기 위한 이미지 어그멘테이션 기법을 개발하였다. 이를 위해 공개 데이터셋과 자체 데이터셋을 결합하여 시맨틱 세그먼테이션용 데이터셋을 구축하고 대표적인 딥러닝 기반 시맨틱 세그먼테이션 모형들을 비교실험하였다. 콘크리트 내벽을 중점으로 학습한 모형의 균열 추출 성능은 81.4%이며, 개발한 이미지 어그멘테이션을 적용한 결과 3%의 성능향상을 확인하였다. 향후 고층 건물과 같이 접근성이 어려운 지점을 드론을 통해 콘크리트 외벽에서 균열을 검출할 수 있는 시스템을 개발함으로써 실질적으로 활용할 수 있기를 기대한다.

Abstract ▼ AI-Helper

Concrete is a widely used material due to its excellent compressive strength and durability. However, depending on the surrounding environment and the characteristics of the materials used in the construction, various defects may occur, such as cracks on the surface and subsidence of the structure. The detects on the surface of the concrete structure occur after completion or over time. Neglecting these cracks may lead to severe structural damage, necessitating regular safety inspections. Traditional visual inspections of concrete walls are labor-intensive and expensive. This research presents a deep learning-based semantic segmentation model designed to detect cracks in concrete walls. The model addresses surface defects that arise from aging, and an image augmentation technique is employed to enhance feature extraction and generalization performance. A dataset for semantic segmentation was created by combining publicly available and self-generated datasets, and notable semantic segmentation models were evaluated and tested. The model, specifically trained for concrete wall fracture detection, achieved an extraction performance of 81.4%. Moreover, a 3% performance improvement was observed when applying the developed augmentation technique.

주제어

표/그림 (7)

그림 Figure 1. Flowchart depicting the deep learning-based semantic segmentation for concrete crack
그림 Figure 2. Architecture of DeepLabV3+ network(Adapted from Chen et al.[28])
그림 Figure 3. Dataset used for semantic segmentation
그림 Figure 4. Illustration of mosaic augmentation technique for semantic segmentation
그림 Figure 5. Visualization obtained from trained semantic segmentation model
표 Table 1. Performance comparison to CNN-based state-of-the-art models on the concrete crack dataset(512x512) at a threshold of 0.5
표 Table 2. Effect of different training strategies on testset: fake crack, remove crack, and mosaic crack augmentation(DeepLabV3+ with ResNet-101 as backbone)

참고문헌 (34)

Oh SG. A View on water-laekage and contermeasure of concrete structure. Magazine of the Korea Concrete Institute. 2002 Nov;14(6):14-9.？
Understanding of Concrete [Internet]. Seoul (Korea): Korea Cement Association. Available from: http://www.cement.or.kr/about_2015/cont8.asp?sm1_4_0？
Kang HK, Hong SG. Causes and mitigation of concrete cracking. Magazine of the Korea Concrete Institute. 2008 Sep;20(5):61-8.？
Choo JH, Park SW, Kim HT, Jee KH, Yoon TG. Analysis and cause of occurrence of lining cracks on NATM tunnel based on the precise inspection for safety and diagnosis-Part I. Journal of Korean Tunnelling and Underground Space Association. 2011 May;13(3):199-214. https://doi.org/10.9711/KTAJ.2011.13.3.199？

원문보기 상세보기
Kim SM, Sohn JM, Kim DS. A method for concrete crack detection using U-Net based image inpainting technique. Journal of the Korea Society of Computer and Information. 2020 Oct;25(10):35-42. https://doi.org/10.9708/jksci.2020.25.10.035？

원문보기 상세보기
Sohn JM, Kim DS, Hwang HB. Improvement of learning concrete crack detection model by weighted loss function. Journal of the Korea Society of Computer and Information. 2020 Oct;25(10):15-22. https://doi.org/10.9708/jksci.2020.25.10.015？

원문보기 상세보기
Kim GY, Kim DH, Kim DJ. Deep learning-based exterior wall crack detection method for building safety diagnosis. Journal of the Korean Institute of Plant Engineering. 2021 Dec;26(4):31-43.？
Lee SM, Kim KY, Kim DJ. Development of robust semantic segmentation modeling on various wall cracks. Proceedings of the Korean Society of Computer Information Conference. 2022 Jul 14-16; Jeju, Korea. Yongin (Korea): Korea Society of Computer Information; 2022. p. 49-52.？
Dung CV, Anh LD. Autonomous concrete crack detection using deep fully convolutional neural network. Automation in Construction. 2019 Mar;99:52-8. https://doi.org/10.1016/j.autcon.2018.11.028？

상세보기
Lee SI, Yang GM, Lee YM, Lee JH, Jeong YJ, Lee JG, Choi W. Recognition and visualization of crack on concrete wall using deep learning and transfer learning. Journal of the Korean Society of Agricultural Engineers. 2019 May;61(3):55-65. https://doi.org/10.5389/KSAE.2019.61.3.055？

원문보기 상세보기
Szegedy C, Vanhoucke V, Ioffe S, Shlens J, Wojna Z. Rethinking the inception architecture for computer vision. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2015 Jun 27-30; Las Vegas, NV; Manhattan (NY): IEEE; 2015. p. 2818-26. https://doi.org/10.1109/CVPR.2016.308？
Seol DH, Oh JH, Kim HJ. Comparison of deep learning-based cnn models for crack detection. Journal of the Architectural Institute of Korea Structure & Construction. 2020 Mar;36(3):113-20. https://doi.org/10.5659/JAIK_SC.2020.36.3.113？

상세보기
Jung SY, Lee SK, Park CI, Cho SY, Yu JH. A method for detecting concrete cracks using deep-learning and image processing. Journal of the Architectural Institute of Korea Structure & Construction. 2019 Nov;35(11):163-70. https://doi.org/10.5659/JAIK_SC.2019.35.11.163？

원문보기 상세보기
Redmon J, Farhadi A. YOLO9000: better, faster, stronger. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2017 July 21-26; Honolulu, HI. Manhattan (NY): IEEE; 2017. p. 7263-71. https://doi.org/10.1109/CVPR.2017.690？
Lee MH, Nam KW, Lee CW. Crack detection on the road in aerial image using mask R-CNN. Journal of the Korea Industrial Information Systems Research. 2019 Jun;24(3):23-9. https://doi.org/10.9723/jksiis.2019.24.3.023？

원문보기 상세보기
Yamane T, Chun P. Crack detection from a concrete surface image based on semantic segmentation using deep learning. Journal of Advanced Concrete Technology. 2020 Sep;18(9):493-504. https://doi.org/10.3151/jact.18.493？

상세보기
Kim SM, Sohn JM, Kim DS. A method for concrete crack detection using U-Net based image inpainting technique. Journal of The Korea Society of Computer and Information. 2020 Oct;25(10):35-42. https://doi.org/10.9708/jksci.2020.25.10.035？

원문보기 상세보기
Ha JW, Park KW, Kim MS. A development of road crack detection system using deep learning-based segmentation and object detection. The Journal of Society for e-Business Studies. 2021 Feb;26(1):93-106. https://doi.org/10.7838/jsebs.2021.26.1.093？

원문보기 상세보기
Panella F, Aldo L, Jan B. Semantic segmentation of cracks: Data challenges and architecture. Automation in Construction. 2022 Mar;135:104110. https://doi.org/10.1016/j.autcon.2021.104110？

상세보기
Krizhevsky A, Sutskever I, Hinton GE. Imagenet classification with deep convolutional neural networks. Communications of the ACM. 2017 Jun;60(6):84-90. https://doi.org/10.1145/3065386？

상세보기
Garcia-Garcia A, Orts-Escolano S, Oprea S, Villena-Martinez V, Garcia-Rodriguez J. A review on deep learning techniques applied to semantic segmentation. arXiv preprint. 2017 Apr;arXiv:1704.06857. https://doi.org/10.48550/arXiv.1704.06857？
Hafiz AM, Bhat GM. A survey on instance segmentation: state of the art. International Journal of Multimedia Information Retrieval. 2020 Jul;9(3):171-189. https://doi.org/10.1007/s13735-020-00195-x？

상세보기
Long J, Shelhamer E, Darrell T. Fully convolutional networks for semantic segmentation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2015 Jun 7-12; Boston, MA. Manhattan (NY): IEEE; 2015. p. 3431-40. https://doi.org/10.1109/CVPR.2015.7298965？
Ronneberger O, Fischer P, Brox T. U-net: Convolutional networks for biomedical image segmentation. In International Conference on Medical Image Computing and Computer-assisted Intervention. 2015 Oct 5-9; Munich, Germany, Manhattan (NY): Springer; 2015. p. 234-241. https://doi.org/10.1007/978-3-319-24574-4_28？
Arkin E, Yadikar N, Muhtar Y, Ubul K. A Survey of Object Detection Based on CNN and Transformer. 2021 IEEE 2nd International Conference on Pattern Recognition and Machine Learning (PRML). 2021 July 16-18; Chengdu, China. Manhattan (NY): IEEE; 2021. p. 99-108. https://doi.org/10.1109/PRML52754.2021.9520732？
Chen LC, Papandreou G, Kokkinos I, Murphy K, Yuille AL. Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2018 Apr;40(4):834-48. https://doi.org/10.1109/TPAMI.2017.2699184？

상세보기
Chen LC, Papandreou G, Schroff F, Adam H. Rethinking atrous convolution for semantic image segmentation. arXiv preprint. 2017 Dec;arXiv:1706.05587. https://doi.org/10.48550/arXiv.1706.05587？
Chen LC, Zhu Y, Papandreou G, Schroff F, Adam H. Encoder-decoder with atrous separable convolution for semantic image segmentation. In Proceedings of the European Conference on Computer Vision (ECCV). 2018 Sep 8-14; Munich, Germany. Manhattan (NY): Springer; 2018. p. 801-8. https://doi.org/10.1007/978-3-030-01234-2_49？
Hassan SI, Dang L, Im SH, Min KB, Nam JY, Moon HJ. Damage detection and classification system for sewer inspection using convolutional neural networks based on deep learning. Journal of the Korea Institute of Information and Communication Engineering. 2018 Mar;22(3):451-7. http://doi.org/10.6109/jkiice.2018.22.3.451？

원문보기 상세보기
Paik SH, Choi DC, Kim YK, Jung SW, Kim DN. Implementation of the drones with deep-learning crack detection analysis for inspection of bridg. Journal of Korea Institute of Information Technology. 2021 Mar;19(3):45-52. http://dx.doi.org/10.14801/jkiit.2021.19.3.45？

상세보기
Ratner AJ, Ehrenberg H, Hussain Z, Dunnmon J, Re C. Learning to compose domain-specific transformations for data augmentation. Advances in Neural Information Processing Systems. 2017 Sep;30:3236-46. https://doi.org/10.48550/arXiv.1709.01643？
Shorten C, Khoshgoftaar TM. A survey on image data augmentation for deep learning. Journal of Big Data. 2019 Jul;6(1):1-48. https://doi.org/10.1186/s40537-019-0197-0？

상세보기
Bochkovskiy A, Wang CY, Liao HYM. Yolov4: Optimal speed and accuracy of object detection. arXiv preprint. 2020 Apr;arXiv:2004.10934. https://doi.org/10.48550/arXiv.2004.10934？
Hao W, Zhili S. Improved mosaic: algorithms for more complex images. Journal of Physics: Conference Series. 2020 Nov; 1684(1):012094. https://doi.org/10.1088/1742-6596/1684/1/012094

상세보기

표제어: PCR

동의어: Packet Collision Rate

용어 설명 출처 목록 (6)

용어 설명: PCR은 세균 특이성이 있는 primer를 이용하여 적은 수의 세균이 있을지라도 쉽게 검출할 수 있는 유용한 방법이며, 이를 이용하여 구강 내 치면세균막이나 타액에서 직접 세균을 검출할 수 있게 되었다[8].

내보내기 구분	파일저장 인쇄 메일전송
구성항목	기본정보 상세정보 관리번호, 논문명, 저널/프로시딩명, 저자 , 발행년, 권, 호, 시작페이지, 끝페이지, 발행기관 관리번호, 논문명, 대등논문명, 저자 , 저널/프로시딩명, 발행기관, 발행년, 발행언어, 권, 호, 시작페이지, 끝페이지, ISBN, ISSN, 주제분야, 키워드, 초록(한글), 초록(영문), 저자(소속기관)
저장형식	Text(ASCII format) Excel format RefWorks Direct Export RIS format (for Reference Manager, ProCite, EndNote), Scholar's Aids, Mendeley
메일정보	받는사람 (필수) @ 보내는사람 (선택) @ 제목 내용 KISTI 검색결과 이메일 서비스
안내	총 건의 자료가 검색되었습니다. 다운받으실 자료의 인덱스를 입력하세요. (1-10,000) 검색결과의 순서대로 최대 10,000건 까지 다운로드가 가능합니다. 데이타가 많을 경우 속도가 느려질 수 있습니다.(최대 2~3분 소요) 다운로드 파일은 UTF-8 형태로 저장됩니다. 파일의 내용이 제대로 보이지 않을실 때는 웹브라우저 상단의 보기 -> 인코딩 -> 자동선택 여부를 확인하십시오. ~ Text(ASCII format) Excel format

연합인증